00010000:00000010:3.1F:1713278950.584038:0:11:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff8800a45b1a00. 00010000:00000010:3.1:1713278950.584049:0:11:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff8800b1ae4000. 00010000:00000010:3.1:1713278950.614537:0:27:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff8800b1a71800. 00010000:00000010:3.1:1713278950.614542:0:27:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff8800b1ae4900. 00010000:00000010:3.1:1713278950.614545:0:27:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff88011e8a46c0. 00010000:00000010:3.1:1713278950.620530:0:11:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff8800a73cf200. 00010000:00000010:3.1:1713278950.620537:0:11:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff8800a7d9c6c0. 00080000:00000010:2.1F:1713278950.630605:0:11:0:(osd_handler.c:1615:osd_oxc_free()) kfreed 'oxe': 68 at ffff880137303a80. 00010000:00010000:0.0:1713279306.629086:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x3032 (ffff8800909b0e00) 00010000:00010000:0.0:1713279306.629088:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.629089:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda3d4a lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.629093:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda3d4a lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.629105:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda3d12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8492:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629108:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda3d12 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8492:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629111:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda3d12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8492:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629113:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf6400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.629115:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda3d12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8492:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629118:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda3d12 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8492:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629121:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8492:0x0].0x0 (ffff88009811e400) 00010000:00010000:0.0:1713279306.629122:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.629124:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda3d12 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8492:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629126:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda3d12 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8492:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629133:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a065b00/0xfc4b8e114eda3eee lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629136:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008a065b00/0xfc4b8e114eda3eee lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629139:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008a065b00/0xfc4b8e114eda3eee lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629142:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a065b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.629143:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a065b00/0xfc4b8e114eda3eee lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629146:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a065b00/0xfc4b8e114eda3eee lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629149:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86db:0x0].0x0 (ffff88008eba0d00) 00010000:00010000:0.0:1713279306.629150:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.629152:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008a065b00/0xfc4b8e114eda3eee lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629154:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a065b00/0xfc4b8e114eda3eee lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629160:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda3dd6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8297:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.629163:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda3dd6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8297:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.629165:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda3dd6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8297:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.629168:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.629169:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda3dd6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8297:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.629172:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda3dd6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8297:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.629176:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8297:0x0].0x0 (ffff880091b35100) 00010000:00010000:0.0:1713279306.629177:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.629178:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda3dd6 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8297:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.629181:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda3dd6 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8297:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.629187:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda3efc lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x7fe9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629190:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda3efc lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x7fe9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629192:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda3efc lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7fe9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629195:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bd440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.629196:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda3efc lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7fe9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629199:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda3efc lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x7fe9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629203:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:0.0:1713279306.629204:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.629206:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda3efc lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x7fe9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629208:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda3efc lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x7fe9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.629214:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda4109 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x820c:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.629217:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda4109 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x820c:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.629220:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda4109 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x820c:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.629223:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a5f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.629224:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda4109 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x820c:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.629227:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda4109 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x820c:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.629230:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x820c:0x0].0x0 (ffff88007fdcab00) 00010000:00010000:0.0:1713279306.629231:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.629232:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda4109 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x820c:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.629235:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda4109 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x820c:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.629241:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda4474 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8266:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629244:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda4474 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8266:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629246:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda4474 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8266:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629249:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bc900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.629250:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda4474 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8266:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629253:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda4474 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8266:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629258:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8266:0x0].0x0 (ffff8801206dae00) 00010000:00010000:0.0:1713279306.629259:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.629260:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda4474 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8266:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629262:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda4474 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8266:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629268:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda4799 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8292:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.629270:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda4799 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8292:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.629273:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda4799 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8292:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.629275:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012c24ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.629277:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda4799 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8292:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.629280:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda4799 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8292:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.629371:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8292:0x0].0x0 (ffff88009588c300) 00010000:00010000:0.0:1713279306.629373:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.629375:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda4799 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8292:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.629378:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda4799 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8292:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.629387:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda4ce7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x863c:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629391:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda4ce7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x863c:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629393:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda4ce7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x863c:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629396:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed51f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.629397:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda4ce7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x863c:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629400:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda4ce7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x863c:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629403:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x863c:0x0].0x0 (ffff880092ae7100) 00010000:00010000:0.0:1713279306.629404:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.629406:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda4ce7 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x863c:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629408:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda4ce7 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x863c:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629431:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda5013 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7f51:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.629434:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda5013 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7f51:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.629437:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda5013 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7f51:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.629442:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68ad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.629443:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda5013 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7f51:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.629446:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda5013 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7f51:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.629450:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f51:0x0].0x0 (ffff8800940a8800) 00010000:00010000:0.0:1713279306.629451:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.629452:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda5013 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7f51:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.629455:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda5013 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7f51:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.629460:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980000/0xfc4b8e114eda4f3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x7e3b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.629463:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980000/0xfc4b8e114eda4f3a lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x7e3b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.629466:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980000/0xfc4b8e114eda4f3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7e3b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.629468:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.629469:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980000/0xfc4b8e114eda4f3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7e3b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.629472:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980000/0xfc4b8e114eda4f3a lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x7e3b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.629476:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7e3b:0x0].0x0 (ffff880091b34300) 00010000:00010000:0.0:1713279306.629477:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.629479:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980000/0xfc4b8e114eda4f3a lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x7e3b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.629482:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980000/0xfc4b8e114eda4f3a lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x7e3b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.629487:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114eda5132 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6672:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.629490:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114eda5132 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6672:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.629492:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114eda5132 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6672:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.629494:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801251d5b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.629496:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114eda5132 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6672:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.629498:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114eda5132 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6672:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.629502:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6672:0x0].0x0 (ffff880092193e00) 00010000:00010000:0.0:1713279306.629503:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.629504:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114eda5132 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6672:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.629507:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114eda5132 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6672:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.629513:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114eda55df lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x7fe9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629515:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114eda55df lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x7fe9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629519:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114eda55df lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7fe9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629522:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.629523:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114eda55df lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7fe9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629526:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114eda55df lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x7fe9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629529:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:0.0:1713279306.629530:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.629531:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114eda55df lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x7fe9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629534:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114eda55df lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x7fe9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.629559:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda59cf lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfc4b8e114eda5966 expref: 65 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.629572:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:0.0:1713279306.629574:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda5b3b lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda5b26 expref: 64 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.629579:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda5b3b lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda5b26 expref: 64 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.629583:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda5b3b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda5b26 expref: 64 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.629590:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda5bf8 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.629600:0:15655:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda5b3b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda5b26 expref: 64 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.629606:0:15655:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000_UUID:15655:1796503200008064:0@lo:105: 00000100:00100000:0.0:1713279306.629622:0:15655:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.629630:0:15655:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c2fbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.629639:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200008064 00000100:00100000:0.0:1713279306.629641:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200008064 00000100:00100000:0.0:1713279306.629654:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33413 00000100:00100000:0.0:1713279306.629656:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15655:x1796503200008064:12345-0@lo:105: 00010000:00010000:0.0:1713279306.629661:0:6913:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.629666:0:6913:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.629671:0:6913:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.629674:0:6913:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.629677:0:6913:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.629683:0:6913:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.629687:0:6913:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.629695:0:6913:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88008fe17a80) 00000100:00100000:0.0:1713279306.629709:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15655:x1796503200008064:12345-0@lo:105: Request processed in 52us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.629795:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33413 00000100:00100000:0.0:1713279306.629815:0:15655:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000_UUID:15655:1796503200008064:0@lo:105: 00010000:00010000:0.0:1713279306.629822:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.629836:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+64:3490:x1796503200007616:12345-0@lo:103:ldlm_bl.0 Request processed in 3039us (3073us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.629840:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196397 00000100:00100000:0.0:1713279306.629852:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200007616:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.629861:0:15534:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.629866:0:15534:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.629874:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1713279306.630044:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda5ede lrc: 3/0,1 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.630052:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda5ede lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630059:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda5ede lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630083:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda5ee5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x260:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.630090:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda5ee5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630096:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda5ee5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630117:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008941c6c0/0xfc4b8e114eda5eec lrc: 3/0,1 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.630123:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008941c6c0/0xfc4b8e114eda5eec lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630129:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008941c6c0/0xfc4b8e114eda5eec lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630137:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda5ef3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25b:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.630143:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda5ef3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630149:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda5ef3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630169:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda5f01 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7b39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.630175:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda5f01 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7b39:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630181:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda5f01 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7b39:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00000004:00010000:0.0:1713279306.630379:0:15534:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880095a68380 reply state ffff88008a74d000 transno 4295183502 ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda5f01 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7b39:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630387:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda5f01 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7b39:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630393:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b39:0x0].0x0 (ffff880090a56a00) 00010000:00010000:0.0:1713279306.630395:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1713279306.630397:0:15534:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.630401:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008941c6c0/0xfc4b8e114eda5eec lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630430:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008941c6c0/0xfc4b8e114eda5eec lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630435:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008941c6c0/0xfc4b8e114eda5eec lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630439:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008941c6c0/0xfc4b8e114eda5eec lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630442:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008941c6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.630445:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008941c6c0/0xfc4b8e114eda5eec lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630449:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008941c6c0/0xfc4b8e114eda5eec lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630454:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88009228e500) 00010000:00010000:0.0:1713279306.630456:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.630459:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008941c6c0/0xfc4b8e114eda5eec lrc: 3/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630463:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008941c6c0/0xfc4b8e114eda5eec lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00000004:00010000:0.0:1713279306.630470:0:15534:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880095a68380 reply state ffff88008a74d000 transno 4295183502 ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda5ef3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630475:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda5ef3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630480:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3231 (ffff880090a56900) 00010000:00010000:0.0:1713279306.630482:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.630483:0:15534:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1713279306.630486:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda5ede lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630490:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda5ede lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630505:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda5ede lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630509:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda5ede lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630513:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f557840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.630515:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda5ede lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630519:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda5ede lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630523:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00010000:00010000:0.0:1713279306.630526:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.630528:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda5ede lrc: 3/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630532:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda5ede lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00000004:00010000:0.0:1713279306.630537:0:15534:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880095a68380 reply state ffff88008a74d000 transno 4295183502 ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda5ee5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630542:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda5ee5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.630546:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x3231 (ffff880090a56800) 00010000:00010000:0.0:1713279306.630547:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.630549:0:15534:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:0.0:1713279306.630568:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.630574:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.630579:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.630587:0:15534:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1713279306.630615:0:15534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3499:11374:x1796503281128576:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 12388us (12478us total) trans 4295183502 rc 0/0 00000100:00100000:0.0:1713279306.630620:0:15534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14307 00010000:00010000:0.0:1713279306.630674:0:6918:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713279306.630678:0:6918:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.630689:0:6918:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe17a80 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:0.0:1713279306.630704:0:6918:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713279306.630711:0:6918:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.630726:0:6918:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.630731:0:6918:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713279306.630846:0:6918:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.630853:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda5b26 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda5b3b expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.630866:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.630867:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.630869:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279306.630879:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200008128 00000100:00100000:0.0:1713279306.630883:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200008128 00010000:00010000:0.0:1713279306.630894:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda5b3b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda5b26 expref: 64 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.630915:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196405 00000100:00100000:0.0:1713279306.630920:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+64:3491:x1796503200008128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.630927:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.630931:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda5b3b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda5b26 expref: 64 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.630942:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda5b3b lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda5b26 expref: 64 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.630951:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:0.0:1713279306.630954:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda5bf8 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.630960:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda5bf8 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.630965:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda5bf8 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.630971:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda5cfb lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15502 initiator: MDT0 00010000:00010000:0.0:1713279306.630982:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.631024:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+63:3491:x1796503200008128:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.631030:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196405 00000100:00100000:0.0:1713279306.631054:0:9223:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9223:1796503200008000:192.168.203.4@tcp:105: 00010000:00010000:0.0:1713279306.631089:0:9223:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.631118:0:9223:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:385c4b71-808c-40cf-91de-b076b668d13f+71:1956:x1796503281134464:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 2722us (2779us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.631125:0:9223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196401 00000100:00100000:0.0:1713279306.631522:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00010000:0.0:1713279306.631922:0:15752:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880096881c00 reply state ffff880093a2e800 transno 4295202538 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023d200/0xfc4b8e114eda5e4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8235:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.631932:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023d200/0xfc4b8e114eda5e4b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x8235:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.631936:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8235:0x0].0x0 (ffff880096da6c00) 00010000:00010000:0.0:1713279306.631938:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1713279306.631939:0:15752:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713279306.631967:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3720:11730:x1796503281134144:12345-192.168.203.4@tcp:36:setfattr.0 Request processed in 3693us (3832us total) trans 4295202538 rc 0/0 00000100:00100000:0.0:1713279306.631971:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784675 00000100:00100000:0.0:1713279306.632290:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.632314:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.632339:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.632527:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200008256 00000100:00100000:0.0:1713279306.632532:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200008256 00000100:00100000:0.0:1713279306.632547:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33414 00000100:00100000:0.0:1713279306.632552:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15752:x1796503200008256:12345-0@lo:104: 00010000:00010000:0.0:1713279306.632560:0:9213:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981b00/0xfc4b8e114eda546c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda5488 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.632596:0:9213:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1713279306.632602:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15752:x1796503200008256:12345-0@lo:104: Request processed in 49us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.632607:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33414 00000100:00100000:0.0:1713279306.632689:0:9223:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200008320 00000100:00100000:0.0:1713279306.632692:0:9223:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200008320 00010000:00010000:0.0:1713279306.632702:0:9223:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda5488 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfc4b8e114eda546c expref: 63 pid: 6934 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.632715:0:9223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196406 00000100:00100000:0.0:1713279306.632719:0:9223:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+63:3492:x1796503200008320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.632726:0:9223:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1713279306.633463:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202538 is committed 00010000:00010000:0.0:1713279306.633486:0:9223:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda5488 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfc4b8e114eda546c expref: 63 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.633492:0:9223:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x0 (ffff88012d067200) 00010000:00010000:0.0:1713279306.633495:0:9223:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda5fd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x139:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.633499:0:9223:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda5fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.633502:0:9223:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda5fd3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.633510:0:9223:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.633528:0:9223:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+62:3492:x1796503200008320:12345-0@lo:103:ldlm_bl.0 Request processed in 808us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.633531:0:9223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196406 00000100:00100000:0.0:1713279306.633542:0:15534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281137280 00000100:00100000:0.0:1713279306.633544:0:15534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281137280 00000100:00100000:0.0:1713279306.633555:0:15534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14311 00000100:00100000:0.0:1713279306.633558:0:15534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3502:9683:x1796503281137280:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:0.0:1713279306.633582:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda5fe1 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.633586:0:15534:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda5fe1 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.633590:0:15534:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda5fe1 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15534 initiator: MDT1 00000100:00100000:0.0:1713279306.633598:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096881500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200008384:0@lo:101:mdt_io00_011.0 00000100:00100000:0.0:1713279306.633611:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.633617:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c2fbcc0 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.633626:0:15752:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda5fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.633630:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda5fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000004:00200000:0.0:1713279306.633645:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x139:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.633647:0:15752:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:0.0:1713279306.633660:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9d40/0xfc4b8e114eda5fc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e6b expref: 3719 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.633667:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda5fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e6b expref: 3718 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.633671:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x0 (ffff88012d067200) 00010000:00010000:0.0:1713279306.633672:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713279306.633674:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba9f80, rc 0) 00000100:00100000:0.0:1713279306.633686:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3718:11695:x1796503281136768:12345-192.168.203.4@tcp:101:touch.0 Request processed in 1324us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.633690:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784692 00000100:00100000:0.0:1713279306.633720:0:15534:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4295202536 gen 2 00000004:00080000:0.0:1713279306.633723:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202428 committed transno 4295202536 00000004:00080000:0.0:1713279306.633735:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202429 committed transno 4295202536 00000004:00080000:0.0:1713279306.633744:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202430 committed transno 4295202536 00000004:00080000:0.0:1713279306.633754:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202431 committed transno 4295202536 00000004:00080000:0.0:1713279306.633762:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202440 committed transno 4295202536 00000004:00080000:0.0:1713279306.633771:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202441 committed transno 4295202536 00000004:00080000:0.0:1713279306.633780:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202442 committed transno 4295202536 00000004:00080000:0.0:1713279306.633790:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202458 committed transno 4295202536 00000004:00080000:0.0:1713279306.633800:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202460 committed transno 4295202536 00000004:00080000:0.0:1713279306.633809:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202474 committed transno 4295202536 00000004:00080000:0.0:1713279306.633819:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202476 committed transno 4295202536 00000004:00080000:0.0:1713279306.633830:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202491 committed transno 4295202536 00000004:00080000:0.0:1713279306.633841:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202509 committed transno 4295202536 00000004:00080000:0.0:1713279306.633849:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202514 committed transno 4295202536 00000004:00080000:0.0:1713279306.633861:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202520 committed transno 4295202536 00000004:00080000:0.0:1713279306.633870:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202536 committed transno 4295202536 00000100:00100000:0.0:1713279306.633878:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096881500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200008384:0@lo:101:mdt_io00_011.0 00010000:00010000:0.0:1713279306.633885:0:15534:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda5fe1 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda5fe8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.633890:0:15534:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda5fe1 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda5fe8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.633902:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.633944:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.634096:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784694 00000100:00100000:0.0:1713279306.634102:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:11666:x1796503281137664:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.634110:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.634118:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda5ff6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39174e80 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.634140:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda6004 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.634148:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda6004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.634155:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda6004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000004:00200000:0.0:1713279306.634168:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x139:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.634171:0:15753:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:0.0:1713279306.634185:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda5ff6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e80 expref: 3723 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.634195:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda6004 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e80 expref: 3722 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.634202:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x0 (ffff88012d067200) 00010000:00010000:0.0:1713279306.634204:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713279306.634206:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935be880, rc 0) 00000100:00100000:0.0:1713279306.634224:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:11666:x1796503281137664:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 121us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.634230:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784694 00000100:00100000:0.0:1713279306.634801:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.634830:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.634905:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.635245:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.635284:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.635298:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.635322:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.635337:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.635346:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.635361:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.635369:0:9223:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281138496 00000100:00100000:0.0:1713279306.635371:0:9223:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281138496 00000100:00100000:0.0:1713279306.635385:0:9223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147181 00000100:00100000:0.0:1713279306.635388:0:9223:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:1956:x1796503281138496:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.635393:0:9223:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.635400:0:9223:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114eda5a3f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x75f8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174cf1 expref: 3723 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.635407:0:9223:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x75f8:0x0].0x0 (ffff880082706900) 00010000:00010000:0.0:1713279306.635409:0:9223:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.635436:0:9223:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:1956:x1796503281138496:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 46us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.635440:0:9223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147181 00000100:00100000:0.0:1713279306.635453:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784699 00000100:00100000:0.0:1713279306.635456:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3718:11768:x1796503281136896:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.635462:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.635467:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc000/0xfc4b8e114eda6035 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39174e72 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.635503:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda603c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635508:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda603c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635512:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda603c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635520:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda6043 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635523:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda6043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635527:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda6043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000004:00200000:0.0:1713279306.635535:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x81cf:0x0]: returning size 2 00010000:00010000:0.0:1713279306.635540:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda603c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635543:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda603c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635547:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda603c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635550:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda603c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635552:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bfa80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.635554:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda603c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635557:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda603c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635561:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:0.0:1713279306.635562:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.635564:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda603c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635569:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda603c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635575:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda6043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635577:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda6043 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635580:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda6043 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635583:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091cbc000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.635584:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda6043 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635587:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda6043 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635590:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3231 (ffff880090a56700) 00010000:00010000:0.0:1713279306.635591:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.635592:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda6043 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635595:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda6043 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635608:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc000/0xfc4b8e114eda6035 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e72 expref: 3719 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.635612:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc000/0xfc4b8e114eda6035 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e72 expref: 3719 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.635619:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bc000, rc 0) 00000100:00100000:0.0:1713279306.635632:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3718:11768:x1796503281136896:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 175us (309us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.635636:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784699 00000100:00100000:0.0:1713279306.635659:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.635667:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281137920 00000100:00100000:0.0:1713279306.635669:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281137920 00000100:00100000:0.0:1713279306.635687:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784702 00000100:00100000:0.0:1713279306.635690:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3743:11711:x1796503281137920:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.635695:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.635696:0:9221:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1713279306.635703:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b2d00/0xfc4b8e114eda4b74 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174939 expref: 3742 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.635709:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88012d067400) 00010000:00010000:0.0:1713279306.635713:0:9221:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.635718:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114eda606d lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39174e87 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.635737:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda6074 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635741:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda6074 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635744:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda6074 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635752:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda607b lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.635756:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda607b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635759:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda607b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635774:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda6074 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635779:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda6074 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635783:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda6074 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635789:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda6074 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635793:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c53ba80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.635795:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda6074 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635801:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda6074 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635807:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880090a56400) 00010000:00010000:0.0:1713279306.635809:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.635812:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda6074 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635817:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda6074 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635825:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda607b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635830:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda607b lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635835:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda607b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635839:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f1d73c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.635842:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda607b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635847:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda607b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635852:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880090a56000) 00010000:00010000:0.0:1713279306.635854:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.635856:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda607b lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635861:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda607b lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.635879:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114eda606d lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e87 expref: 3741 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.635887:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114eda606d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e87 expref: 3741 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.635895:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e34b40, rc 0) 00000100:00100000:0.0:1713279306.635912:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3740:11711:x1796503281137920:12345-192.168.203.4@tcp:101:touch.0 Request processed in 220us (252us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.635918:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784702 00000100:00100000:0.0:1713279306.636191:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.636225:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.636274:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.636650:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.636666:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.636709:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.636751:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.636932:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.637580:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.637596:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.637621:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.637657:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784713 00000100:00100000:0.0:1713279306.637661:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3719:11711:x1796503281139968:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.637668:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.637675:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d4fc0/0xfc4b8e114eda6146 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39174ecd expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.637717:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda6162 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637723:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda6162 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637727:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda6162 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637733:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda6170 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637739:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda6170 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637744:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda6170 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00200000:0.0:1713279306.637759:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:0.0:1713279306.637771:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda6162 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637840:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda6162 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637846:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda6162 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637890:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda6162 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637896:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c9b5680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.637899:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda6162 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637904:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda6162 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637912:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880090a56d00) 00010000:00010000:0.0:1713279306.637915:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.637917:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda6162 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637923:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda6162 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637934:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda6170 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637939:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda6170 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637944:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda6170 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637948:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942db00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.637951:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda6170 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637956:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda6170 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637962:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880090a56600) 00010000:00010000:0.0:1713279306.637964:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.637966:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda6170 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637971:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda6170 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.637993:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d4fc0/0xfc4b8e114eda6146 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ecd expref: 3720 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.638000:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d4fc0/0xfc4b8e114eda6146 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ecd expref: 3720 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.638009:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f1d4fc0, rc 0) 00000100:00100000:0.0:1713279306.638027:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3719:11711:x1796503281139968:12345-192.168.203.4@tcp:101:touch.0 Request processed in 364us (405us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.638034:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784713 00000100:00100000:0.0:1713279306.638062:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.638113:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.638172:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281140480 00000100:00100000:0.0:1713279306.638176:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281140480 00000100:00100000:0.0:1713279306.638193:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784717 00000100:00100000:0.0:1713279306.638197:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3719:11695:x1796503281140480:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1713279306.638214:0:15473:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.638223:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114eda60d6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8694:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e95 expref: 3719 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.638232:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8694:0x0].0x0 (ffff88009588cc00) 00010000:00010000:0.0:1713279306.638235:0:15473:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.638265:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e880/0xfc4b8e114eda61bd lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8694:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.638272:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e880/0xfc4b8e114eda61bd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8694:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.638279:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e880/0xfc4b8e114eda61bd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8694:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00010000:0.0:1713279306.638315:0:15473:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880135efdc00 reply state ffff88012f198000 transno 4295202542 ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e880/0xfc4b8e114eda61bd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8694:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.638323:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e880/0xfc4b8e114eda61bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8694:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.638328:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8694:0x0].0x0 (ffff88009588cc00) 00010000:00010000:0.0:1713279306.638330:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.638333:0:15473:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713279306.638376:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3720:11695:x1796503281140480:12345-192.168.203.4@tcp:36:touch.0 Request processed in 166us (302us total) trans 4295202542 rc 0/0 00000100:00100000:0.0:1713279306.638382:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784717 00000100:00100000:0.0:1713279306.638990:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281140672 00000100:00100000:0.0:1713279306.638995:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281140672 00000100:00100000:0.0:1713279306.639013:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784718 00000100:00100000:0.0:1713279306.639017:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:11374:x1796503281140672:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.639025:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.639033:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda61c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39174ee2 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.639056:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda61cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639064:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda61cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639081:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda61cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639089:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda61d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639093:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda61d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639096:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda61d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639123:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114eda61d9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639129:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114eda61d9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639133:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114eda61d9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00010000:0.0:1713279306.639139:0:15473:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114eda61d9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639144:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda61cb lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639146:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda61cb lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639149:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda61cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639152:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda61cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639155:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.639157:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda61cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639160:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda61cb lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639163:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:0.0:1713279306.639165:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.639166:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda61cb lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639169:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda61cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639175:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda61d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639178:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda61d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639181:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda61d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639183:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.639184:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda61d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639187:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda61d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639190:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3531 (ffff880090a56500) 00010000:00010000:0.0:1713279306.639191:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.639192:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda61d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639195:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda61d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639206:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda61c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ee2 expref: 3723 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.639211:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114eda61d9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ee2 expref: 3722 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.639214:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7693:0x0].0x0 (ffff880096b90d00) 00010000:00010000:0.0:1713279306.639215:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713279306.639217:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008941c6c0, rc 0) 00000100:00100000:0.0:1713279306.639241:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:11374:x1796503281140672:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 223us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.639245:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784718 00000100:00100000:0.0:1713279306.639452:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.639471:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.639478:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.639489:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.639496:0:9223:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281140928 00000100:00100000:0.0:1713279306.639498:0:9223:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281140928 00010000:00010000:0.0:1713279306.639506:0:9223:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce53a80/0xfc4b8e114eda1c03 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x685c:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173c04 expref: 3745 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.639516:0:9223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196407 00000100:00100000:0.0:1713279306.639519:0:9223:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:385c4b71-808c-40cf-91de-b076b668d13f+3745:1955:x1796503281140928:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.639524:0:9223:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.639527:0:9223:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce53a80/0xfc4b8e114eda1c03 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x685c:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173c04 expref: 3745 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.639532:0:9223:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce53a80/0xfc4b8e114eda1c03 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x685c:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173c04 expref: 3745 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.639540:0:9223:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce53a80/0xfc4b8e114eda1c03 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x685c:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173c04 expref: 3745 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.639551:0:9223:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x685c:0x0].0x0 (ffff88007f14b100) 00010000:00010000:0.0:1713279306.639554:0:9223:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114eda60f9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x685c:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.639560:0:9223:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114eda60f9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x685c:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.639563:0:9223:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.639574:0:9223:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:385c4b71-808c-40cf-91de-b076b668d13f+3744:1955:x1796503281140928:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 53us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.639578:0:9223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196407 00000100:00100000:0.0:1713279306.639584:0:9223:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281140992 00000100:00100000:0.0:1713279306.639586:0:9223:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281140992 00010000:00010000:0.0:1713279306.639590:0:9223:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800963e0240/0xfc4b8e114eda5274 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x685c:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174aeb expref: 3513 pid: 15483 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.639605:0:9223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196409 00000100:00100000:0.0:1713279306.639608:0:9223:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3513:1956:x1796503281140992:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.639612:0:9223:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.639615:0:9223:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800963e0240/0xfc4b8e114eda5274 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x685c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174aeb expref: 3513 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.639619:0:9223:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800963e0240/0xfc4b8e114eda5274 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x685c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174aeb expref: 3513 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.639626:0:9223:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800963e0240/0xfc4b8e114eda5274 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x685c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174aeb expref: 3513 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.639630:0:9223:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x685c:0x0].0x0 (ffff88007f14b100) 00010000:00010000:0.0:1713279306.639632:0:9223:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114eda60f9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x685c:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.639638:0:9223:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114eda60f9 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x685c:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.639641:0:9223:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114eda60f9 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x685c:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.639648:0:9223:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.639657:0:9223:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3512:1956:x1796503281140992:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 48us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.639660:0:9223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196409 00000100:00100000:0.0:1713279306.639670:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281140800 00000100:00100000:0.0:1713279306.639672:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281140800 00000100:00100000:0.0:1713279306.639680:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784719 00000100:00100000:0.0:1713279306.639682:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3743:11406:x1796503281140800:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.639687:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.639693:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda61ee lrc: 2/0,0 mode: --/CR res: [0x240000400:0x245:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39174ee9 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.639711:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda61fc lrc: 3/1,0 mode: --/CR res: [0x240000400:0x245:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639715:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda61fc lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639719:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda61fc lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639724:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114eda6203 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x245:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.639727:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114eda6203 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x245:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639731:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114eda6203 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x245:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639742:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda61fc lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639745:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda61fc lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639748:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda61fc lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639751:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda61fc lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639753:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.639755:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda61fc lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639758:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda61fc lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639761:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x245:0x0].0x0 (ffff880090a56c00) 00010000:00010000:0.0:1713279306.639763:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.639765:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda61fc lrc: 3/0,0 mode: --/CR res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639770:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda61fc lrc: 0/0,0 mode: --/CR res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639776:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114eda6203 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x245:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639781:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114eda6203 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x245:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639786:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114eda6203 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x245:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639790:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed51f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.639793:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114eda6203 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x245:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639797:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114eda6203 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x245:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639803:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x245:0x0].0x3431 (ffff880090a56e00) 00010000:00010000:0.0:1713279306.639805:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.639807:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114eda6203 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x245:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639812:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114eda6203 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x245:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.639831:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda61ee lrc: 1/0,0 mode: --/CR res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ee9 expref: 3744 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.639838:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda61ee lrc: 0/0,0 mode: --/CR res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ee9 expref: 3744 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.639846:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801251d5b00, rc 0) 00000100:00100000:0.0:1713279306.639867:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3743:11406:x1796503281140800:12345-192.168.203.4@tcp:101:touch.0 Request processed in 183us (395us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.639874:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784719 00000040:00080000:0.0:1713279306.640087:0:15484:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x1c0:0x0].1533, 384 off808312 00000001:00080000:0.0:1713279306.640093:0:15484:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4295183511 00000040:00080000:0.0:1713279306.640143:0:15484:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xf8:0x0].2141, 648 off1507976 00000004:00080000:0.0:1713279306.640147:0:15484:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88008c2fb9c0 with version 31964 00000100:00100000:0.0:1713279306.640285:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.640301:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.640342:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00010000:0.0:1713279306.640385:0:15484:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880090a4df80 reply state ffff88008e43d400 transno 4295183512 ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114eda60f9 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x685c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.640404:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114eda60f9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x685c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.640410:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x685c:0x0].0x0 (ffff88007f14b100) 00010000:00010000:0.0:1713279306.640428:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1713279306.640430:0:15484:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713279306.640456:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3514:11763:x1796503281139328:12345-192.168.203.4@tcp:36:setfattr.0 Request processed in 3560us (3788us total) trans 4295183512 rc 0/0 00000100:00100000:0.0:1713279306.640462:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784707 00000020:00080000:0.0:1713279306.640465:0:15484:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1713279306.640829:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.640838:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.640845:0:9223:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281141248 00000100:00100000:0.0:1713279306.640847:0:9223:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281141248 00010000:00010000:0.0:1713279306.640856:0:9223:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114ed9fe3c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8273:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173360 expref: 3722 pid: 6929 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.640878:0:9223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196411 00000100:00100000:0.0:1713279306.640881:0:9223:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:385c4b71-808c-40cf-91de-b076b668d13f+3722:1957:x1796503281141248:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.640886:0:9223:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.640889:0:9223:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114ed9fe3c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8273:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173360 expref: 3722 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.640898:0:9223:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114ed9fe3c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8273:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173360 expref: 3722 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.640905:0:9223:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114ed9fe3c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8273:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173360 expref: 3722 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.640911:0:9223:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8273:0x0].0x0 (ffff88011f3ebf00) 00010000:00010000:0.0:1713279306.640914:0:9223:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda61b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8273:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.640917:0:9223:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda61b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8273:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.640920:0:9223:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda61b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8273:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.640923:0:9223:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.640934:0:9223:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:385c4b71-808c-40cf-91de-b076b668d13f+3721:1957:x1796503281141248:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 52us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.640938:0:9223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196411 00000100:00100000:0.0:1713279306.641017:0:9223:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281141760 00000100:00100000:0.0:1713279306.641020:0:9223:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281141760 00010000:00010000:0.0:1713279306.641027:0:9223:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2bcc0/0xfc4b8e114ed81179 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x8273:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a005 expref: 3723 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.641036:0:9223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196412 00000100:00100000:0.0:1713279306.641038:0:9223:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:1956:x1796503281141760:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.641042:0:9223:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.641045:0:9223:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2bcc0/0xfc4b8e114ed81179 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x8273:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a005 expref: 3723 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.641049:0:9223:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2bcc0/0xfc4b8e114ed81179 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8273:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a005 expref: 3723 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.641056:0:9223:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8273:0x0].0x0 (ffff88011f3ebf00) 00010000:00010000:0.0:1713279306.641058:0:9223:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda61b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8273:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.641061:0:9223:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda61b6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8273:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.641064:0:9223:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda61b6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x8273:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.641087:0:9223:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.641099:0:9223:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:1956:x1796503281141760:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 59us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.641103:0:9223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196412 00000100:00100000:0.0:1713279306.641149:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281141888 00000100:00100000:0.0:1713279306.641225:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281141888 00000100:00100000:0.0:1713279306.641234:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784724 00000100:00100000:0.0:1713279306.641237:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:9807:x1796503281142080:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1713279306.641256:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda626c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x149:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641261:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda626c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641265:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda626c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641271:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6273 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x149:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641274:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641277:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641300:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda627a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x81a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641304:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda627a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x81a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641307:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda627a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x81a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000004:00010000:0.0:1713279306.641320:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda627a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x81a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641325:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda626c lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641328:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda626c lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641331:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda626c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641334:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda626c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641336:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.641338:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda626c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641341:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda626c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641346:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x149:0x0].0x0 (ffff880090a56100) 00010000:00010000:0.0:1713279306.641347:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.641349:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda626c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641352:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda626c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641359:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641361:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6273 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641365:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6273 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641368:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.641369:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6273 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641372:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6273 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641375:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x149:0x0].0x3831 (ffff8800909b0e00) 00010000:00010000:0.0:1713279306.641376:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.641377:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6273 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x149:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641386:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6273 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x149:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641391:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda627a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x81a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641394:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda627a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x81a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641398:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda627a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x81a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641402:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f557840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.641404:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda627a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x81a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641409:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda627a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x81a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641434:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x81a8:0x0].0x0 (ffff88008fcbec00) 00010000:00010000:0.0:1713279306.641437:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.641439:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda627a lrc: 2/0,0 mode: --/PR res: [0x200000403:0x81a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.641452:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda627a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x81a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.641480:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:9807:x1796503281142080:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 239us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.641486:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784724 00000100:00100000:0.0:1713279306.641498:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784725 00000100:00100000:0.0:1713279306.641502:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3723:11695:x1796503281141824:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.641510:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.641516:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f555b00/0xfc4b8e114eda6296 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x8694:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39174f05 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.641536:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f555b00/0xfc4b8e114eda6296 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x8694:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f05 expref: 3723 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.641545:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f555b00/0xfc4b8e114eda6296 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x8694:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f05 expref: 3723 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.641556:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8694:0x0].0x0 (ffff88009588cc00) 00010000:00010000:0.0:1713279306.641558:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1713279306.641560:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f555b00, rc 0) 00000100:00100000:0.0:1713279306.641578:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3723:11695:x1796503281141824:12345-192.168.203.4@tcp:101:touch.0 Request processed in 75us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.641584:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784725 00000100:00100000:0.0:1713279306.641598:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200009728 00000100:00100000:0.0:1713279306.641601:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200009728 00000100:00100000:0.0:1713279306.641613:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33415 00000100:00100000:0.0:1713279306.641618:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15525:x1796503200009728:12345-0@lo:105: 00010000:00010000:0.0:1713279306.641624:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda5fe1 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda5fe8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.641631:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda5fe1 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda5fe8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.641638:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda5fe1 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda5fe8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.641648:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda5fe1 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114eda5fe8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.641654:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda5fe1 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114eda5fe8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.641671:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda5fe1 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfc4b8e114eda5fe8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.641682:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800935bcfc0) 00000100:00100000:0.0:1713279306.641705:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15525:x1796503200009728:12345-0@lo:105: Request processed in 87us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.641711:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33415 00010000:00010000:0.0:1713279306.641725:0:15534:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda5fe1 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda5fe8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.641732:0:15534:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda5fe1 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda5fe8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.641744:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1713279306.641767:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135eff800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200009792:0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.641789:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.641798:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a65dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.641821:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784727 00000100:00100000:0.0:1713279306.641825:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3512:11374:x1796503281141888:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.641833:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.641859:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135eff800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200009792:0@lo:1000:mdt_io00_011.0 00000004:00080000:0.0:1713279306.641874:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x8179:0x0] 00000100:00100000:0.0:1713279306.641888:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135eff800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200009856:0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.641907:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.641915:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c213b40 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.641923:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda62a4 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x7693:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39174f0c expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.641948:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009435f600/0xfc4b8e114eda62ab lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.641955:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009435f600/0xfc4b8e114eda62ab lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.641962:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009435f600/0xfc4b8e114eda62ab lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000004:00200000:0.0:1713279306.642019:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7693:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.642022:0:15485:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1713279306.642038:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda62a4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f0c expref: 3513 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.642047:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009435f600/0xfc4b8e114eda62ab lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f0c expref: 3512 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.642053:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7693:0x0].0x0 (ffff880090aad600) 00010000:00010000:0.0:1713279306.642056:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1713279306.642058:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009435f600, rc 0) 00000100:00100000:0.0:1713279306.642102:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3512:11374:x1796503281141888:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 275us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.642108:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784727 00000100:00100000:0.0:1713279306.642731:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.642770:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.642924:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.644582:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.644597:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.644612:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.644634:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.644664:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.644682:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.644860:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200010304 00000100:00100000:0.0:1713279306.644864:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200010304 00000100:00100000:0.0:1713279306.644882:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33416 00000100:00100000:0.0:1713279306.644886:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6934:x1796503200010304:12345-0@lo:104: 00010000:00010000:0.0:1713279306.644893:0:9213:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda5fe1 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda5fe8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.645008:0:9213:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1713279306.645012:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6934:x1796503200010304:12345-0@lo:104: Request processed in 125us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.645016:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33416 00000100:00100000:0.0:1713279306.645067:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281143808 00000100:00100000:0.0:1713279306.645080:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281143808 00000100:00100000:0.0:1713279306.645094:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784735 00000100:00100000:0.0:1713279306.645096:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3515:11727:x1796503281143488:12345-192.168.203.4@tcp:36:setfattr.0 00010000:00010000:0.0:1713279306.645129:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x75c9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.645137:0:15471:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda61a1 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ed4 expref: 3516 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.645145:0:15471:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.645156:0:15471:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda61a1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ed4 expref: 3516 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.645161:0:15471:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda61a1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ed4 expref: 3516 pid: 15474 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.645167:0:15471:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c368700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001_UUID:15471:1796503200010368:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.645181:0:15471:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a65dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.645406:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281143744 00000100:00100000:0.0:1713279306.645409:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281143744 00000100:00100000:0.0:1713279306.645435:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784737 00000100:00100000:0.0:1713279306.645438:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3516:11717:x1796503281143744:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.645443:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.645449:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda63a7 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39174f52 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.645487:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda63ae lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.645494:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda63ae lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645501:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda63ae lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645511:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda63b5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.645517:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda63b5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645522:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda63b5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645551:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114eda63bc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.645558:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114eda63bc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645564:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114eda63bc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000004:00200000:0.0:1713279306.645570:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x78ee:0x0]: returning size 40670 00010000:00010000:0.0:1713279306.645599:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda63ae lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645605:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda63ae lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645610:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda63ae lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645616:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda63ae lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645620:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ed8c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.645623:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda63ae lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645628:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda63ae lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645639:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:0.0:1713279306.645642:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.645645:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda63ae lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645650:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda63ae lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645658:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda63b5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645662:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda63b5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645668:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda63b5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645672:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ef600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.645675:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda63b5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645679:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda63b5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645685:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff88012514da00) 00010000:00010000:0.0:1713279306.645687:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.645689:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda63b5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645693:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda63b5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.645715:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda63a7 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f52 expref: 3519 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.645724:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114eda63bc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f52 expref: 3518 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.645730:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x78ee:0x0].0x0 (ffff880091b35f00) 00010000:00010000:0.0:1713279306.645732:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713279306.645734:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ecd80, rc 0) 00000100:00100000:0.0:1713279306.645764:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3518:11717:x1796503281143744:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 324us (366us total) trans 4295183516 rc 0/0 00000100:00100000:0.0:1713279306.645770:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784737 00000100:00100000:0.0:1713279306.646961:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.646988:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.647167:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784740 00000100:00100000:0.0:1713279306.647171:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3745:11747:x1796503281144384:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.647179:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.647191:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda63d8 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x7693:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39174f75 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713279306.647247:0:15474:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7693:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.647286:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda63d8 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f75 expref: 3748 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.647294:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda63d8 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f75 expref: 3748 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.647302:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ef840, rc 0) 00000100:00100000:0.0:1713279306.647324:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3747:11747:x1796503281144384:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 152us (280us total) trans 4295183517 rc 301/301 00000100:00100000:0.0:1713279306.647331:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784740 00000100:00100000:0.0:1713279306.647523:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200010560 00000100:00100000:0.0:1713279306.647527:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200010560 00000100:00100000:0.0:1713279306.647609:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98574 00000100:00100000:0.0:1713279306.647614:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+68:15534:x1796503200010560:12345-0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.647653:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+68:15534:x1796503200010560:12345-0@lo:1000:mdt_io00_011.0 Request processed in 38us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.647663:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98574 00000100:00100000:0.0:1713279306.647736:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200010624 00000100:00100000:0.0:1713279306.647739:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200010624 00000100:00100000:0.0:1713279306.647749:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98575 00000100:00100000:0.0:1713279306.647752:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+68:15534:x1796503200010624:12345-0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.647787:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+68:15534:x1796503200010624:12345-0@lo:1000:mdt_io00_011.0 Request processed in 35us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.647791:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98575 00000100:00100000:0.0:1713279306.647878:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200010752 00000100:00100000:0.0:1713279306.647881:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200010752 00000100:00100000:0.0:1713279306.647892:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98576 00000100:00100000:0.0:1713279306.647895:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+9:15534:x1796503200010752:12345-0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.647937:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+9:15534:x1796503200010752:12345-0@lo:1000:mdt_io00_011.0 Request processed in 41us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.647941:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98576 00000100:00100000:0.0:1713279306.647984:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.648029:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.648048:0:15471:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c368700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001_UUID:15471:1796503200010368:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.648057:0:15471:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00000100:00100000:0.0:1713279306.648099:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.648106:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281144640 00000100:00100000:0.0:1713279306.648108:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281144640 00010000:00010000:0.0:1713279306.648116:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114ed9f655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xfd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917311b expref: 71 pid: 15519 timeout: 509 lvb_type: 1 00000100:00100000:0.0:1713279306.648126:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196415 00000100:00100000:0.0:1713279306.648129:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a147a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+71:1957:x1796503281144640:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.648134:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.648141:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114ed9f655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xfd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917311b expref: 71 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.648146:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114ed9f655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xfd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917311b expref: 71 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.648156:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114ed9f655 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xfd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917311b expref: 71 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.648161:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.648162:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.648164:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091dd4000/0xfc4b8e114eda638b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.648169:0:6916:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091dd4000/0xfc4b8e114eda638b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xfd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.648186:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.648199:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a147a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+70:1957:x1796503281144640:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 69us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.648203:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196415 00000100:00100000:0.0:1713279306.648216:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98577 00000100:00100000:0.0:1713279306.648219:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+9:15534:x1796503200010816:12345-0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.648356:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+10:15534:x1796503200010816:12345-0@lo:1000:mdt_io00_011.0 Request processed in 135us (216us total) trans 4295010085 rc 0/0 00000100:00100000:0.0:1713279306.648360:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98577 00000100:00100000:0.0:1713279306.648470:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200011008 00000100:00100000:0.0:1713279306.648473:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200011008 00000100:00100000:0.0:1713279306.648488:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98579 00000100:00100000:0.0:1713279306.648491:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+68:8074:x1796503200011008:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.648761:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+69:8074:x1796503200011008:12345-0@lo:1000:osp_up0-1.0 Request processed in 267us (306us total) trans 4295202549 rc 0/0 00000100:00100000:0.0:1713279306.648767:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98579 00000100:00100000:0.0:1713279306.648866:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.648880:0:9223:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281144576 00000100:00100000:0.0:1713279306.648883:0:9223:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281144576 00010000:00010000:0.0:1713279306.648895:0:9223:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda61a1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ed4 expref: 3526 pid: 15474 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.648911:0:9223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196416 00000100:00100000:0.0:1713279306.648915:0:9223:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c368700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3526:1955:x1796503281144576:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.648923:0:9223:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.648927:0:9223:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda61a1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ed4 expref: 3526 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.648935:0:9223:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda61a1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ed4 expref: 3526 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.648947:0:9223:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda61a1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ed4 expref: 3526 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.648956:0:9223:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75c9:0x0].0x0 (ffff88008eb9f100) 00010000:00010000:0.0:1713279306.648960:0:9223:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.648967:0:9223:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.648973:0:9223:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.648985:0:9223:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.649003:0:9223:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c368700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3525:1955:x1796503281144576:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 86us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.649008:0:9223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196416 00010000:00010000:0.0:1713279306.649022:0:15471:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.649025:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00000004:00010000:0.0:1713279306.649066:0:15471:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008bd40a80 reply state ffff88012f123800 transno 4295183522 ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.649089:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.649093:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75c9:0x0].0x0 (ffff88008eb9f100) 00010000:00010000:0.0:1713279306.649095:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1713279306.649096:0:15471:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713279306.649110:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200011136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.649140:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.649154:0:9223:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200011136 00000100:00100000:0.0:1713279306.649157:0:9223:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200011136 00000100:00100000:0.0:1713279306.649171:0:9223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196417 00000100:00100000:0.0:1713279306.649173:0:9223:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+70:3493:x1796503200011072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.649178:0:9223:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.649323:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3527:11727:x1796503281143488:12345-192.168.203.4@tcp:36:setfattr.0 Request processed in 4225us (4292us total) trans 4295183522 rc 0/0 00000100:00100000:0.0:1713279306.649328:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784735 00000100:00100000:0.0:1713279306.649356:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.649372:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.649400:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00080000:0.0:1713279306.649578:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31966 rpc_version 31966 00000020:00100000:0.0:1713279306.649590:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.649593:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880123a41180 x1796503200011264/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1272/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.649605:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a41180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200011264:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.649690:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.649699:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a65dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.649710:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200011264 00000100:00100000:0.0:1713279306.649713:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200011264 00000100:00100000:0.0:1713279306.649729:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98580 00000100:00100000:0.0:1713279306.649733:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b2418050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+69:8074:x1796503200011264:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.649849:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b2418050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+70:8074:x1796503200011264:12345-0@lo:1000:osp_up0-1.0 Request processed in 115us (159us total) trans 4295202551 rc 0/0 00000100:00100000:0.0:1713279306.649856:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98580 00010000:00010000:0.0:1713279306.650468:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114eda5f7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650473:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114eda5f7f lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650477:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114eda5f7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650480:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba98c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.650481:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114eda5f7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650485:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114eda5f7f lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650490:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x35 (ffff88007f157a00) 00010000:00010000:0.0:1713279306.650492:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.650493:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114eda5f7f lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x24a:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650497:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114eda5f7f lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x24a:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650504:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda5f8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650508:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda5f8d lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650511:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda5f8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650514:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.650515:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda5f8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650518:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda5f8d lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650521:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x35 (ffff88008dba4500) 00010000:00010000:0.0:1713279306.650522:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.650523:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda5f8d lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x231:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650526:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda5f8d lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x231:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650531:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda5f94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x858e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650534:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda5f94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x858e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650537:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda5f94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x858e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650539:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.650541:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda5f94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x858e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650546:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda5f94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x858e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650550:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x858e:0x0].0x0 (ffff88008e735e00) 00010000:00010000:0.0:1713279306.650551:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1713279306.650553:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda5f94 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x858e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650555:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda5f94 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x858e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.650579:0:9223:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda5fe8 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfc4b8e114eda5fe1 expref: 66 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.650584:0:9223:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:0.0:1713279306.650587:0:9223:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda634c lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda6329 expref: 65 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.650591:0:9223:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda634c lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114eda6329 expref: 65 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.650595:0:9223:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda634c lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114eda6329 expref: 65 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.650606:0:9223:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda634c lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda6329 expref: 65 pid: 6934 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.650612:0:9223:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a42680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:9223:1796503200011520:0@lo:105: 00000100:00100000:0.0:1713279306.650629:0:9223:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.650636:0:9223:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012fb0e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.650737:0:9223:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a42680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:9223:1796503200011520:0@lo:105: 00010000:00010000:0.0:1713279306.650744:0:9223:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.650757:0:9223:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+65:3493:x1796503200011072:12345-0@lo:103:ldlm_bl.0 Request processed in 1583us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.650761:0:9223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196417 00000100:00100000:0.0:1713279306.650803:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200011584 00000100:00100000:0.0:1713279306.650805:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200011584 00000100:00100000:0.0:1713279306.650814:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98581 00000100:00100000:0.0:1713279306.650816:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+65:15525:x1796503200011584:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.650941:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+65:15525:x1796503200011584:12345-0@lo:1000:mdt_io00_009.0 Request processed in 122us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.650948:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98581 00000100:00100000:0.0:1713279306.651084:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200011648 00000100:00100000:0.0:1713279306.651088:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200011648 00000100:00100000:0.0:1713279306.651230:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281147008 00000100:00100000:0.0:1713279306.651234:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281147008 00000100:00100000:0.0:1713279306.651247:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281146304 00000100:00100000:0.0:1713279306.651249:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281146304 00000100:00100000:0.0:1713279306.651268:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784752 00000100:00100000:0.0:1713279306.651273:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3526:11773:x1796503281146112:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.651282:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.651290:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee1c0/0xfc4b8e114eda64e9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x76d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39174fa6 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.651373:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee1c0/0xfc4b8e114eda64e9 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x76d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174fa6 expref: 3527 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.651385:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee1c0/0xfc4b8e114eda64e9 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x76d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174fa6 expref: 3527 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.651404:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76d5:0x0].0x0 (ffff8800960e8200) 00010000:00010000:0.0:1713279306.651406:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1713279306.651408:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ee1c0, rc 0) 00010000:00010000:0.0:1713279306.651428:0:6918:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713279306.651432:0:6918:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f2b600/0xfc4b8e114eda6329 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda634c expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.651437:0:6918:0:(ldlm_lockd.c:1968:ldlm_handle_bl_callback()) Lock ffff880096f2b600 is referenced, will be cancelled later 00010000:00010000:0.0:1713279306.651438:0:6918:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f2b600/0xfc4b8e114eda6329 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda634c expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.651442:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.651443:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.651444:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279306.651456:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3527:11773:x1796503281146112:12345-192.168.203.4@tcp:101:touch.0 Request processed in 182us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.651460:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784752 00000100:00100000:0.0:1713279306.651648:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200011776 00000100:00100000:0.0:1713279306.651650:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200011776 00000100:00100000:0.0:1713279306.651666:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98583 00000100:00100000:0.0:1713279306.651668:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+65:15525:x1796503200011776:12345-0@lo:403:mdt_io00_009.0 00000100:00100000:0.0:1713279306.653085:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+65:15525:x1796503200011776:12345-0@lo:403:mdt_io00_009.0 Request processed in 1414us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.653090:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98583 00000100:00100000:0.0:1713279306.653250:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.653436:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.653445:0:9223:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281148352 00000100:00100000:0.0:1713279306.653447:0:9223:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281148352 00000100:00100000:0.0:1713279306.653459:0:9223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147184 00000100:00100000:0.0:1713279306.653462:0:9223:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3530:1956:x1796503281148352:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.653477:0:9223:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.653484:0:9223:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114eda64a3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f98 expref: 3530 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.653491:0:9223:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84ee:0x0].0x0 (ffff88008acd3000) 00010000:00010000:0.0:1713279306.653493:0:9223:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.653505:0:9223:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3529:1956:x1796503281148352:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 42us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.653508:0:9223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147184 00000100:00100000:0.0:1713279306.653526:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.653536:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.653558:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.653566:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281148672 00000100:00100000:0.0:1713279306.653568:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281148672 00000100:00100000:0.0:1713279306.653577:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281148800 00000100:00100000:0.0:1713279306.653578:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281148800 00000100:00100000:0.0:1713279306.653586:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784763 00000100:00100000:0.0:1713279306.653588:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3750:11695:x1796503281148672:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1713279306.653601:0:15752:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.653607:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023df80/0xfc4b8e114eda6528 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x768b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174fc2 expref: 3750 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.653614:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x768b:0x0].0x0 (ffff88007fdca900) 00010000:00010000:0.0:1713279306.653616:0:15752:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.653652:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200011840 00000100:00100000:0.0:1713279306.653654:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200011840 00000100:00100000:0.0:1713279306.653664:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98584 00000100:00100000:0.0:1713279306.653667:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+65:15525:x1796503200011840:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:0.0:1713279306.653672:0:15580:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.653678:0:15580:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed200/0xfc4b8e114eda65c2 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda65b4 expref: -99 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.653686:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed200/0xfc4b8e114eda65c2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda65b4 expref: 66 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.653691:0:15580:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed200/0xfc4b8e114eda65c2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda65b4 expref: 66 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.653695:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x0 (ffff88012d067700) 00010000:00010000:0.0:1713279306.653697:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.653698:0:15580:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ed200, rc 0) 00000100:00100000:0.0:1713279306.653716:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+66:15525:x1796503200011840:12345-0@lo:101:mdt_io00_009.0 Request processed in 48us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.653719:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98584 00010000:00010000:0.0:1713279306.653736:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecb40/0xfc4b8e114eda65c9 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x768b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.653741:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecb40/0xfc4b8e114eda65c9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x768b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.653745:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecb40/0xfc4b8e114eda65c9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x768b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000004:00010000:0.0:1713279306.653771:0:15752:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880123a40700 reply state ffff88012f19f000 transno 4295183530 ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecb40/0xfc4b8e114eda65c9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x768b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.653777:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecb40/0xfc4b8e114eda65c9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x768b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.653780:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x768b:0x0].0x0 (ffff88007fdca900) 00010000:00010000:0.0:1713279306.653781:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.653782:0:15752:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713279306.653808:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3751:11695:x1796503281148672:12345-192.168.203.4@tcp:36:touch.0 Request processed in 218us (280us total) trans 4295183530 rc 0/0 00000100:00100000:0.0:1713279306.653811:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784763 00000100:00100000:0.0:1713279306.654104:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.654270:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.654288:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.654401:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.654470:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.654481:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281149376 00000100:00100000:0.0:1713279306.654483:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281149376 00000100:00100000:0.0:1713279306.654498:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784768 00000100:00100000:0.0:1713279306.654501:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3533:9683:x1796503281149376:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.654508:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.654513:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936eed00/0xfc4b8e114eda6632 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7a1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917500f expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.654542:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda6639 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7a1c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.654547:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda6639 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7a1c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.654552:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda6639 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7a1c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000004:00200000:0.0:1713279306.654557:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7a1c:0x0]: returning size 0 00010000:00010000:0.0:1713279306.654585:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936eed00/0xfc4b8e114eda6632 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7a1c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917500f expref: 3535 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.654592:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda6639 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7a1c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917500f expref: 3534 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.654596:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7a1c:0x0].0x0 (ffff8800908e1d00) 00010000:00010000:0.0:1713279306.654598:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1713279306.654599:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ee640, rc 0) 00000100:00100000:0.0:1713279306.654615:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3534:9683:x1796503281149376:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 113us (145us total) trans 4295183533 rc 0/0 00000100:00100000:0.0:1713279306.654618:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784768 00000100:00100000:0.0:1713279306.655029:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.655048:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.655078:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281149632 00000100:00100000:0.0:1713279306.655081:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281149632 00000100:00100000:0.0:1713279306.655121:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281149824 00000100:00100000:0.0:1713279306.655122:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281149824 00000100:00100000:0.0:1713279306.655209:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784770 00000100:00100000:0.0:1713279306.655212:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3753:11642:x1796503281149568:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.655232:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.655238:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee880/0xfc4b8e114eda6663 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175016 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.655276:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda6671 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.655284:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda6671 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655290:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda6671 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655299:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda667f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.655304:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda667f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655310:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda667f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000004:00200000:0.0:1713279306.655324:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7a64:0x0]: returning size 2 00010000:00010000:0.0:1713279306.655331:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda6671 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655337:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda6671 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655342:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda6671 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655347:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda6671 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655352:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936edf80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.655355:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda6671 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655360:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda6671 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655372:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x0 (ffff88012d067600) 00010000:00010000:0.0:1713279306.655374:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.655376:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda6671 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655381:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda6671 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655389:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda667f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655394:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda667f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655399:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda667f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655404:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942db00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.655406:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda667f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655436:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda667f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655441:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x3931 (ffff88012d067300) 00010000:00010000:0.0:1713279306.655443:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.655445:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda667f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655448:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda667f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.655464:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee880/0xfc4b8e114eda6663 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175016 expref: 3754 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.655468:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee880/0xfc4b8e114eda6663 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175016 expref: 3754 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.655474:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ee880, rc 0) 00000100:00100000:0.0:1713279306.655487:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3753:11642:x1796503281149568:12345-192.168.203.4@tcp:101:touch.0 Request processed in 275us (459us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.655491:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784770 00000100:00100000:0.0:1713279306.655857:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.655926:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110398 00000100:00100000:0.0:1713279306.655931:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1955:x1796503281150016:12345-192.168.203.4@tcp:1:lfs.0 00002000:00010000:0.0:1713279306.655953:0:11415:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x102f:0x0] initial LVB size: 0, mtime: 0x661e9147, atime: 0x661e9147, ctime: 0x661e9147, blocks: 0x0 00010000:00010000:0.0:1713279306.655959:0:11415:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094e34b40/0xfc4b8e114eda669b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x102f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.655966:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.655967:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.655971:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e34b40/0xfc4b8e114eda669b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x102f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.655979:0:11415:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e34b40/0xfc4b8e114eda669b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x102f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.655988:0:11415:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094e34b40/0xfc4b8e114eda669b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x102f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.655995:0:11415:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094e34b40/0xfc4b8e114eda669b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x102f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.656002:0:11415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094e34b40/0xfc4b8e114eda669b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x102f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.656008:0:11415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094e34b40 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:0.0:1713279306.656011:0:11415:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e34b40/0xfc4b8e114eda669b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x102f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.656017:0:11415:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e34b40/0xfc4b8e114eda669b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x102f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.656027:0:11415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094e34b40/0xfc4b8e114eda669b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x102f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.656034:0:11415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e34b40/0xfc4b8e114eda669b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x102f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.656064:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1955:x1796503281150016:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 131us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.656094:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110398 00000100:00100000:0.0:1713279306.656113:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784774 00000100:00100000:0.0:1713279306.656117:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3754:11695:x1796503281150208:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.656125:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.656133:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d4fc0/0xfc4b8e114eda66a9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x768b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175024 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.656157:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d4fc0/0xfc4b8e114eda66a9 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x768b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175024 expref: 3754 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.656166:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d4fc0/0xfc4b8e114eda66a9 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x768b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175024 expref: 3754 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.656177:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x768b:0x0].0x0 (ffff88007fdca900) 00010000:00010000:0.0:1713279306.656179:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1713279306.656181:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f1d4fc0, rc 0) 00000100:00100000:0.0:1713279306.656201:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3754:11695:x1796503281150208:12345-192.168.203.4@tcp:101:touch.0 Request processed in 82us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.656206:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784774 00000100:00100000:0.0:1713279306.656303:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281150528 00000100:00100000:0.0:1713279306.656305:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281150528 00000100:00100000:0.0:1713279306.656316:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281150592 00000100:00100000:0.0:1713279306.656317:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281150592 00000100:00100000:0.0:1713279306.656324:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784776 00000100:00100000:0.0:1713279306.656327:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:11755:x1796503281150528:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.656332:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.656346:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda66c5 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x242:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175032 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.656363:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda66d3 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x242:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.656367:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda66d3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x242:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.656374:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda66d3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x242:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000004:00200000:0.0:1713279306.656388:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x242:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.656389:0:15753:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:0.0:1713279306.656399:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda66c5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175032 expref: 3726 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.656406:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda66d3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x242:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175032 expref: 3725 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.656410:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x242:0x0].0x0 (ffff88009e797800) 00010000:00010000:0.0:1713279306.656426:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713279306.656428:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c53ba80, rc 0) 00000100:00100000:0.0:1713279306.656444:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11755:x1796503281150528:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 116us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.656448:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784776 00000100:00100000:0.0:1713279306.656566:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200012288:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.656594:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fd500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200012416:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.656660:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.656788:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c2fb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.656919:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fd500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200012416:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.657022:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fd500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200012480:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.657044:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.657061:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c2fb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.657141:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fd500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200012480:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.657260:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fd500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200012544:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.657276:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.657282:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120671b40 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.657367:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fd500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200012544:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.657392:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fd500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200012608:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.657406:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.657425:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135ce8480 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.657500:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fd500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200012608:0@lo:1000:mdt_io00_009.0 00000040:00080000:0.0:1713279306.657671:0:15525:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x1c0:0x0].1536, 1488 off811416 00000040:00080000:0.0:1713279306.657698:0:15525:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xf8:0x0].2144, 1568 off1511440 00000100:00100000:0.0:1713279306.657712:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fd500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200012736:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.657727:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.657735:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.657842:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fd500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200012736:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.657961:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f1d7800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200012864:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.657982:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.657988:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.658020:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281151872 00000100:00100000:0.0:1713279306.658023:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281151872 00000100:00100000:0.0:1713279306.658033:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281151744 00000100:00100000:0.0:1713279306.658034:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281151744 00000100:00100000:0.0:1713279306.658039:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281152000 00000100:00100000:0.0:1713279306.658041:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281152000 00000100:00100000:0.0:1713279306.658050:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784781 00000100:00100000:0.0:1713279306.658053:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3758:11642:x1796503281151872:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.658061:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.658080:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda672e lrc: 2/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175055 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.658127:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6735 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.658132:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6735 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658137:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6735 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658143:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda6743 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.658147:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda6743 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658150:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda6743 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000004:00200000:0.0:1713279306.658158:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7a64:0x0]: returning size 2 00010000:00010000:0.0:1713279306.658162:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6735 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658165:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6735 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658168:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6735 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658171:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6735 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658177:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ef840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.658178:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6735 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658182:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6735 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658186:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x0 (ffff880097910a00) 00010000:00010000:0.0:1713279306.658187:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.658189:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6735 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658191:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6735 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658204:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda6743 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658207:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda6743 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658210:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda6743 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658213:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ef600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.658214:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda6743 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658216:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda6743 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658220:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x3931 (ffff880097910000) 00010000:00010000:0.0:1713279306.658221:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.658222:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda6743 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658225:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda6743 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658238:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda672e lrc: 1/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175055 expref: 3758 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.658242:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda672e lrc: 0/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175055 expref: 3758 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.658248:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea5f180, rc 0) 00000100:00100000:0.0:1713279306.658263:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3757:11642:x1796503281151872:12345-192.168.203.4@tcp:101:touch.0 Request processed in 209us (298us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.658267:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784781 00000100:00100000:0.0:1713279306.658274:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784783 00000100:00100000:0.0:1713279306.658277:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3756:11711:x1796503281152000:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.658282:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.658287:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda675f lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917505c expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.658306:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda6766 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.658310:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda6766 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658314:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda6766 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658321:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda676d lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.658324:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda676d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658327:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda676d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658337:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda6766 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658434:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda6766 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658437:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda6766 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658440:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda6766 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658442:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094552ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.658444:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda6766 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658448:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda6766 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658455:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88007f009300) 00010000:00010000:0.0:1713279306.658457:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.658459:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda6766 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658463:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda6766 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658472:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda676d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658477:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda676d lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658482:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda676d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658487:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f557840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.658489:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda676d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658494:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda676d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658500:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880096da6900) 00010000:00010000:0.0:1713279306.658502:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.658504:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda676d lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658509:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda676d lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.658530:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda675f lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917505c expref: 3757 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.658547:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda675f lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917505c expref: 3757 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.658557:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ed8c0, rc 0) 00000100:00100000:0.0:1713279306.658576:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3756:11711:x1796503281152000:12345-192.168.203.4@tcp:101:touch.0 Request processed in 296us (566us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.658582:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784783 00010000:00010000:0.0:1713279306.658708:0:8071:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1713279306.658713:0:8071:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f2b600/0xfc4b8e114eda6329 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda634c expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.658719:0:8071:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f2b600 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:0.0:1713279306.658722:0:8071:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f2b600/0xfc4b8e114eda6329 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda634c expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713279306.658729:0:8071:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f2b600/0xfc4b8e114eda6329 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda634c expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.658744:0:8071:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f2b600/0xfc4b8e114eda6329 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda634c expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.658749:0:8071:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713279306.658760:0:8071:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f2b600/0xfc4b8e114eda6329 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda634c expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.658766:0:8071:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f2b600/0xfc4b8e114eda6329 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda634c expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.658774:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.658775:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.658777:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279306.658784:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200013120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.658801:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.658811:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713279306.658814:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200013184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.658823:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.658843:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200013184 00000100:00100000:0.0:1713279306.658845:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200013184 00000100:00100000:0.0:1713279306.658858:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196423 00000100:00100000:0.0:1713279306.658861:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+72:3492:x1796503200013120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.658866:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.658992:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200013184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.659006:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281152448 00000100:00100000:0.0:1713279306.659009:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281152448 00000100:00100000:0.0:1713279306.659026:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110400 00000100:00100000:0.0:1713279306.659030:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+72:1957:x1796503281152448:12345-192.168.203.4@tcp:22:fallocate.0 00002000:00010000:0.0:1713279306.659177:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb size from disk: 37238 -> 46934 00002000:00010000:0.0:1713279306.659180:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279306.659181:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb atime from disk: 1713279302 -> 1648351934 00002000:00010000:0.0:1713279306.659182:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279306.659183:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb blocks from disk: 48 -> 88 00000100:00100000:0.0:1713279306.659240:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+73:1957:x1796503281152448:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 209us (420us total) trans 4295010090 rc 0/0 00000100:00100000:0.0:1713279306.659244:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110400 00000100:00100000:0.0:1713279306.659769:0:15507:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281152960 00000100:00100000:0.0:1713279306.659773:0:15507:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281152960 00000100:00100000:0.0:1713279306.659798:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14317 00000100:00100000:0.0:1713279306.659803:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:10123:x1796503281152960:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:0.0:1713279306.659828:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.659861:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda6782 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.659867:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.659876:0:15507:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda6782 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.659882:0:15507:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.659896:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114eda64bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x84eb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.659902:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114eda64bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x84eb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.659908:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114eda64bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x84eb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.659912:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023e880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.659914:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114eda64bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x84eb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.659919:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114eda64bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x84eb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.659926:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84eb:0x0].0x0 (ffff88012061ff00) 00010000:00010000:0.0:1713279306.659929:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.659931:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114eda64bf lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x84eb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.659939:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114eda64bf lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x84eb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00000100:00100000:0.0:1713279306.659953:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281152832 00000100:00100000:0.0:1713279306.659956:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281152832 00000100:00100000:0.0:1713279306.659971:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110401 00000100:00100000:0.0:1713279306.659976:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b42d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+72:1957:x1796503281152832:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:0.0:1713279306.660045:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b42d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+73:1957:x1796503281152832:12345-192.168.203.4@tcp:2:touch.0 Request processed in 68us (312us total) trans 4295010091 rc 0/0 00000100:00100000:0.0:1713279306.660051:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110401 00000100:00100000:0.0:1713279306.661110:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.661152:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281153664 00000100:00100000:0.0:1713279306.661156:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281153664 00000100:00100000:0.0:1713279306.661176:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784789 00000100:00100000:0.0:1713279306.661180:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3537:10814:x1796503281153664:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1713279306.661210:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda67cf lrc: 3/1,0 mode: --/CR res: [0x240000401:0x134:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661218:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda67cf lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661225:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda67cf lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661234:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda67dd lrc: 3/1,0 mode: --/PR res: [0x240000401:0x134:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661240:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda67dd lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661249:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda67dd lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661280:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda67f2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x763e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661286:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda67f2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x763e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661291:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda67f2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x763e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000004:00010000:0.0:1713279306.661310:0:9221:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda67f2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x763e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661316:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda67cf lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661320:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda67cf lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661323:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda67cf lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661326:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda67cf lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661328:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.661330:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda67cf lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661333:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda67cf lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661340:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x0 (ffff88012514d400) 00010000:00010000:0.0:1713279306.661341:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.661343:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda67cf lrc: 3/0,0 mode: --/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661346:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda67cf lrc: 0/0,0 mode: --/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661354:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda67dd lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661357:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda67dd lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661360:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda67dd lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661362:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801312c58c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.661364:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda67dd lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661367:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda67dd lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661370:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x3431 (ffff88012514d000) 00010000:00010000:0.0:1713279306.661371:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.661372:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda67dd lrc: 2/0,0 mode: --/PR res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661375:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda67dd lrc: 0/0,0 mode: --/PR res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661379:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda67f2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x763e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661383:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda67f2 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x763e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661386:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda67f2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x763e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661388:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801251d5b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.661389:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda67f2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x763e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661392:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda67f2 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x763e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661395:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x763e:0x0].0x0 (ffff88012fbfeb00) 00010000:00010000:0.0:1713279306.661396:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.661397:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda67f2 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x763e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.661400:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda67f2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x763e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713279306.661453:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3537:10814:x1796503281153664:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 271us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.661457:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784789 00000100:00100000:0.0:1713279306.661465:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281153984 00000100:00100000:0.0:1713279306.661467:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281153984 00000100:00100000:0.0:1713279306.661480:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784791 00000100:00100000:0.0:1713279306.661483:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3724:11753:x1796503281153984:12345-192.168.203.4@tcp:101:setfattr.0 00010000:00010000:0.0:1713279306.661488:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.661493:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda67f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917508d expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.661509:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6800 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661514:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6800 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661518:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6800 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661523:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6807 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661538:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661541:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661565:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda680e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8378:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661573:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda680e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8378:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661578:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda680e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8378:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000004:00200000:0.0:1713279306.661627:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8378:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.661630:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1713279306.661638:0:9221:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda680e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8378:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661645:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6800 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661659:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6800 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661662:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6800 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661665:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6800 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661667:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800963e0240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.661668:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6800 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661671:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6800 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661676:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:0.0:1713279306.661677:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.661678:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6800 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661681:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6800 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661686:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661688:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6807 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661691:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6807 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661694:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ce53a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.661695:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6807 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661699:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6807 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661702:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3431 (ffff88012514d200) 00010000:00010000:0.0:1713279306.661703:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.661704:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6807 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661707:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6807 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661718:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda67f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917508d expref: 3726 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.661724:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda680e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8378:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917508d expref: 3725 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.661727:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8378:0x0].0x0 (ffff88008e5b8b00) 00010000:00010000:0.0:1713279306.661728:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713279306.661729:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942eac0, rc 0) 00000100:00100000:0.0:1713279306.661744:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3725:11753:x1796503281153984:12345-192.168.203.4@tcp:101:setfattr.0 Request processed in 260us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.661749:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784791 00000100:00100000:0.0:1713279306.661761:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.661768:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281153920 00000100:00100000:0.0:1713279306.661770:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281153920 00000100:00100000:0.0:1713279306.661779:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784794 00000100:00100000:0.0:1713279306.661782:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3725:11711:x1796503281153920:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.661787:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.661792:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda6815 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175086 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.661827:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6823 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661831:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6823 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661835:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6823 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661841:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda682a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661844:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda682a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661848:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda682a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000004:00200000:0.0:1713279306.661856:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:0.0:1713279306.661860:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6823 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661863:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6823 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661866:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6823 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661869:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6823 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661874:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.661876:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6823 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661879:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6823 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661882:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012514d500) 00010000:00010000:0.0:1713279306.661883:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.661885:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6823 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661887:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6823 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661892:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda682a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661894:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda682a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661897:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda682a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661899:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091cbc000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.661901:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda682a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661904:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda682a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661907:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff88012514de00) 00010000:00010000:0.0:1713279306.661908:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.661910:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda682a lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661913:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda682a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.661925:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda6815 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175086 expref: 3726 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.661929:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda6815 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175086 expref: 3726 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.661935:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942e400, rc 0) 00000100:00100000:0.0:1713279306.661950:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3725:11711:x1796503281153920:12345-192.168.203.4@tcp:101:touch.0 Request processed in 167us (188us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.661953:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784794 00000100:00100000:0.0:1713279306.662766:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efc700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000-mdtlov_UUID:15534:1796503200013440:0@lo:403:mdt_io00_011.0 00010000:00010000:0.0:1713279306.663332:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda688c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x149:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.663340:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda688c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.663347:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda688c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.663355:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda689a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x149:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.663361:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda689a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x149:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.663366:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda689a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x149:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.663386:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda68a1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x81a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.663394:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda62e3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x81a8:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f2f expref: 3723 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.663400:0:15534:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda68a1 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x81a8:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.663435:0:15534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda62e3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x81a8:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f2f expref: 3723 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.663444:0:15534:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda62e3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x81a8:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f2f expref: 3723 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.663453:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3ff800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200013952:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.663472:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d8240 going to sleep for 11 seconds 00000004:00080000:0.0:1713279306.663743:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29394 rpc_version 29394 00000020:00100000:0.0:1713279306.663754:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.663758:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009764d880 x1796503200014080/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1320/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.663767:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200014080:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.663784:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.663791:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.663901:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200014080:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.664145:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281155520 00000100:00100000:0.0:1713279306.664148:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281155520 00000100:00100000:0.0:1713279306.664162:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784800 00000100:00100000:0.0:1713279306.664165:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3758:11642:x1796503281155520:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.664172:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.664178:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda68cb lrc: 2/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391750b7 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.664215:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda68d2 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.664220:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda68d2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664224:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda68d2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664229:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda68e0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.664233:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda68e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664236:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda68e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000004:00200000:0.0:1713279306.664244:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7a64:0x0]: returning size 2 00010000:00010000:0.0:1713279306.664248:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda68d2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664251:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda68d2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664254:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda68d2 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664260:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda68d2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664263:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bfa80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.664265:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda68d2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664267:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda68d2 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664271:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x0 (ffff88012514d300) 00010000:00010000:0.0:1713279306.664273:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.664275:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda68d2 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664277:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda68d2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664282:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda68e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664285:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda68e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664288:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda68e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664290:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bf3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.664292:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda68e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664294:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda68e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664300:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x3931 (ffff88012514d800) 00010000:00010000:0.0:1713279306.664302:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.664303:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda68e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664306:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda68e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.664318:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda68cb lrc: 1/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750b7 expref: 3759 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.664322:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda68cb lrc: 0/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750b7 expref: 3759 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.664328:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bc000, rc 0) 00000100:00100000:0.0:1713279306.664350:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3758:11642:x1796503281155520:12345-192.168.203.4@tcp:101:touch.0 Request processed in 185us (216us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.664354:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784800 00000100:00100000:0.0:1713279306.666872:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.666922:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.666936:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281155840 00000100:00100000:0.0:1713279306.666939:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281155840 00000100:00100000:0.0:1713279306.666958:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110402 00000100:00100000:0.0:1713279306.666963:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1955:x1796503281155840:12345-192.168.203.4@tcp:1:lfs.0 00002000:00010000:0.0:1713279306.667044:0:15538:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x105d:0x0] initial LVB size: 0, mtime: 0x661e9148, atime: 0x661e9148, ctime: 0x661e9148, blocks: 0x0 00010000:00010000:0.0:1713279306.667050:0:15538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda690a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x105d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667063:0:15538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.667065:0:15538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.667081:0:15538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda690a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x105d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667091:0:15538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda690a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x105d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667101:0:15538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda690a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x105d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667108:0:15538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda690a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x105d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667115:0:15538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda690a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667121:0:15538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcfc0 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:0.0:1713279306.667124:0:15538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda690a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667130:0:15538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda690a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x105d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667141:0:15538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda690a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x105d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667153:0:15538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda690a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x105d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.667183:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1955:x1796503281155840:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 219us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.667201:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110402 00000100:00100000:0.0:1713279306.667218:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281156544 00000100:00100000:0.0:1713279306.667221:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281156544 00000100:00100000:0.0:1713279306.667235:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784804 00000100:00100000:0.0:1713279306.667240:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3761:11711:x1796503281156416:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.667247:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.667256:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda6926 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391750d3 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667283:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda692d lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.667290:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda692d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667297:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda692d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667323:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda693b lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.667330:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda693b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667339:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda693b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667357:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda692d lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667362:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda692d lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667367:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda692d lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667372:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda692d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667377:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801250f5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.667380:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda692d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667385:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda692d lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667392:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88012514d600) 00010000:00010000:0.0:1713279306.667394:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.667396:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda692d lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667402:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda692d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667409:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda693b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667434:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda693b lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667440:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda693b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667445:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801250f7a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.667447:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda693b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667453:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda693b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667459:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88012514d900) 00010000:00010000:0.0:1713279306.667461:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.667464:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda693b lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667469:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda693b lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667488:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda6926 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750d3 expref: 3765 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667496:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda6926 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750d3 expref: 3765 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667504:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801250f7840, rc 0) 00000100:00100000:0.0:1713279306.667532:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3763:11711:x1796503281156416:12345-192.168.203.4@tcp:101:touch.0 Request processed in 291us (591us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.667538:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784804 00000100:00100000:0.0:1713279306.667552:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784807 00000100:00100000:0.0:1713279306.667556:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3762:11642:x1796503281156800:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.667564:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.667572:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda695e lrc: 2/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391750e1 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667614:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda696c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.667621:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda696c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667627:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda696c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667636:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda6973 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.667642:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda6973 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667648:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda6973 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000004:00200000:0.0:1713279306.667660:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7a64:0x0]: returning size 2 00010000:00010000:0.0:1713279306.667666:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda696c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667671:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda696c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667677:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda696c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667682:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda696c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667690:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a7180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.667692:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda696c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667698:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda696c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667704:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x0 (ffff88012514db00) 00010000:00010000:0.0:1713279306.667706:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.667709:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda696c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667714:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda696c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667721:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda6973 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667726:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda6973 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667731:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda6973 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667736:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a5f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.667738:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda6973 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667743:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda6973 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667748:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x3931 (ffff88012514d700) 00010000:00010000:0.0:1713279306.667750:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.667753:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda6973 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667758:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda6973 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.667778:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda695e lrc: 1/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750e1 expref: 3763 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667795:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda695e lrc: 0/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750e1 expref: 3763 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.667803:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009681c900, rc 0) 00000100:00100000:0.0:1713279306.667824:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3762:11642:x1796503281156800:12345-192.168.203.4@tcp:101:touch.0 Request processed in 267us (551us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.667830:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784807 00000100:00100000:0.0:1713279306.667961:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281156928 00000100:00100000:0.0:1713279306.667965:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281156928 00000100:00100000:0.0:1713279306.667984:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784808 00000100:00100000:0.0:1713279306.667989:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3731:11761:x1796503281156928:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.667999:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.668006:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda6981 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391750e8 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.668147:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda69b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668156:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda69b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668162:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda69b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668226:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda69b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668233:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda69b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668240:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda69b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000004:00200000:0.0:1713279306.668274:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8378:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.668281:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda69b2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668287:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda69b2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668292:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda69b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668297:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda69b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668302:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880130c93cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.668305:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda69b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668310:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda69b2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668317:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:0.0:1713279306.668319:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.668322:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda69b2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668331:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda69b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668338:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda69b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668343:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda69b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668348:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda69b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668353:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880130c92640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.668355:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda69b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668360:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda69b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668366:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3431 (ffff8800909b0e00) 00010000:00010000:0.0:1713279306.668368:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.668370:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda69b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668375:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda69b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.668392:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda6981 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750e8 expref: 3733 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.668400:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda6981 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750e8 expref: 3733 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.668410:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d4b3180, rc 0) 00000100:00100000:0.0:1713279306.668505:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3732:11761:x1796503281156928:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 515us (559us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.668512:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784808 00000100:00100000:0.0:1713279306.668545:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.668573:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.668588:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281157376 00000100:00100000:0.0:1713279306.668592:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281157376 00000100:00100000:0.0:1713279306.668608:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784810 00010000:00010000:2.0:1713279306.668609:0:15499:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6911 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x117c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.668613:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3547:11204:x1796503281157376:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.668619:0:15499:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x117c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.668622:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.668629:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800918cbcc0/0xfc4b8e114eda69e3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x76dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391750f6 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.668629:0:15499:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6911 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x117c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.668635:0:15499:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6911 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x117c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.668650:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800918cbcc0/0xfc4b8e114eda69e3 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x76dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750f6 expref: 3548 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.668659:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800918cbcc0/0xfc4b8e114eda69e3 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x76dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750f6 expref: 3548 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.668659:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+73:1956:x1796503281156288:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 1620us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.668665:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110403 00010000:00010000:0.0:1713279306.668670:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76dd:0x0].0x0 (ffff880097910700) 00000100:00100000:2.0:1713279306.668677:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281157504 00000100:00100000:2.0:1713279306.668680:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281157504 00000100:00100000:2.0:1713279306.668693:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222942 00000100:00100000:2.0:1713279306.668698:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:9807:x1796503281157504:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1713279306.668731:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:9807:x1796503281157504:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 33us (159us total) trans 0 rc -116/-116 00000100:00100000:2.0:1713279306.668737:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222942 00010000:00010000:0.0:1713279306.668764:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1713279306.668766:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918cbcc0, rc 0) 00000100:00100000:0.0:1713279306.668782:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3548:11204:x1796503281157376:12345-192.168.203.4@tcp:101:touch.0 Request processed in 168us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.668786:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784810 00000100:00100000:2.0:1713279306.668806:0:15658:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000_UUID:15658:1796503200014400:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.671139:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.671164:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.671172:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.671179:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.671199:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.671222:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.671222:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196429 00000100:00100000:2.0:1713279306.671228:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3732:1954:x1796503281157824:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.671235:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.671240:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda6250 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174efe expref: 3732 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.671248:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda6250 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174efe expref: 3732 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.671259:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda6250 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174efe expref: 3732 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.671267:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281158336 00010000:00010000:2.0:1713279306.671269:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7e71:0x0].0x0 (ffff8800939e3100) 00000100:00100000:0.0:1713279306.671271:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281158336 00010000:00010000:2.0:1713279306.671272:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114eda69ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.671278:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114eda69ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.671283:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.671301:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3731:1954:x1796503281157824:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 73us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.671307:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196429 00000100:00100000:2.0:1713279306.671326:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784815 00000100:00100000:2.0:1713279306.671330:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3764:11798:x1796503281158208:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.671338:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.671345:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784816 00010000:00010000:2.0:1713279306.671346:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0900/0xfc4b8e114eda6a22 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175112 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.671351:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3550:11789:x1796503281157952:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.671361:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.671370:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013076cb40/0xfc4b8e114eda6a30 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x757a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175104 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.671393:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b2d00/0xfc4b8e114eda6a45 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.671396:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a065b00/0xfc4b8e114eda6a4c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x757a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.671401:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b2d00/0xfc4b8e114eda6a45 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.671404:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a065b00/0xfc4b8e114eda6a4c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x757a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.671407:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b2d00/0xfc4b8e114eda6a45 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.671428:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a065b00/0xfc4b8e114eda6a4c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x757a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.671436:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda6a5a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.671443:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda6a5a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671448:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda6a5a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00200000:0.0:1713279306.671450:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x757a:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.671453:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713279306.671470:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076cb40/0xfc4b8e114eda6a30 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x757a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175104 expref: 3553 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.671476:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3a80/0xfc4b8e114eda6a61 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x75e2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.671481:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a065b00/0xfc4b8e114eda6a4c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x757a:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175104 expref: 3552 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.671483:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3a80/0xfc4b8e114eda6a61 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x75e2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.671487:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x757a:0x0].0x0 (ffff88008c725f00) 00010000:00010000:0.0:1713279306.671489:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1713279306.671489:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3a80/0xfc4b8e114eda6a61 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x75e2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.671492:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a065b00, rc 0) 00000004:00200000:2.0:1713279306.671494:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x75e2:0x0]: returning size 31037 00000100:00100000:0.0:1713279306.671512:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3552:11789:x1796503281157952:12345-192.168.203.4@tcp:101:touch.0 Request processed in 161us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.671519:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784816 00010000:00010000:2.0:1713279306.671522:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b2d00/0xfc4b8e114eda6a45 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671527:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b2d00/0xfc4b8e114eda6a45 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671532:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b2d00/0xfc4b8e114eda6a45 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671537:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b2d00/0xfc4b8e114eda6a45 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671542:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b2d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.671545:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b2d00/0xfc4b8e114eda6a45 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671549:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b2d00/0xfc4b8e114eda6a45 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671557:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:2.0:1713279306.671559:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.671561:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b2d00/0xfc4b8e114eda6a45 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671566:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b2d00/0xfc4b8e114eda6a45 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671573:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda6a5a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671578:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda6a5a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671583:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda6a5a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671587:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b3cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.671590:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda6a5a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671595:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda6a5a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671600:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3931 (ffff880096051900) 00010000:00010000:2.0:1713279306.671603:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.671605:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda6a5a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671609:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda6a5a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.671627:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0900/0xfc4b8e114eda6a22 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175112 expref: 3769 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.671635:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3a80/0xfc4b8e114eda6a61 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x75e2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175112 expref: 3768 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.671640:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75e2:0x0].0x0 (ffff880092ae7200) 00010000:00010000:2.0:1713279306.671642:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.671644:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800926b3a80, rc 0) 00000100:00100000:2.0:1713279306.671659:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3768:11798:x1796503281158208:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 329us (488us total) trans 4295183554 rc 0/0 00000100:00100000:2.0:1713279306.671666:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784815 00000100:00100000:2.0:1713279306.671817:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281158528 00000100:00100000:2.0:1713279306.671821:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281158528 00000100:00100000:2.0:1713279306.671827:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281158656 00000100:00100000:2.0:1713279306.671829:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281158656 00000100:00100000:2.0:1713279306.671846:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281158720 00000100:00100000:2.0:1713279306.671848:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281158720 00000100:00100000:2.0:1713279306.671858:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110404 00000100:00100000:2.0:1713279306.671862:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+74:1957:x1796503281158656:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:0.0:1713279306.671868:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110405 00000100:00100000:0.0:1713279306.671872:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+73:1957:x1796503281158720:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1713279306.671942:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1957:x1796503281158656:12345-192.168.203.4@tcp:2:touch.0 Request processed in 78us (124us total) trans 4295010146 rc 0/0 00000100:00100000:0.0:1713279306.671945:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+74:1957:x1796503281158720:12345-192.168.203.4@tcp:2:touch.0 Request processed in 72us (116us total) trans 4295010092 rc 0/0 00000100:00100000:2.0:1713279306.671948:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110404 00000100:00100000:0.0:1713279306.671951:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110405 00000100:00100000:2.0:1713279306.671961:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281158592 00000100:00100000:2.0:1713279306.671963:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281158592 00000100:00100000:2.0:1713279306.671983:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784819 00000100:00100000:2.0:1713279306.671988:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3767:11708:x1796503281158592:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.671995:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.672002:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce50480/0xfc4b8e114eda6a8b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7d64:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175127 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.672020:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce50480/0xfc4b8e114eda6a8b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7d64:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175127 expref: 3769 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.672027:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce50480/0xfc4b8e114eda6a8b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7d64:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175127 expref: 3769 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.672037:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d64:0x0].0x0 (ffff880096696c00) 00010000:00010000:2.0:1713279306.672039:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1713279306.672040:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce50480, rc 0) 00000100:00100000:0.0:1713279306.672046:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.672056:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3769:11708:x1796503281158592:12345-192.168.203.4@tcp:101:touch.0 Request processed in 68us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.672057:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281159296 00000100:00100000:0.0:1713279306.672059:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281159296 00000100:00100000:2.0:1713279306.672061:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784819 00000100:00100000:0.0:1713279306.672083:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110406 00000100:00100000:0.0:1713279306.672087:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1957:x1796503281159296:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:2.0:1713279306.672096:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784821 00000100:00100000:2.0:1713279306.672100:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:9807:x1796503281158528:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:2.0:1713279306.672121:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6a99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x149:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672127:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672133:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672145:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6aa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x149:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672150:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672155:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00002000:00010000:0.0:1713279306.672172:0:15538:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb size from disk: 30052 -> 30052 00002000:00010000:0.0:1713279306.672174:0:15538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279306.672176:0:15538:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1713279306.672177:0:15538:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279306.672178:0:15538:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1713279306.672183:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6aa7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x826a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672190:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x826a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.672193:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1957:x1796503281159296:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 105us (147us total) trans 4295010147 rc 0/0 00010000:00010000:2.0:1713279306.672196:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x826a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.672197:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110406 00000004:00010000:2.0:1713279306.672215:0:15658:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x826a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672222:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6a99 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672227:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6a99 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672231:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6a99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672236:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6a99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672240:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.672243:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6a99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672249:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6a99 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672255:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x149:0x0].0x0 (ffff880096696900) 00010000:00010000:2.0:1713279306.672257:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.672259:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6a99 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.672260:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.672263:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6a99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672272:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672277:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672281:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672285:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925433c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.672288:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672293:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.672296:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281159232 00010000:00010000:2.0:1713279306.672298:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x149:0x0].0x32 (ffff88008c124700) 00000100:00100000:0.0:1713279306.672299:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281159232 00010000:00010000:2.0:1713279306.672300:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.672302:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6aa0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672310:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6aa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.672312:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784823 00000100:00100000:0.0:1713279306.672315:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3731:11711:x1796503281159232:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.672319:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x826a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.672321:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.672323:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6aa7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x826a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672328:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x826a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672332:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092541d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.672334:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x826a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672339:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x826a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672345:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x826a:0x0].0x0 (ffff880091553000) 00010000:00010000:2.0:1713279306.672346:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.672348:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6aa7 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x826a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.672353:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6aa7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x826a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.672372:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6f40/0xfc4b8e114eda6ac3 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175135 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.672377:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:9807:x1796503281158528:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 275us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.672382:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784821 00010000:00010000:0.0:1713279306.672428:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda6aca lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.672434:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda6aca lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.672438:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda6aca lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.672441:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281159424 00010000:00010000:0.0:1713279306.672444:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda6ad1 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.672444:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281159424 00010000:00010000:0.0:1713279306.672447:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda6ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.672450:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda6ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.672457:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784824 00000004:00200000:0.0:1713279306.672460:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00000100:00100000:2.0:1713279306.672461:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3550:11789:x1796503281159424:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.672464:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda6aca lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.672467:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda6aca lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.672468:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.672470:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda6aca lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.672474:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda6aca lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.672475:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda6ad8 lrc: 2/0,0 mode: --/CW res: [0x240000403:0x757a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917513c expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.672477:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf7cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.672479:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda6aca lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.672482:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda6aca lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.672486:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012d067300) 00010000:00010000:0.0:1713279306.672487:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.672489:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda6aca lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.672492:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda6aca lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.672496:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda6ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.672499:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda6ad1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.672502:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda6ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.672504:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf6400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.672506:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda6ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.672509:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda6ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.672510:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda6adf lrc: 3/0,1 mode: --/CW res: [0x240000403:0x757a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.672512:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff88012d067700) 00010000:00010000:0.0:1713279306.672513:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.672514:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda6ad1 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.672516:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda6adf lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x757a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.672518:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda6ad1 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.672522:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda6adf lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x757a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.672531:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda6ae6 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x757a:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.672536:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6f40/0xfc4b8e114eda6ac3 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175135 expref: 3732 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.672536:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda6ae6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x757a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.672541:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda6ae6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x757a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.672543:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6f40/0xfc4b8e114eda6ac3 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175135 expref: 3732 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.672582:0:15473:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15473:1796503200014848:0@lo:1000:mdt00_010.0 00000100:00100000:2.0:1713279306.672602:0:15473:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.672612:0:15473:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092545b40 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.672620:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200014848 00000100:00100000:2.0:1713279306.672623:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200014848 00000100:00100000:2.0:1713279306.672638:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98607 00000100:00100000:2.0:1713279306.672642:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+67:15473:x1796503200014848:12345-0@lo:1000:mdt00_010.0 00000100:00100000:2.0:1713279306.672679:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+67:15473:x1796503200014848:12345-0@lo:1000:mdt00_010.0 Request processed in 36us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.672685:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98607 00000100:00100000:2.0:1713279306.672706:0:15473:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15473:1796503200014848:0@lo:1000:mdt00_010.0 00010000:00010000:0.0:1713279306.672806:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf6f40, rc 0) 00000004:00080000:2.0:1713279306.672807:0:15473:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x1082:0x0], index 1: 0 00000100:00100000:0.0:1713279306.672828:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3732:11711:x1796503281159232:12345-192.168.203.4@tcp:101:touch.0 Request processed in 510us (566us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.672834:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784823 00010000:00010000:2.0:1713279306.672867:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda6b17 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x76df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.672873:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda6b17 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.672879:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda6b17 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.672894:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda6adf lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x757a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.672899:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda6adf lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x757a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.672904:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda6adf lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x757a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.672908:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda6adf lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x757a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.672909:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.672912:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b46c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.672917:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda6adf lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x757a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.672922:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda6adf lrc: 5/0,0 mode: CW/CW res: [0x240000403:0x757a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.672931:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.672931:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x757a:0x0].0x0 (ffff88008c725f00) 00010000:00010000:2.0:1713279306.672933:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.672936:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda6adf lrc: 3/0,0 mode: --/CW res: [0x240000403:0x757a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.672941:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda6adf lrc: 0/0,0 mode: --/CW res: [0x240000403:0x757a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000004:00010000:2.0:1713279306.672948:0:15473:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008accd500 reply state ffff88009386c000 transno 4295183557 ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda6ae6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x757a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.672954:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda6ae6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x757a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.672958:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x757a:0x0].0x3031 (ffff880089dc2100) 00010000:00010000:2.0:1713279306.672960:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.672962:0:15473:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.672973:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda6ad8 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x757a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917513c expref: 3553 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.672982:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda6b17 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917513c expref: 3552 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.672988:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76df:0x0].0x0 (ffff880089dc2800) 00010000:00010000:2.0:1713279306.672990:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.672992:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fef8b40, rc 0) 00000100:00100000:2.0:1713279306.673003:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281159680 00000100:00100000:2.0:1713279306.673005:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281159680 00000100:00100000:0.0:1713279306.673007:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.673021:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222943 00000100:00100000:2.0:1713279306.673025:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3554:11204:x1796503281159680:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1713279306.673135:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3557:11204:x1796503281159680:12345-192.168.203.4@tcp:35:touch.0 Request processed in 108us (225us total) trans 4295183558 rc 0/0 00000100:00100000:2.0:1713279306.673141:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222943 00000100:00100000:2.0:1713279306.673154:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200014912 00000100:00100000:2.0:1713279306.673157:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200014912 00000100:00100000:2.0:1713279306.673170:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98608 00000100:00100000:2.0:1713279306.673174:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+66:6943:x1796503200014912:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.673218:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+66:6943:x1796503200014912:12345-0@lo:1000:mdt_io00_002.0 Request processed in 43us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.673223:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98608 00000100:00100000:0.0:1713279306.673235:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efc700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200014912:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.673246:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3556:11789:x1796503281159424:12345-192.168.203.4@tcp:101:touch.0 Request processed in 784us (835us total) trans 4295183557 rc 0/0 00000004:00080000:0.0:1713279306.673249:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x8179:0x0] 00000100:00100000:2.0:1713279306.673252:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784824 00000100:00100000:0.0:1713279306.673262:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c369f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015104:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.673279:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.673286:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.673293:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200015104 00000100:00100000:2.0:1713279306.673296:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200015104 00000100:00100000:2.0:1713279306.673309:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98609 00000100:00100000:2.0:1713279306.673312:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+66:6943:x1796503200015104:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.673349:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+66:6943:x1796503200015104:12345-0@lo:1000:mdt_io00_002.0 Request processed in 36us (68us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.673354:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98609 00000100:00100000:0.0:1713279306.673445:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c369f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015104:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.673448:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.673463:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.673511:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110409 00000100:00100000:2.0:1713279306.673516:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+73:1956:x1796503281160192:12345-192.168.203.4@tcp:22:fallocate.0 00002000:00010000:2.0:1713279306.673704:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb size from disk: 35262 -> 35262 00002000:00010000:2.0:1713279306.673707:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.673709:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb atime from disk: 1713279302 -> 1713279302 00002000:00010000:2.0:1713279306.673711:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.673713:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb blocks from disk: 40 -> 8 00000100:00100000:2.0:1713279306.673731:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+74:1956:x1796503281160192:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 214us (267us total) trans 4295010093 rc 0/0 00000100:00100000:2.0:1713279306.673737:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110409 00000100:00100000:2.0:1713279306.673787:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281160320 00000100:00100000:2.0:1713279306.673790:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281160320 00010000:00010000:2.0:1713279306.673799:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda28cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173f61 expref: 3731 pid: 15474 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.673812:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196433 00000100:00100000:2.0:1713279306.673816:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:385c4b71-808c-40cf-91de-b076b668d13f+3731:1957:x1796503281160320:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.673822:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.673826:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda28cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x19/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173f61 expref: 3731 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.673834:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda28cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173f61 expref: 3731 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.673844:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda28cf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x19/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173f61 expref: 3731 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.673862:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:2.0:1713279306.673865:0:9215:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4000/0xfc4b8e114eda6b02 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.673874:0:9215:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4000/0xfc4b8e114eda6b02 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.673878:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.673894:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:385c4b71-808c-40cf-91de-b076b668d13f+3730:1957:x1796503281160320:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 77us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.673899:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196433 00000100:00100000:0.0:1713279306.673910:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdf480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015168:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1713279306.673911:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281160448 00000100:00100000:2.0:1713279306.673914:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281160448 00000100:00100000:2.0:1713279306.673925:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222944 00000100:00100000:0.0:1713279306.673929:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.673929:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3770:11708:x1796503281160448:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1713279306.673937:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.673949:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200015168 00000100:00100000:0.0:1713279306.673951:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200015168 00000100:00100000:0.0:1713279306.673968:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98610 00000100:00100000:0.0:1713279306.673972:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+66:6943:x1796503200015168:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1713279306.674009:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3771:11708:x1796503281160448:12345-192.168.203.4@tcp:35:touch.0 Request processed in 78us (218us total) trans 4295183559 rc 0/0 00000100:00100000:2.0:1713279306.674015:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222944 00000100:00100000:2.0:1713279306.674045:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281160640 00000100:00100000:2.0:1713279306.674048:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281160640 00000100:00100000:2.0:1713279306.674061:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281160576 00000100:00100000:2.0:1713279306.674063:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281160576 00000100:00100000:2.0:1713279306.674094:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784828 00000100:00100000:2.0:1713279306.674098:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3772:11642:x1796503281160640:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.674105:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.674113:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008be60900/0xfc4b8e114eda6b56 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917515f expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.674155:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda6b5d lrc: 3/1,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.674162:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda6b5d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674168:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda6b5d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674177:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda6b64 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.674182:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda6b64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674188:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda6b64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000004:00200000:2.0:1713279306.674201:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7a64:0x0]: returning size 2 00010000:00010000:2.0:1713279306.674207:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda6b5d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674211:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda6b5d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674216:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda6b5d lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674221:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda6b5d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674225:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942db00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.674227:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda6b5d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674232:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda6b5d lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674239:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x0 (ffff880136671900) 00010000:00010000:2.0:1713279306.674244:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.674246:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda6b5d lrc: 3/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674250:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942db00/0xfc4b8e114eda6b5d lrc: 0/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674258:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda6b64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674263:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda6b64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674268:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda6b64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674272:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.674275:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda6b64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674280:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda6b64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674286:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x3931 (ffff880136671a00) 00010000:00010000:2.0:1713279306.674288:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.674291:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda6b64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674296:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda6b64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.674315:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be60900/0xfc4b8e114eda6b56 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917515f expref: 3773 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.674326:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008be60900/0xfc4b8e114eda6b56 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917515f expref: 3774 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.674334:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008be60900, rc 0) 00000100:00100000:2.0:1713279306.674343:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281161152 00000100:00100000:2.0:1713279306.674346:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281161152 00000100:00100000:2.0:1713279306.674361:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222945 00000100:00100000:2.0:1713279306.674365:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3556:11786:x1796503281161152:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.674437:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3557:11786:x1796503281161152:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 70us (203us total) trans 4295183560 rc 0/0 00000100:00100000:2.0:1713279306.674442:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222945 00000100:00100000:2.0:1713279306.674456:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784831 00000100:00100000:2.0:1713279306.674460:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3556:11374:x1796503281160832:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.674465:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.674472:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6b79 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175166 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.674493:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda6b80 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.674499:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda6b80 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.674504:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda6b80 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.674512:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6b87 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.674518:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6b87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.674524:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6b87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00200000:2.0:1713279306.674585:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76da:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.674610:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda6b80 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.674615:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda6b80 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.674620:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda6b80 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.674625:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda6b80 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.674630:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012068e400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.674632:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda6b80 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.674633:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281161280 00000100:00100000:0.0:1713279306.674637:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281161280 00010000:00010000:2.0:1713279306.674637:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda6b80 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.674646:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00010000:00010000:2.0:1713279306.674648:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.674650:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda6b80 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.674654:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110410 00010000:00010000:2.0:1713279306.674655:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda6b80 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.674659:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1956:x1796503281161280:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:2.0:1713279306.674666:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6b87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.674671:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6b87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.674675:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6b87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.674676:0:15538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda6b9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xfd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.674680:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f2b3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.674682:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6b87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.674687:0:15538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e688240/0xfc4b8e114ed9f663 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xfd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173122 expref: 76 pid: 11415 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713279306.674687:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6b87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.674693:0:15538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.674693:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x3531 (ffff880092ae7100) 00010000:00010000:0.0:1713279306.674695:0:15538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.674695:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.674697:0:15538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda6b9c lrc: 4/0,1 mode: --/PW res: [0x280000400:0xfd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.674697:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6b87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.674701:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6b87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.674712:0:15538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e688240/0xfc4b8e114ed9f663 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xfd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173122 expref: 76 pid: 11415 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713279306.674719:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6b79 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175166 expref: 3558 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.674722:0:15538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e688240/0xfc4b8e114ed9f663 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xfd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173122 expref: 76 pid: 11415 timeout: 509 lvb_type: 1 00010000:00010000:2.0:1713279306.674726:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6b79 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175166 expref: 3558 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.674732:0:15538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:15538:1796503200015232:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.674732:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b9ed00, rc 0) 00000100:00100000:2.0:1713279306.674742:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281161408 00000100:00100000:2.0:1713279306.674745:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281161408 00000100:00100000:0.0:1713279306.674755:0:15538:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.674768:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281161536 00000100:00100000:2.0:1713279306.674770:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281161536 00000100:00100000:2.0:1713279306.674781:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222946 00000100:00100000:2.0:1713279306.674786:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008acce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3775:11695:x1796503281161408:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1713279306.674841:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008acce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3776:11695:x1796503281161408:12345-192.168.203.4@tcp:35:touch.0 Request processed in 54us (199us total) trans 4295183563 rc 0/0 00000100:00100000:2.0:1713279306.674849:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222946 00000100:00100000:2.0:1713279306.674880:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3557:11374:x1796503281160832:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 420us (690us total) trans 4295183562 rc 301/301 00000100:00100000:2.0:1713279306.674885:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784831 00000100:00100000:2.0:1713279306.674902:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3775:11642:x1796503281160640:12345-192.168.203.4@tcp:101:touch.0 Request processed in 803us (1129us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.674907:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784828 00000100:00100000:0.0:1713279306.675678:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+66:6943:x1796503200015168:12345-0@lo:403:mdt_io00_002.0 Request processed in 1705us (1747us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.675684:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98610 00000100:00100000:2.0:1713279306.675697:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdf480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015168:0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1713279306.675818:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.675846:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281161856 00000100:00100000:0.0:1713279306.675849:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281161856 00000100:00100000:0.0:1713279306.675860:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784833 00000100:00100000:0.0:1713279306.675863:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:11796:x1796503281161856:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.675870:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.675871:0:15480:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1713279306.675880:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda5d41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x146:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174db5 expref: 3723 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.675886:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x146:0x0].0x0 (ffff880090371e00) 00010000:00010000:0.0:1713279306.675890:0:15480:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.675895:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda6bb8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x146:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917517b expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.675917:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114eda6bbf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x146:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.675922:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114eda6bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x146:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.675926:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114eda6bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x146:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.675932:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6bc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x146:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.675935:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x146:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.675938:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x146:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.675953:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114eda6bbf lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x146:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.675956:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114eda6bbf lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x146:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.675959:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114eda6bbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x146:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.675964:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114eda6bbf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x146:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.675969:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131f3c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.675972:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114eda6bbf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x146:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.675976:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114eda6bbf lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x146:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.675983:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x146:0x0].0x0 (ffff8800937cef00) 00010000:00010000:0.0:1713279306.675985:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.675987:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114eda6bbf lrc: 3/0,0 mode: --/CR res: [0x200000401:0x146:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.675992:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114eda6bbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x146:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.676000:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x146:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.676005:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x146:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.676011:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x146:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.676016:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131f3f3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.676018:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x146:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.676023:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x146:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.676029:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x146:0x0].0x33 (ffff8800937ce800) 00010000:00010000:0.0:1713279306.676031:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.676032:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6bc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x146:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.676037:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6bc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x146:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.676055:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda6bb8 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x146:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917517b expref: 3723 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.676063:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda6bb8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x146:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917517b expref: 3723 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.676086:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c24ef40, rc 0) 00000100:00100000:0.0:1713279306.676117:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:11796:x1796503281161856:12345-192.168.203.4@tcp:101:touch.0 Request processed in 251us (280us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.676123:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784833 00010000:00010000:2.0:1713279306.676187:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f29b00/0xfc4b8e114eda6bcd lrc: 3/0,1 mode: --/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.676192:0:6943:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f29b00/0xfc4b8e114eda6bcd lrc: 3/0,1 mode: --/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.676196:0:6943:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f29b00/0xfc4b8e114eda6bcd lrc: 3/0,1 mode: --/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6943 initiator: MDT1 00000100:00100000:2.0:1713279306.676203:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015296:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1713279306.676217:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.676224:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092545b40 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.676226:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200015296 00000100:00100000:0.0:1713279306.676229:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200015296 00000100:00100000:2.0:1713279306.676232:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281161728 00000100:00100000:2.0:1713279306.676234:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281161728 00000100:00100000:2.0:1713279306.676245:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110411 00000100:00100000:2.0:1713279306.676249:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+75:1955:x1796503281161728:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:0.0:1713279306.676253:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98611 00000100:00100000:0.0:1713279306.676257:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+66:6943:x1796503200015296:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1713279306.676264:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.676272:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda6bd4 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda6bcd expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.676285:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda6bd4 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda6bcd expref: 67 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.676293:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda6bd4 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda6bcd expref: 67 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.676300:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x23e:0x0].0x0 (ffff880091714100) 00010000:00010000:0.0:1713279306.676302:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.676304:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d982400, rc 0) 00000100:00100000:0.0:1713279306.676336:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+67:6943:x1796503200015296:12345-0@lo:101:mdt_io00_002.0 Request processed in 78us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.676342:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98611 00002000:00010000:2.0:1713279306.676345:0:15499:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x105a:0x0] updating lvb size from disk: 31037 -> 31037 00002000:00010000:2.0:1713279306.676348:0:15499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x105a:0x0] updating lvb mtime from disk: 1713279304 -> 1713279304 00002000:00010000:2.0:1713279306.676349:0:15499:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x105a:0x0] updating lvb atime from disk: 1713279303 -> 0 00002000:00010000:2.0:1713279306.676350:0:15499:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x105a:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.676351:0:15499:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x105a:0x0] updating lvb blocks from disk: 56 -> 88 00000100:00100000:2.0:1713279306.676367:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+76:1955:x1796503281161728:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 117us (549us total) trans 4295010150 rc 0/0 00000100:00100000:2.0:1713279306.676371:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110411 00000100:00100000:2.0:1713279306.676494:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200015360 00000100:00100000:2.0:1713279306.676496:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200015360 00000100:00100000:2.0:1713279306.676513:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98612 00000100:00100000:2.0:1713279306.676516:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+67:6943:x1796503200015360:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1713279306.676523:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.676533:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b600/0xfc4b8e114eda6be2 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x3032 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda6bdb expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.676545:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b600/0xfc4b8e114eda6be2 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x23e:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda6bdb expref: 68 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.676553:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b600/0xfc4b8e114eda6be2 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x23e:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda6bdb expref: 68 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.676559:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x23e:0x0].0x3032 (ffff880136671000) 00010000:00010000:2.0:1713279306.676560:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.676562:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f2b600, rc 0) 00000100:00100000:2.0:1713279306.676585:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+68:6943:x1796503200015360:12345-0@lo:101:mdt_io00_002.0 Request processed in 69us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.676589:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98612 00000100:00100000:1.0:1713279306.676605:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015360:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1713279306.676613:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f1d73c0/0xfc4b8e114eda6bdb lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x23e:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda6be2 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.676618:0:6943:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f1d73c0/0xfc4b8e114eda6bdb lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x23e:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda6be2 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713279306.676624:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x23e:0x0] 00010000:00010000:1.0:1713279306.676632:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6be9 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x245:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.676636:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6be9 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.676640:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6be9 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.676645:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda6bf0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x245:0x0].0x3032 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.676648:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda6bf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x245:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.676651:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda6bf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x245:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.676667:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7a1c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.676673:0:6943:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda6639 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x7a1c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917500f expref: 3556 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.676677:0:6943:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.676689:0:6943:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda6639 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7a1c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917500f expref: 3556 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.676694:0:6943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda6639 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7a1c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917500f expref: 3556 pid: 9221 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.676700:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001_UUID:6943:1796503200015424:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.676723:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880093a833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.676940:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.676952:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.676958:0:15538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:15538:1796503200015232:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.676966:0:15538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda6b9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xfd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.676977:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.676978:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.676996:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.677006:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281162048 00000100:00100000:0.0:1713279306.677010:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281162048 00000100:00100000:1.0:1713279306.677012:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.677025:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281162240 00000100:00100000:0.0:1713279306.677027:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281162240 00000100:00100000:1.0:1713279306.677031:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.677036:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281162624 00000100:00100000:0.0:1713279306.677038:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281162304 00000100:00100000:2.0:1713279306.677039:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281162624 00000100:00100000:0.0:1713279306.677040:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281162304 00000100:00100000:1.0:1713279306.677041:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.677048:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281162432 00000100:00100000:0.0:1713279306.677051:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281162688 00000100:00100000:1.0:1713279306.677051:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281162432 00000100:00100000:0.0:1713279306.677053:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281162688 00000100:00100000:2.0:1713279306.677060:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784834 00000100:00100000:2.0:1713279306.677064:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3559:11374:x1796503281162048:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.677066:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784835 00000100:00100000:1.0:1713279306.677081:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3730:11695:x1796503281162240:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.677083:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.677088:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.677091:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda6bfe lrc: 2/0,0 mode: --/CR res: [0x240000400:0x262:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175189 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.677094:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda6c05 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175190 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.677113:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd46c0/0xfc4b8e114eda6c0c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x262:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.677118:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6c13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.677120:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd46c0/0xfc4b8e114eda6c0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x262:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.677122:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6c13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.677126:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd46c0/0xfc4b8e114eda6c0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x262:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.677127:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6c13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.677132:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6c1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.677135:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.677138:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.677141:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784836 00000004:00200000:2.0:1713279306.677143:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x262:0x0]: returning size 4096 00000004:00200000:2.0:1713279306.677146:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1713279306.677147:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3775:11642:x1796503281162304:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.677157:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.677162:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda6bfe lrc: 0/0,0 mode: --/CR res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175189 expref: 3561 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.677166:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9833c0/0xfc4b8e114eda6c21 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175197 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.677171:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd46c0/0xfc4b8e114eda6c0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x262:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175189 expref: 3560 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.677173:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda6c28 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x86b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.677177:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda6c28 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x86b1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.677178:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x262:0x0].0x0 (ffff88012fbfed00) 00010000:00010000:2.0:1713279306.677179:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1713279306.677181:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda6c28 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x86b1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.677181:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd46c0, rc 0) 00000004:00200000:1.0:1713279306.677185:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x86b1:0x0]: returning size 0 00010000:00010000:0.0:1713279306.677189:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda6c2f lrc: 3/1,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.677196:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda6c2f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.677197:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3560:11374:x1796503281162048:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 133us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.677201:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784834 00010000:00010000:0.0:1713279306.677203:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda6c2f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.677207:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6c13 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.677210:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6c13 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.677210:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784837 00010000:00010000:0.0:1713279306.677212:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983cc0/0xfc4b8e114eda6c3d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.677212:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3559:11204:x1796503281162624:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.677213:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6c13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.677226:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6c13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.677229:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983cc0/0xfc4b8e114eda6c3d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.677229:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.677230:0:15483:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1713279306.677231:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ce53a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.677233:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6c13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.677234:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983cc0/0xfc4b8e114eda6c3d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.677236:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6c13 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.677238:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114eda58d3 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xff:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174cab expref: 3559 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.677240:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x0 (ffff88012514d800) 00010000:00010000:1.0:1713279306.677242:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.677243:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6c13 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.677243:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xff:0x0].0x0 (ffff880091de1a00) 00010000:00010000:2.0:1713279306.677245:0:15483:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.677246:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda6c13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.677249:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda6c44 lrc: 2/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175174 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.677252:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.677255:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6c1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.677258:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.677261:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800963e0240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.677262:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.677264:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981b00/0xfc4b8e114eda6c4b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7a64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.677265:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6c1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.677266:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6c52 lrc: 3/1,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.677268:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x3731 (ffff88012514d500) 00010000:00010000:1.0:1713279306.677269:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.677270:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981b00/0xfc4b8e114eda6c4b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7a64:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.677270:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6c1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.677270:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6c52 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.677273:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda6c1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.677274:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6c52 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.677276:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981b00/0xfc4b8e114eda6c4b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7a64:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.677279:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114eda6c59 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.677283:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114eda6c59 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00000004:00200000:0.0:1713279306.677284:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7a64:0x0]: returning size 2 00010000:00010000:2.0:1713279306.677286:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114eda6c59 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.677289:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda6c05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x139:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175190 expref: 3733 pid: 15482 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713279306.677292:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981b00/0xfc4b8e114eda6c4b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7a64:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.677296:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda6c28 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x86b1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175190 expref: 3732 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.677298:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6c52 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.677299:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86b1:0x0].0x0 (ffff880092a4c000) 00010000:00010000:1.0:1713279306.677301:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.677301:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6c52 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.677302:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093691440, rc 0) 00010000:00010000:2.0:1713279306.677304:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6c52 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.677307:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6c52 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.677310:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68a1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.677312:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6c52 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.677315:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6c52 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.677316:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3732:11695:x1796503281162240:12345-192.168.203.4@tcp:101:touch.0 Request processed in 235us (341us total) trans 4295202572 rc 0/0 00010000:00010000:2.0:1713279306.677318:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xff:0x0].0x0 (ffff880091de1a00) 00010000:00010000:2.0:1713279306.677319:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.677320:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6c52 lrc: 3/0,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.677323:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6c52 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.677324:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784835 00010000:00010000:2.0:1713279306.677327:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114eda6c59 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.677330:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114eda6c59 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.677333:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784839 00010000:00010000:2.0:1713279306.677333:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114eda6c59 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.677336:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3559:11789:x1796503281162688:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.677336:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68ba80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.677337:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114eda6c59 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.677340:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114eda6c59 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.677341:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.677343:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xff:0x0].0x3331 (ffff88008c2e7e00) 00010000:00010000:2.0:1713279306.677344:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.677345:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114eda6c59 lrc: 2/0,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.677346:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936921c0/0xfc4b8e114eda6c60 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x76df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391751a5 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.677347:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114eda6c59 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.677357:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda6c44 lrc: 1/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175174 expref: 3560 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.677359:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda6c2f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.677359:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936921c0/0xfc4b8e114eda6c60 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x76df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751a5 expref: 3560 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.677361:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda6c44 lrc: 0/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175174 expref: 3560 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.677364:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936921c0/0xfc4b8e114eda6c60 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x76df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751a5 expref: 3560 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.677365:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda6c2f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.677365:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e689d40, rc 0) 00010000:00010000:0.0:1713279306.677370:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda6c2f lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.677374:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76df:0x0].0x0 (ffff88008eb46200) 00010000:00010000:0.0:1713279306.677375:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda6c2f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.677375:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1713279306.677376:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936921c0, rc 0) 00000100:00100000:2.0:1713279306.677377:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3559:11204:x1796503281162624:12345-192.168.203.4@tcp:101:touch.0 Request processed in 163us (381us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.677379:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980000 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.677381:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784837 00010000:00010000:0.0:1713279306.677382:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda6c2f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.677386:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda6c2f lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.677387:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3558:11789:x1796503281162688:12345-192.168.203.4@tcp:101:touch.0 Request processed in 50us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.677390:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784839 00010000:00010000:0.0:1713279306.677394:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x0 (ffff880090a56d00) 00010000:00010000:0.0:1713279306.677396:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.677399:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda6c2f lrc: 3/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.677404:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda6c2f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.677404:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.677429:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983cc0/0xfc4b8e114eda6c3d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.677433:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.677435:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983cc0/0xfc4b8e114eda6c3d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.677440:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983cc0/0xfc4b8e114eda6c3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.677445:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983cc0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.677445:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281162752 00010000:00010000:0.0:1713279306.677448:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983cc0/0xfc4b8e114eda6c3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.677448:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281162752 00010000:00010000:0.0:1713279306.677453:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983cc0/0xfc4b8e114eda6c3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.677456:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281162560 00000100:00100000:1.0:1713279306.677457:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281162560 00000100:00100000:2.0:1713279306.677459:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.677460:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x3931 (ffff880090a56700) 00010000:00010000:0.0:1713279306.677462:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.677464:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983cc0/0xfc4b8e114eda6c3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.677470:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983cc0/0xfc4b8e114eda6c3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.677470:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281162816 00000100:00100000:1.0:1713279306.677471:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281162816 00000100:00100000:2.0:1713279306.677474:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784840 00000100:00100000:2.0:1713279306.677478:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3559:11783:x1796503281162752:12345-192.168.203.4@tcp:36:touch.0 00000100:00100000:1.0:1713279306.677486:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784841 00010000:00010000:0.0:1713279306.677489:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9833c0/0xfc4b8e114eda6c21 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175197 expref: 3778 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.677489:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3778:11797:x1796503281162560:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:2.0:1713279306.677489:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784842 00000100:00100000:2.0:1713279306.677491:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3559:11787:x1796503281162816:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.677494:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.677497:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.677499:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114eda6c67 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917519e expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.677500:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981b00/0xfc4b8e114eda6c4b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7a64:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175197 expref: 3777 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.677502:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda6c6e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39174f9f expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.677506:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7a64:0x0].0x0 (ffff880090a56600) 00010000:00010000:0.0:1713279306.677508:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713279306.677510:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d981b00, rc 0) 00010000:00010000:1.0:1713279306.677527:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9d40/0xfc4b8e114eda6c75 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x753e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.677529:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3777:11642:x1796503281162304:12345-192.168.203.4@tcp:101:touch.0 Request processed in 382us (515us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.677530:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688000/0xfc4b8e114eda6c7c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x7b15:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.677533:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9d40/0xfc4b8e114eda6c75 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x753e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.677535:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688000/0xfc4b8e114eda6c7c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x7b15:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00000100:00100000:0.0:1713279306.677536:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784836 00010000:00010000:1.0:1713279306.677537:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9d40/0xfc4b8e114eda6c75 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x753e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.677540:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688000/0xfc4b8e114eda6c7c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x7b15:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00000004:00200000:1.0:1713279306.677541:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x753e:0x0]: returning size 15382 00000004:00200000:2.0:1713279306.677544:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7b15:0x0]: returning size 23529 00010000:00010000:1.0:1713279306.677569:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114eda6c67 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917519e expref: 3779 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.677570:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda6c6e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f9f expref: 3562 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.677576:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9d40/0xfc4b8e114eda6c75 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x753e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917519e expref: 3778 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.677577:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688000/0xfc4b8e114eda6c7c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7b15:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f9f expref: 3561 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.677580:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x753e:0x0].0x0 (ffff880095b48100) 00010000:00010000:1.0:1713279306.677581:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1713279306.677581:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b15:0x0].0x0 (ffff880090884a00) 00010000:00010000:2.0:1713279306.677582:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1713279306.677583:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba9d40, rc 0) 00010000:00010000:2.0:1713279306.677584:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e688000, rc 0) 00000100:00100000:1.0:1713279306.677596:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3778:11797:x1796503281162560:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 106us (162us total) trans 4295183564 rc 0/0 00000100:00100000:2.0:1713279306.677598:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3561:11787:x1796503281162816:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 106us (140us total) trans 4295183565 rc 0/0 00000100:00100000:1.0:1713279306.677599:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784841 00000100:00100000:2.0:1713279306.677602:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784842 00010000:00010000:2.0:1713279306.677619:0:15658:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.677624:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114eda6a37 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x76d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917510b expref: 3560 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.677630:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76d4:0x0].0x0 (ffff88011eea5600) 00010000:00010000:2.0:1713279306.677632:0:15658:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.677644:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda6cb4 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x76d4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.677648:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda6cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.677652:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda6cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000004:00010000:2.0:1713279306.677676:0:15658:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007fd8d500 reply state ffff88009602a000 transno 4295183567 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda6cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.677680:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda6cb4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.677683:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76d4:0x0].0x0 (ffff88011eea5600) 00010000:00010000:2.0:1713279306.677685:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.677686:0:15658:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713279306.677707:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3561:11783:x1796503281162752:12345-192.168.203.4@tcp:36:touch.0 Request processed in 229us (302us total) trans 4295183567 rc 0/0 00000100:00100000:2.0:1713279306.677711:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784840 00000100:00100000:2.0:1713279306.677740:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.677749:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281162944 00000100:00100000:2.0:1713279306.677751:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281162944 00000100:00100000:2.0:1713279306.677759:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222948 00000100:00100000:2.0:1713279306.677762:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3778:11798:x1796503281162944:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:0.0:1713279306.677775:0:6943:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff88008accdf80 x1796503200015424) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda6639 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7a1c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917500f expref: 3560 pid: 9221 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.677786:0:6943:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda6639 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7a1c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917500f expref: 3560 pid: 9221 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.677789:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.677794:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda6639 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x7a1c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917500f expref: 3560 pid: 9221 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.677800:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001_UUID:6943:1796503200015424:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.677807:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7a1c:0x0].0x0 (ffff8800908e1d00) 00000001:00080000:2.0:1713279306.677807:0:15649:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4295183568 00010000:00010000:0.0:1713279306.677809:0:6943:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.677813:0:6943:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.677816:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.677822:0:6943:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.677825:0:6943:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.677828:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00000100:00100000:2.0:1713279306.677830:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3780:11798:x1796503281162944:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 66us (88us total) trans 4295183569 rc 0/0 00000100:00100000:2.0:1713279306.677833:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222948 00000020:00080000:2.0:1713279306.677835:0:15649:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1713279306.677866:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdf480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015552:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.677883:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.677891:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.677895:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200015552 00000100:00100000:1.0:1713279306.677897:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200015552 00000100:00100000:1.0:1713279306.677908:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98614 00000100:00100000:1.0:1713279306.677911:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+68:6943:x1796503200015552:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.677964:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+68:6943:x1796503200015552:12345-0@lo:1000:mdt_io00_002.0 Request processed in 52us (80us total) trans 0 rc -2/-2 00000100:00100000:1.0:1713279306.677968:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98614 00000100:00100000:2.0:1713279306.677985:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdf480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015552:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.677994:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.678008:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a42300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015616:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.678024:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.678025:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.678031:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801360c7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.678034:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200015616 00000100:00100000:1.0:1713279306.678036:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200015616 00000100:00100000:2.0:1713279306.678039:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281163328 00000100:00100000:2.0:1713279306.678041:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281163328 00000100:00100000:1.0:1713279306.678043:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98615 00000100:00100000:1.0:1713279306.678046:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+68:6943:x1796503200015616:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.678051:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222949 00000100:00100000:0.0:1713279306.678052:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784845 00000100:00100000:2.0:1713279306.678054:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3561:11820:x1796503281163328:12345-192.168.203.4@tcp:33:lfs.0 00000100:00100000:0.0:1713279306.678058:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3733:11790:x1796503281163392:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.678066:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.678083:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+68:6943:x1796503200015616:12345-0@lo:1000:mdt_io00_002.0 Request processed in 36us (59us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.678087:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981680/0xfc4b8e114eda6cc2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391751ba expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.678087:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98615 00000100:00100000:1.0:1713279306.678101:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a42300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015616:0@lo:1000:mdt_io00_002.0 00000004:00200000:2.0:1713279306.678104:0:15467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x76d2:0x0]: returning size 4096 00000004:00200000:2.0:1713279306.678106:0:15467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713279306.678111:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114eda6cc9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.678119:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114eda6cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00000100:00100000:2.0:1713279306.678124:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3561:11820:x1796503281163328:12345-192.168.203.4@tcp:33:lfs.0 Request processed in 69us (128us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.678126:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114eda6cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00000100:00100000:2.0:1713279306.678128:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222949 00010000:00010000:0.0:1713279306.678135:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114eda6cde lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.678141:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114eda6cde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00000100:00100000:1.0:1713279306.678142:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015680:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.678144:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784846 00000100:00100000:2.0:1713279306.678146:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3560:11796:x1796503281163264:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.678147:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114eda6cde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.678151:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.678152:0:15749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:1.0:1713279306.678156:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.678160:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114ed9e808 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x258:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172cec expref: 3560 pid: 15469 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.678163:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801360c7540 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.678164:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x258:0x0].0x0 (ffff88008e5b8400) 00010000:00010000:2.0:1713279306.678168:0:15749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.678170:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200015680 00000100:00100000:1.0:1713279306.678172:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200015680 00010000:00010000:2.0:1713279306.678172:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda6ce5 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x258:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391751b3 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.678174:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980b40/0xfc4b8e114eda6cec lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8378:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.678183:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980b40/0xfc4b8e114eda6cec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8378:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.678189:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980b40/0xfc4b8e114eda6cec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8378:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00000100:00100000:1.0:1713279306.678189:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98616 00000100:00100000:1.0:1713279306.678191:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008acce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+68:6943:x1796503200015680:12345-0@lo:1000:mdt_io00_002.0 00010000:00010000:2.0:1713279306.678204:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda6cf3 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x258:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.678209:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda6cf3 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.678213:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda6cf3 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00000100:00100000:1.0:1713279306.678214:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008acce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+68:6943:x1796503200015680:12345-0@lo:1000:mdt_io00_002.0 Request processed in 22us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.678218:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98616 00010000:00010000:2.0:1713279306.678218:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda6cfa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x258:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.678221:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda6cfa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x258:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.678224:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda6cfa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x258:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00000100:00100000:1.0:1713279306.678230:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015680:0@lo:1000:mdt_io00_002.0 00000004:00200000:0.0:1713279306.678238:0:15471:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8378:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.678241:0:15471:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00200000:2.0:1713279306.678250:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7ac4:0x0]: returning size 4096 00000004:00010000:0.0:1713279306.678251:0:15471:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980b40/0xfc4b8e114eda6cec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8378:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.678254:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda6cf3 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.678258:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114eda6cc9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.678258:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda6cf3 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.678263:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114eda6cc9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.678263:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda6cf3 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.678266:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda6cf3 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.678269:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114eda6cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.678269:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68ad00 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.678270:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015744:0@lo:1000:mdt_io00_002.0 00010000:00010000:2.0:1713279306.678270:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda6cf3 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.678273:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda6cf3 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.678274:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114eda6cc9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.678277:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x258:0x0].0x0 (ffff88008bf03500) 00010000:00010000:0.0:1713279306.678278:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.678278:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.678279:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda6cf3 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.678281:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114eda6cc9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.678282:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda6cf3 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00000100:00100000:1.0:1713279306.678283:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.678287:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114eda6cc9 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.678287:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda6cfa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x258:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00000100:00100000:1.0:1713279306.678288:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880094f8ee40 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.678289:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda6cfa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x258:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.678292:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda6cfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x258:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.678294:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00000100:00100000:1.0:1713279306.678294:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200015744 00010000:00010000:2.0:1713279306.678295:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68b180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.678296:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.678296:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200015744 00010000:00010000:2.0:1713279306.678296:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda6cfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x258:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.678299:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114eda6cc9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.678302:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda6cfa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x258:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.678303:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114eda6cc9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.678305:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x258:0x0].0x33 (ffff880097910a00) 00010000:00010000:2.0:1713279306.678306:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.678307:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda6cfa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x258:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.678310:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda6cfa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x258:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00000100:00100000:1.0:1713279306.678311:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98617 00010000:00010000:0.0:1713279306.678313:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114eda6cde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00000100:00100000:1.0:1713279306.678314:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+11:6943:x1796503200015744:12345-0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.678319:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114eda6cde lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.678320:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda6ce5 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x258:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751b3 expref: 3560 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.678324:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114eda6cde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.678324:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda6ce5 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x258:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751b3 expref: 3560 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.678327:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.678329:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114eda6cde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.678329:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68aac0, rc 0) 00010000:00010000:0.0:1713279306.678334:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114eda6cde lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.678340:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3431 (ffff880090a56e00) 00010000:00010000:0.0:1713279306.678342:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.678344:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114eda6cde lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00000100:00100000:1.0:1713279306.678344:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+11:6943:x1796503200015744:12345-0@lo:1000:mdt_io00_002.0 Request processed in 28us (59us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.678344:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3559:11796:x1796503281163264:12345-192.168.203.4@tcp:101:touch.0 Request processed in 196us (318us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.678347:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98617 00000100:00100000:2.0:1713279306.678348:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784846 00010000:00010000:0.0:1713279306.678349:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114eda6cde lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00000100:00100000:1.0:1713279306.678360:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015744:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.678366:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981680/0xfc4b8e114eda6cc2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751ba expref: 3734 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.678376:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980b40/0xfc4b8e114eda6cec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8378:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751ba expref: 3733 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.678380:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8378:0x0].0x0 (ffff88008e5b8b00) 00000100:00100000:1.0:1713279306.678380:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251da680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015808:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.678382:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713279306.678383:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d980b40, rc 0) 00000100:00100000:1.0:1713279306.678390:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.678399:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801360c7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.678402:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200015808 00000100:00100000:0.0:1713279306.678404:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3733:11790:x1796503281163392:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 346us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.678404:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200015808 00000100:00100000:0.0:1713279306.678427:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784845 00000100:00100000:1.0:1713279306.678427:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98618 00000100:00100000:1.0:1713279306.678430:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6943:x1796503200015808:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.678460:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6943:x1796503200015808:12345-0@lo:1000:mdt_io00_002.0 Request processed in 29us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.678463:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98618 00000100:00100000:2.0:1713279306.678471:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251da680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015808:0@lo:1000:mdt_io00_002.0 00000040:00080000:2.0:1713279306.678611:0:6943:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x1c0:0x0].1537, 1392 off812808 00000040:00080000:2.0:1713279306.678632:0:6943:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xf8:0x0].2145, 1472 off1512912 00000100:00100000:2.0:1713279306.678646:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a43800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015872:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.678660:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.678676:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c213180 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.678687:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200015872 00000100:00100000:1.0:1713279306.678690:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200015872 00000100:00100000:1.0:1713279306.678700:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98619 00000100:00100000:1.0:1713279306.678702:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6943:x1796503200015872:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.678746:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:6943:x1796503200015872:12345-0@lo:1000:mdt_io00_002.0 Request processed in 43us (85us total) trans 4295010151 rc 0/0 00000100:00100000:1.0:1713279306.678750:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98619 00000100:00100000:2.0:1713279306.678755:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a43800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200015872:0@lo:1000:mdt_io00_002.0 00000004:00080000:2.0:1713279306.678760:0:6943:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800924b49c0 with version 31968 00000004:00080000:0.0:1713279306.678783:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31968 rpc_version 31968 00000020:00100000:0.0:1713279306.678800:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.678806:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880131cdd500 x1796503200016000/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.678819:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdd500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200016000:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.678841:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.678851:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d8240 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.678853:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200016000 00000100:00100000:1.0:1713279306.678864:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200016000 00000100:00100000:1.0:1713279306.678876:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98620 00000100:00100000:1.0:1713279306.678878:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+68:8074:x1796503200016000:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.679080:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+69:8074:x1796503200016000:12345-0@lo:1000:osp_up0-1.0 Request processed in 187us (226us total) trans 4295202573 rc 0/0 00000100:00100000:1.0:1713279306.679085:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98620 00000100:00100000:0.0:1713279306.679104:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdd500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200016000:0@lo:1000:osp_up0-1.0 00000004:00010000:2.0:1713279306.679122:0:6943:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008e606a00 reply state ffff880096042000 transno 4295183570 ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00000100:00100000:0.0:1713279306.679124:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.679128:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.679131:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7a1c:0x0].0x0 (ffff8800908e1d00) 00010000:00010000:2.0:1713279306.679133:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1713279306.679134:0:6943:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713279306.679135:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281163520 00010000:00010000:2.0:1713279306.679136:0:6943:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6be9 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00000100:00100000:1.0:1713279306.679137:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281163520 00010000:00010000:2.0:1713279306.679139:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6be9 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.679142:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6be9 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.679145:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6be9 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00000100:00100000:1.0:1713279306.679147:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784847 00010000:00010000:2.0:1713279306.679148:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091cbc000 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.679149:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:11807:x1796503281163520:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.679149:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6be9 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.679152:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6be9 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00000100:00100000:0.0:1713279306.679154:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.679155:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.679156:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x245:0x0].0x0 (ffff88012d067c00) 00010000:00010000:2.0:1713279306.679157:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.679158:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6be9 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.679160:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda6d01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391751c1 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.679161:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6be9 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x245:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00000004:00010000:2.0:1713279306.679168:0:6943:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008e606a00 reply state ffff880096042000 transno 4295183570 ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda6bf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x245:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.679172:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda6bf0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.679175:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x245:0x0].0x3032 (ffff88012d067200) 00010000:00010000:2.0:1713279306.679176:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.679177:0:6943:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:2.0:1713279306.679178:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x23e:0x0] 00010000:00010000:2.0:1713279306.679181:0:6943:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f29b00/0xfc4b8e114eda6bcd lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda6bd4 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.679184:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f29b00/0xfc4b8e114eda6bcd lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda6bd4 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.679188:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f29b00/0xfc4b8e114eda6bcd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda6bd4 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.679195:0:6943:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1713279306.679197:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x23e:0x0] 00010000:00010000:2.0:1713279306.679199:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f1d73c0/0xfc4b8e114eda6bdb lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x23e:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda6be2 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.679203:0:6943:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f1d73c0/0xfc4b8e114eda6bdb lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x23e:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda6be2 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713279306.679217:0:15471:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x83b5:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.679243:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda6d01 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751c1 expref: 3725 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.679248:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda6d01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751c1 expref: 3725 pid: 15471 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.679252:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x8179:0x0] 00010000:00010000:1.0:1713279306.679253:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baa400, rc 0) 00010000:00010000:2.0:1713279306.679255:0:6943:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda6719 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda6720 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.679258:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda6719 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda6720 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.679262:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda6719 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda6720 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.679268:0:6943:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1713279306.679269:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11807:x1796503281163520:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 118us (144us total) trans 4295202574 rc 301/301 00000100:00100000:1.0:1713279306.679272:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784847 00010000:00010000:0.0:1713279306.679273:0:6918:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1713279306.679279:0:6918:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda6719 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda6720 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.679285:0:6918:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe17a80 already unused, calling callback (ffffffffa0f0e520) 00000100:00100000:2.0:1713279306.679287:0:6943:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3560:9683:x1796503281151168:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 21722us (21752us total) trans 4295183570 rc 0/0 00010000:00010000:0.0:1713279306.679288:0:6918:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda6719 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda6720 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.679291:0:6943:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14315 00000004:00010000:0.0:1713279306.679295:0:6918:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda6719 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda6720 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.679302:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713279306.679305:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f29b00/0xfc4b8e114eda6bcd lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114eda6bd4 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.679308:0:9214:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f29b00 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:0.0:1713279306.679310:0:6918:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda6719 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda6720 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.679311:0:9214:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f29b00/0xfc4b8e114eda6bcd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda6bd4 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.679315:0:6918:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000004:00010000:2.0:1713279306.679315:0:9214:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f29b00/0xfc4b8e114eda6bcd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda6bd4 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.679324:0:9214:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f29b00/0xfc4b8e114eda6bcd lrc: 2/0,0 mode: --/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6bd4 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.679326:0:6918:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda6719 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda6720 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.679330:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c36b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200016064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.679330:0:9214:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713279306.679336:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe17a80/0xfc4b8e114eda6719 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda6720 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.679339:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f29b00/0xfc4b8e114eda6bcd lrc: 1/0,0 mode: --/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6bd4 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.679343:0:9214:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f29b00/0xfc4b8e114eda6bcd lrc: 0/0,0 mode: --/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6bd4 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.679344:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279306.679344:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.679345:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.679347:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.679349:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.679350:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.679351:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279306.679353:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713279306.679356:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200016064 00000100:00100000:1.0:1713279306.679358:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200016064 00000100:00100000:0.0:1713279306.679360:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200016128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.679364:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17600/0xfc4b8e114eda6720 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda6719 expref: 69 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.679373:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196436 00000100:00100000:0.0:1713279306.679375:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.679376:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+69:3491:x1796503200016064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.679380:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.679380:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200016128 00000100:00100000:2.0:1713279306.679382:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200016128 00010000:00010000:1.0:1713279306.679383:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17600/0xfc4b8e114eda6720 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda6719 expref: 69 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.679390:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17600/0xfc4b8e114eda6720 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda6719 expref: 70 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.679394:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147194 00000100:00100000:2.0:1713279306.679396:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+70:3493:x1796503200016128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.679399:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:2.0:1713279306.679400:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.679401:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda6782 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.679405:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda6782 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.679406:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda6bd4 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda6bcd expref: 69 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.679408:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda6782 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.679423:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x23e:0x0].0x0 (ffff880091714100) 00010000:00010000:1.0:1713279306.679425:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.679426:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.679433:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.679443:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+68:3493:x1796503200016128:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (68us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.679446:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147194 00000100:00100000:1.0:1713279306.679447:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+68:3491:x1796503200016064:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.679451:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196436 00000100:00100000:1.0:1713279306.679465:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c36b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200016064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.679514:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200016128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.679514:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.679527:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda6782 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.679528:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.679531:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda6782 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.679547:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.679557:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784849 00000100:00100000:0.0:1713279306.679560:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c369f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200016192:0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713279306.679560:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:11204:x1796503281163840:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.679567:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.679568:0:15471:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:0.0:1713279306.679576:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.679576:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114eda57ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x124:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c49 expref: 3723 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.679582:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x0 (ffff88012061fc00) 00000100:00100000:0.0:1713279306.679583:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d8180 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.679584:0:15471:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.679588:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda6d24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391751d6 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.679590:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200016192 00000100:00100000:0.0:1713279306.679592:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200016192 00000100:00100000:0.0:1713279306.679603:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98621 00000100:00100000:0.0:1713279306.679606:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+126:15525:x1796503200016192:12345-0@lo:1000:mdt_io00_009.0 00010000:00010000:1.0:1713279306.679618:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.679624:0:15471:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2aac0/0xfc4b8e114eda1cd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x124:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173c58 expref: 3732 pid: 15488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.679627:0:15471:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00000100:00100000:0.0:1713279306.679634:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+126:15525:x1796503200016192:12345-0@lo:1000:mdt_io00_009.0 Request processed in 27us (58us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.679637:0:15471:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2aac0/0xfc4b8e114eda1cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x124:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173c58 expref: 3732 pid: 15488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.679638:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98621 00010000:00010000:1.0:1713279306.679642:0:15471:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2aac0/0xfc4b8e114eda1cd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x124:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173c58 expref: 3732 pid: 15488 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.679648:0:15471:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:15471:1796503200016256:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.679650:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c369f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200016192:0@lo:1000:mdt_io00_009.0 00000004:00080000:0.0:1713279306.679662:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000403:0x76b7:0x0] 00000100:00100000:1.0:1713279306.679663:0:15471:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75f300 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.679672:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c369f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200016320:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.679683:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.679696:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d8180 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.679698:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200016320 00000100:00100000:2.0:1713279306.679700:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200016320 00000100:00100000:2.0:1713279306.679711:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98622 00000100:00100000:2.0:1713279306.679714:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+126:15525:x1796503200016320:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:2.0:1713279306.679746:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+126:15525:x1796503200016320:12345-0@lo:1000:mdt_io00_009.0 Request processed in 32us (62us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.679749:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98622 00000100:00100000:0.0:1713279306.679760:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c369f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200016320:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.680191:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200016384:0@lo:403:mdt_io00_009.0 00000100:00100000:0.0:1713279306.680214:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.680233:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d8240 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.680256:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200016384 00000100:00100000:2.0:1713279306.680259:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200016384 00000100:00100000:2.0:1713279306.680269:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98623 00000100:00100000:2.0:1713279306.680272:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+126:15525:x1796503200016384:12345-0@lo:403:mdt_io00_009.0 00000100:00100000:0.0:1713279306.680755:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.680782:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.680879:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784853 00000100:00100000:0.0:1713279306.680883:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3781:11711:x1796503281164864:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.680890:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.680933:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda6d55 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391751eb expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.680957:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda6d63 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.680962:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda6d63 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.680966:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda6d63 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.680972:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda6d6a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.680975:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda6d6a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.680979:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda6d6a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.680991:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda6d63 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.680994:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda6d63 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.680997:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda6d63 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.681000:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda6d63 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.681003:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.681004:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda6d63 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.681007:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda6d63 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.681011:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880090a56200) 00010000:00010000:0.0:1713279306.681013:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.681014:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda6d63 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.681017:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda6d63 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.681022:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda6d6a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.681024:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda6d6a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.681028:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda6d6a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.681030:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.681032:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda6d6a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.681034:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda6d6a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.681037:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880090a56c00) 00010000:00010000:0.0:1713279306.681038:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.681040:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda6d6a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.681042:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda6d6a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.681053:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda6d55 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751eb expref: 3782 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.681057:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda6d55 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751eb expref: 3782 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.681062:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d980d80, rc 0) 00000100:00100000:0.0:1713279306.681093:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3781:11711:x1796503281164864:12345-192.168.203.4@tcp:101:touch.0 Request processed in 209us (309us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.681097:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784853 00000100:00100000:0.0:1713279306.681144:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.681167:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.681194:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.681207:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.681207:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281164224 00000100:00100000:1.0:1713279306.681212:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281164224 00000100:00100000:0.0:1713279306.681214:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.681222:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.681226:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281164608 00000100:00100000:1.0:1713279306.681228:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281164608 00000100:00100000:0.0:1713279306.681231:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.681234:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281164736 00000100:00100000:1.0:1713279306.681236:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281164736 00000100:00100000:1.0:1713279306.681245:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784854 00000100:00100000:1.0:1713279306.681249:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3735:11695:x1796503281164224:12345-192.168.203.4@tcp:36:touch.0 00000100:00100000:2.0:1713279306.681252:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+126:15525:x1796503200016384:12345-0@lo:403:mdt_io00_009.0 Request processed in 979us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.681257:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98623 00000100:00100000:0.0:1713279306.681258:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200016384:0@lo:403:mdt_io00_009.0 00010000:00010000:1.0:1713279306.681265:0:15749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.681273:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda6c28 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x86b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175190 expref: 3736 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.681274:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281164352 00000100:00100000:2.0:1713279306.681276:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281164352 00010000:00010000:1.0:1713279306.681282:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86b1:0x0].0x0 (ffff880092a4c000) 00010000:00010000:1.0:1713279306.681284:0:15749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.681286:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110413 00000100:00100000:2.0:1713279306.681288:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1954:x1796503281164288:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:1.0:1713279306.681313:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda6d7f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x86b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.681318:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda6d7f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x86b1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.681322:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda6d7f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x86b1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.681336:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+78:1954:x1796503281164288:12345-192.168.203.4@tcp:2:touch.0 Request processed in 46us (140us total) trans 4295010095 rc 0/0 00000100:00100000:2.0:1713279306.681339:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110413 00000100:00100000:2.0:1713279306.681346:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110415 00000100:00100000:2.0:1713279306.681348:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1955:x1796503281164544:12345-192.168.203.4@tcp:2:touch.0 00000004:00010000:1.0:1713279306.681351:0:15749:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012c369f80 reply state ffff880094f53000 transno 4295202576 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda6d7f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x86b1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.681355:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda6d7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x86b1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.681359:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86b1:0x0].0x0 (ffff880092a4c000) 00010000:00010000:1.0:1713279306.681360:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.681361:0:15749:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713279306.681387:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3737:11695:x1796503281164224:12345-192.168.203.4@tcp:36:touch.0 Request processed in 137us (218us total) trans 4295202576 rc 0/0 00000100:00100000:1.0:1713279306.681391:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784854 00000100:00100000:2.0:1713279306.681392:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1955:x1796503281164544:12345-192.168.203.4@tcp:2:touch.0 Request processed in 42us (176us total) trans 4295010152 rc 0/0 00000100:00100000:2.0:1713279306.681396:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110415 00000100:00100000:1.0:1713279306.681400:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784856 00000100:00100000:1.0:1713279306.681403:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3781:11790:x1796503281164736:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:2.0:1713279306.681407:0:6943:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281164096 00000100:00100000:2.0:1713279306.681409:0:6943:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281164096 00000100:00100000:2.0:1713279306.681434:0:6943:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14320 00000100:00100000:2.0:1713279306.681437:0:6943:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3726:9807:x1796503281164096:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:2.0:1713279306.681448:0:6943:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.681452:0:15749:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-mdtlov_UUID:15749:1796503200016448:0@lo:1000:mdt00_031.0 00010000:00010000:2.0:1713279306.681456:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114ed9f3a7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x826a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917306c expref: 3726 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.681462:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x826a:0x0].0x0 (ffff880091553000) 00010000:00010000:2.0:1713279306.681464:0:6943:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.681468:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00000100:00100000:1.0:1713279306.681471:0:15749:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.681473:0:6943:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.681476:0:6943:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00000100:00100000:1.0:1713279306.681478:0:15749:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c199480 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.681481:0:6943:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.681485:0:6943:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00000100:00100000:2.0:1713279306.681495:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200016448 00000100:00100000:1.0:1713279306.681497:0:15471:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:15471:1796503200016256:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.681497:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200016448 00010000:00010000:1.0:1713279306.681505:0:15471:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00000100:00100000:2.0:1713279306.681506:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98624 00000100:00100000:2.0:1713279306.681508:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac44bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+67:15749:x1796503200016448:12345-0@lo:1000:mdt00_031.0 00000100:00100000:2.0:1713279306.681544:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac44bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+67:15749:x1796503200016448:12345-0@lo:1000:mdt00_031.0 Request processed in 35us (73us total) trans 0 rc 1/1 00000100:00100000:2.0:1713279306.681548:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98624 00000100:00100000:1.0:1713279306.681551:0:15749:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-mdtlov_UUID:15749:1796503200016448:0@lo:1000:mdt00_031.0 00000100:00100000:1.0:1713279306.681575:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3781:11790:x1796503281164736:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 171us (343us total) trans 0 rc -17/-17 00000100:00100000:1.0:1713279306.681579:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784856 00000100:00100000:0.0:1713279306.681706:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e525f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200016512:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.681772:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.681783:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d8180 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.681784:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200016512 00000100:00100000:2.0:1713279306.681787:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200016512 00000100:00100000:2.0:1713279306.681804:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98625 00000100:00100000:2.0:1713279306.681807:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+126:15525:x1796503200016512:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.681819:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.681837:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+126:15525:x1796503200016512:12345-0@lo:1000:mdt_io00_009.0 Request processed in 30us (67us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.681841:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98625 00000100:00100000:1.0:1713279306.681846:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281164928 00000100:00100000:0.0:1713279306.681847:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e525f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200016512:0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713279306.681848:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281164928 00010000:00010000:1.0:1713279306.681857:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2aac0/0xfc4b8e114eda1cd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x124:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173c58 expref: 3736 pid: 15488 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.681868:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196437 00000100:00100000:1.0:1713279306.681870:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a147a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3736:1957:x1796503281164928:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.681875:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.681876:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.681877:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2aac0/0xfc4b8e114eda1cd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x124:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173c58 expref: 3736 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.681880:0:15525:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.681882:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2aac0/0xfc4b8e114eda1cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x124:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173c58 expref: 3736 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.681885:0:15525:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.681889:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2aac0/0xfc4b8e114eda1cd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x124:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173c58 expref: 3736 pid: 15488 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.681892:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e525f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200016576:0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713279306.681896:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x0 (ffff88012061fc00) 00010000:00010000:1.0:1713279306.681898:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.681902:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15471 initiator: MDT0 00000100:00100000:0.0:1713279306.681904:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.681905:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15471 initiator: MDT0 00000100:00100000:0.0:1713279306.681911:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d8240 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.681912:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.681913:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200016576 00000100:00100000:2.0:1713279306.681914:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200016576 00000100:00100000:1.0:1713279306.681925:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a147a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3735:1957:x1796503281164928:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 54us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.681926:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98626 00000100:00100000:0.0:1713279306.681928:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.681928:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+126:15525:x1796503200016576:12345-0@lo:101:mdt_io00_009.0 00000100:00100000:1.0:1713279306.681929:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196437 00010000:00010000:2.0:1713279306.681932:0:6934:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.681939:0:6934:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda6da9 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda6da2 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.681946:0:6934:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114eda5403 lrc: 2/0,1 mode: TXN/TXN res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.681948:0:15471:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.681951:0:6934:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda5e44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174df4 expref: 3780 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.681952:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.681955:0:6934:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda6da9 lrc: 5/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda6da2 expref: 127 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.681958:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda6db0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x124:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.681962:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda6db0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x124:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.681965:0:6934:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda5e44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174df4 expref: 3780 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.681966:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda6db0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x124:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.681971:0:6934:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda5e44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174df4 expref: 3780 pid: 15482 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.681980:0:6934:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a40700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6934:1796503200016640:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.681995:0:6934:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114eda5403 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT1 00080000:00080000:2.0:1713279306.682009:0:6934:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1713279306.682014:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.682028:0:6934:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c213180 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.682033:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281165056 00000100:00100000:1.0:1713279306.682035:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281165056 00000100:00100000:1.0:1713279306.682045:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281165120 00000100:00100000:1.0:1713279306.682046:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281165120 00000100:00100000:2.0:1713279306.682052:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784857 00000100:00100000:1.0:1713279306.682056:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784858 00000100:00100000:2.0:1713279306.682056:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:9683:x1796503281165056:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:1.0:1713279306.682059:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3781:11708:x1796503281165120:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.682066:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.682084:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8000/0xfc4b8e114eda6db7 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x75a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391751f2 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.682092:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda6dbe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.682097:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda6dbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.682099:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8000/0xfc4b8e114eda6db7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x75a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751f2 expref: 3782 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.682102:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda6dbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.682104:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8000/0xfc4b8e114eda6db7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x75a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751f2 expref: 3782 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.682108:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.682111:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75a8:0x0].0x0 (ffff8800908e1000) 00010000:00010000:1.0:1713279306.682112:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1713279306.682112:0:15485:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ed00/0xfc4b8e114ed95e93 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x8179:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39170753 expref: 3724 pid: 15468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.682114:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba8000, rc 0) 00010000:00010000:2.0:1713279306.682116:0:15485:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114ed9f41e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x8179:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173073 expref: 3724 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.682120:0:15485:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114eda079d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x8179:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917362a expref: 3734 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.682126:0:15485:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 6/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.682129:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3782:11708:x1796503281165120:12345-192.168.203.4@tcp:101:touch.0 Request processed in 69us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.682132:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784858 00010000:00010000:2.0:1713279306.682135:0:15485:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114eda079d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8179:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917362a expref: 3734 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.682140:0:15485:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114eda079d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8179:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917362a expref: 3734 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.682145:0:15485:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000_UUID:15485:1796503200016704:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.682163:0:15485:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114ed9f41e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8179:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173073 expref: 3724 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.682168:0:15485:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114ed9f41e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8179:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173073 expref: 3724 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.682172:0:15485:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a42300 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000_UUID:15485:1796503200016768:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.682181:0:15485:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ed00/0xfc4b8e114ed95e93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x8179:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39170753 expref: 3724 pid: 15468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.682185:0:15485:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ed00/0xfc4b8e114ed95e93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x8179:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39170753 expref: 3724 pid: 15468 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.682190:0:15485:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000_UUID:15485:1796503200016832:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.682196:0:15485:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801360c7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.682212:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.682229:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281165504 00000100:00100000:2.0:1713279306.682231:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.682232:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281165504 00000100:00100000:1.0:1713279306.682241:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281165184 00000100:00100000:1.0:1713279306.682242:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281165184 00000100:00100000:1.0:1713279306.682249:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784859 00000100:00100000:1.0:1713279306.682252:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3735:11711:x1796503281165504:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.682257:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.682262:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8240/0xfc4b8e114eda6dcc lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175207 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.682263:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.682266:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784860 00000100:00100000:0.0:1713279306.682269:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3561:11374:x1796503281165184:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.682281:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.682285:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.682287:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114eda6dd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391751f9 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.682292:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281165376 00000100:00100000:1.0:1713279306.682293:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281165248 00000100:00100000:1.0:1713279306.682294:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281165248 00000100:00100000:2.0:1713279306.682295:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281165376 00010000:00010000:0.0:1713279306.682297:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114eda6dd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751f9 expref: 3562 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.682303:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114eda6dd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751f9 expref: 3562 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.682304:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784861 00000100:00100000:2.0:1713279306.682304:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222950 00010000:00010000:0.0:1713279306.682306:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00000100:00100000:1.0:1713279306.682307:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3737:11809:x1796503281165248:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:2.0:1713279306.682307:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11801:x1796503281165376:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:0.0:1713279306.682308:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.682309:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d981f80, rc 0) 00010000:00010000:1.0:1713279306.682311:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.682316:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114eda6dda lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175200 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.682322:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3562:11374:x1796503281165184:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 53us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.682326:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784860 00010000:00010000:1.0:1713279306.682331:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda6de1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682335:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda6de1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682339:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda6de1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682346:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda6de8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682350:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda6de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682353:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda6de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682379:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab3c0/0xfc4b8e114eda6def lrc: 3/1,0 mode: --/PR res: [0x200000402:0x820c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1713279306.682380:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3726:11801:x1796503281165376:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 72us (94us total) trans 4295202577 rc 0/0 00010000:00010000:1.0:1713279306.682383:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab3c0/0xfc4b8e114eda6def lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x820c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1713279306.682384:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222950 00010000:00010000:1.0:1713279306.682387:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab3c0/0xfc4b8e114eda6def lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x820c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1713279306.682442:0:15474:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x820c:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.682444:0:15474:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1713279306.682451:0:15474:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab3c0/0xfc4b8e114eda6def lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x820c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682456:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda6de1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682459:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda6de1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682462:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda6de1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682465:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda6de1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682467:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.682469:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda6de1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682472:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda6de1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682476:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.682478:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.682480:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda6de1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682482:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda6de1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682487:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda6de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682489:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda6de8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682493:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda6de8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682496:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091bab600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.682497:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda6de8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682499:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda6de8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682503:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x32 (ffff880097910000) 00010000:00010000:1.0:1713279306.682504:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.682505:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda6de8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682507:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda6de8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.682519:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114eda6dda lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175200 expref: 3739 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.682524:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab3c0/0xfc4b8e114eda6def lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x820c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175200 expref: 3738 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.682527:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x820c:0x0].0x0 (ffff88007fdcab00) 00010000:00010000:1.0:1713279306.682528:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713279306.682529:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bab3c0, rc 0) 00000100:00100000:1.0:1713279306.682546:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3738:11809:x1796503281165248:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 238us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.682550:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784861 00000004:00080000:1.0:1713279306.682599:0:15471:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x118c:0x0], index 0: 0 00000004:00080000:1.0:1713279306.682602:0:15471:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x11a0:0x0], index 1: 0 00010000:00010000:1.0:1713279306.682652:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114eda6df6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x871b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.682657:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114eda6df6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x871b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.682662:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114eda6df6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x871b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.682673:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.682676:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.682679:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.682681:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda6e04 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.682682:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.682685:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.682686:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.682687:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda6e04 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.682689:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.682691:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda6e04 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.682693:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x0 (ffff88012061fc00) 00010000:00010000:1.0:1713279306.682694:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.682695:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00000100:00100000:2.0:1713279306.682696:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.682697:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda6e0b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.682700:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda6e0b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.682701:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda6d32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.682706:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda6e0b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000004:00010000:1.0:1713279306.682706:0:15471:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880123a40a80 reply state ffff88012b1c8000 transno 4295202578 ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda6db0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x124:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.682710:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda6db0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.682713:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x3331 (ffff88012514d400) 00010000:00010000:1.0:1713279306.682714:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.682715:0:15471:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1713279306.682719:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00000100:00100000:2.0:1713279306.682720:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.682723:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda6e04 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.682725:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda6d24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751d6 expref: 3727 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.682726:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda6e04 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.682730:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda6e04 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.682732:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114eda6df6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x871b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751d6 expref: 3726 pid: 15471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.682733:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.682735:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x871b:0x0].0x0 (ffff88011f3ebc00) 00010000:00010000:1.0:1713279306.682737:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.682738:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba8d80, rc 0) 00000100:00100000:1.0:1713279306.682755:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:11204:x1796503281163840:12345-192.168.203.4@tcp:101:touch.0 Request processed in 3194us (3227us total) trans 4295202578 rc 0/0 00000100:00100000:1.0:1713279306.682758:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784849 00000100:00100000:1.0:1713279306.682775:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281165760 00000100:00100000:1.0:1713279306.682777:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281165760 00000100:00100000:1.0:1713279306.682784:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281165824 00000100:00100000:1.0:1713279306.682785:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281165824 00000100:00100000:2.0:1713279306.682785:0:6934:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a40700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6934:1796503200016640:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.682791:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784862 00000100:00100000:1.0:1713279306.682794:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3738:11642:x1796503281165760:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1713279306.682798:0:6934:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda6da9 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda6da2 expref: 127 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.682804:0:6934:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x0 (ffff88012d067e00) 00010000:00010000:1.0:1713279306.682805:0:15471:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.682806:0:6934:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.682809:0:6934:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda6da9 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda6da2 expref: 127 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.682810:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936edf80/0xfc4b8e114eda6d71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x847f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751dd expref: 3738 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.682815:0:6934:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e689680, rc 0) 00010000:00010000:1.0:1713279306.682816:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x847f:0x0].0x0 (ffff880129b60300) 00010000:00010000:1.0:1713279306.682819:0:15471:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.682820:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda6e04 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.682824:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d9818c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.682825:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda6e04 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.682829:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda6e04 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.682833:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012514d300) 00010000:00010000:0.0:1713279306.682834:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.682835:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda6e12 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x847f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.682836:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda6e04 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.682839:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda6e04 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.682839:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda6e12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00000100:00100000:2.0:1713279306.682839:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:15525:x1796503200016576:12345-0@lo:101:mdt_io00_009.0 Request processed in 909us (933us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.682842:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda6e12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.682844:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda6e0b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.682844:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98626 00010000:00010000:0.0:1713279306.682850:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda6e0b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.682853:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda6e0b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.682855:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.682856:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda6e0b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.682859:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda6e0b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.682862:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880090a56100) 00010000:00010000:0.0:1713279306.682863:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00010000:1.0:1713279306.682863:0:15471:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880131cdd880 reply state ffff880095199000 transno 4295202579 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda6e12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.682864:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda6e0b lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.682867:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda6e0b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.682868:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda6e12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.682871:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x847f:0x0].0x0 (ffff88008d729200) 00010000:00010000:1.0:1713279306.682872:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.682873:0:15471:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.682882:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8240/0xfc4b8e114eda6dcc lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175207 expref: 3739 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.682886:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8240/0xfc4b8e114eda6dcc lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175207 expref: 3739 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.682891:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba8240, rc 0) 00000100:00100000:1.0:1713279306.682895:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3738:11642:x1796503281165760:12345-192.168.203.4@tcp:36:touch.0 Request processed in 100us (175us total) trans 4295202579 rc 0/0 00000100:00100000:1.0:1713279306.682899:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784862 00000100:00100000:0.0:1713279306.682905:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3737:11711:x1796503281165504:12345-192.168.203.4@tcp:101:touch.0 Request processed in 652us (694us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.683088:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784859 00000100:00100000:1.0:1713279306.683103:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.683110:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281165888 00000100:00100000:1.0:1713279306.683112:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281165888 00000100:00100000:0.0:1713279306.683118:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e525f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200016576:0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713279306.683128:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda5e44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174df4 expref: 3782 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.683135:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 4/0,1 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.683138:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196438 00000100:00100000:1.0:1713279306.683140:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3782:1954:x1796503281165888:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.683142:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 4/0,1 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.683145:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.683147:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda5e44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174df4 expref: 3782 pid: 15482 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.683148:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3566:11789:x1796503281165632:12345-192.168.203.4@tcp:35:touch.0 Request processed in 374us (451us total) trans 4295183572 rc 0/0 00010000:00010000:1.0:1713279306.683152:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda5e44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174df4 expref: 3782 pid: 15482 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.683158:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222951 00010000:00010000:1.0:1713279306.683160:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda5e44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x261:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174df4 expref: 3782 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.683165:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x0 (ffff88012d067e00) 00010000:00010000:1.0:1713279306.683168:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda6da9 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda6da2 expref: 126 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.683172:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.683181:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3781:1954:x1796503281165888:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 40us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.683185:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196438 00000100:00100000:1.0:1713279306.683234:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.683237:0:15485:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000_UUID:15485:1796503200016704:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.683243:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.683244:0:15485:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a42300 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000_UUID:15485:1796503200016768:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.683254:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281165952 00000100:00100000:1.0:1713279306.683257:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.683257:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281166080 00000100:00100000:0.0:1713279306.683258:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281165952 00000100:00100000:2.0:1713279306.683260:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281166080 00000100:00100000:1.0:1713279306.683263:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281166272 00000100:00100000:1.0:1713279306.683265:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281166272 00010000:00010000:0.0:1713279306.683270:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114eda079d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8179:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917362a expref: 3737 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.683271:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114ed9f41e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8179:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173073 expref: 3727 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.683275:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110416 00000100:00100000:1.0:1713279306.683277:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+76:1956:x1796503281166272:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:0.0:1713279306.683286:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196439 00000100:00100000:0.0:1713279306.683291:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3737:1956:x1796503281165952:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.683291:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196440 00000100:00100000:2.0:1713279306.683295:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:1955:x1796503281166080:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.683297:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.683301:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114eda079d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8179:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917362a expref: 3737 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.683302:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.683306:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114ed9f41e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8179:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173073 expref: 3727 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.683310:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114eda079d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8179:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917362a expref: 3737 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.683331:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114ed9f41e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8179:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173073 expref: 3727 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.683342:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114eda079d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8179:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917362a expref: 3737 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.683342:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+77:1956:x1796503281166272:12345-192.168.203.4@tcp:2:touch.0 Request processed in 63us (84us total) trans 4295010153 rc 0/0 00000100:00100000:1.0:1713279306.683346:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110416 00010000:00010000:2.0:1713279306.683346:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114ed9f41e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8179:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173073 expref: 3727 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.683351:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8179:0x0].0x0 (ffff88007f389300) 00010000:00010000:0.0:1713279306.683354:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.683361:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.683363:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.683366:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.683371:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.683376:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.683389:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.683395:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.683400:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.683404:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.683405:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8179:0x0].0x0 (ffff88007f389300) 00010000:00010000:2.0:1713279306.683409:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.683428:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.683437:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.683438:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3737:1956:x1796503281165952:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 145us (202us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.683442:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.683444:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196439 00010000:00010000:2.0:1713279306.683446:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.683452:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.683456:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.683460:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.683476:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3726:1955:x1796503281166080:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 180us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.683482:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196440 00000100:00100000:2.0:1713279306.683500:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281166144 00000100:00100000:2.0:1713279306.683502:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281166144 00000100:00100000:2.0:1713279306.683516:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222952 00000100:00100000:2.0:1713279306.683519:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3564:11783:x1796503281166144:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1713279306.683582:0:15485:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000_UUID:15485:1796503200016832:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.683595:0:15485:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.683857:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f1d73c0/0xfc4b8e114eda6bdb lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x23e:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda6be2 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713279306.683866:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f1d73c0/0xfc4b8e114eda6bdb lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x23e:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda6be2 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.683881:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f1d73c0/0xfc4b8e114eda6bdb lrc: 2/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6be2 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.683886:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713279306.683903:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f1d73c0/0xfc4b8e114eda6bdb lrc: 0/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6be2 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.683911:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713279306.683920:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200016896:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279306.683922:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda65d0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda65d7 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713279306.683928:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda65d0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda65d7 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.683939:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.683941:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda65d0 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda65d7 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.683946:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713279306.683956:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200016896 00000100:00100000:2.0:1713279306.683959:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200016896 00010000:00010000:0.0:1713279306.683966:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda65d0 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda65d7 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.683973:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200016960:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1713279306.683975:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147195 00010000:00010000:0.0:1713279306.683977:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008dae3180/0xfc4b8e114eda62ff lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x23e:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda6306 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.683979:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+67:3492:x1796503200016896:12345-0@lo:103:jbd2/dm-1-8.0 00000004:00010000:0.0:1713279306.683984:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008dae3180/0xfc4b8e114eda62ff lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x23e:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda6306 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.683985:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.683993:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b600/0xfc4b8e114eda6be2 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x3032 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda6bdb expref: 67 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.683994:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.684003:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x23e:0x0].0x3032 (ffff880136671000) 00010000:00010000:2.0:1713279306.684008:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.684013:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008dae3180/0xfc4b8e114eda62ff lrc: 2/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6306 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684014:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200016960 00000100:00100000:1.0:1713279306.684017:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200016960 00010000:00010000:0.0:1713279306.684019:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713279306.684029:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008dae3180/0xfc4b8e114eda62ff lrc: 0/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6306 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684031:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147196 00000100:00100000:1.0:1713279306.684034:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+67:3490:x1796503200016960:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1713279306.684039:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.684040:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda5c68 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x23e:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda5c84 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.684043:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+67:3492:x1796503200016896:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 62us (103us total) trans 0 rc 0/0 00000004:00010000:0.0:1713279306.684046:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda5c68 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x23e:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda5c84 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.684048:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda65d7 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x65656ce3 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda65d0 expref: 67 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.684049:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147195 00010000:00010000:1.0:1713279306.684056:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x65656ce3 (ffff880136671800) 00010000:00010000:0.0:1713279306.684057:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda5c68 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda5c84 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.684060:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.684063:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713279306.684067:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200016896:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1713279306.684089:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+65:3490:x1796503200016960:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 54us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.684089:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200017088:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1713279306.684093:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147196 00010000:00010000:0.0:1713279306.684105:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda5c68 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda5c84 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684114:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200017024:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1713279306.684114:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.684116:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c366880/0xfc4b8e114eda54f8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x23e:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda550d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713279306.684123:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c366880/0xfc4b8e114eda54f8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x23e:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda550d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684127:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.684134:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017088 00010000:00010000:0.0:1713279306.684135:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c366880/0xfc4b8e114eda54f8 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda550d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.684136:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017088 00010000:00010000:0.0:1713279306.684140:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1713279306.684140:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017024 00000100:00100000:1.0:1713279306.684142:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017024 00000100:00100000:2.0:1713279306.684150:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147197 00010000:00010000:0.0:1713279306.684151:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c366880/0xfc4b8e114eda54f8 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda550d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684154:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147198 00000100:00100000:2.0:1713279306.684155:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+66:3492:x1796503200017088:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1713279306.684157:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+66:3491:x1796503200017024:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279306.684161:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda470d lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda4714 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.684161:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.684161:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:0.0:1713279306.684167:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda470d lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda4714 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.684167:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013585d200/0xfc4b8e114eda6306 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda62ff expref: 66 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.684169:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa880/0xfc4b8e114eda5c84 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda5c68 expref: 66 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.684174:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x23e:0x0].0x3931 (ffff88007fcb8400) 00010000:00010000:0.0:1713279306.684177:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda470d lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda4714 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.684177:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.684179:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x23e:0x0].0x39 (ffff880092193400) 00010000:00010000:0.0:1713279306.684182:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713279306.684183:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.684187:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda470d lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda4714 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684188:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+64:3491:x1796503200017024:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 30us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.684191:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147198 00010000:00010000:0.0:1713279306.684198:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c53ad00/0xfc4b8e114eda415d lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x23e:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda4164 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.684198:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+63:3492:x1796503200017088:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 43us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.684203:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147197 00000004:00010000:0.0:1713279306.684204:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c53ad00/0xfc4b8e114eda415d lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x23e:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda4164 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684208:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200017024:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279306.684214:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c53ad00/0xfc4b8e114eda415d lrc: 2/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda4164 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684214:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713279306.684217:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200017216:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279306.684219:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713279306.684223:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c53ad00/0xfc4b8e114eda415d lrc: 0/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda4164 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684227:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.684233:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf5b00/0xfc4b8e114eda3826 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda382d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.684233:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200017088:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1713279306.684234:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200017280:0@lo:103:jbd2/dm-1-8.0 00000004:00010000:0.0:1713279306.684240:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf5b00/0xfc4b8e114eda3826 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda382d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.684240:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713279306.684241:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.684244:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200017152:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279306.684249:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf5b00/0xfc4b8e114eda3826 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda382d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684251:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017216 00000100:00100000:1.0:1713279306.684252:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017216 00010000:00010000:0.0:1713279306.684254:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713279306.684258:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.684260:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf5b00/0xfc4b8e114eda3826 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda382d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684263:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017280 00000100:00100000:1.0:1713279306.684264:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017280 00010000:00010000:0.0:1713279306.684270:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008bf8d440/0xfc4b8e114eda2f20 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x238:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda2f27 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.684270:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200017344:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1713279306.684271:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017152 00000100:00100000:1.0:1713279306.684272:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017152 00000100:00100000:1.0:1713279306.684279:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147199 00000004:00010000:0.0:1713279306.684280:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008bf8d440/0xfc4b8e114eda2f20 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x238:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda2f27 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.684280:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.684281:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008acce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+65:3491:x1796503200017216:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1713279306.684285:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.684290:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda4714 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda470d expref: 65 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.684291:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008bf8d440/0xfc4b8e114eda2f20 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x238:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda2f27 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.684295:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017344 00010000:00010000:0.0:1713279306.684296:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713279306.684297:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017344 00010000:00010000:1.0:1713279306.684299:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x37 (ffff88008c2e7f00) 00010000:00010000:0.0:1713279306.684302:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008bf8d440/0xfc4b8e114eda2f20 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x238:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda2f27 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.684302:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.684311:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147200 00010000:00010000:0.0:1713279306.684312:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801222cd440/0xfc4b8e114eda2a57 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda2a5e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684314:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008acce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+65:3491:x1796503200017216:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 31us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.684315:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+65:3491:x1796503200017280:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1713279306.684317:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147199 00000004:00010000:0.0:1713279306.684318:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801222cd440/0xfc4b8e114eda2a57 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda2a5e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.684320:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.684322:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147201 00000100:00100000:1.0:1713279306.684325:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+64:3492:x1796503200017152:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279306.684328:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801222cd440/0xfc4b8e114eda2a57 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda2a5e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.684328:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.684328:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538900/0xfc4b8e114eda4164 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda415d expref: 64 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.684332:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713279306.684332:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda550d lrc: 0/0,0 mode: --/PW res: [0x200000400:0x23e:0x0].0x32 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda54f8 expref: 64 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.684335:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x23e:0x0].0x3631 (ffff88008afd9900) 00010000:00010000:0.0:1713279306.684337:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801222cd440/0xfc4b8e114eda2a57 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda2a5e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.684337:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x23e:0x0].0x32 (ffff88012fbfe000) 00010000:00010000:1.0:1713279306.684340:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.684346:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda2716 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7af3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda271d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684347:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+62:3492:x1796503200017152:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 22us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.684350:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147201 00010000:00010000:2.0:1713279306.684350:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:0.0:1713279306.684353:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda2716 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7af3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda271d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684355:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147202 00000100:00100000:1.0:1713279306.684357:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+61:3492:x1796503200017344:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1713279306.684361:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.684362:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda2716 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x7af3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda271d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.684365:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e6898c0/0xfc4b8e114eda382d lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x38 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda3826 expref: 61 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.684367:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713279306.684369:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+61:3491:x1796503200017280:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 53us (126us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.684370:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x38 (ffff88008ea88b00) 00010000:00010000:0.0:1713279306.684371:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda2716 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x7af3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda271d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.684373:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.684374:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147200 00000100:00100000:1.0:1713279306.684380:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+60:3492:x1796503200017344:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 22us (100us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.684381:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094550fc0/0xfc4b8e114eda261a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x8283:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda2621 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684384:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147202 00000004:00010000:0.0:1713279306.684387:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094550fc0/0xfc4b8e114eda261a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x8283:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda2621 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684394:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200017408:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279306.684397:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094550fc0/0xfc4b8e114eda261a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x8283:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda2621 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.684401:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1713279306.684402:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.684405:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094550fc0/0xfc4b8e114eda261a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x8283:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda2621 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684408:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713279306.684410:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200017600:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279306.684445:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009435eac0/0xfc4b8e114eda1e1e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x14a:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda1e48 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.684445:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3565:11783:x1796503281166144:12345-192.168.203.4@tcp:35:touch.0 Request processed in 924us (1080us total) trans 4295183573 rc 0/0 00000100:00100000:1.0:1713279306.684448:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1713279306.684452:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009435eac0/0xfc4b8e114eda1e1e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x14a:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda1e48 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.684452:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222952 00000100:00100000:1.0:1713279306.684457:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017408 00000100:00100000:1.0:1713279306.684459:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017408 00010000:00010000:0.0:1713279306.684463:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009435eac0/0xfc4b8e114eda1e1e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x14a:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda1e48 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684467:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017600 00010000:00010000:0.0:1713279306.684468:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1713279306.684468:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017600 00000100:00100000:1.0:1713279306.684475:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147203 00010000:00010000:0.0:1713279306.684476:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009435eac0/0xfc4b8e114eda1e1e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x14a:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda1e48 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684477:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+60:3493:x1796503200017408:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1713279306.684481:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.684491:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c869f80/0xfc4b8e114eda1cb9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x14e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda1cc0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.684491:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147204 00000100:00100000:2.0:1713279306.684496:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+60:3493:x1796503200017600:12345-0@lo:103:jbd2/dm-1-8.0 00000004:00010000:0.0:1713279306.684497:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c869f80/0xfc4b8e114eda1cb9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x14e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda1cc0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.684502:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.684509:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c869f80/0xfc4b8e114eda1cb9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x14e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda1cc0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.684512:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda2f27 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x238:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda2f20 expref: 60 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.684514:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713279306.684517:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x238:0x0].0x0 (ffff880089dc3a00) 00010000:00010000:0.0:1713279306.684518:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c869f80/0xfc4b8e114eda1cb9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x14e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda1cc0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.684521:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.684528:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800936efcc0/0xfc4b8e114eda157a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda1581 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.684532:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda2621 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x8283:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda261a expref: 59 pid: 6933 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684533:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+59:3493:x1796503200017408:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 55us (129us total) trans 0 rc 0/0 00000004:00010000:0.0:1713279306.684534:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800936efcc0/0xfc4b8e114eda157a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda1581 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684536:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147203 00010000:00010000:2.0:1713279306.684541:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8283:0x0].0x0 (ffff880089dfb600) 00010000:00010000:0.0:1713279306.684544:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800936efcc0/0xfc4b8e114eda157a lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda1581 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.684546:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.684548:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200017536:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279306.684549:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713279306.684554:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800936efcc0/0xfc4b8e114eda157a lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda1581 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684560:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1713279306.684564:0:8061:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4295183571 is committed 00000100:00100000:2.0:1713279306.684564:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+57:3493:x1796503200017600:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 68us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.684570:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147204 00000100:00100000:1.0:1713279306.684571:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200017280:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1713279306.684574:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200017216:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1713279306.684578:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017536 00000100:00100000:2.0:1713279306.684581:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017536 00000100:00100000:1.0:1713279306.684583:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200017792:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1713279306.684591:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1713279306.684593:0:8061:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4295183570 is committed 00000100:00100000:2.0:1713279306.684594:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017792 00000100:00100000:1.0:1713279306.684596:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1713279306.684596:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017792 00000100:00100000:1.0:1713279306.684599:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200017472:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1713279306.684605:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147205 00000100:00100000:1.0:1713279306.684606:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.684609:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a147ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+58:3491:x1796503200017536:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1713279306.684611:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200017728:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1713279306.684614:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.684618:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.684622:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5680/0xfc4b8e114eda271d lrc: 0/0,0 mode: --/EX res: [0x240000402:0x7af3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda2716 expref: 58 pid: 6933 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.684625:0:9223:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017472 00000100:00100000:1.0:1713279306.684626:0:9223:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017472 00000001:00080000:0.0:1713279306.684629:0:8061:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4295183547 is committed 00010000:00010000:2.0:1713279306.684629:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7af3:0x0].0x0 (ffff88009e5e1d00) 00000100:00100000:1.0:1713279306.684634:0:9223:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017728 00010000:00010000:2.0:1713279306.684634:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.684635:0:9223:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017728 00000100:00100000:1.0:1713279306.684640:0:9223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147206 00000100:00100000:1.0:1713279306.684642:0:9223:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+59:3491:x1796503200017792:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1713279306.684645:0:9223:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.684651:0:9223:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda1581 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda157a expref: 59 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.684651:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a147ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+59:3491:x1796503200017536:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 41us (89us total) trans 0 rc 0/0 00000020:00080000:0.0:1713279306.684652:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88008c2fb3c0 refcount 2 committed 0 result 0 batchid 17676 00000020:00080000:0.0:1713279306.684656:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880134856300 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88009606cb40 00000100:00100000:2.0:1713279306.684656:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147205 00010000:00010000:1.0:1713279306.684657:0:9223:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x34 (ffff880131eda200) 00000020:00080000:0.0:1713279306.684659:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007fdca600 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880120671cc0 00010000:00010000:1.0:1713279306.684661:0:9223:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1713279306.684662:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880092ae7500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008c2fb9c0 00000020:00080000:0.0:1713279306.684665:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2144 00000020:00080000:0.0:1713279306.684667:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880092ae7700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800960e0c00 00000020:00080000:0.0:1713279306.684669:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1536 00000100:00100000:1.0:1713279306.684670:0:9223:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+57:3491:x1796503200017792:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 27us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.684673:0:9223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147206 00000100:00100000:2.0:1713279306.684676:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147207 00000100:00100000:1.0:1713279306.684679:0:9223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147208 00000100:00100000:2.0:1713279306.684680:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+56:3491:x1796503200017472:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1713279306.684681:0:9223:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+56:3491:x1796503200017728:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1713279306.684685:0:9223:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.684686:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1713279306.684692:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880094f8e9c0 refcount 2 committed 0 result 0 batchid 17675 00010000:00010000:2.0:1713279306.684692:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda2a5e lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24b:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda2a57 expref: 56 pid: 6933 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1713279306.684694:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008ad67b00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880094f8ef00 00010000:00010000:1.0:1713279306.684695:0:9223:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b180/0xfc4b8e114eda1cc0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x14e:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda1cb9 expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1713279306.684697:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2143 00000020:00080000:0.0:1713279306.684699:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d11ee00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880097fc6600 00010000:00010000:2.0:1713279306.684700:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24b:0x0].0x3031 (ffff88012d067b00) 00000020:00080000:0.0:1713279306.684701:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1535 00010000:00010000:1.0:1713279306.684702:0:9223:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14e:0x0].0x0 (ffff880089dc2200) 00010000:00010000:2.0:1713279306.684704:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.684706:0:9223:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1713279306.684710:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8801306373c0 refcount 2 committed 0 result 0 batchid 17674 00000020:00080000:0.0:1713279306.684713:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880091b35d00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8800917f20c0 00000020:00080000:0.0:1713279306.684715:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880091b35500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880120671000 00000100:00100000:1.0:1713279306.684716:0:9223:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+54:3491:x1796503200017728:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000020:00080000:0.0:1713279306.684718:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2142 00000020:00080000:0.0:1713279306.684719:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88013484fc00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008e609200 00000100:00100000:1.0:1713279306.684719:0:9223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147208 00000100:00100000:2.0:1713279306.684719:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+54:3491:x1796503200017472:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 39us (112us total) trans 0 rc 0/0 00000020:00080000:0.0:1713279306.684721:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1534 00000100:00100000:2.0:1713279306.684725:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147207 00000100:00100000:1.0:1713279306.684728:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200017664:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1713279306.684731:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88008c2fb600 refcount 2 committed 0 result 0 batchid 17673 00000020:00080000:0.0:1713279306.684734:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880090a56300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008c2fb9c0 00000020:00080000:0.0:1713279306.684747:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2141 00000100:00100000:1.0:1713279306.684748:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1713279306.684749:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880090a56b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880090845e00 00000020:00080000:0.0:1713279306.684751:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1533 00000020:00080000:0.0:1713279306.684756:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88012ffbd180 refcount 2 committed 0 result 0 batchid 17672 00000100:00100000:1.0:1713279306.684756:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200017600:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1713279306.684758:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880095863300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008ca45d80 00000100:00100000:1.0:1713279306.684760:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200017408:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1713279306.684761:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2139 00000100:00100000:2.0:1713279306.684762:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017664 00000020:00080000:0.0:1713279306.684763:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008ea88600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800935c6e00 00000020:00080000:0.0:1713279306.684765:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1532 00000100:00100000:2.0:1713279306.684765:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017664 00000100:00100000:1.0:1713279306.684773:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200017472:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1713279306.684776:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200017728:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1713279306.684777:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147209 00000100:00100000:1.0:1713279306.684780:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200017792:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1713279306.684780:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+53:3493:x1796503200017664:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1713279306.684784:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200017536:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1713279306.684785:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1713279306.684789:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88008c213540 refcount 2 committed 0 result 0 batchid 17671 00000020:00080000:0.0:1713279306.684792:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007f2ad300 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88009e75f840 00000020:00080000:0.0:1713279306.684794:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007f2ad800 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012fb0e000 00000020:00080000:0.0:1713279306.684797:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096696500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008c213000 00000020:00080000:0.0:1713279306.684799:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2138 00000020:00080000:0.0:1713279306.684801:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096696a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880090845200 00000020:00080000:0.0:1713279306.684803:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1531 00010000:00010000:2.0:1713279306.684814:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801237da400/0xfc4b8e114eda1e48 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x14a:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda1e1e expref: 53 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.684822:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14a:0x0].0x0 (ffff880135caa400) 00000020:00080000:0.0:1713279306.684826:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880120671f00 refcount 2 committed 0 result 0 batchid 17670 00010000:00010000:2.0:1713279306.684827:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1713279306.684828:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d7fc100 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880093a83c00 00000020:00080000:0.0:1713279306.684831:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800934f8000 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012ba286c0 00000020:00080000:0.0:1713279306.684833:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096da6500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8801206719c0 00000020:00080000:0.0:1713279306.684836:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2137 00000020:00080000:0.0:1713279306.684838:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096da6200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012fa4ba00 00000020:00080000:0.0:1713279306.684840:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1530 00000020:00080000:0.0:1713279306.684852:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091944d80 refcount 2 committed 0 result 0 batchid 17669 00000020:00080000:0.0:1713279306.684854:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012d067f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008c9f7600 00000100:00100000:2.0:1713279306.684854:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+52:3493:x1796503200017664:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 73us (105us total) trans 0 rc 0/0 00000020:00080000:0.0:1713279306.684857:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2136 00000020:00080000:0.0:1713279306.684859:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012d067900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880093405800 00000100:00100000:2.0:1713279306.684860:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147209 00000020:00080000:0.0:1713279306.684861:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1529 00000020:00080000:0.0:1713279306.684867:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88008e4a2f00 refcount 2 committed 0 result 0 batchid 17668 00000020:00080000:0.0:1713279306.684870:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012d397100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012445b9c0 00000020:00080000:0.0:1713279306.684872:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2135 00000020:00080000:0.0:1713279306.684874:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012d397800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008c6fde00 00000100:00100000:1.0:1713279306.684874:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200017664:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1713279306.684876:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1528 00000100:00100000:1.0:1713279306.685024:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000020:00080000:0.0:1713279306.685030:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88012ffbdc00 refcount 2 committed 0 result 0 batchid 17667 00000020:00080000:0.0:1713279306.685034:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800938abc00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012ffbd180 00000020:00080000:0.0:1713279306.685037:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2134 00000020:00080000:0.0:1713279306.685039:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800938ab700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008e69ce00 00000020:00080000:0.0:1713279306.685041:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1527 00000100:00100000:2.0:1713279306.685042:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281166400 00000100:00100000:2.0:1713279306.685045:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281166400 00000020:00080000:0.0:1713279306.685050:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880094f8ecc0 refcount 2 committed 0 result 0 batchid 17666 00000020:00080000:0.0:1713279306.685053:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012d067800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880136a3fc00 00000020:00080000:0.0:1713279306.685055:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2133 00000020:00080000:0.0:1713279306.685057:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012d067500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880090b11600 00000100:00100000:2.0:1713279306.685058:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222953 00000020:00080000:0.0:1713279306.685060:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1526 00000100:00100000:2.0:1713279306.685062:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012347ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3505:11374:x1796503281166400:12345-192.168.203.4@tcp:37:lfs.0 00000020:00080000:0.0:1713279306.685066:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88007fcca000 refcount 2 committed 0 result 0 batchid 17665 00000020:00080000:0.0:1713279306.685084:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880097910900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88007fccad80 00000020:00080000:0.0:1713279306.685086:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2132 00000020:00080000:0.0:1713279306.685088:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008ade5c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800901d4600 00000020:00080000:0.0:1713279306.685091:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1525 00000020:00080000:0.0:1713279306.685110:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880135eb00c0 refcount 2 committed 0 result 0 batchid 17664 00000020:00080000:0.0:1713279306.685112:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880091d49900 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012445b540 00000020:00080000:0.0:1713279306.685115:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880091d49000 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880135eb0600 00000020:00080000:0.0:1713279306.685117:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880091d49400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880135eb0900 00000020:00080000:0.0:1713279306.685120:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2131 00000020:00080000:0.0:1713279306.685123:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008da65300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8801360e5a00 00000020:00080000:0.0:1713279306.685125:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1524 00000020:00080000:0.0:1713279306.685130:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880096e070c0 refcount 2 committed 0 result 0 batchid 17663 00000020:00080000:0.0:1713279306.685133:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011f3eb900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880096e07000 00000020:00080000:0.0:1713279306.685135:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2130 00000020:00080000:0.0:1713279306.685137:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131eda600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880092063e00 00000020:00080000:0.0:1713279306.685139:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1523 00000020:00080000:0.0:1713279306.685164:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88012fb0ee40 refcount 2 committed 0 result 0 batchid 17661 00000020:00080000:0.0:1713279306.685166:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880082706400 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012445b300 00000020:00080000:0.0:1713279306.685168:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880082706d00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8800917f2000 00000020:00080000:0.0:1713279306.685171:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007fe41f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012fb0e6c0 00000020:00080000:0.0:1713279306.685173:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2129 00000020:00080000:0.0:1713279306.685175:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880082706100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880097538600 00000020:00080000:0.0:1713279306.685177:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1522 00000020:00080000:0.0:1713279306.685181:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8800961900c0 refcount 2 committed 0 result 0 batchid 17662 00000020:00080000:0.0:1713279306.685183:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880091d49f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012fa43300 00000020:00080000:0.0:1713279306.685185:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2128 00000020:00080000:0.0:1713279306.685187:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880091d49c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d644600 00000020:00080000:0.0:1713279306.685189:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1521 00000020:00080000:0.0:1713279306.685193:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88008c9f79c0 refcount 2 committed 0 result 0 batchid 17660 00000020:00080000:0.0:1713279306.685195:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880135caa200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008c9f7cc0 00000020:00080000:0.0:1713279306.685197:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2127 00000020:00080000:0.0:1713279306.685200:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880129bec700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880097539000 00000020:00080000:0.0:1713279306.685202:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1520 00000020:00080000:0.0:1713279306.685208:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88008c2fbc00 refcount 2 committed 0 result 0 batchid 17659 00000020:00080000:0.0:1713279306.685210:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880092a4cd00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008c2fb9c0 00000020:00080000:0.0:1713279306.685213:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2126 00000020:00080000:0.0:1713279306.685215:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880092a4cb00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d644000 00000020:00080000:0.0:1713279306.685217:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1519 00000020:00080000:0.0:1713279306.685221:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091944e40 refcount 2 committed 0 result 0 batchid 17658 00000020:00080000:0.0:1713279306.685223:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880129b60800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012ce88cc0 00000020:00080000:0.0:1713279306.685225:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2125 00000020:00080000:0.0:1713279306.685227:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880097a6b100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880093a47e00 00000020:00080000:0.0:1713279306.685229:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1518 00000020:00080000:0.0:1713279306.685233:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880095aef3c0 refcount 2 committed 0 result 0 batchid 17657 00000020:00080000:0.0:1713279306.685235:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880097a6be00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8800940c4a80 00000020:00080000:0.0:1713279306.685238:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2124 00000020:00080000:0.0:1713279306.685239:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800935a6800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880093a47000 00000020:00080000:0.0:1713279306.685242:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1517 00000020:00080000:0.0:1713279306.685245:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88008f4ba600 refcount 2 committed 0 result 0 batchid 17656 00000020:00080000:0.0:1713279306.685248:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880097e7b600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8801222496c0 00000020:00080000:0.0:1713279306.685250:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2123 00000020:00080000:0.0:1713279306.685252:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096eff400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880093a46200 00000020:00080000:0.0:1713279306.685255:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1516 00000020:00080000:0.0:1713279306.685284:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88012fb0e540 refcount 2 committed 0 result 0 batchid 17655 00000020:00080000:0.0:1713279306.685286:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800939e3e00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880097df86c0 00000020:00080000:0.0:1713279306.685289:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800939e3500 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880094f09780 00000020:00080000:0.0:1713279306.685292:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880094168500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012fb0e000 00000020:00080000:0.0:1713279306.685294:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2122 00000020:00080000:0.0:1713279306.685296:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800958c9700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008e710600 00000020:00080000:0.0:1713279306.685298:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1515 00000020:00080000:0.0:1713279306.685333:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8800917f2540 refcount 2 committed 0 result 0 batchid 17654 00000020:00080000:0.0:1713279306.685335:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012d067000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8801237270c0 00000020:00080000:0.0:1713279306.685337:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2121 00000020:00080000:0.0:1713279306.685339:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012d067a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800969bd000 00000020:00080000:0.0:1713279306.685341:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1514 00000020:00080000:0.0:1713279306.685349:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8800917f2780 refcount 2 committed 0 result 0 batchid 17653 00000020:00080000:0.0:1713279306.685351:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096b8ee00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8800917f23c0 00000020:00080000:0.0:1713279306.685353:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2120 00000020:00080000:0.0:1713279306.685355:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096b8e800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880096e0c200 00000020:00080000:0.0:1713279306.685357:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1513 00000020:00080000:0.0:1713279306.685369:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88008a2fd780 refcount 2 committed 0 result 0 batchid 17652 00000020:00080000:0.0:1713279306.685371:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007fcb8000 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880123727c00 00000020:00080000:0.0:1713279306.685374:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007fcb8100 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008a2fd6c0 00000020:00080000:0.0:1713279306.685376:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007fcb8800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008a2fd300 00000020:00080000:0.0:1713279306.685378:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2119 00000020:00080000:0.0:1713279306.685380:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007fcb8600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800977c6200 00000020:00080000:0.0:1713279306.685383:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1512 00000020:00080000:0.0:1713279306.685387:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8800994df000 refcount 2 committed 0 result 0 batchid 17651 00000020:00080000:0.0:1713279306.685389:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096b8e400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8800977c5180 00000020:00080000:0.0:1713279306.685392:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2118 00000020:00080000:0.0:1713279306.685394:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096b8e600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880095895a00 00000020:00080000:0.0:1713279306.685396:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1511 00000020:00080000:0.0:1713279306.685400:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880122249540 refcount 2 committed 0 result 0 batchid 17650 00000020:00080000:0.0:1713279306.685402:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800960e8500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880122249300 00000020:00080000:0.0:1713279306.685404:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2117 00000020:00080000:0.0:1713279306.685406:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800960e8c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880095894a00 00000020:00080000:0.0:1713279306.685409:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1510 00000020:00080000:0.0:1713279306.685431:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88008f549240 refcount 2 committed 0 result 0 batchid 17649 00000020:00080000:0.0:1713279306.685434:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007fcb8e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008f549a80 00000020:00080000:0.0:1713279306.685436:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2116 00000020:00080000:0.0:1713279306.685438:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007fcb8f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008fc8d000 00000020:00080000:0.0:1713279306.685440:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1509 00000020:00080000:0.0:1713279306.685454:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88012445b180 refcount 2 committed 0 result 0 batchid 17648 00000020:00080000:0.0:1713279306.685456:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007f389700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880123727900 00000020:00080000:0.0:1713279306.685458:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2115 00000020:00080000:0.0:1713279306.685460:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008e4c8e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880094624000 00000020:00080000:0.0:1713279306.685463:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1508 00000020:00080000:0.0:1713279306.685468:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8800994e0e40 refcount 2 committed 0 result 0 batchid 17647 00000020:00080000:0.0:1713279306.685470:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096da6800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880098f8b480 00000020:00080000:0.0:1713279306.685472:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2114 00000020:00080000:0.0:1713279306.685474:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096da6400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800977c6000 00000020:00080000:0.0:1713279306.685477:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1506 00000020:00080000:0.0:1713279306.685499:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880135ce83c0 refcount 2 committed 0 result 0 batchid 17646 00000020:00080000:0.0:1713279306.685501:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131e5c800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880130c8d180 00000020:00080000:0.0:1713279306.685504:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2113 00000020:00080000:0.0:1713279306.685506:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800908e1400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008a763400 00000020:00080000:0.0:1713279306.685508:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1505 00000020:00080000:0.0:1713279306.685514:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8800917f2180 refcount 2 committed 0 result 0 batchid 17645 00000020:00080000:0.0:1713279306.685516:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800927e1400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8800917f26c0 00000020:00080000:0.0:1713279306.685518:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2112 00000020:00080000:0.0:1713279306.685520:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008c5c2000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008e60c200 00000020:00080000:0.0:1713279306.685522:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1504 00000020:00080000:0.0:1713279306.685548:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8800917f2b40 refcount 2 committed 0 result 0 batchid 17644 00000020:00080000:0.0:1713279306.685551:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012cffdd00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8800917f2000 00000020:00080000:0.0:1713279306.685553:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2111 00000020:00080000:0.0:1713279306.685555:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b918f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880095967200 00000020:00080000:0.0:1713279306.685558:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1503 00000020:00080000:0.0:1713279306.685570:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88009e70d900 refcount 2 committed 0 result 0 batchid 17643 00000020:00080000:0.0:1713279306.685573:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800938ab100 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880092abfd80 00000020:00080000:0.0:1713279306.685575:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012bac7600 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880098112e40 00000020:00080000:0.0:1713279306.685578:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012bac7800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012edd9600 00000020:00080000:0.0:1713279306.685580:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2110 00000020:00080000:0.0:1713279306.685582:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880136671600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880096337200 00000020:00080000:0.0:1713279306.685584:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1502 00000100:00100000:2.0:1713279306.685592:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.685625:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda14d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15488 initiator: MDT1 00010000:00010000:0.0:1713279306.685636:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda14d9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15488 initiator: MDT1 00010000:00010000:0.0:1713279306.685642:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda14d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15488 initiator: MDT1 00010000:00010000:0.0:1713279306.685647:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bc6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.685649:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda14d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15488 initiator: MDT1 00010000:00010000:0.0:1713279306.685655:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda14d9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15488 initiator: MDT1 00010000:00010000:0.0:1713279306.685663:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x3531 (ffff880136671500) 00010000:00010000:0.0:1713279306.685666:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.685668:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda14d9 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15488 initiator: MDT1 00010000:00010000:0.0:1713279306.685673:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda14d9 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15488 initiator: MDT1 00010000:00010000:0.0:1713279306.685705:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda15ce lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x768b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15488 initiator: MDT1 00010000:00010000:0.0:1713279306.685710:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda15ce lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x768b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15488 initiator: MDT1 00010000:00010000:0.0:1713279306.685715:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda15ce lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x768b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15488 initiator: MDT1 00010000:00010000:0.0:1713279306.685719:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ef180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.685722:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda15ce lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x768b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15488 initiator: MDT1 00010000:00010000:0.0:1713279306.685727:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda15ce lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x768b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15488 initiator: MDT1 00010000:00010000:0.0:1713279306.685733:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x768b:0x0].0x0 (ffff88007fdca900) 00010000:00010000:0.0:1713279306.685735:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.685738:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda15ce lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x768b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15488 initiator: MDT1 00010000:00010000:0.0:1713279306.685742:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda15ce lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x768b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15488 initiator: MDT1 00010000:00010000:0.0:1713279306.685754:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda1b4d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7529:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.685759:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda1b4d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7529:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.685764:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda1b4d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7529:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.685768:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.685771:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda1b4d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7529:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.685776:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda1b4d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7529:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.685782:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7529:0x0].0x0 (ffff880121a3cd00) 00010000:00010000:0.0:1713279306.685784:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.685786:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda1b4d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7529:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.685791:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda1b4d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7529:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.685801:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda1b0e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x753e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.685806:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda1b0e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x753e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.685811:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda1b0e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x753e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.685815:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe158c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.685817:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda1b0e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x753e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.685822:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda1b0e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x753e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.685927:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x753e:0x0].0x0 (ffff880095b48100) 00000100:00100000:1.0:1713279306.685928:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.685930:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.685933:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda1b0e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x753e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.685937:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda1b0e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x753e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.685943:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281166656 00000100:00100000:2.0:1713279306.685946:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281166656 00000100:00100000:1.0:1713279306.685947:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.685948:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009435c900/0xfc4b8e114eda1e4f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x76d2:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.685953:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009435c900/0xfc4b8e114eda1e4f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x76d2:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.685958:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009435c900/0xfc4b8e114eda1e4f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x76d2:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.685961:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222954 00000100:00100000:2.0:1713279306.685965:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3726:13168:x1796503281166656:12345-192.168.203.4@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1713279306.685966:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009435c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.685969:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009435c900/0xfc4b8e114eda1e4f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x76d2:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.685974:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009435c900/0xfc4b8e114eda1e4f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x76d2:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.685981:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x76d2:0x0].0x0 (ffff880095455e00) 00010000:00010000:0.0:1713279306.685983:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.685986:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009435c900/0xfc4b8e114eda1e4f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x76d2:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.685990:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009435c900/0xfc4b8e114eda1e4f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x76d2:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686000:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda1bf5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x765e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686005:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda1bf5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x765e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686010:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda1bf5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x765e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686014:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ce52640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686016:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda1bf5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x765e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686021:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda1bf5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x765e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686027:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x765e:0x0].0x0 (ffff88008ea88d00) 00010000:00010000:0.0:1713279306.686030:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:0.0:1713279306.686032:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda1bf5 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x765e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686036:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda1bf5 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x765e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686046:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda1e17 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x255:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686050:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda1e17 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x255:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686055:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda1e17 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x255:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00000040:00080000:2.0:1713279306.686057:0:15649:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x1b7:0x0].189, 344 off108240 00010000:00010000:0.0:1713279306.686059:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68b840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686061:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda1e17 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x255:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686064:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda1e17 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x255:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686081:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x255:0x0].0x0 (ffff88012fbfe700) 00010000:00010000:0.0:1713279306.686084:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:0.0:1713279306.686085:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda1e17 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x255:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686088:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda1e17 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x255:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686096:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114eda1cb2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00000040:00080000:2.0:1713279306.686096:0:15649:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0xf2:0x0].674, 424 off476920 00010000:00010000:0.0:1713279306.686099:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114eda1cb2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x25e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00000004:00080000:2.0:1713279306.686099:0:15649:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88008c213180 with version 29395 00010000:00010000:0.0:1713279306.686103:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114eda1cb2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686105:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008245f840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686107:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114eda1cb2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686109:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114eda1cb2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x25e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00000004:00080000:2.0:1713279306.686112:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29395 rpc_version 29395 00010000:00010000:0.0:1713279306.686113:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25e:0x0].0x0 (ffff8800902cc600) 00010000:00010000:0.0:1713279306.686114:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:0.0:1713279306.686115:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114eda1cb2 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x25e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686118:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114eda1cb2 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x25e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686125:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda2430 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7b15:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000020:00100000:2.0:1713279306.686125:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1713279306.686128:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda2430 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7b15:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.686130:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda2430 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7b15:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713279306.686130:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880131cdea00 x1796503200017920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1713279306.686133:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008245cfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686134:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda2430 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7b15:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.686137:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda2430 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7b15:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.686141:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b15:0x0].0x0 (ffff880090884a00) 00010000:00010000:0.0:1713279306.686142:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1713279306.686142:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200017920:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713279306.686143:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda2430 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7b15:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.686146:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda2430 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7b15:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.686151:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda27e8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7b9c:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686154:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda27e8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7b9c:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686156:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda27e8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7b9c:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686159:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ef3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686160:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda27e8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7b9c:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00000100:00100000:2.0:1713279306.686162:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.686164:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda27e8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7b9c:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686167:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b9c:0x0].0x0 (ffff88009588c000) 00010000:00010000:0.0:1713279306.686168:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686169:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda27e8 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7b9c:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00000100:00100000:2.0:1713279306.686171:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98480 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.686172:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda27e8 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7b9c:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.686177:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda2c95 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x79a0:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.686180:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda2c95 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x79a0:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.686183:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda2c95 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x79a0:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.686186:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942cd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686187:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda2c95 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x79a0:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.686189:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda2c95 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x79a0:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.686193:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x79a0:0x0].0x0 (ffff88012fbfe600) 00010000:00010000:0.0:1713279306.686194:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686195:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda2c95 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x79a0:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.686198:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda2c95 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x79a0:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.686203:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda2c10 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686205:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda2c10 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686208:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda2c10 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686210:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686212:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda2c10 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686215:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda2c10 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686219:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x777b:0x0].0x0 (ffff880097e7bf00) 00010000:00010000:0.0:1713279306.686220:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.686221:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda2c10 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686224:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda2c10 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686230:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda2e08 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7afa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686233:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda2e08 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7afa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686236:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda2e08 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7afa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686238:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686239:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda2e08 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7afa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686242:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda2e08 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7afa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686293:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7afa:0x0].0x0 (ffff88012d067d00) 00010000:00010000:0.0:1713279306.686295:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686297:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda2e08 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7afa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686300:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda2e08 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7afa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686308:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10480/0xfc4b8e114eda2e2b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7676:0x0].0x0 bits 0x7e/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686311:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10480/0xfc4b8e114eda2e2b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x7676:0x0].0x0 bits 0x7e/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686314:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10480/0xfc4b8e114eda2e2b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7676:0x0].0x0 bits 0x7e/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686316:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686317:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10480/0xfc4b8e114eda2e2b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7676:0x0].0x0 bits 0x7e/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686320:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10480/0xfc4b8e114eda2e2b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x7676:0x0].0x0 bits 0x7e/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686324:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7676:0x0].0x0 (ffff88012514df00) 00010000:00010000:0.0:1713279306.686325:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7e 00010000:00010000:0.0:1713279306.686326:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10480/0xfc4b8e114eda2e2b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x7676:0x0].0x0 bits 0x7e/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686328:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10480/0xfc4b8e114eda2e2b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x7676:0x0].0x0 bits 0x7e/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686334:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda2f12 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25f:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686337:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda2f12 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x25f:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686340:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda2f12 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25f:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686345:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686347:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda2f12 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25f:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686350:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda2f12 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x25f:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686353:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25f:0x0].0x0 (ffff880082706700) 00010000:00010000:0.0:1713279306.686354:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:0.0:1713279306.686355:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda2f12 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x25f:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686358:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda2f12 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x25f:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686363:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114eda3000 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7b15:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.686366:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114eda3000 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7b15:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.686369:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114eda3000 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7b15:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.686371:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ef180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686372:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114eda3000 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7b15:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.686375:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114eda3000 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7b15:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.686379:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b15:0x0].0x0 (ffff880090884a00) 00010000:00010000:0.0:1713279306.686380:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686382:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114eda3000 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7b15:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.686384:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114eda3000 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7b15:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.686390:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda3460 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x76d2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.686393:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda3460 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x76d2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.686396:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda3460 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x76d2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.686398:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096a2fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686400:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda3460 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x76d2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.686403:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda3460 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x76d2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.686406:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x76d2:0x0].0x0 (ffff880095455e00) 00010000:00010000:0.0:1713279306.686407:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686408:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda3460 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x76d2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.686424:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda3460 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x76d2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.686430:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda36f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x721d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.686432:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda36f2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x721d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.686436:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda36f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x721d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.686439:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a4b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686440:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda36f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x721d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.686443:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda36f2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x721d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.686446:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x721d:0x0].0x0 (ffff8800902cc000) 00010000:00010000:0.0:1713279306.686447:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686448:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda36f2 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x721d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.686451:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda36f2 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x721d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.686456:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda3b98 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x129:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.686459:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda3b98 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x129:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.686461:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda3b98 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x129:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.686464:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134927180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686465:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda3b98 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x129:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.686468:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda3b98 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x129:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.686472:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x129:0x0].0x34 (ffff880091d49100) 00010000:00010000:0.0:1713279306.686474:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.686475:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda3b98 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x129:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.686478:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda3b98 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x129:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.686485:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda3afe lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x74d1:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15489 initiator: MDT1 00010000:00010000:0.0:1713279306.686488:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda3afe lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x74d1:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15489 initiator: MDT1 00010000:00010000:0.0:1713279306.686490:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda3afe lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x74d1:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT1 00010000:00010000:0.0:1713279306.686493:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686494:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda3afe lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x74d1:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15489 initiator: MDT1 00010000:00010000:0.0:1713279306.686497:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda3afe lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x74d1:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15489 initiator: MDT1 00010000:00010000:0.0:1713279306.686501:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74d1:0x0].0x0 (ffff88008d597900) 00010000:00010000:0.0:1713279306.686502:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686504:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda3afe lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x74d1:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT1 00010000:00010000:0.0:1713279306.686506:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda3afe lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x74d1:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15489 initiator: MDT1 00010000:00010000:0.0:1713279306.686511:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda3d43 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686515:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda3d43 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x76ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686518:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda3d43 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686520:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b0480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686521:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda3d43 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686524:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda3d43 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x76ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686527:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76ab:0x0].0x0 (ffff880091d49e00) 00010000:00010000:0.0:1713279306.686528:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.686530:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda3d43 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x76ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686532:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda3d43 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x76ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686538:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda3a72 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x752c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.686541:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda3a72 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x752c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.686543:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda3a72 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x752c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.686546:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800923421c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686547:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda3a72 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x752c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.686550:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda3a72 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x752c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.686554:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x752c:0x0].0x0 (ffff88008a641f00) 00010000:00010000:0.0:1713279306.686555:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686556:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda3a72 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x752c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.686559:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda3a72 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x752c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.686564:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecfc0/0xfc4b8e114eda430f lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x753e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686567:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecfc0/0xfc4b8e114eda430f lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x753e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686569:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecfc0/0xfc4b8e114eda430f lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x753e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686572:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ecfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686579:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecfc0/0xfc4b8e114eda430f lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x753e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686582:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecfc0/0xfc4b8e114eda430f lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x753e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686585:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x753e:0x0].0x0 (ffff880095b48100) 00010000:00010000:0.0:1713279306.686586:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686588:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecfc0/0xfc4b8e114eda430f lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x753e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686590:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecfc0/0xfc4b8e114eda430f lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x753e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.686597:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda462d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7c0d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.686600:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda462d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7c0d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.686603:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda462d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7c0d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.686605:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe16d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686606:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda462d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7c0d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.686609:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda462d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7c0d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.686612:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7c0d:0x0].0x0 (ffff880123701600) 00010000:00010000:0.0:1713279306.686613:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686614:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda462d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7c0d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.686617:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda462d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7c0d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.686622:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e39440/0xfc4b8e114eda4991 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7884:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.686624:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131e39440/0xfc4b8e114eda4991 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7884:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.686627:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131e39440/0xfc4b8e114eda4991 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7884:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.686632:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131e39440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686633:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131e39440/0xfc4b8e114eda4991 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7884:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.686636:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131e39440/0xfc4b8e114eda4991 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7884:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.686637:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012347ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3394:11374:x1796503281166400:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1573us (1611us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.686639:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7884:0x0].0x0 (ffff880091bf6700) 00010000:00010000:0.0:1713279306.686640:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686642:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131e39440/0xfc4b8e114eda4991 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7884:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.686644:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131e39440/0xfc4b8e114eda4991 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7884:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.686644:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222953 00010000:00010000:0.0:1713279306.686649:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda4c31 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.686652:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda4c31 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.686655:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda4c31 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.686657:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090b25440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686658:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda4c31 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.686661:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda4c31 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.686665:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75c9:0x0].0x0 (ffff88008eb9f100) 00010000:00010000:0.0:1713279306.686667:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686668:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda4c31 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.686668:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017920 00000100:00100000:2.0:1713279306.686670:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017920 00010000:00010000:0.0:1713279306.686671:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda4c31 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.686686:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98627 00000100:00100000:2.0:1713279306.686689:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+87:8634:x1796503200017920:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.686701:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.686749:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda4da4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7c0d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.686749:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.686753:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda4da4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7c0d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686756:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda4da4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7c0d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686759:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906ea640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686760:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda4da4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7c0d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.686760:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.686763:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda4da4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7c0d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686768:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7c0d:0x0].0x0 (ffff880123701600) 00010000:00010000:0.0:1713279306.686769:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686770:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda4da4 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7c0d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.686770:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+88:8634:x1796503200017920:12345-0@lo:1000:osp_up1-0.0 Request processed in 79us (607us total) trans 4295183574 rc 0/0 00010000:00010000:0.0:1713279306.686773:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda4da4 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7c0d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.686776:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98627 00000100:00100000:1.0:1713279306.686777:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.686781:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda52ac lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x75f8:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686784:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda52ac lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x75f8:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686788:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda52ac lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x75f8:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00000100:00100000:2.0:1713279306.686788:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281167168 00010000:00010000:0.0:1713279306.686790:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205440 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.686791:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281167168 00010000:00010000:0.0:1713279306.686792:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda52ac lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x75f8:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686794:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda52ac lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x75f8:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686798:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x75f8:0x0].0x0 (ffff88007f3afd00) 00010000:00010000:0.0:1713279306.686799:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686800:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda52ac lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x75f8:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.686803:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda52ac lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x75f8:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000100:00100000:2.0:1713279306.686805:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110417 00010000:00010000:0.0:1713279306.686810:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114eda532a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x758f:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.686810:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+74:1957:x1796503281167168:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:0.0:1713279306.686812:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114eda532a lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x758f:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.686815:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114eda532a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x758f:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.686817:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e8b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686819:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114eda532a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x758f:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.686821:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114eda532a lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x758f:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.686826:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x758f:0x0].0x0 (ffff8800908e1600) 00010000:00010000:0.0:1713279306.686827:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.686828:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114eda532a lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x758f:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.686831:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114eda532a lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x758f:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.686837:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda5dc6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686839:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda5dc6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686842:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda5dc6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686845:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d2d7a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686846:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda5dc6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686849:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda5dc6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686853:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3031 (ffff8800960e8800) 00010000:00010000:0.0:1713279306.686854:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.686855:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda5dc6 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x20b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686859:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda5dc6 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x20b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.686875:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda5e75 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x757a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.686880:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda5e75 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x757a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.686885:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda5e75 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x757a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.686888:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+75:1957:x1796503281167168:12345-192.168.203.4@tcp:2:touch.0 Request processed in 77us (138us total) trans 4295010097 rc 0/0 00010000:00010000:0.0:1713279306.686889:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938fcfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686892:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda5e75 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x757a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.686895:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110417 00010000:00010000:0.0:1713279306.686897:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda5e75 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x757a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.686904:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x757a:0x0].0x31 (ffff880095863700) 00010000:00010000:0.0:1713279306.686906:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.686908:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda5e75 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x757a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.686913:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda5e75 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x757a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.686916:0:8634:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4295183547 gen 2 00000004:00080000:2.0:1713279306.686929:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183320 committed transno 4295183547 00000020:00080000:2.0:1713279306.686932:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012445bb40 refcount 2 committed 0 result 0 batchid 16374 00000020:00080000:2.0:1713279306.686935:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009588c900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880092abff00 00000020:00080000:2.0:1713279306.686937:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009588cf00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880129a98780 00010000:00010000:0.0:1713279306.686938:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16880/0xfc4b8e114eda5ead lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000020:00080000:2.0:1713279306.686940:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].641 00000100:00100000:1.0:1713279306.686942:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200017984 00000020:00080000:2.0:1713279306.686942:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009588cb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880094f5b400 00010000:00010000:0.0:1713279306.686943:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16880/0xfc4b8e114eda5ead lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000020:00080000:2.0:1713279306.686944:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].155 00000100:00100000:1.0:1713279306.686946:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200017984 00010000:00010000:0.0:1713279306.686948:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16880/0xfc4b8e114eda5ead lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.686953:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe16880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.686955:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16880/0xfc4b8e114eda5ead lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000004:00080000:2.0:1713279306.686960:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183329 committed transno 4295183547 00010000:00010000:0.0:1713279306.686961:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16880/0xfc4b8e114eda5ead lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.686961:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33421 00000020:00080000:2.0:1713279306.686963:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880135eb0300 refcount 2 committed 0 result 0 batchid 16375 00000100:00100000:1.0:1713279306.686965:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:3476:x1796503200017984:12345-0@lo:105: 00000020:00080000:2.0:1713279306.686965:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800914c5000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880092abfd80 00000020:00080000:2.0:1713279306.686967:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].642 00010000:00010000:0.0:1713279306.686968:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76d4:0x0].0x0 (ffff88011eea5600) 00000020:00080000:2.0:1713279306.686969:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880134856900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012ed58c00 00010000:00010000:0.0:1713279306.686970:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.686971:0:6913:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 5/0,1 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1713279306.686971:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].156 00010000:00010000:0.0:1713279306.686972:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16880/0xfc4b8e114eda5ead lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.686976:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16880/0xfc4b8e114eda5ead lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.686978:0:6913:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 5/0,1 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.686983:0:6913:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 5/0,1 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.686983:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183334 committed transno 4295183547 00000020:00080000:2.0:1713279306.686986:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008f549f00 refcount 2 committed 0 result 0 batchid 16376 00010000:00010000:0.0:1713279306.686987:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114eda60f9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x685c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.686987:0:6913:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 5/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1713279306.686988:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800958c9300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008f5499c0 00010000:00010000:1.0:1713279306.686990:0:6913:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 6/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1713279306.686991:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008fda9000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008f549c00 00010000:00010000:0.0:1713279306.686993:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114eda60f9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x685c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000020:00080000:2.0:1713279306.686993:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].643 00010000:00010000:1.0:1713279306.686994:0:6913:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 6/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1713279306.686995:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007f389c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800977c7200 00010000:00010000:0.0:1713279306.686998:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114eda60f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x685c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000020:00080000:2.0:1713279306.686998:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].158 00010000:00010000:0.0:1713279306.687002:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baaf40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.687003:0:6913:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88008d983840) 00010000:00010000:0.0:1713279306.687004:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114eda60f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x685c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.687009:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114eda60f9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x685c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000004:00080000:2.0:1713279306.687010:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183336 committed transno 4295183547 00000020:00080000:2.0:1713279306.687014:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008f5493c0 refcount 2 committed 0 result 0 batchid 16377 00010000:00010000:0.0:1713279306.687015:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x685c:0x0].0x0 (ffff88007f14b100) 00000020:00080000:2.0:1713279306.687016:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880089f68800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008f549540 00010000:00010000:0.0:1713279306.687017:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00000020:00080000:2.0:1713279306.687019:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].644 00010000:00010000:0.0:1713279306.687020:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114eda60f9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x685c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000020:00080000:2.0:1713279306.687020:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880092853900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800977c7c00 00000020:00080000:2.0:1713279306.687022:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].159 00010000:00010000:0.0:1713279306.687025:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114eda60f9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x685c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.687026:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:3476:x1796503200017984:12345-0@lo:105: Request processed in 61us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.687030:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33421 00010000:00010000:0.0:1713279306.687034:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda6353 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00000004:00080000:2.0:1713279306.687034:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183341 committed transno 4295183547 00000020:00080000:2.0:1713279306.687036:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880124ce2300 refcount 2 committed 0 result 0 batchid 16378 00000020:00080000:2.0:1713279306.687039:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011eea5000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88012ba280c0 00010000:00010000:0.0:1713279306.687040:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda6353 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x76d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00000020:00080000:1.0:1713279306.687040:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 16377 committed batchid 16373 00000020:00080000:2.0:1713279306.687041:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].645 00000020:00080000:2.0:1713279306.687043:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011eea5800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d51c000 00010000:00010000:0.0:1713279306.687044:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda6353 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00000020:00080000:2.0:1713279306.687045:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].160 00010000:00010000:0.0:1713279306.687049:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd5680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.687051:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda6353 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.687056:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda6353 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x76d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00000020:00080000:1.0:1713279306.687057:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 16378 committed batchid 16373 00000004:00080000:2.0:1713279306.687057:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183344 committed transno 4295183547 00000020:00080000:1.0:1713279306.687061:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16373 00010000:00010000:0.0:1713279306.687062:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76d5:0x0].0x0 (ffff8800960e8200) 00010000:00010000:0.0:1713279306.687064:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.687066:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda6353 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x76d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000004:00080000:2.0:1713279306.687066:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183345 committed transno 4295183547 00010000:00010000:1.0:1713279306.687082:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.687086:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda6353 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x76d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.687087:0:15525:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.687088:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183346 committed transno 4295183547 00010000:00010000:0.0:1713279306.687097:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114eda6433 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000004:00080000:2.0:1713279306.687097:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183355 committed transno 4295183547 00010000:00010000:0.0:1713279306.687102:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114eda6433 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.687107:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114eda6433 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000004:00080000:2.0:1713279306.687107:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183356 committed transno 4295183547 00010000:00010000:0.0:1713279306.687116:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181db00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.687118:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114eda6433 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000004:00080000:2.0:1713279306.687118:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183357 committed transno 4295183547 00010000:00010000:0.0:1713279306.687123:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114eda6433 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00000004:00080000:2.0:1713279306.687128:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183358 committed transno 4295183547 00010000:00010000:0.0:1713279306.687130:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3131 (ffff880091b35600) 00010000:00010000:0.0:1713279306.687132:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.687134:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114eda6433 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x20b:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000004:00080000:2.0:1713279306.687137:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183360 committed transno 4295183547 00010000:00010000:0.0:1713279306.687139:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114eda6433 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x20b:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000020:00080000:2.0:1713279306.687140:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880122249a80 refcount 2 committed 0 result 0 batchid 16379 00000020:00080000:2.0:1713279306.687142:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800960e8b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880122249240 00000020:00080000:2.0:1713279306.687144:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].646 00000020:00080000:2.0:1713279306.687146:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800960e8d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009e685000 00000020:00080000:2.0:1713279306.687148:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].161 00010000:00010000:0.0:1713279306.687152:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.687157:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00000004:00080000:2.0:1713279306.687161:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183366 committed transno 4295183547 00010000:00010000:0.0:1713279306.687162:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00000020:00080000:2.0:1713279306.687164:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880122249840 refcount 2 committed 0 result 0 batchid 16380 00010000:00010000:0.0:1713279306.687166:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091805440 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:2.0:1713279306.687166:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800960e8900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880122249600 00000020:00080000:2.0:1713279306.687168:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].647 00010000:00010000:0.0:1713279306.687169:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00000020:00080000:2.0:1713279306.687170:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800960e8600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800980db000 00000020:00080000:2.0:1713279306.687172:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].162 00010000:00010000:0.0:1713279306.687174:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.687180:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75c9:0x0].0x0 (ffff88008eb9f100) 00010000:00010000:0.0:1713279306.687182:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00000004:00080000:2.0:1713279306.687182:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183368 committed transno 4295183547 00000020:00080000:2.0:1713279306.687184:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880122249180 refcount 2 committed 0 result 0 batchid 16381 00010000:00010000:0.0:1713279306.687185:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00000020:00080000:2.0:1713279306.687186:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008f653900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880122249000 00000020:00080000:2.0:1713279306.687188:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].648 00010000:00010000:0.0:1713279306.687189:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda6376 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x75c9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00000020:00080000:2.0:1713279306.687190:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800960e8e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008be4b400 00000020:00080000:2.0:1713279306.687192:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].163 00010000:00010000:0.0:1713279306.687199:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda6536 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00000004:00080000:2.0:1713279306.687202:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183371 committed transno 4295183547 00010000:00010000:0.0:1713279306.687204:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda6536 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x76d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00000020:00080000:2.0:1713279306.687204:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008fdf7540 refcount 2 committed 0 result 0 batchid 16382 00000020:00080000:2.0:1713279306.687206:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880129b60200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800900af480 00010000:00010000:0.0:1713279306.687209:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda6536 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00000020:00080000:2.0:1713279306.687209:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].649 00000020:00080000:2.0:1713279306.687211:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880129b60a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880098d34000 00010000:00010000:0.0:1713279306.687213:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec480 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:2.0:1713279306.687213:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].164 00010000:00010000:0.0:1713279306.687215:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda6536 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.687220:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda6536 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x76d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00000004:00080000:2.0:1713279306.687223:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183372 committed transno 4295183547 00010000:00010000:0.0:1713279306.687226:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76d9:0x0].0x0 (ffff88012cfc6900) 00000020:00080000:2.0:1713279306.687226:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880135eb0d80 refcount 2 committed 0 result 0 batchid 16383 00010000:00010000:0.0:1713279306.687228:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:2.0:1713279306.687228:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880092193800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880135eb0540 00010000:00010000:0.0:1713279306.687229:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda6536 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x76d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000020:00080000:2.0:1713279306.687230:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].650 00010000:00010000:0.0:1713279306.687232:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda6536 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x76d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000020:00080000:2.0:1713279306.687233:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008ad67800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880130722a00 00000020:00080000:2.0:1713279306.687235:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].165 00010000:00010000:0.0:1713279306.687240:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda6567 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7509:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.687243:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda6567 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x7509:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000004:00080000:2.0:1713279306.687244:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183376 committed transno 4295183547 00010000:00010000:0.0:1713279306.687246:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda6567 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7509:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000020:00080000:2.0:1713279306.687247:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880122249b40 refcount 2 committed 0 result 0 batchid 16384 00010000:00010000:0.0:1713279306.687249:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd73c0 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:2.0:1713279306.687249:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880090aa0500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880122249780 00010000:00010000:0.0:1713279306.687250:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda6567 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7509:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000020:00080000:2.0:1713279306.687251:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].651 00010000:00010000:0.0:1713279306.687253:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda6567 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x7509:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00000020:00080000:2.0:1713279306.687253:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880090aa0000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009e685000 00000020:00080000:2.0:1713279306.687256:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].166 00010000:00010000:0.0:1713279306.687257:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7509:0x0].0x0 (ffff88008d729400) 00010000:00010000:0.0:1713279306.687258:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.687259:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda6567 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x7509:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.687262:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda6567 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x7509:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000004:00080000:2.0:1713279306.687265:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183377 committed transno 4295183547 00000020:00080000:2.0:1713279306.687268:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880097b62180 refcount 2 committed 0 result 0 batchid 16385 00010000:00010000:0.0:1713279306.687270:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda685b lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000020:00080000:2.0:1713279306.687270:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880122e5f900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880129ced240 00010000:00010000:0.0:1713279306.687272:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda685b lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000020:00080000:2.0:1713279306.687273:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].652 00000020:00080000:2.0:1713279306.687274:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880122e5f600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012ff96e00 00010000:00010000:0.0:1713279306.687275:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda685b lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.687277:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4b40 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:2.0:1713279306.687277:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].167 00010000:00010000:0.0:1713279306.687279:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda685b lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.687281:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda685b lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.687285:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3231 (ffff8800937ce400) 00010000:00010000:0.0:1713279306.687287:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:2.0:1713279306.687287:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183378 committed transno 4295183547 00010000:00010000:0.0:1713279306.687288:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda685b lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x20b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000020:00080000:2.0:1713279306.687289:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880096190240 refcount 2 committed 0 result 0 batchid 16386 00010000:00010000:0.0:1713279306.687290:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda685b lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x20b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000020:00080000:2.0:1713279306.687291:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880136671300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880096190cc0 00000020:00080000:2.0:1713279306.687293:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].653 00000020:00080000:2.0:1713279306.687295:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880136671700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800922c7000 00000020:00080000:2.0:1713279306.687297:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].168 00010000:00010000:3.0:1713279306.687299:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda59b3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.687300:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda6949 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.687303:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda6949 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x76dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.687305:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda6949 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.687305:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda59b3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.687308:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4fc0 already unused, calling callback (ffffffffa0f0d730) 00000004:00080000:2.0:1713279306.687308:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183379 committed transno 4295183547 00010000:00010000:3.0:1713279306.687309:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800943f3600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.687310:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda6949 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000020:00080000:2.0:1713279306.687310:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009e7ab900 refcount 2 committed 0 result 0 batchid 16387 00010000:00010000:3.0:1713279306.687311:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda59b3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.687312:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda6949 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x76dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00000020:00080000:2.0:1713279306.687312:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008c64cb00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88009e7ab600 00000020:00080000:2.0:1713279306.687315:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].654 00010000:00010000:0.0:1713279306.687316:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76dd:0x0].0x0 (ffff880097910700) 00010000:00010000:3.0:1713279306.687316:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda59b3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.687317:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:2.0:1713279306.687317:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096fbb500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012c37d000 00010000:00010000:0.0:1713279306.687318:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda6949 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x76dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000020:00080000:2.0:1713279306.687319:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].169 00010000:00010000:0.0:1713279306.687321:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda6949 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x76dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.687321:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880131204d00) 00010000:00010000:3.0:1713279306.687323:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.687325:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda59b3 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.687327:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda6ae6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x757a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.687329:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda59b3 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.687330:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda6ae6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x757a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000004:00080000:2.0:1713279306.687330:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183382 committed transno 4295183547 00000020:00080000:2.0:1713279306.687332:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800929bd180 refcount 2 committed 0 result 0 batchid 16388 00010000:00010000:0.0:1713279306.687333:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda6ae6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x757a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.687335:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b61c0 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:2.0:1713279306.687335:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011f2c2100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88009606c000 00010000:00010000:0.0:1713279306.687336:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda6ae6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x757a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000020:00080000:2.0:1713279306.687337:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].655 00010000:00010000:3.0:1713279306.687338:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda59c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.687339:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda6ae6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x757a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000020:00080000:2.0:1713279306.687339:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008a21e200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880097df3800 00000020:00080000:2.0:1713279306.687341:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].170 00010000:00010000:0.0:1713279306.687343:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x757a:0x0].0x3031 (ffff880089dc2100) 00010000:00010000:0.0:1713279306.687344:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.687344:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda59c1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.687345:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda6ae6 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x757a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.687348:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda6ae6 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x757a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.687348:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda59c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00000004:00080000:2.0:1713279306.687351:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183383 committed transno 4295183547 00010000:00010000:3.0:1713279306.687351:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d9806c0 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:2.0:1713279306.687353:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800917f26c0 refcount 2 committed 0 result 0 batchid 16389 00010000:00010000:3.0:1713279306.687354:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda59c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.687356:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb600/0xfc4b8e114eda6b8e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000020:00080000:2.0:1713279306.687356:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012cfc6a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800917f23c0 00010000:00010000:0.0:1713279306.687358:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb600/0xfc4b8e114eda6b8e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x76df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000020:00080000:2.0:1713279306.687358:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].656 00010000:00010000:3.0:1713279306.687358:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda59c1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00000020:00080000:2.0:1713279306.687360:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012cfc6800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008fc8c400 00010000:00010000:0.0:1713279306.687361:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb600/0xfc4b8e114eda6b8e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000020:00080000:2.0:1713279306.687362:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].171 00010000:00010000:0.0:1713279306.687363:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906eb600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.687365:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb600/0xfc4b8e114eda6b8e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.687376:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff880131204f00) 00010000:00010000:0.0:1713279306.687377:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb600/0xfc4b8e114eda6b8e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x76df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.687377:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.687379:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda59c1 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.687381:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76df:0x0].0x0 (ffff88008eb46200) 00010000:00010000:0.0:1713279306.687382:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.687383:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb600/0xfc4b8e114eda6b8e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x76df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.687383:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda59c1 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00000004:00080000:2.0:1713279306.687384:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183396 committed transno 4295183547 00010000:00010000:0.0:1713279306.687385:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb600/0xfc4b8e114eda6b8e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x76df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000020:00080000:2.0:1713279306.687387:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880123727cc0 refcount 2 committed 0 result 0 batchid 16390 00000020:00080000:2.0:1713279306.687389:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880123701a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880097df83c0 00010000:00010000:0.0:1713279306.687390:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda6cb4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00000020:00080000:2.0:1713279306.687391:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].657 00000020:00080000:2.0:1713279306.687392:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880123701500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012e93de00 00010000:00010000:0.0:1713279306.687393:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda6cb4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.687393:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980900/0xfc4b8e114eda59c8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7443:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.687395:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda6cb4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000020:00080000:2.0:1713279306.687395:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].172 00010000:00010000:3.0:1713279306.687397:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980900/0xfc4b8e114eda59c8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x7443:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.687398:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e6886c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.687399:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda6cb4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.687401:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda6cb4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.687402:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980900/0xfc4b8e114eda59c8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7443:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.687405:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76d4:0x0].0x0 (ffff88011eea5600) 00010000:00010000:0.0:1713279306.687406:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:2.0:1713279306.687406:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183399 committed transno 4295183547 00010000:00010000:3.0:1713279306.687406:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.687407:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda6cb4 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000020:00080000:2.0:1713279306.687408:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012f003b40 refcount 2 committed 0 result 0 batchid 16391 00010000:00010000:3.0:1713279306.687408:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980900/0xfc4b8e114eda59c8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7443:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.687410:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda6cb4 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x76d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000020:00080000:2.0:1713279306.687410:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880090bee800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f0033c0 00000020:00080000:2.0:1713279306.687428:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].658 00010000:00010000:3.0:1713279306.687428:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980900/0xfc4b8e114eda59c8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x7443:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00000020:00080000:2.0:1713279306.687430:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800940f8200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012e93da00 00000020:00080000:2.0:1713279306.687433:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].173 00010000:00010000:3.0:1713279306.687435:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7443:0x0].0x0 (ffff88008bde0b00) 00010000:00010000:3.0:1713279306.687436:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1713279306.687438:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980900/0xfc4b8e114eda59c8 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x7443:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713279306.687443:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980900/0xfc4b8e114eda59c8 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x7443:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00000004:00080000:2.0:1713279306.687446:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183411 committed transno 4295183547 00000020:00080000:2.0:1713279306.687448:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880123727900 refcount 2 committed 0 result 0 batchid 16392 00000020:00080000:2.0:1713279306.687450:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880091d49500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880097df8180 00000020:00080000:2.0:1713279306.687453:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].659 00010000:00010000:3.0:1713279306.687453:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda5ca7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00000020:00080000:2.0:1713279306.687455:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880091d49b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800944ab400 00000020:00080000:2.0:1713279306.687457:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].174 00010000:00010000:3.0:1713279306.687459:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda5ca7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.687463:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda5ca7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00000004:00080000:2.0:1713279306.687467:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183412 committed transno 4295183547 00010000:00010000:3.0:1713279306.687467:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298edb00 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:2.0:1713279306.687469:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008ca450c0 refcount 2 committed 0 result 0 batchid 16393 00010000:00010000:3.0:1713279306.687469:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda5ca7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00000020:00080000:2.0:1713279306.687472:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007fdcae00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008e4a2480 00000020:00080000:2.0:1713279306.687474:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].660 00010000:00010000:3.0:1713279306.687474:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda5ca7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00000020:00080000:2.0:1713279306.687476:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011eea5d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008fc75400 00000020:00080000:2.0:1713279306.687478:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].175 00010000:00010000:3.0:1713279306.687480:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x245:0x0].0x39 (ffff88008a641600) 00000100:00100000:0.0:1713279306.687483:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200016960:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1713279306.687492:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.687494:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda5ca7 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x245:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.687498:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda5ca7 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x245:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00000004:00080000:2.0:1713279306.687499:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183430 committed transno 4295183547 00000020:00080000:2.0:1713279306.687502:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008f4ba000 refcount 2 committed 0 result 0 batchid 16394 00000100:00100000:0.0:1713279306.687503:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200017344:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:2.0:1713279306.687503:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011eea4b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008f549480 00000020:00080000:2.0:1713279306.687505:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].661 00010000:00010000:3.0:1713279306.687506:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda5cae lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x796d:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00000100:00100000:0.0:1713279306.687507:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200017152:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:2.0:1713279306.687507:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880092139200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880096590400 00000020:00080000:2.0:1713279306.687510:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].176 00010000:00010000:3.0:1713279306.687511:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda5cae lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x796d:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.687515:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda5cae lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x796d:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.687519:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ecb40 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.687520:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784866 00010000:00010000:3.0:1713279306.687521:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda5cae lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x796d:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00000004:00080000:2.0:1713279306.687522:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183431 committed transno 4295183547 00000100:00100000:0.0:1713279306.687524:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3739:11642:x1796503281166720:12345-192.168.203.4@tcp:101:touch.0 00000020:00080000:2.0:1713279306.687524:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880123a15000 refcount 2 committed 0 result 0 batchid 16395 00000020:00080000:2.0:1713279306.687526:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011eea4a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008ca45000 00010000:00010000:3.0:1713279306.687526:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda5cae lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x796d:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00000020:00080000:2.0:1713279306.687529:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].662 00010000:00010000:0.0:1713279306.687531:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00080000:2.0:1713279306.687531:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011eea4100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009810d400 00010000:00010000:3.0:1713279306.687532:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x796d:0x0].0x0 (ffff8800934f8e00) 00000020:00080000:2.0:1713279306.687533:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].177 00010000:00010000:3.0:1713279306.687533:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1713279306.687535:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda5cae lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x796d:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.687537:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983a80/0xfc4b8e114eda6e3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x847f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175223 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.687539:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda5cae lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x796d:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.687546:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda5ee5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279306.687550:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda5ee5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.687553:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983a80/0xfc4b8e114eda6e3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x847f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175223 expref: 3740 pid: 15482 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.687553:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183460 committed transno 4295183547 00000020:00080000:2.0:1713279306.687555:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008c199780 refcount 2 committed 0 result 0 batchid 16396 00010000:00010000:3.0:1713279306.687555:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda5ee5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.687558:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983a80/0xfc4b8e114eda6e3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x847f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175223 expref: 3740 pid: 15482 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1713279306.687558:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007fcb8900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800968ddc00 00010000:00010000:3.0:1713279306.687559:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133315b00 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:2.0:1713279306.687560:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].663 00000020:00080000:2.0:1713279306.687562:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007fcb8300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800980dc400 00010000:00010000:3.0:1713279306.687562:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda5ee5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00000020:00080000:2.0:1713279306.687564:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].178 00010000:00010000:0.0:1713279306.687565:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x847f:0x0].0x0 (ffff88008d729200) 00010000:00010000:0.0:1713279306.687566:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713279306.687566:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda5ee5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.687567:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d983a80, rc 0) 00010000:00010000:3.0:1713279306.687571:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x3231 (ffff880090a56800) 00010000:00010000:3.0:1713279306.687573:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:2.0:1713279306.687575:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183461 committed transno 4295183547 00010000:00010000:3.0:1713279306.687575:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda5ee5 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00000020:00080000:2.0:1713279306.687578:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880096190300 refcount 2 committed 0 result 0 batchid 16397 00000100:00100000:0.0:1713279306.687579:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3740:11642:x1796503281166720:12345-192.168.203.4@tcp:101:touch.0 Request processed in 55us (1632us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.687579:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda5ee5 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00000020:00080000:2.0:1713279306.687580:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007fcb8500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880096e073c0 00000020:00080000:2.0:1713279306.687582:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].664 00000100:00100000:0.0:1713279306.687583:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784866 00000020:00080000:2.0:1713279306.687584:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007fcb8c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d644200 00000020:00080000:2.0:1713279306.687586:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].179 00010000:00010000:3.0:1713279306.687590:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda5ef3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00000100:00100000:0.0:1713279306.687592:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784867 00000100:00100000:0.0:1713279306.687594:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3370:11796:x1796503281167360:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:3.0:1713279306.687594:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda5ef3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00000004:00080000:2.0:1713279306.687595:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183466 committed transno 4295183547 00000020:00080000:2.0:1713279306.687597:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880096f77540 refcount 2 committed 0 result 0 batchid 16398 00000020:00080000:2.0:1713279306.687599:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012fbfe200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880096f77f00 00010000:00010000:3.0:1713279306.687599:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda5ef3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00000020:00080000:2.0:1713279306.687602:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].665 00010000:00010000:3.0:1713279306.687603:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800902ab840 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:2.0:1713279306.687604:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012fbfee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800942cf400 00010000:00010000:0.0:1713279306.687605:0:15482:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1713279306.687605:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda5ef3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00000020:00080000:2.0:1713279306.687606:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].180 00010000:00010000:3.0:1713279306.687610:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda5ef3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.687612:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114eda6e2e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7ac4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917520e expref: 3370 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.687615:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3231 (ffff880090a56900) 00000004:00080000:2.0:1713279306.687616:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183467 committed transno 4295183547 00010000:00010000:3.0:1713279306.687616:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.687618:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda5ef3 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00000020:00080000:2.0:1713279306.687619:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88011f137180 refcount 2 committed 0 result 0 batchid 16399 00010000:00010000:0.0:1713279306.687620:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114ed88e53 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7ac4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c5dd expref: 3369 pid: 15657 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1713279306.687621:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012bacd400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008f4bad80 00000020:00080000:2.0:1713279306.687623:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].666 00010000:00010000:3.0:1713279306.687623:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda5ef3 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.687624:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ac4:0x0].0x0 (ffff88007f389900) 00000020:00080000:2.0:1713279306.687625:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008c124600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880122ed0200 00010000:00010000:0.0:1713279306.687627:0:15482:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:2.0:1713279306.687627:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].181 00010000:00010000:3.0:1713279306.687631:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda5f01 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7b39:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.687633:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114eda6e43 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7ac4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.687635:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda5f01 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7b39:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00000004:00080000:2.0:1713279306.687636:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183468 committed transno 4295183547 00010000:00010000:0.0:1713279306.687637:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114eda6e43 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7ac4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000020:00080000:2.0:1713279306.687639:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8801360c70c0 refcount 2 committed 0 result 0 batchid 16400 00010000:00010000:3.0:1713279306.687640:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda5f01 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7b39:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.687641:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114eda6e43 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7ac4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000020:00080000:2.0:1713279306.687641:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012d397500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008c1996c0 00000020:00080000:2.0:1713279306.687643:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].667 00000020:00080000:2.0:1713279306.687645:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012cfc6c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880093405000 00000020:00080000:2.0:1713279306.687647:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].182 00010000:00010000:3.0:1713279306.687647:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935beac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.687648:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.687650:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda5f01 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7b39:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.687652:0:15482:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114ed88afd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c4b0 expref: 3368 pid: 8637 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.687654:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda5f01 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7b39:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.687656:0:15482:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000004:00080000:2.0:1713279306.687658:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183470 committed transno 4295183547 00010000:00010000:3.0:1713279306.687659:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b39:0x0].0x0 (ffff880090a56a00) 00000020:00080000:2.0:1713279306.687660:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88011ed0e0c0 refcount 2 committed 0 result 0 batchid 16401 00010000:00010000:3.0:1713279306.687661:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000020:00080000:2.0:1713279306.687662:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880092a4c300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88011ed0e780 00010000:00010000:3.0:1713279306.687663:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda5f01 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7b39:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.687665:0:15482:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114ed88afd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c4b0 expref: 3368 pid: 8637 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1713279306.687665:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].668 00000020:00080000:2.0:1713279306.687667:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880092a4c500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012fa4a600 00010000:00010000:3.0:1713279306.687667:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda5f01 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7b39:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00000020:00080000:2.0:1713279306.687669:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].183 00010000:00010000:0.0:1713279306.687671:0:15482:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114ed88afd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c4b0 expref: 3368 pid: 8637 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.687678:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda6314 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00000004:00080000:2.0:1713279306.687679:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183471 committed transno 4295183547 00000100:00100000:0.0:1713279306.687680:0:15482:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0001_UUID:15482:1796503200018048:192.168.203.4@tcp:104: 00000020:00080000:2.0:1713279306.687682:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880136a3f240 refcount 2 committed 0 result 0 batchid 16402 00010000:00010000:3.0:1713279306.687683:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda6314 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00000020:00080000:2.0:1713279306.687684:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880093401d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800959c23c0 00000020:00080000:2.0:1713279306.687686:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].669 00000020:00080000:2.0:1713279306.687688:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880094169700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880093404c00 00010000:00010000:3.0:1713279306.687688:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda6314 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00000020:00080000:2.0:1713279306.687701:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].184 00010000:00010000:3.0:1713279306.687702:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f298c0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.687704:0:15482:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d8240 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.687704:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda6314 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279306.687708:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda6314 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00000004:00080000:2.0:1713279306.687711:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183480 committed transno 4295183547 00000020:00080000:2.0:1713279306.687713:0:8634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880120671a80 refcount 2 committed 0 result 0 batchid 16403 00010000:00010000:3.0:1713279306.687713:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x245:0x0].0x3931 (ffff880097a5f200) 00000100:00100000:0.0:1713279306.687715:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784868 00000020:00080000:2.0:1713279306.687715:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096eff800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880120671240 00010000:00010000:3.0:1713279306.687715:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.687717:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda6314 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x245:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00000100:00100000:0.0:1713279306.687718:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3739:11809:x1796503281167424:12345-192.168.203.4@tcp:101:lfs.0 00000020:00080000:2.0:1713279306.687718:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].670 00000020:00080000:2.0:1713279306.687720:0:8634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096fbbf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008c6fc400 00000020:00080000:2.0:1713279306.687722:0:8634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].185 00010000:00010000:3.0:1713279306.687722:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda6314 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x245:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.687723:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.687728:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114eda6e51 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x246:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917523f expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.687730:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda631b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6f79:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279306.687734:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda631b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x6f79:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279306.687738:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda631b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6f79:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00000004:00080000:2.0:1713279306.687740:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183543 committed transno 4295183547 00010000:00010000:3.0:1713279306.687742:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f286c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.687744:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda6e58 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x246:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.687744:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda631b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6f79:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.687748:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda6e58 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x246:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.687749:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda631b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x6f79:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00000004:00080000:2.0:1713279306.687751:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183544 committed transno 4295183547 00010000:00010000:0.0:1713279306.687752:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda6e58 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x246:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.687754:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6f79:0x0].0x0 (ffff88007f389d00) 00010000:00010000:3.0:1713279306.687756:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1713279306.687758:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda631b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x6f79:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279306.687762:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda631b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x6f79:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00000004:00080000:2.0:1713279306.687764:0:8634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183547 committed transno 4295183547 00000004:00200000:0.0:1713279306.687767:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x246:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.687769:0:15749:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1713279306.687769:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114eda65e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:3.0:1713279306.687774:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114eda65e5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.687778:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114eda6e51 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x246:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917523f expref: 3741 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.687778:0:8634:0:(client.c:2997:ptlrpc_free_committed()) @@@ stopping search req@ffff880131cdea00 x1796503200017920/t4295183574(4295183574) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 1713279322 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 00010000:00010000:3.0:1713279306.687779:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114eda65e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:3.0:1713279306.687783:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf5d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.687785:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda6e58 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x246:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917523f expref: 3740 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.687786:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114eda65e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.687789:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x246:0x0].0x0 (ffff880089dc2800) 00010000:00010000:0.0:1713279306.687790:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713279306.687790:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114eda65e5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.687792:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bf8dd40, rc 0) 00010000:00010000:3.0:1713279306.687796:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x65656ce3 (ffff88009e5e1200) 00010000:00010000:3.0:1713279306.687799:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.687801:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114eda65e5 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x134:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.687802:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200017920:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713279306.687805:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114eda65e5 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x134:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00000004:00080000:1.0:1713279306.687806:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x261:0x0] 00010000:00010000:3.0:1713279306.687814:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda65ec lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7a5b:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.687827:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281167104 00000100:00100000:2.0:1713279306.687829:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281167104 00010000:00010000:3.0:1713279306.687829:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda65ec lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7a5b:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.687830:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ba9200/0xfc4b8e114eda6e5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x261:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.687834:0:15525:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ba9200/0xfc4b8e114eda6e5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x261:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.687834:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda65ec lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7a5b:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:3.0:1713279306.687838:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d507cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.687839:0:15525:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ba9200/0xfc4b8e114eda6e5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x261:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.687840:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda65ec lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7a5b:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.687842:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222955 00010000:00010000:3.0:1713279306.687845:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda65ec lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7a5b:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT1 00000100:00100000:1.0:1713279306.687846:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f1d4e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200018112:0@lo:101:mdt_io00_009.0 00000100:00100000:2.0:1713279306.687846:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3639:11708:x1796503281167104:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:3.0:1713279306.687852:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7a5b:0x0].0x0 (ffff8800908e1800) 00010000:00010000:3.0:1713279306.687854:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1713279306.687857:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda65ec lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7a5b:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00000100:00100000:1.0:1713279306.687860:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.687861:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda65ec lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7a5b:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00000100:00100000:1.0:1713279306.687867:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fe40 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.687869:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114eda6988 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.687873:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114eda6988 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00000020:00080000:1.0:1713279306.687875:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 16403 committed batchid 16373 00010000:00010000:3.0:1713279306.687878:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114eda6988 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.687882:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320900 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:1.0:1713279306.687884:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16373 00010000:00010000:3.0:1713279306.687884:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114eda6988 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279306.687889:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200018112 00010000:00010000:3.0:1713279306.687889:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114eda6988 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279306.687891:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200018112 00000100:00100000:0.0:1713279306.687892:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3740:11809:x1796503281167424:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 84us (1026us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.687895:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x3531 (ffff880092ae7100) 00000100:00100000:0.0:1713279306.687897:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784868 00010000:00010000:3.0:1713279306.687897:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.687899:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114eda6988 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279306.687900:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98628 00000100:00100000:1.0:1713279306.687903:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+88:15525:x1796503200018112:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713279306.687903:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114eda6988 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279306.687905:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3640:11708:x1796503281167104:12345-192.168.203.4@tcp:35:touch.0 Request processed in 58us (1206us total) trans 4295183575 rc 0/0 00010000:00010000:1.0:1713279306.687911:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.687911:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222955 00010000:00010000:3.0:1713279306.687913:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322d00/0xfc4b8e114eda699d lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.687917:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114eda6e66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x261:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda6e5f expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.687918:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322d00/0xfc4b8e114eda699d lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.687922:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322d00/0xfc4b8e114eda699d lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.687926:0:15494:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114eda6e66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x261:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda6e5f expref: 89 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.687926:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d322d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.687940:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322d00/0xfc4b8e114eda699d lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.687945:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322d00/0xfc4b8e114eda699d lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.687947:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114eda6e66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x261:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda6e5f expref: 89 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.687951:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x38 (ffff8800937ce800) 00010000:00010000:3.0:1713279306.687951:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3531 (ffff88012bacd500) 00010000:00010000:1.0:1713279306.687952:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.687954:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba98c0, rc 0) 00000100:00100000:2.0:1713279306.687954:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:13168:x1796503281166656:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 1988us (2028us total) trans 4295202580 rc 0/0 00010000:00010000:3.0:1713279306.687954:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.687956:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322d00/0xfc4b8e114eda699d lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279306.687959:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222954 00010000:00010000:3.0:1713279306.687961:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322d00/0xfc4b8e114eda699d lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279306.687969:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+89:15525:x1796503200018112:12345-0@lo:101:mdt_io00_009.0 Request processed in 65us (108us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.687969:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114eda69a4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7b82:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279306.687972:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98628 00010000:00010000:3.0:1713279306.687974:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114eda69a4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7b82:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00000100:00100000:0.0:1713279306.687979:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f1d4e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200018112:0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713279306.687979:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114eda69a4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7b82:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.687982:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d322400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.687984:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114eda69a4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7b82:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.687988:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ba9200/0xfc4b8e114eda6e5f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x261:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda6e66 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.687989:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114eda69a4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7b82:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.687994:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b82:0x0].0x0 (ffff88012fbfe500) 00010000:00010000:0.0:1713279306.687995:0:15525:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ba9200/0xfc4b8e114eda6e5f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x261:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda6e66 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.687996:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1713279306.687998:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114eda69a4 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7b82:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279306.688002:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.688002:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114eda69a4 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7b82:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000004:00080000:0.0:1713279306.688007:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x261:0x0] 00010000:00010000:3.0:1713279306.688011:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda69c7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.688016:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda69c7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.688018:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801349258c0/0xfc4b8e114eda6e6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.688020:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda69c7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.688024:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.688025:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801349258c0/0xfc4b8e114eda6e6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.688026:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda69c7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.688031:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801349258c0/0xfc4b8e114eda6e6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.688031:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda69c7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.688037:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76da:0x0].0x0 (ffff88012fbfef00) 00010000:00010000:3.0:1713279306.688039:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.688040:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda6e74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x139:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.688041:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda69c7 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279306.688042:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.688045:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda6e74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x139:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.688046:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda69c7 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.688048:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda6e74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x139:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.688054:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281167616 00000100:00100000:1.0:1713279306.688056:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281167616 00010000:00010000:3.0:1713279306.688056:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda69dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279306.688060:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.688061:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda69dc lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.688065:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda69dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.688066:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114eda6e7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x7de3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.688081:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281166848 00000100:00100000:1.0:1713279306.688082:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281166848 00010000:00010000:3.0:1713279306.688083:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800929098c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.688084:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114eda6e7b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7de3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.688086:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda69dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.688088:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114eda6e7b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7de3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.688091:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.688091:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda69dc lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279306.688095:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281166976 00000100:00100000:1.0:1713279306.688097:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281166976 00010000:00010000:3.0:1713279306.688097:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25c:0x0].0x0 (ffff88011eea5300) 00010000:00010000:3.0:1713279306.688099:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.688101:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281167552 00010000:00010000:3.0:1713279306.688101:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda69dc lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279306.688102:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281167552 00000100:00100000:2.0:1713279306.688106:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784869 00010000:00010000:3.0:1713279306.688106:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda69dc lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279306.688111:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3366:11813:x1796503281167616:12345-192.168.203.4@tcp:36:mkdir.0 00000100:00100000:0.0:1713279306.688112:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4d180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200018176:0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713279306.688113:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114eda69d5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279306.688117:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784870 00010000:00010000:3.0:1713279306.688117:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114eda69d5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279306.688120:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3641:11711:x1796503281166848:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.688122:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114eda69d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.688126:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.688126:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092920240 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.688128:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.688128:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114eda69d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.688132:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda6e82 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917522a expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.688132:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114eda69d5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00000100:00100000:0.0:1713279306.688137:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d89c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.688138:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x262:0x0].0x0 (ffff88012fbfed00) 00010000:00010000:3.0:1713279306.688140:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.688142:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114eda69d5 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.688146:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114eda69d5 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000100:00100000:0.0:1713279306.688147:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784871 00000100:00100000:0.0:1713279306.688151:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3642:11824:x1796503281166976:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.688155:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda6bf0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.688156:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda6e89 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.688157:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.688159:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda6bf0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.688161:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda6e89 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.688162:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086f40/0xfc4b8e114eda6e90 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175231 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.688164:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda6bf0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.688167:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda6e89 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713279306.688168:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3365:11813:x1796503281167616:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 57us (166us total) trans 0 rc -17/-17 00010000:00010000:3.0:1713279306.688168:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.688170:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda6bf0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.688173:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8480/0xfc4b8e114eda6e97 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713279306.688174:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784869 00010000:00010000:3.0:1713279306.688175:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda6bf0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x245:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.688176:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8480/0xfc4b8e114eda6e97 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.688179:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8480/0xfc4b8e114eda6e97 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.688181:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x245:0x0].0x3032 (ffff88012d067200) 00010000:00010000:3.0:1713279306.688183:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.688185:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784872 00010000:00010000:3.0:1713279306.688185:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda6bf0 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x245:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00000100:00100000:2.0:1713279306.688189:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3740:11737:x1796503281167552:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.688193:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.688194:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda6e89 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.688194:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda6bf0 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x245:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.688195:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.688197:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda6e89 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.688199:0:15484:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda38dc lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917443f expref: 3643 pid: 15489 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.688201:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda6e89 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.688202:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008957c900/0xfc4b8e114eda6ea5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175246 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.688203:0:15484:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda571a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c0a expref: 3364 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.688203:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.688204:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda6e89 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.688206:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.688207:0:15484:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 5/0,1 mode: --/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.688208:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda6e89 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.688208:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.688211:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda6e89 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.688213:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.688215:0:15484:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda571a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c0a expref: 3364 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.688215:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88009606b800) 00010000:00010000:1.0:1713279306.688216:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.688217:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.688219:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda6e89 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.688220:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.688222:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda6e89 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.688223:0:15484:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda571a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c0a expref: 3364 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.688224:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.688227:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8480/0xfc4b8e114eda6e97 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713279306.688229:0:15484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001_UUID:15484:1796503200018240:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.688230:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8480/0xfc4b8e114eda6e97 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.688230:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda6eac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.688230:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7a1c:0x0].0x0 (ffff8800908e1d00) 00010000:00010000:3.0:1713279306.688232:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1713279306.688233:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8480/0xfc4b8e114eda6e97 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.688235:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.688236:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.688237:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8480/0xfc4b8e114eda6e97 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.688237:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda6eac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.688239:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e1c0/0xfc4b8e114eda6bf7 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7a1c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.688240:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8480/0xfc4b8e114eda6e97 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.688243:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88009bf9a000) 00010000:00010000:2.0:1713279306.688243:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda6eac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.688244:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.688245:0:15484:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda38dc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917443f expref: 3643 pid: 15489 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.688245:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8480/0xfc4b8e114eda6e97 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.688248:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8480/0xfc4b8e114eda6e97 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.688249:0:15484:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda38dc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917443f expref: 3643 pid: 15489 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.688252:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda6eb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713279306.688254:0:15484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001_UUID:15484:1796503200018304:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.688257:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.688258:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda6eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713279306.688260:0:15484:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c2fb9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.688260:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda6e82 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917522a expref: 3643 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.688263:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda6eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.688264:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda6e82 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917522a expref: 3643 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.688264:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114eda6eba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917521c expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.688270:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baba80, rc 0) 00000100:00100000:1.0:1713279306.688284:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3642:11711:x1796503281166848:12345-192.168.203.4@tcp:101:touch.0 Request processed in 163us (242us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.688288:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784870 00010000:00010000:3.0:1713279306.688289:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6ec1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.688296:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.688299:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200018176 00000100:00100000:1.0:1713279306.688301:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200018176 00010000:00010000:3.0:1713279306.688302:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.688310:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98629 00010000:00010000:3.0:1713279306.688311:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda6ec8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.688312:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+89:15525:x1796503200018176:12345-0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713279306.688316:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda6ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00000004:00200000:2.0:1713279306.688318:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x863c:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.688321:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda6ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.688344:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda6eac lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.688350:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda6eac lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.688355:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda6eac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.688358:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+89:15525:x1796503200018176:12345-0@lo:1000:mdt_io00_009.0 Request processed in 44us (229us total) trans 0 rc -2/-2 00010000:00010000:2.0:1713279306.688359:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda6eac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.688361:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98629 00000100:00100000:0.0:1713279306.688363:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4d180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200018176:0@lo:1000:mdt_io00_009.0 00010000:00010000:2.0:1713279306.688364:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.688366:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda6eac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000004:00200000:3.0:1713279306.688367:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x8179:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.688372:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda6eac lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.688379:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:2.0:1713279306.688381:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.688382:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4d180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200018368:0@lo:1000:mdt_io00_009.0 00010000:00010000:2.0:1713279306.688383:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda6eac lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.688388:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda6eac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.688388:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6ec1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.688393:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6ec1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.688394:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.688396:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda6eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.688398:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.688401:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d89c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.688401:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda6eb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.688403:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6ec1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.688404:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200018368 00010000:00010000:2.0:1713279306.688406:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda6eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.688406:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013585cd80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.688407:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200018368 00010000:00010000:3.0:1713279306.688409:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6ec1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.688410:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd61c0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.688428:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98630 00010000:00010000:2.0:1713279306.688428:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda6eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.688430:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6ec1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.688431:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+89:15525:x1796503200018368:12345-0@lo:1000:mdt_io00_009.0 00010000:00010000:2.0:1713279306.688432:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda6eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.688438:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3131 (ffff88007f23d400) 00010000:00010000:2.0:1713279306.688440:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.688441:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:2.0:1713279306.688442:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda6eb3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.688443:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.688445:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6ec1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.688447:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda6eb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.688450:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda6ec1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.688455:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+89:15525:x1796503200018368:12345-0@lo:1000:mdt_io00_009.0 Request processed in 23us (60us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.688456:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda6ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.688458:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98630 00010000:00010000:3.0:1713279306.688460:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda6ec8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.688465:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda6ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.688468:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4d180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200018368:0@lo:1000:mdt_io00_009.0 00010000:00010000:2.0:1713279306.688468:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008957c900/0xfc4b8e114eda6ea5 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175246 expref: 3744 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.688469:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ce533c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.688471:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda6ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.688476:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008957c900/0xfc4b8e114eda6ea5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175246 expref: 3744 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.688476:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda6ec8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.688482:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3031 (ffff880092a4c700) 00010000:00010000:2.0:1713279306.688483:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008957c900, rc 0) 00010000:00010000:3.0:1713279306.688483:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.688485:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda6ec8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.688489:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda6ec8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.688506:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4d180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200018432:0@lo:1000:mdt_io00_009.0 00000100:00100000:2.0:1713279306.688507:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3743:11737:x1796503281167552:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 317us (417us total) trans 4295202581 rc 301/301 00000100:00100000:2.0:1713279306.688512:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784872 00010000:00010000:3.0:1713279306.688516:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114eda6eba lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917521c expref: 3743 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.688523:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114eda6eba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917521c expref: 3742 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.688530:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023ed00, rc 0) 00000100:00100000:2.0:1713279306.688562:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.688567:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.688575:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281167744 00000100:00100000:2.0:1713279306.688578:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281167744 00000100:00100000:0.0:1713279306.688586:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.688591:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784873 00000100:00100000:2.0:1713279306.688595:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3742:11829:x1796503281167744:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.688596:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200018432 00000100:00100000:1.0:1713279306.688599:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200018432 00010000:00010000:2.0:1713279306.688602:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.688604:0:6929:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:1.0:1713279306.688608:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98631 00000100:00100000:1.0:1713279306.688610:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+89:15525:x1796503200018432:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713279306.688612:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3742:11810:x1796503281166528:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1596us (3020us total) trans 4295202582 rc 301/301 00010000:00010000:2.0:1713279306.688613:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda66e8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175039 expref: 3742 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.688618:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784865 00010000:00010000:2.0:1713279306.688621:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff88012d067400) 00010000:00010000:2.0:1713279306.688626:0:6929:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.688633:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda6edd lrc: 2/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917524d expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.688677:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6640/0xfc4b8e114eda6ee4 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:1.0:1713279306.688683:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+89:15525:x1796503200018432:12345-0@lo:1000:mdt_io00_009.0 Request processed in 72us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.688687:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98631 00010000:00010000:2.0:1713279306.688687:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6640/0xfc4b8e114eda6ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688693:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6640/0xfc4b8e114eda6ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.688699:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4d180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200018432:0@lo:1000:mdt_io00_009.0 00010000:00010000:2.0:1713279306.688700:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda6eeb lrc: 3/1,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688706:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda6eeb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688711:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda6eeb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688733:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda6ef2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7f40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688737:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda6ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688741:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda6ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00000004:00200000:2.0:1713279306.688744:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7f40:0x0]: returning size 0 00010000:00010000:2.0:1713279306.688761:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6640/0xfc4b8e114eda6ee4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688764:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6640/0xfc4b8e114eda6ee4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688767:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6640/0xfc4b8e114eda6ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688770:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6640/0xfc4b8e114eda6ee4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688774:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.688775:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6640/0xfc4b8e114eda6ee4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688778:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6640/0xfc4b8e114eda6ee4 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688782:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff88012514d700) 00010000:00010000:2.0:1713279306.688783:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.688785:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6640/0xfc4b8e114eda6ee4 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688787:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6640/0xfc4b8e114eda6ee4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688792:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda6eeb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688795:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda6eeb lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.688798:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4d180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200018496:0@lo:1000:mdt_io00_009.0 00010000:00010000:2.0:1713279306.688798:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda6eeb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688800:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.688802:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda6eeb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688804:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda6eeb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688807:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x3931 (ffff88012514d600) 00010000:00010000:2.0:1713279306.688808:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.688810:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda6eeb lrc: 2/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.688813:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda6eeb lrc: 0/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.688817:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.688826:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda6edd lrc: 0/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917524d expref: 3743 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.688831:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda6ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917524d expref: 3742 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.688843:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880093a833c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.688846:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f40:0x0].0x0 (ffff88013484f000) 00010000:00010000:2.0:1713279306.688847:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.688848:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd7840, rc 0) 00000100:00100000:1.0:1713279306.688849:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200018496 00000100:00100000:1.0:1713279306.688852:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200018496 00000100:00100000:2.0:1713279306.688860:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3742:11829:x1796503281167744:12345-192.168.203.4@tcp:101:touch.0 Request processed in 265us (299us total) trans 4295202583 rc 0/0 00000100:00100000:2.0:1713279306.688863:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784873 00000100:00100000:1.0:1713279306.688866:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98632 00000100:00100000:1.0:1713279306.688868:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+89:15525:x1796503200018496:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713279306.688898:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+89:15525:x1796503200018496:12345-0@lo:1000:mdt_io00_009.0 Request processed in 29us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.688901:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98632 00000100:00100000:0.0:1713279306.688912:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4d180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200018496:0@lo:1000:mdt_io00_009.0 00000040:00080000:0.0:1713279306.689049:0:15525:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x1b7:0x0].190, 904 off109144 00000040:00080000:0.0:1713279306.689089:0:15525:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0xf2:0x0].675, 984 off477904 00000004:00080000:0.0:1713279306.689093:0:15525:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800a42d8180 with version 29396 00000004:00080000:2.0:1713279306.689106:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29396 rpc_version 29396 00000020:00100000:2.0:1713279306.689118:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.689122:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008acce300 x1796503200018624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1713279306.689130:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008acce300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200018624:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1713279306.689145:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.689159:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98900 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.689171:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200018624 00000100:00100000:1.0:1713279306.689173:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200018624 00000100:00100000:1.0:1713279306.689182:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98633 00000100:00100000:1.0:1713279306.689185:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+89:8634:x1796503200018624:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1713279306.689232:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.689268:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281168128 00000100:00100000:3.0:1713279306.689272:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281168128 00000100:00100000:3.0:1713279306.689286:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784874 00000100:00100000:3.0:1713279306.689291:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3642:11823:x1796503281168128:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.689299:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.689305:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda6f00 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917525b expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.689342:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6f07 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.689349:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6f07 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.689355:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6f07 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.689362:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+90:8634:x1796503200018624:12345-0@lo:1000:osp_up1-0.0 Request processed in 175us (215us total) trans 4295183576 rc 0/0 00010000:00010000:3.0:1713279306.689363:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda6f0e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.689366:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98633 00010000:00010000:3.0:1713279306.689369:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda6f0e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.689374:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda6f0e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:2.0:1713279306.689394:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008acce300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200018624:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1713279306.689426:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x752c:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.689432:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6f07 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.689437:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6f07 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00000004:00010000:0.0:1713279306.689438:0:15525:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008e604a80 reply state ffff880090233000 transno 4295202584 ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114eda6e7b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7de3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.689442:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6f07 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.689446:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6f07 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.689447:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114eda6e7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x7de3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.689449:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091cbc000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.689451:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6f07 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.689453:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7de3:0x0].0x0 (ffff88012d397900) 00010000:00010000:0.0:1713279306.689455:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1713279306.689456:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6f07 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713279306.689457:0:15525:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.689462:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801349258c0/0xfc4b8e114eda6e6d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.689462:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:3.0:1713279306.689463:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.689465:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6f07 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.689467:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801349258c0/0xfc4b8e114eda6e6d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.689469:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda6f07 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.689472:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801349258c0/0xfc4b8e114eda6e6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.689475:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda6f0e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.689477:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801349258c0/0xfc4b8e114eda6e6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.689482:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801349258c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.689483:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda6f0e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.689484:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801349258c0/0xfc4b8e114eda6e6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.689487:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda6f0e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.689490:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801349258c0/0xfc4b8e114eda6e6d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.689490:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68aac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.689492:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda6f0e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.689496:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x0 (ffff880098d56e00) 00010000:00010000:3.0:1713279306.689496:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda6f0e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.689499:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.689501:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801349258c0/0xfc4b8e114eda6e6d lrc: 3/0,0 mode: --/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.689501:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3331 (ffff880092a4c800) 00010000:00010000:3.0:1713279306.689502:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.689504:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda6f0e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.689508:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda6f0e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.689522:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda6f00 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917525b expref: 3643 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.689527:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda6f00 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917525b expref: 3643 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.689533:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d982400, rc 0) 00000100:00100000:3.0:1713279306.689550:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3642:11823:x1796503281168128:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 258us (316us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.689555:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784874 00010000:00010000:0.0:1713279306.689562:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801349258c0/0xfc4b8e114eda6e6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00000004:00010000:0.0:1713279306.689573:0:15525:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008e604a80 reply state ffff880090233000 transno 4295202584 ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda6e74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x139:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.689581:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda6e74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x139:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.689588:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x38 (ffff88009228ef00) 00010000:00010000:0.0:1713279306.689590:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.689592:0:15525:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1713279306.689594:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x261:0x0] 00010000:00010000:0.0:1713279306.689614:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.689621:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.689627:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.689648:0:8071:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713279306.689652:0:8071:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.689657:0:8071:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983840 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:2.0:1713279306.689660:0:8071:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.689664:0:8071:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.689676:0:8071:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 4/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.689679:0:8071:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713279306.689692:0:8071:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.689698:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.689699:0:15525:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1713279306.689700:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.689701:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.689703:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008d983840/0xfc4b8e114eda6da2 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6da9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.689706:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:0.0:1713279306.689712:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x261:0x0] 00000100:00100000:1.0:1713279306.689712:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200018688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.689715:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ba9200/0xfc4b8e114eda6e5f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x261:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda6e66 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.689720:0:15525:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ba9200/0xfc4b8e114eda6e5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x261:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda6e66 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.689727:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.689745:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200018688 00000100:00100000:0.0:1713279306.689748:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200018688 00000100:00100000:3.0:1713279306.689749:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.689763:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147210 00000100:00100000:0.0:1713279306.689765:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+90:3493:x1796503200018688:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.689765:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281168448 00000100:00100000:2.0:1713279306.689768:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281168448 00010000:00010000:0.0:1713279306.689770:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.689776:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda6da9 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda6da2 expref: 90 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.689782:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x0 (ffff88012d067e00) 00000100:00100000:2.0:1713279306.689783:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784875 00010000:00010000:0.0:1713279306.689786:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.689787:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3642:11708:x1796503281168448:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.689795:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.689802:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda6f15 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175262 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.689803:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+89:3493:x1796503200018688:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.689806:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147210 00000100:00100000:1.0:1713279306.689810:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200018688:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.689842:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda6f1c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.689848:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda6f1c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.689855:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda6f1c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.689863:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda6f23 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000004:00080000:0.0:1713279306.689864:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000403:0x76b7:0x0] 00010000:00010000:0.0:1713279306.689868:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda6782 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.689868:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda6f23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.689871:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda6f23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.689872:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda6782 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.689875:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda6782 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.689878:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68a640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.689879:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda6782 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.689885:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda6782 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.689890:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:2.0:1713279306.689890:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda6f2a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x72a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.689891:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.689893:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.689893:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda6f2a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x72a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.689896:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda6f2a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x72a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.689897:0:15525:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.689900:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15507 initiator: MDT0 00000004:00200000:2.0:1713279306.689900:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x72a2:0x0]: returning size 0 00010000:00010000:0.0:1713279306.689904:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114eda69ce lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda69c0 expref: 51 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.689914:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda6782 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.689917:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda6782 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.689919:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda6f1c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.689921:0:15507:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.689922:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda6f1c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.689925:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.689925:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda6f1c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.689928:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda6f1c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.689933:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd58c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.689934:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda6f1c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.689938:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda6f1c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.689942:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88012514d900) 00010000:00010000:2.0:1713279306.689944:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.689946:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda6f1c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713279306.689948:0:15525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:11666:x1796503281152576:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 31083us (31112us total) trans 4295202584 rc 0/0 00010000:00010000:2.0:1713279306.689950:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda6f1c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713279306.689952:0:15525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14316 00010000:00010000:2.0:1713279306.689957:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda6f23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.689961:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda6f23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.689967:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda6f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.689971:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.689973:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda6f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.689978:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114eda6f38 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.689978:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda6f23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.689982:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114eda6f38 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.689984:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3731 (ffff88012514db00) 00010000:00010000:2.0:1713279306.689986:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.689988:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda6f23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.689989:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114eda6f38 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.689993:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda6f23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.689994:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda6f3f lrc: 3/0,1 mode: --/PW res: [0x200000400:0x235:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.689997:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda6f3f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.690001:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda6f3f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.690012:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.690013:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda6f15 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175262 expref: 3645 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.690018:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114ed812c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f24:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a059 expref: 3727 pid: 15477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.690023:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b33600/0xfc4b8e114ed9ff7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f24:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391733c2 expref: 3741 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.690023:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda6f2a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x72a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175262 expref: 3644 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.690027:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda64db lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7f24:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174fbb expref: 3727 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.690028:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x72a2:0x0].0x0 (ffff8800927b4000) 00010000:00010000:2.0:1713279306.690030:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.690031:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 6/0,1 mode: --/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.690032:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd7a80, rc 0) 00010000:00010000:1.0:1713279306.690041:0:15507:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda64db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f24:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174fbb expref: 3727 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.690046:0:15507:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda64db lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7f24:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174fbb expref: 3727 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.690049:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3644:11708:x1796503281168448:12345-192.168.203.4@tcp:101:touch.0 Request processed in 261us (299us total) trans 4295183577 rc 0/0 00000100:00100000:1.0:1713279306.690052:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efe680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200018752:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.690054:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784875 00010000:00010000:1.0:1713279306.690085:0:15507:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129b33600/0xfc4b8e114ed9ff7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f24:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391733c2 expref: 3741 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.690090:0:15507:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b33600/0xfc4b8e114ed9ff7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f24:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391733c2 expref: 3741 pid: 15482 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.690095:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200018816:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.690106:0:15507:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114ed812c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f24:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a059 expref: 3727 pid: 15477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.690110:0:15507:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114ed812c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f24:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a059 expref: 3727 pid: 15477 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.690115:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efc700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200018880:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.690126:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.690126:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.690140:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281167808 00000100:00100000:2.0:1713279306.690143:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281167808 00000100:00100000:2.0:1713279306.690158:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784876 00000100:00100000:2.0:1713279306.690162:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3364:11374:x1796503281167808:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.690169:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.690177:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda6f4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175254 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.690177:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.690189:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281167936 00010000:00010000:2.0:1713279306.690189:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda6f4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175254 expref: 3365 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.690191:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281167936 00000100:00100000:3.0:1713279306.690192:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.690198:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda6f4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175254 expref: 3365 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.690200:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281168000 00000100:00100000:0.0:1713279306.690203:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222956 00000100:00100000:3.0:1713279306.690203:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281168000 00010000:00010000:2.0:1713279306.690205:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012514dc00) 00000100:00100000:0.0:1713279306.690206:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3742:11695:x1796503281167936:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:2.0:1713279306.690207:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.690208:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd7cc0, rc 0) 00000100:00100000:3.0:1713279306.690216:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784877 00000100:00100000:3.0:1713279306.690221:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:11204:x1796503281168000:12345-192.168.203.4@tcp:36:touch.0 00000100:00100000:2.0:1713279306.690227:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3365:11374:x1796503281167808:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 64us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.690232:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784876 00010000:00010000:3.0:1713279306.690236:0:6929:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.690245:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114eda6df6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x871b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751d6 expref: 3728 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.690254:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x871b:0x0].0x0 (ffff88011f3ebc00) 00000100:00100000:2.0:1713279306.690257:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.690259:0:6929:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.690268:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281168192 00000100:00100000:2.0:1713279306.690270:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281168192 00000100:00100000:0.0:1713279306.690273:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3743:11695:x1796503281167936:12345-192.168.203.4@tcp:35:touch.0 Request processed in 64us (95us total) trans 4295202585 rc 0/0 00000100:00100000:0.0:1713279306.690280:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222956 00000100:00100000:2.0:1713279306.690284:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222957 00000100:00100000:2.0:1713279306.690288:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:11807:x1796503281168192:12345-192.168.203.4@tcp:33:lfs.0 00010000:00010000:3.0:1713279306.690292:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b180/0xfc4b8e114eda6f54 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x871b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.690298:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b180/0xfc4b8e114eda6f54 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x871b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.690304:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b180/0xfc4b8e114eda6f54 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x871b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00000004:00200000:2.0:1713279306.690336:0:15527:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x83b5:0x0]: returning size 4096 00000004:00200000:2.0:1713279306.690338:0:15527:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1713279306.690340:0:6929:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880098ccaa00 reply state ffff8800726ca000 transno 4295202586 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b180/0xfc4b8e114eda6f54 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x871b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.690348:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b180/0xfc4b8e114eda6f54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x871b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.690353:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x871b:0x0].0x0 (ffff880092a4cc00) 00010000:00010000:3.0:1713279306.690355:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.690356:0:6929:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713279306.690360:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3729:11807:x1796503281168192:12345-192.168.203.4@tcp:33:lfs.0 Request processed in 71us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.690365:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222957 00000100:00100000:3.0:1713279306.690381:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3729:11204:x1796503281168000:12345-192.168.203.4@tcp:36:touch.0 Request processed in 160us (188us total) trans 4295202586 rc 0/0 00000100:00100000:3.0:1713279306.690386:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784877 00000100:00100000:3.0:1713279306.690485:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.690498:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281168960 00000100:00100000:3.0:1713279306.690501:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281168960 00000100:00100000:3.0:1713279306.690519:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784878 00000100:00100000:3.0:1713279306.690523:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3743:11711:x1796503281168960:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.690531:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.690532:0:15482:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0001_UUID:15482:1796503200018048:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.690538:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda6f5b lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175270 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.690539:0:15482:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.690542:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.690553:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281168256 00000100:00100000:0.0:1713279306.690556:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281168256 00000100:00100000:2.0:1713279306.690557:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.690565:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114ed88afd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c4b0 expref: 3365 pid: 8637 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.690567:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281168320 00000100:00100000:2.0:1713279306.690570:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281168320 00000100:00100000:0.0:1713279306.690576:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196441 00000100:00100000:0.0:1713279306.690579:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3365:1957:x1796503281168256:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.690583:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.690584:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda6f62 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.690586:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114ed88afd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c4b0 expref: 3365 pid: 8637 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.690586:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110418 00000100:00100000:2.0:1713279306.690590:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+77:1956:x1796503281168320:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:0.0:1713279306.690591:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114ed88afd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c4b0 expref: 3365 pid: 8637 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.690591:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda6f62 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.690597:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda6f62 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.690598:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114ed88afd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c4b0 expref: 3365 pid: 8637 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.690604:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25a:0x0].0x0 (ffff880095863200) 00010000:00010000:3.0:1713279306.690605:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda6f69 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.690606:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.690610:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.690610:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda6f69 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.690613:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.690615:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda6f69 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.690621:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.690626:0:15482:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000004:00200000:3.0:1713279306.690628:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:1.0:1713279306.690629:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.690634:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3364:1957:x1796503281168256:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 55us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.690644:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196441 00010000:00010000:3.0:1713279306.690646:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda6f62 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.690652:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda6f62 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.690653:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x221:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.690656:0:15482:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.690657:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda6f62 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.690660:0:15482:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.690662:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda6f62 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.690664:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.690667:0:15482:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efd500 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0001-mdtlov_UUID:15482:1796503200018944:0@lo:101:mdt00_018.0 00010000:00010000:3.0:1713279306.690667:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.690669:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda6f62 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.690671:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281168512 00000100:00100000:0.0:1713279306.690673:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281168512 00010000:00010000:3.0:1713279306.690674:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda6f62 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.690678:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ed00/0xfc4b8e114ed95e93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x8179:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39170753 expref: 3729 pid: 15468 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.690678:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+78:1956:x1796503281168320:12345-192.168.203.4@tcp:2:touch.0 Request processed in 87us (120us total) trans 4295010154 rc 0/0 00000100:00100000:1.0:1713279306.690681:0:15482:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.690681:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880097910a00) 00010000:00010000:3.0:1713279306.690683:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.690684:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110418 00010000:00010000:3.0:1713279306.690685:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda6f62 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.690687:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196442 00000100:00100000:1.0:1713279306.690687:0:15482:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75f300 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.690689:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda6f62 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.690690:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5243450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3729:1956:x1796503281168512:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.690693:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.690694:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200018944 00010000:00010000:0.0:1713279306.690696:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ed00/0xfc4b8e114ed95e93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x8179:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39170753 expref: 3729 pid: 15468 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.690696:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200018944 00010000:00010000:3.0:1713279306.690698:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda6f69 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.690701:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ed00/0xfc4b8e114ed95e93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x8179:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39170753 expref: 3729 pid: 15468 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.690703:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda6f69 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.690707:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ed00/0xfc4b8e114ed95e93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x8179:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39170753 expref: 3729 pid: 15468 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.690708:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98634 00010000:00010000:3.0:1713279306.690708:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda6f69 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00000100:00100000:1.0:1713279306.690711:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+52:15482:x1796503200018944:12345-0@lo:101:mdt00_018.0 00010000:00010000:0.0:1713279306.690712:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8179:0x0].0x0 (ffff88007f389300) 00010000:00010000:3.0:1713279306.690713:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.690714:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.690716:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.690716:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda6f69 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.690717:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.690721:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.690721:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda6f69 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.690722:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9d40/0xfc4b8e114eda6f77 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x221:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda6f70 expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.690724:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.690727:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.690727:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff88008e5b8400) 00010000:00010000:3.0:1713279306.690729:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.690730:0:15494:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114ed88c7e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x221:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c551 expref: 3728 pid: 15477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.690731:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda6f69 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.690733:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281168704 00010000:00010000:1.0:1713279306.690734:0:15494:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9d40/0xfc4b8e114eda6f77 lrc: 4/0,0 mode: --/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda6f70 expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.690735:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281168704 00010000:00010000:3.0:1713279306.690736:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda6f69 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.690737:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5243450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:1956:x1796503281168512:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 45us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.690740:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196442 00010000:00010000:1.0:1713279306.690743:0:15494:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114ed88c7e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x221:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c551 expref: 3728 pid: 15477 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.690746:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222958 00010000:00010000:1.0:1713279306.690748:0:15494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114ed88c7e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x221:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c551 expref: 3727 pid: 15477 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.690751:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3745:11737:x1796503281168704:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:3.0:1713279306.690756:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda6f5b lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175270 expref: 3745 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.690757:0:15494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efc380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:15494:1796503200019008:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.690763:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda6f5b lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175270 expref: 3745 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.690764:0:15484:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001_UUID:15484:1796503200018240:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.690768:0:15494:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d8240 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.690769:0:15484:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001_UUID:15484:1796503200018304:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.690771:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68ad00, rc 0) 00010000:00010000:0.0:1713279306.690778:0:15484:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.690788:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3745:11711:x1796503281168960:12345-192.168.203.4@tcp:101:touch.0 Request processed in 264us (303us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.690794:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784878 00000100:00100000:0.0:1713279306.690803:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.690806:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3744:11737:x1796503281168704:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 54us (81us total) trans 4295202587 rc 0/0 00000100:00100000:2.0:1713279306.690812:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222958 00000100:00100000:1.0:1713279306.690813:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281168576 00000100:00100000:1.0:1713279306.690815:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281168576 00000100:00100000:0.0:1713279306.690816:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.690821:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda571a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c0a expref: 3364 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.690825:0:15485:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.690828:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.690831:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281168768 00010000:00010000:2.0:1713279306.690831:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.690832:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281168768 00010000:00010000:1.0:1713279306.690836:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda38dc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917443f expref: 3644 pid: 15489 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.690843:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196443 00000100:00100000:3.0:1713279306.690848:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3364:1954:x1796503281168576:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.690850:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196444 00000100:00100000:1.0:1713279306.690853:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3644:1956:x1796503281168768:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.690855:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.690857:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.690857:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5f80/0xfc4b8e114eda6f7e lrc: 3/0,1 mode: --/EX res: [0x200000400:0x23e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.690859:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda571a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c0a expref: 3364 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.690860:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda38dc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917443f expref: 3644 pid: 15489 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.690863:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5f80/0xfc4b8e114eda6f7e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x23e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.690865:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda38dc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917443f expref: 3644 pid: 15489 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.690869:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5f80/0xfc4b8e114eda6f7e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x23e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.690872:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda38dc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917443f expref: 3644 pid: 15489 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.690874:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda571a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c0a expref: 3364 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.690879:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7bca:0x0].0x0 (ffff880093598800) 00010000:00010000:1.0:1713279306.690882:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.690882:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091dd4480/0xfc4b8e114eda6f85 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x245:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.690886:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.690886:0:15485:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091dd4480/0xfc4b8e114eda6f85 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x245:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.690889:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.690892:0:15485:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091dd4480/0xfc4b8e114eda6f85 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x245:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.690894:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda571a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c0a expref: 3364 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.690900:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3643:1956:x1796503281168768:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 47us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.690902:0:15485:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-mdtlov_UUID:15485:1796503200019072:0@lo:101:mdt00_021.0 00010000:00010000:3.0:1713279306.690902:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7bca:0x0].0x0 (ffff880093598800) 00000100:00100000:1.0:1713279306.690904:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196444 00010000:00010000:3.0:1713279306.690905:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.690910:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.690914:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.690921:0:15485:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.690923:0:15507:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880135efe680 x1796503200018752) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda64db lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7f24:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174fbb expref: 3727 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.690929:0:15507:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda64db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f24:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174fbb expref: 3727 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.690931:0:15485:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98780 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.690933:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.690935:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda64db lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7f24:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174fbb expref: 3727 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.690937:0:15484:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.690940:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efe680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200018752:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.690941:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.690945:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200018816:192.168.203.4@tcp:104: 00000004:00200000:0.0:1713279306.690947:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7bca:0x0]: returning size 27670 00000100:00100000:3.0:1713279306.690949:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3363:1954:x1796503281168576:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 100us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.690952:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efc700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200018880:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.690955:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196443 00010000:00010000:1.0:1713279306.690960:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f24:0x0].0x0 (ffff880093401300) 00010000:00010000:1.0:1713279306.690962:0:15507:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.690966:0:15507:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00000100:00100000:2.0:1713279306.690966:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.690969:0:15507:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00000100:00100000:3.0:1713279306.690969:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281168832 00000100:00100000:3.0:1713279306.690972:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281168832 00010000:00010000:1.0:1713279306.690973:0:15507:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:1.0:1713279306.690979:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200019072 00000100:00100000:3.0:1713279306.690979:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281169024 00000100:00100000:1.0:1713279306.690981:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200019072 00000100:00100000:3.0:1713279306.690981:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281169024 00010000:00010000:0.0:1713279306.690983:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086f40/0xfc4b8e114eda6e90 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175231 expref: 3644 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.690989:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98635 00010000:00010000:3.0:1713279306.690989:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b33600/0xfc4b8e114ed9ff7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f24:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391733c2 expref: 3744 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.690991:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175231 expref: 3643 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.690991:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+89:15485:x1796503200019072:12345-0@lo:101:mdt00_021.0 00010000:00010000:0.0:1713279306.690995:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7bca:0x0].0x0 (ffff880093598800) 00010000:00010000:0.0:1713279306.690997:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1713279306.690997:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.690998:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f086400, rc 0) 00000100:00100000:3.0:1713279306.691009:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196445 00000100:00100000:0.0:1713279306.691014:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3643:11824:x1796503281166976:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 2863us (2953us total) trans 4295183578 rc 0/0 00000100:00100000:3.0:1713279306.691015:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3744:1957:x1796503281169024:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.691016:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda6f93 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x245:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda6f85 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.691018:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784871 00010000:00010000:3.0:1713279306.691022:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.691024:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda6f93 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x245:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda6f85 expref: 90 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.691025:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129b33600/0xfc4b8e114ed9ff7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f24:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391733c2 expref: 3744 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.691029:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda6f93 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x245:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda6f85 expref: 90 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.691033:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.691033:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129b33600/0xfc4b8e114ed9ff7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f24:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391733c2 expref: 3744 pid: 15482 timeout: 509 lvb_type: 0 00000004:00010000:1.0:1713279306.691037:0:15542:0:(mdt_lvb.c:110:mdt_dom_disk_lvbo_update()) res: [0x240000400:0x245:0x0] updating lvb size from disk: 0 -> 4096 00000004:00010000:1.0:1713279306.691039:0:15542:0:(mdt_lvb.c:117:mdt_dom_disk_lvbo_update()) res: [0x240000400:0x245:0x0] updating lvb mtime from disk: 0 -> 1713279304 00000004:00010000:1.0:1713279306.691040:0:15542:0:(mdt_lvb.c:123:mdt_dom_disk_lvbo_update()) res: [0x240000400:0x245:0x0] updating lvb atime from disk: 0 -> 1713279253 00000004:00010000:1.0:1713279306.691042:0:15542:0:(mdt_lvb.c:129:mdt_dom_disk_lvbo_update()) res: [0x240000400:0x245:0x0] updating lvb ctime from disk: 0 -> 1713279304 00000004:00010000:1.0:1713279306.691043:0:15542:0:(mdt_lvb.c:135:mdt_dom_disk_lvbo_update()) res: [0x240000400:0x245:0x0] updating lvb blocks from disk: 18427282363563114435 -> 16 00010000:00010000:3.0:1713279306.691043:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b33600/0xfc4b8e114ed9ff7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f24:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391733c2 expref: 3744 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.691045:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x245:0x0].0x0 (ffff88008d729f00) 00010000:00010000:1.0:1713279306.691047:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:1.0:1713279306.691048:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906e8fc0, rc 0) 00010000:00010000:3.0:1713279306.691051:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f24:0x0].0x0 (ffff880093401300) 00010000:00010000:3.0:1713279306.691054:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:0.0:1713279306.691060:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281169216 00010000:00010000:3.0:1713279306.691060:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:0.0:1713279306.691063:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281169216 00000100:00100000:1.0:1713279306.691064:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+90:15485:x1796503200019072:12345-0@lo:101:mdt00_021.0 Request processed in 72us (142us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.691065:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.691083:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.691084:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98635 00000100:00100000:2.0:1713279306.691090:0:15485:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-mdtlov_UUID:15485:1796503200019072:0@lo:101:mdt00_021.0 00000100:00100000:0.0:1713279306.691093:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784879 00000100:00100000:0.0:1713279306.691096:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3643:11708:x1796503281169216:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1713279306.691099:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091dd4480/0xfc4b8e114eda6f85 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x245:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda6f93 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.691099:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3743:1957:x1796503281169024:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 84us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.691105:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196445 00010000:00010000:2.0:1713279306.691106:0:15485:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091dd4480/0xfc4b8e114eda6f85 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x245:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda6f93 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.691108:0:15484:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.691115:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda6f2a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x72a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175262 expref: 3643 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.691121:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x72a2:0x0].0x0 (ffff8800927b4000) 00010000:00010000:0.0:1713279306.691123:0:15484:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.691131:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784880 00000100:00100000:3.0:1713279306.691135:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3363:11813:x1796503281168832:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:3.0:1713279306.691142:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.691149:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114eda6f9a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175269 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.691153:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda6fa1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x72a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.691157:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda6fa1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.691161:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda6fa1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.691177:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6fa8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.691183:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6fa8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00000004:00010000:0.0:1713279306.691187:0:15484:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007fd8dc00 reply state ffff880094155000 transno 4295183579 ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda6fa1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.691189:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6fa8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.691192:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda6fa1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.691195:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x72a2:0x0].0x0 (ffff8800927b4000) 00010000:00010000:0.0:1713279306.691197:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.691197:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda6faf lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.691198:0:15484:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.691202:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda6faf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691206:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda6faf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:0.0:1713279306.691220:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3644:11708:x1796503281169216:12345-192.168.203.4@tcp:36:touch.0 Request processed in 122us (187us total) trans 4295183579 rc 0/0 00000100:00100000:0.0:1713279306.691224:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784879 00010000:00010000:3.0:1713279306.691229:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6fb6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x721d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.691234:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6fb6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x721d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691239:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6fb6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x721d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000004:00200000:3.0:1713279306.691268:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x721d:0x0]: returning size 4096 00000004:00200000:3.0:1713279306.691270:0:6929:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713279306.691278:0:6929:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6fb6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x721d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691284:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6fa8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691288:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6fa8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691292:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6fa8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691296:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6fa8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691300:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68a1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.691302:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6fa8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691306:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6fa8 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691311:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:3.0:1713279306.691313:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.691315:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6fa8 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691319:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda6fa8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691325:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda6faf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691329:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda6faf lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691333:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda6faf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691337:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c868480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.691339:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda6faf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691343:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda6faf lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691348:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x31 (ffff880136671e00) 00010000:00010000:3.0:1713279306.691349:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.691351:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda6faf lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691355:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda6faf lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.691368:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114eda6f9a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175269 expref: 3365 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.691375:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x721d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175269 expref: 3364 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.691379:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x721d:0x0].0x0 (ffff8800902cc000) 00010000:00010000:3.0:1713279306.691381:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713279306.691383:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b9ed00, rc 0) 00000100:00100000:3.0:1713279306.691409:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3364:11813:x1796503281168832:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 273us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.691430:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784880 00000100:00100000:2.0:1713279306.691582:0:15485:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-mdtlov_UUID:15485:1796503200019136:0@lo:403:mdt00_021.0 00000100:00100000:2.0:1713279306.691602:0:15485:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.691610:0:15485:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98780 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.691612:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200019136 00000100:00100000:1.0:1713279306.691615:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200019136 00000100:00100000:2.0:1713279306.691625:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.691629:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98636 00000100:00100000:1.0:1713279306.691632:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+90:15485:x1796503200019136:12345-0@lo:403:mdt00_021.0 00000100:00100000:2.0:1713279306.691639:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.691650:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.691657:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281169088 00000100:00100000:3.0:1713279306.691661:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281169088 00000100:00100000:2.0:1713279306.691664:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.691671:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114ed812c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a059 expref: 3727 pid: 15477 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.691692:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196446 00000100:00100000:2.0:1713279306.691695:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.691698:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:1955:x1796503281169088:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.691700:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281169280 00000100:00100000:0.0:1713279306.691704:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281169280 00000100:00100000:2.0:1713279306.691704:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281169536 00010000:00010000:3.0:1713279306.691704:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.691707:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281169536 00010000:00010000:3.0:1713279306.691708:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114ed812c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f24:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a059 expref: 3728 pid: 15477 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.691715:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114ed812c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f24:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a059 expref: 3728 pid: 15477 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.691719:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281169408 00000100:00100000:2.0:1713279306.691719:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222959 00000100:00100000:0.0:1713279306.691721:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281169408 00000100:00100000:2.0:1713279306.691723:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130147450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3364:11374:x1796503281169536:12345-192.168.203.4@tcp:37:lfs.0 00010000:00010000:3.0:1713279306.691726:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114ed812c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f24:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a059 expref: 3728 pid: 15477 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.691730:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281169472 00000100:00100000:0.0:1713279306.691732:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281169472 00010000:00010000:3.0:1713279306.691734:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f24:0x0].0x0 (ffff880093401300) 00010000:00010000:3.0:1713279306.691737:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.691742:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15507 initiator: MDT0 00000100:00100000:0.0:1713279306.691744:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784881 00010000:00010000:3.0:1713279306.691747:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15507 initiator: MDT0 00000100:00100000:0.0:1713279306.691748:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:11204:x1796503281169280:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.691757:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.691763:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.691765:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea5d680/0xfc4b8e114eda6fbd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x871b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175277 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.691767:0:15507:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691770:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:3.0:1713279306.691780:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3729:1955:x1796503281169088:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 82us (154us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.691785:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea5d680/0xfc4b8e114eda6fbd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x871b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175277 expref: 3729 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.691786:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196446 00010000:00010000:0.0:1713279306.691793:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea5d680/0xfc4b8e114eda6fbd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x871b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175277 expref: 3728 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.691800:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784882 00010000:00010000:0.0:1713279306.691803:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x871b:0x0].0x0 (ffff880092a4cc00) 00000100:00100000:3.0:1713279306.691804:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3644:11809:x1796503281169408:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:0.0:1713279306.691806:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1713279306.691808:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea5d680, rc 0) 00010000:00010000:1.0:1713279306.691810:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691814:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691817:0:15507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691820:0:15507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131f3f3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.691822:0:15507:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00000100:00100000:0.0:1713279306.691825:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:11204:x1796503281169280:12345-192.168.203.4@tcp:101:touch.0 Request processed in 76us (185us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.691825:0:15507:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691830:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f24:0x0].0x0 (ffff880093401300) 00000100:00100000:0.0:1713279306.691831:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784881 00010000:00010000:1.0:1713279306.691831:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1713279306.691833:0:15507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00000100:00100000:3.0:1713279306.691837:0:6929:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6929:1796503200019200:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1713279306.691838:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda6f46 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7f24:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00000100:00100000:0.0:1713279306.691840:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784883 00000100:00100000:0.0:1713279306.691842:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:11666:x1796503281169472:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:1.0:1713279306.691844:0:15507:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114eda6f38 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691847:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114eda6f38 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691850:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114eda6f38 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691853:0:15507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114eda6f38 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691855:0:15507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.691856:0:15507:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114eda6f38 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00000100:00100000:3.0:1713279306.691858:0:6929:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.691859:0:15507:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114eda6f38 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691862:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff88009426dd00) 00010000:00010000:1.0:1713279306.691863:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.691864:0:15507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114eda6f38 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691867:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114eda6f38 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00000100:00100000:3.0:1713279306.691867:0:6929:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800968dda80 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.691872:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda6f3f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691875:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda6f3f lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT0 00000100:00100000:3.0:1713279306.691876:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200019200 00010000:00010000:1.0:1713279306.691879:0:15507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda6f3f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00000100:00100000:3.0:1713279306.691879:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200019200 00010000:00010000:1.0:1713279306.691881:0:15507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012c24ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.691882:0:15507:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda6f3f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691885:0:15507:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda6f3f lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691888:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x3131 (ffff88011f2c2200) 00010000:00010000:1.0:1713279306.691889:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.691890:0:15507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda6f3f lrc: 2/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691893:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda6f3f lrc: 0/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00000100:00100000:3.0:1713279306.691896:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98637 00010000:00010000:1.0:1713279306.691899:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15507 initiator: MDT0 00000100:00100000:3.0:1713279306.691900:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+54:6929:x1796503200019200:12345-0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1713279306.691902:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691904:0:15507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691906:0:15507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.691908:0:15507:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691910:0:15507:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.691916:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.691918:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.691920:0:15507:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114eda69ce lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda69c0 expref: 54 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.691924:0:15507:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114eda69ce lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda69c0 expref: 54 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.691928:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114eda69ce lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda69c0 expref: 54 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.691932:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6fc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.691932:0:15507:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.691937:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.691941:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.691942:0:15507:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114eda69ce lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda69c0 expref: 54 pid: 6934 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.691945:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+54:6929:x1796503200019200:12345-0@lo:1000:mdt00_001.0 Request processed in 44us (85us total) trans 0 rc 1/1 00010000:00010000:0.0:1713279306.691946:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6fcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x139:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.691948:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efc700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200019264:0@lo:105: 00010000:00010000:0.0:1713279306.691950:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.691950:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98637 00010000:00010000:0.0:1713279306.691953:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.691962:0:15507:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.691968:0:6929:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6929:1796503200019200:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1713279306.691969:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fe40 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.691977:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6fd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.691977:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200019264 00000100:00100000:1.0:1713279306.691979:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200019264 00010000:00010000:0.0:1713279306.691981:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.691985:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.691988:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33422 00000004:00200000:0.0:1713279306.691990:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7c03:0x0]: returning size 1 00000100:00100000:1.0:1713279306.691990:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15507:x1796503200019264:12345-0@lo:105: 00000004:00010000:0.0:1713279306.691995:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.691995:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.691995:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3644:11809:x1796503281169408:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 190us (344us total) trans 0 rc -17/-17 00010000:00010000:0.0:1713279306.691999:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6fc4 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.691999:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.692000:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784882 00010000:00010000:0.0:1713279306.692014:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6fc4 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.692017:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.692017:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.692020:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6fc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.692021:0:9213:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.692022:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092541d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.692024:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6fc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.692024:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.692027:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6fc4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.692028:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.692031:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.692038:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880091dd6f40) 00000100:00100000:1.0:1713279306.692050:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15507:x1796503200019264:12345-0@lo:105: Request processed in 58us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.692053:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33422 00010000:00010000:1.0:1713279306.692061:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.692065:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.692080:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x0 (ffff880130675300) 00010000:00010000:0.0:1713279306.692083:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.692085:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6fc4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.692088:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda6fc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000004:00080000:1.0:1713279306.692091:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1713279306.692096:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.692099:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6fcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.692102:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6fcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.692104:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925433c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.692106:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6fcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.692108:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efe680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200019328:0@lo:1000:mdt_io00_007.0 00010000:00010000:0.0:1713279306.692109:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6fcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.692124:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x34 (ffff880130675800) 00010000:00010000:0.0:1713279306.692125:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.692126:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6fcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.692129:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda6fcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.692132:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.692134:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.692137:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6fd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.692140:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.692142:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.692143:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.692145:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124ce2d80 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.692146:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.692149:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c03:0x0].0x0 (ffff880131200900) 00010000:00010000:0.0:1713279306.692150:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.692151:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6fd2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.692155:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200019328 00010000:00010000:0.0:1713279306.692157:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda6fd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.692157:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200019328 00000100:00100000:1.0:1713279306.692170:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98638 00000100:00100000:1.0:1713279306.692173:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+54:15514:x1796503200019328:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:0.0:1713279306.692177:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:11666:x1796503281169472:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 333us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.692181:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784883 00000100:00100000:1.0:1713279306.692200:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+54:15514:x1796503200019328:12345-0@lo:1000:mdt_io00_007.0 Request processed in 26us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.692203:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98638 00000100:00100000:1.0:1713279306.692217:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efe680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200019328:0@lo:1000:mdt_io00_007.0 00000004:00080000:1.0:1713279306.692227:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000403:0x863c:0x0] 00000100:00100000:1.0:1713279306.692237:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efe680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200019392:0@lo:1000:mdt_io00_007.0 00000100:00100000:0.0:1713279306.692245:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.692248:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.692249:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.692253:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124ce2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.692258:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200019392 00000100:00100000:1.0:1713279306.692260:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200019392 00000100:00100000:3.0:1713279306.692264:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281169600 00000100:00100000:3.0:1713279306.692267:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281169600 00000100:00100000:1.0:1713279306.692268:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98639 00000100:00100000:1.0:1713279306.692270:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+54:15514:x1796503200019392:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:2.0:1713279306.692273:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.692277:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114ed88c7e lrc: 5/0,0 mode: PR/PR res: [0x200000400:0x221:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c551 expref: 3727 pid: 15477 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.692291:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196447 00000100:00100000:2.0:1713279306.692294:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.692296:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+54:15514:x1796503200019392:12345-0@lo:1000:mdt_io00_007.0 Request processed in 24us (47us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.692296:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c369500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:1956:x1796503281169600:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.692299:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98639 00010000:00010000:3.0:1713279306.692302:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.692304:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281169792 00010000:00010000:3.0:1713279306.692306:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114ed88c7e lrc: 5/0,0 mode: PR/PR res: [0x200000400:0x221:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c551 expref: 3727 pid: 15477 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.692307:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281169792 00000100:00100000:1.0:1713279306.692310:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efe680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200019392:0@lo:1000:mdt_io00_007.0 00010000:00010000:3.0:1713279306.692314:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114ed88c7e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x221:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c551 expref: 3727 pid: 15477 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.692319:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222960 00000100:00100000:2.0:1713279306.692323:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3743:11737:x1796503281169792:12345-192.168.203.4@tcp:33:lfs.0 00010000:00010000:3.0:1713279306.692328:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x221:0x0].0x0 (ffff88008ea88000) 00010000:00010000:3.0:1713279306.692332:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9d40/0xfc4b8e114eda6f77 lrc: 3/0,0 mode: --/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda6f70 expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.692339:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9d40/0xfc4b8e114eda6f77 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfc4b8e114eda6f70 expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.692345:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9d40/0xfc4b8e114eda6f77 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfc4b8e114eda6f70 expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.692359:0:15655:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9d40/0xfc4b8e114eda6f77 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda6f70 expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.692361:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00200000:2.0:1713279306.692365:0:15467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x863c:0x0]: returning size 4096 00000004:00200000:2.0:1713279306.692368:0:15467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:3.0:1713279306.692368:0:15655:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000_UUID:15655:1796503200019456:0@lo:105: 00000100:00100000:0.0:1713279306.692370:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281169728 00000100:00100000:0.0:1713279306.692373:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281169728 00000100:00100000:0.0:1713279306.692381:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281170048 00000100:00100000:0.0:1713279306.692382:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281170048 00000100:00100000:0.0:1713279306.692388:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281170176 00000100:00100000:2.0:1713279306.692388:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3745:11737:x1796503281169792:12345-192.168.203.4@tcp:33:lfs.0 Request processed in 63us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.692388:0:15655:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.692389:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281170176 00000100:00100000:2.0:1713279306.692394:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222960 00000100:00100000:0.0:1713279306.692396:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784884 00000100:00100000:0.0:1713279306.692398:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3745:11695:x1796503281169728:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.692398:0:15655:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800968ddc00 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.692404:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.692409:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114eda6fd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917527e expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.692428:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784885 00000100:00100000:3.0:1713279306.692433:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3745:11794:x1796503281170048:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.692440:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.692444:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda6fe0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.692448:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda6fe0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.692448:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda6fe7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175285 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.692450:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.692452:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda6fe0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.692458:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda6fee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.692462:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda6fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.692462:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281169920 00010000:00010000:0.0:1713279306.692465:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda6fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.692465:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281169920 00010000:00010000:3.0:1713279306.692473:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6ff5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.692477:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222961 00010000:00010000:3.0:1713279306.692480:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.692481:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3747:11642:x1796503281169920:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:3.0:1713279306.692489:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.692494:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320000/0xfc4b8e114eda6ffc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x86bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.692498:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320000/0xfc4b8e114eda6ffc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x86bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.692499:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda7003 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.692502:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320000/0xfc4b8e114eda6ffc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x86bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.692504:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda7003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00000004:00200000:0.0:1713279306.692506:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x86bb:0x0]: returning size 0 00010000:00010000:3.0:1713279306.692509:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda7003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.692525:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda6fe0 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.692529:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda6fe0 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.692532:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda6fe0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.692535:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda6fe0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000004:00200000:3.0:1713279306.692535:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8516:0x0]: returning size 1 00010000:00010000:0.0:1713279306.692537:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131e35f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.692538:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda6fe0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.692541:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda6fe0 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.692542:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6ff5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.692546:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x0 (ffff880130675000) 00010000:00010000:0.0:1713279306.692547:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.692547:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6ff5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.692549:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda6fe0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.692552:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda6fe0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.692552:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.692557:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda6fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.692557:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6ff5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.692559:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda6fee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.692559:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3749:11642:x1796503281169920:12345-192.168.203.4@tcp:35:touch.0 Request processed in 76us (108us total) trans 4295202589 rc 0/0 00010000:00010000:0.0:1713279306.692562:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda6fee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.692562:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f2b3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.692564:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e5f5200 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.692564:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222961 00010000:00010000:3.0:1713279306.692564:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6ff5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.692566:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda6fee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.692569:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda6fee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.692569:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6ff5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.692572:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x3831 (ffff880130675200) 00010000:00010000:0.0:1713279306.692573:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.692575:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda6fee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.692576:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:0.0:1713279306.692577:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda6fee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.692578:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.692582:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6ff5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.692587:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda6ff5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.692591:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114eda6fd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x139:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917527e expref: 3749 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.692595:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda7003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.692599:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320000/0xfc4b8e114eda6ffc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x86bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917527e expref: 3748 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.692599:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda7003 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.692602:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86bb:0x0].0x0 (ffff880092a4c900) 00010000:00010000:0.0:1713279306.692604:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713279306.692604:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda7003 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.692605:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d320000, rc 0) 00010000:00010000:3.0:1713279306.692609:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012068e400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.692611:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda7003 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.692616:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda7003 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.692618:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3748:11695:x1796503281169728:12345-192.168.203.4@tcp:101:touch.0 Request processed in 219us (373us total) trans 4295202588 rc 0/0 00000100:00100000:0.0:1713279306.692622:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784884 00010000:00010000:3.0:1713279306.692622:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3931 (ffff880136671900) 00000100:00100000:2.0:1713279306.692624:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.692624:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.692627:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda7003 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.692630:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281170240 00010000:00010000:3.0:1713279306.692631:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda7003 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.692633:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281170240 00000100:00100000:0.0:1713279306.692647:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784886 00000100:00100000:0.0:1713279306.692651:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3645:11711:x1796503281170176:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.692653:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda6fe7 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175285 expref: 3747 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.692659:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.692659:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda6fe7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175285 expref: 3747 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.692665:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.692668:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7011 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917528c expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.692670:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f29b00, rc 0) 00000100:00100000:1.0:1713279306.692672:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efe680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200019520:0@lo:403:mdt_io00_007.0 00000100:00100000:1.0:1713279306.692688:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.692688:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3746:11794:x1796503281170048:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 255us (414us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.692694:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda7018 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.692694:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784885 00000100:00100000:1.0:1713279306.692695:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124ce2b40 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.692698:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda7018 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.692702:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda7018 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.692703:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200019456 00000100:00100000:3.0:1713279306.692704:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281170304 00000100:00100000:1.0:1713279306.692705:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200019456 00000100:00100000:3.0:1713279306.692707:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281170304 00000100:00100000:1.0:1713279306.692714:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33423 00000100:00100000:1.0:1713279306.692716:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15655:x1796503200019456:12345-0@lo:105: 00010000:00010000:1.0:1713279306.692720:0:6913:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 4/0,1 mode: --/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda6f77 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.692722:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784887 00010000:00010000:1.0:1713279306.692724:0:6913:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 4/0,1 mode: --/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda6f77 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.692726:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3646:11708:x1796503281170240:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.692728:0:6913:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 4/0,1 mode: --/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda6f77 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.692732:0:6913:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114eda6f77 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.692733:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.692735:0:6913:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 5/0,1 mode: PW/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114eda6f77 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.692739:0:6913:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 5/0,1 mode: PW/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfc4b8e114eda6f77 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.692739:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008be60900/0xfc4b8e114eda701f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x72a2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175293 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.692744:0:6913:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880131f3c480) 00010000:00010000:3.0:1713279306.692756:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008be60900/0xfc4b8e114eda701f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x72a2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175293 expref: 3647 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.692757:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15655:x1796503200019456:12345-0@lo:105: Request processed in 41us (370us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.692759:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7026 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.692761:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33423 00010000:00010000:3.0:1713279306.692765:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be60900/0xfc4b8e114eda701f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x72a2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175293 expref: 3647 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.692766:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7026 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.692769:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200019520 00010000:00010000:0.0:1713279306.692770:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7026 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.692770:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200019520 00010000:00010000:3.0:1713279306.692775:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x72a2:0x0].0x0 (ffff8800927b4000) 00000100:00100000:2.0:1713279306.692776:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.692777:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98640 00010000:00010000:3.0:1713279306.692777:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1713279306.692779:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+54:15514:x1796503200019520:12345-0@lo:403:mdt_io00_007.0 00010000:00010000:3.0:1713279306.692779:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008be60900, rc 0) 00010000:00010000:0.0:1713279306.692783:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda7018 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.692786:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda7018 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.692789:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda7018 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.692792:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda7018 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00000100:00100000:2.0:1713279306.692792:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.692793:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3647:11708:x1796503281170240:12345-192.168.203.4@tcp:101:touch.0 Request processed in 67us (169us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.692794:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe14480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.692796:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda7018 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00000100:00100000:3.0:1713279306.692798:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784887 00010000:00010000:0.0:1713279306.692799:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda7018 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00000100:00100000:2.0:1713279306.692801:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281170496 00010000:00010000:0.0:1713279306.692802:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880130675400) 00010000:00010000:0.0:1713279306.692804:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.692804:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281170496 00010000:00010000:0.0:1713279306.692805:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda7018 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.692808:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda7018 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00000100:00100000:3.0:1713279306.692808:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784888 00000100:00100000:3.0:1713279306.692812:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3366:11813:x1796503281170304:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:0.0:1713279306.692813:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7026 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00000100:00100000:2.0:1713279306.692815:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222962 00010000:00010000:0.0:1713279306.692816:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7026 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.692819:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7026 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00000100:00100000:2.0:1713279306.692819:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3647:11811:x1796503281170496:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:3.0:1713279306.692819:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.692821:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe15b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.692822:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7026 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.692825:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7026 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.692826:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda702d lrc: 2/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917529a expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.692828:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880130675b00) 00010000:00010000:0.0:1713279306.692829:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.692830:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7026 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.692833:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7026 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.692845:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7011 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917528c expref: 3647 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.692846:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda7034 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.692849:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7011 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917528c expref: 3647 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.692852:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda7034 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.692854:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009435e880, rc 0) 00010000:00010000:3.0:1713279306.692858:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda7034 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:0.0:1713279306.692866:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3647:11711:x1796503281170176:12345-192.168.203.4@tcp:101:touch.0 Request processed in 215us (507us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.692870:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784886 00000004:00200000:3.0:1713279306.692872:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x233:0x0]: returning size 4096 00000004:00200000:3.0:1713279306.692875:0:6929:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1713279306.692888:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda702d lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917529a expref: 3368 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.692892:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3646:11811:x1796503281170496:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 71us (99us total) trans 4295183580 rc 0/0 00010000:00010000:3.0:1713279306.692898:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda7034 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917529a expref: 3367 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.692901:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222962 00010000:00010000:3.0:1713279306.692903:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88008c124700) 00010000:00010000:3.0:1713279306.692906:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713279306.692908:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801245b46c0, rc 0) 00000100:00100000:3.0:1713279306.692922:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3366:11813:x1796503281170304:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 110us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.692927:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784888 00000100:00100000:3.0:1713279306.692940:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281170368 00000100:00100000:3.0:1713279306.692942:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281170368 00000100:00100000:3.0:1713279306.692956:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147211 00000100:00100000:3.0:1713279306.692960:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3646:1956:x1796503281170368:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.692965:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.692972:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11d40/0xfc4b8e114eda6a76 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175119 expref: 3646 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.692979:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b15:0x0].0x0 (ffff880090884a00) 00010000:00010000:3.0:1713279306.692981:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.692991:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3645:1956:x1796503281170368:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 30us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.692995:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147211 00000100:00100000:3.0:1713279306.693015:0:15655:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000_UUID:15655:1796503200019456:0@lo:105: 00010000:00010000:3.0:1713279306.693022:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.693030:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c369500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:1956:x1796503281169600:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 735us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.693035:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196447 00000100:00100000:2.0:1713279306.693340:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130147450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3365:11374:x1796503281169536:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1616us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.693345:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222959 00000100:00100000:2.0:1713279306.693581:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.693596:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281170624 00000100:00100000:3.0:1713279306.693599:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281170624 00000100:00100000:3.0:1713279306.693612:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222963 00000100:00100000:3.0:1713279306.693616:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:11807:x1796503281170624:12345-192.168.203.4@tcp:35:lfs.0 00000040:00080000:3.0:1713279306.693688:0:15649:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x1b7:0x0].191, 344 off109488 00000040:00080000:3.0:1713279306.693707:0:15649:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0xf2:0x0].676, 424 off478328 00000004:00080000:3.0:1713279306.693710:0:15649:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800968ddc00 with version 29397 00000004:00080000:2.0:1713279306.693724:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29397 rpc_version 29397 00000020:00100000:2.0:1713279306.693736:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.693741:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012e7eb480 x1796503200019648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.693751:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.693752:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7eb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200019648:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.693762:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.693766:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281170816 00000100:00100000:3.0:1713279306.693769:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281170816 00000100:00100000:2.0:1713279306.693773:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.693783:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98480 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.693784:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222964 00000100:00100000:3.0:1713279306.693788:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3746:11737:x1796503281170816:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1713279306.693792:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.693792:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281170688 00000100:00100000:2.0:1713279306.693794:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281170688 00000100:00100000:2.0:1713279306.693807:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281170880 00000100:00100000:2.0:1713279306.693821:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281170880 00000100:00100000:2.0:1713279306.693833:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110419 00000100:00100000:2.0:1713279306.693837:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1954:x1796503281170688:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:3.0:1713279306.693861:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3747:11737:x1796503281170816:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 71us (110us total) trans 4295202591 rc 0/0 00000100:00100000:3.0:1713279306.693866:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222964 00000100:00100000:3.0:1713279306.693879:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200019648 00000100:00100000:3.0:1713279306.693882:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200019648 00000100:00100000:3.0:1713279306.693896:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98641 00000100:00100000:3.0:1713279306.693899:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+91:8634:x1796503200019648:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1713279306.693908:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+77:1954:x1796503281170688:12345-192.168.203.4@tcp:2:touch.0 Request processed in 70us (144us total) trans 4295010155 rc 0/0 00000100:00100000:1.0:1713279306.693913:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+54:15514:x1796503200019520:12345-0@lo:403:mdt_io00_007.0 Request processed in 1132us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.693914:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110419 00000100:00100000:1.0:1713279306.693918:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98640 00000100:00100000:2.0:1713279306.693923:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110420 00000100:00100000:2.0:1713279306.693927:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+77:1954:x1796503281170880:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:1.0:1713279306.693943:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efc700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200019264:0@lo:105: 00010000:00010000:1.0:1713279306.693949:0:15507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.693953:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda6797 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15507 initiator: MDT0 00000004:00020000:1.0:1713279306.693958:0:15507:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200000402:0x7f51:0x0]/11 failed: rc = -114 00000100:00100000:3.0:1713279306.693976:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+92:8634:x1796503200019648:12345-0@lo:1000:osp_up1-0.0 Request processed in 75us (201us total) trans 4295183581 rc 0/0 00000100:00100000:1.0:1713279306.693977:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:10123:x1796503281152960:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 34174us (34234us total) trans 0 rc -114/-114 00000100:00100000:1.0:1713279306.693981:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14317 00000100:00100000:3.0:1713279306.693982:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98641 00000100:00100000:0.0:1713279306.693987:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.693996:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efe680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200019520:0@lo:403:mdt_io00_007.0 00000100:00100000:2.0:1713279306.693999:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+78:1954:x1796503281170880:12345-192.168.203.4@tcp:2:touch.0 Request processed in 70us (205us total) trans 4295010098 rc 0/0 00000100:00100000:2.0:1713279306.694008:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110420 00000100:00100000:3.0:1713279306.694010:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7eb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200019648:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.694029:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.694045:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:11807:x1796503281170624:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 428us (464us total) trans 4295202590 rc 0/0 00000100:00100000:3.0:1713279306.694050:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222963 00000100:00100000:3.0:1713279306.694065:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281171136 00000100:00100000:3.0:1713279306.694081:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281171136 00000100:00100000:3.0:1713279306.694095:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784889 00000100:00100000:3.0:1713279306.694100:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3747:11794:x1796503281171136:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.694107:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.694113:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b58c0/0xfc4b8e114eda703b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391752a1 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.694138:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda7042 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694145:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda7042 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694151:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda7042 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694159:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda7049 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694163:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda7049 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694168:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda7049 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694190:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda7042 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694194:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda7042 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694199:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda7042 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694203:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda7042 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694207:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c86b600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.694209:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda7042 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694213:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda7042 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694219:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.694221:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.694223:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda7042 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694228:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda7042 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694234:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda7049 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694238:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda7049 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694243:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda7049 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.694246:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.694246:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c86ad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.694248:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda7049 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694252:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda7049 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.694258:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x33 (ffff8800908e1900) 00000100:00100000:0.0:1713279306.694259:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.694259:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.694261:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281171264 00010000:00010000:3.0:1713279306.694262:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda7049 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:2.0:1713279306.694265:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281171264 00010000:00010000:3.0:1713279306.694266:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda7049 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:2.0:1713279306.694273:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281171328 00000100:00100000:2.0:1713279306.694275:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281171328 00010000:00010000:3.0:1713279306.694282:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b58c0/0xfc4b8e114eda703b lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752a1 expref: 3749 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.694289:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110421 00010000:00010000:3.0:1713279306.694289:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b58c0/0xfc4b8e114eda703b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752a1 expref: 3749 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.694293:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+78:1957:x1796503281171328:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:3.0:1713279306.694300:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801245b58c0, rc 0) 00000100:00100000:3.0:1713279306.694319:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3748:11794:x1796503281171136:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 219us (289us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.694324:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784889 00000100:00100000:2.0:1713279306.694355:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+79:1957:x1796503281171328:12345-192.168.203.4@tcp:2:touch.0 Request processed in 60us (93us total) trans 4295010156 rc 0/0 00000100:00100000:2.0:1713279306.694361:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110421 00000100:00100000:2.0:1713279306.694383:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784890 00000100:00100000:2.0:1713279306.694387:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3747:11695:x1796503281171264:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1713279306.694402:0:15752:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.694410:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320000/0xfc4b8e114eda6ffc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x86bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917527e expref: 3747 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.694434:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86bb:0x0].0x0 (ffff880092a4c900) 00010000:00010000:2.0:1713279306.694436:0:15752:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.694450:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114eda7050 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.694454:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114eda7050 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.694458:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114eda7050 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.694462:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda7057 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x86bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.694465:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efe680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200019712:0@lo:101:mdt_io00_007.0 00010000:00010000:2.0:1713279306.694469:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda7057 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x86bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.694474:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda7057 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x86bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.694477:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.694490:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124ce2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.694498:0:15507:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281171008 00000100:00100000:1.0:1713279306.694500:0:15507:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281171008 00000004:00010000:2.0:1713279306.694504:0:15752:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008be59f80 reply state ffff880097710000 transno 4295202592 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda7057 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x86bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.694513:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda7057 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x86bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.694514:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200019712 00000100:00100000:1.0:1713279306.694516:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14321 00010000:00010000:2.0:1713279306.694518:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86bb:0x0].0x0 (ffff880092a4c900) 00000100:00100000:3.0:1713279306.694518:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200019712 00000100:00100000:1.0:1713279306.694519:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:11666:x1796503281171008:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:2.0:1713279306.694520:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.694522:0:15752:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713279306.694533:0:15507:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.694535:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98642 00000100:00100000:3.0:1713279306.694539:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+54:15514:x1796503200019712:12345-0@lo:101:mdt_io00_007.0 00010000:00010000:1.0:1713279306.694540:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114ecdefe4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39138f95 expref: 3727 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.694545:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.694546:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c03:0x0].0x0 (ffff880131200900) 00010000:00010000:1.0:1713279306.694548:0:15507:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.694552:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3748:11695:x1796503281171264:12345-192.168.203.4@tcp:36:touch.0 Request processed in 163us (306us total) trans 4295202592 rc 0/0 00010000:00010000:1.0:1713279306.694554:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.694554:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda705e lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda7050 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.694558:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00000100:00100000:2.0:1713279306.694558:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784890 00010000:00010000:1.0:1713279306.694561:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.694566:0:15516:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda705e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda7050 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.694567:0:15507:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.694571:0:15507:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.694573:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda705e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda7050 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.694579:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x0 (ffff880092a4c400) 00010000:00010000:3.0:1713279306.694581:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.694583:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c869f80, rc 0) 00010000:00010000:1.0:1713279306.694585:0:15494:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114ed88c7e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x221:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916c551 expref: 3726 pid: 15477 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.694590:0:15494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efc380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:15494:1796503200019008:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.694597:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9d40/0xfc4b8e114eda6f77 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda6f70 expref: 55 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.694601:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x221:0x0].0x0 (ffff88008ea88000) 00010000:00010000:1.0:1713279306.694603:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.694604:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906e9d40, rc 0) 00000100:00100000:3.0:1713279306.694604:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:15514:x1796503200019712:12345-0@lo:101:mdt_io00_007.0 Request processed in 64us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.694609:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98642 00000100:00100000:2.0:1713279306.694617:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efe680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200019712:0@lo:101:mdt_io00_007.0 00000100:00100000:1.0:1713279306.694621:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+54:15482:x1796503200018944:12345-0@lo:101:mdt00_018.0 Request processed in 3909us (3939us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.694624:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98634 00010000:00010000:2.0:1713279306.694626:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114eda7050 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda705e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.694634:0:15482:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efd500 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0001-mdtlov_UUID:15482:1796503200018944:0@lo:101:mdt00_018.0 00010000:00010000:2.0:1713279306.694634:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114eda7050 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda705e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.694641:0:15482:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda6f77 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.694644:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00010000:00010000:2.0:1713279306.694657:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6400/0xfc4b8e114eda706c lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.694662:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6400/0xfc4b8e114eda706c lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.694668:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6400/0xfc4b8e114eda706c lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713279306.694677:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e9880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200019776:0@lo:101:mdt_io00_007.0 00000100:00100000:2.0:1713279306.694693:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.694702:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98000 going to sleep for 11 seconds 00000040:00080000:0.0:1713279306.694707:0:15482:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x1c0:0x0].1538, 344 off813152 00000100:00100000:3.0:1713279306.694709:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200019776 00000100:00100000:3.0:1713279306.694712:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200019776 00000040:00080000:0.0:1713279306.694724:0:15482:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xf8:0x0].2146, 424 off1513336 00000004:00080000:0.0:1713279306.694726:0:15482:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800958e3c00 with version 31969 00000100:00100000:3.0:1713279306.694726:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98643 00000100:00100000:3.0:1713279306.694730:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+54:15514:x1796503200019776:12345-0@lo:101:mdt_io00_007.0 00000004:00080000:0.0:1713279306.694733:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31969 rpc_version 31969 00010000:00010000:3.0:1713279306.694737:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00100000:0.0:1713279306.694742:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1713279306.694745:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009435eac0/0xfc4b8e114eda7073 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda706c expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.694746:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008be58380 x1796503200019904/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.694754:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200019904:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.694757:0:15494:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009435eac0/0xfc4b8e114eda7073 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda706c expref: 55 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.694764:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009435eac0/0xfc4b8e114eda7073 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda706c expref: 55 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.694769:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x3431 (ffff880092a4ca00) 00010000:00010000:3.0:1713279306.694771:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.694772:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009435eac0, rc 0) 00000100:00100000:0.0:1713279306.694773:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.694782:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092078900 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.694787:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200019904 00000100:00100000:2.0:1713279306.694790:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200019904 00000100:00100000:3.0:1713279306.694801:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15514:x1796503200019776:12345-0@lo:101:mdt_io00_007.0 Request processed in 70us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.694805:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e9880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200019776:0@lo:101:mdt_io00_007.0 00000100:00100000:3.0:1713279306.694806:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98643 00010000:00010000:2.0:1713279306.694813:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6400/0xfc4b8e114eda706c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7073 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.694820:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6400/0xfc4b8e114eda706c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7073 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.694829:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00010000:00010000:2.0:1713279306.694837:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114eda707a lrc: 3/0,1 mode: --/CW res: [0x240000401:0x134:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.694842:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114eda707a lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.694847:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114eda707a lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.694854:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114eda7081 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x134:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.694859:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114eda7081 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.694863:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114eda7081 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.694880:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x763e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.694887:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda68af lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x763e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750b0 expref: 3365 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.694897:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.694909:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda68af lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x763e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750b0 expref: 3365 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.694916:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda68af lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x763e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750b0 expref: 3365 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.694924:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001_UUID:15514:1796503200019968:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.694952:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98000 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.694974:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98644 00000100:00100000:2.0:1713279306.694978:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+55:8074:x1796503200019904:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1713279306.695055:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+56:8074:x1796503200019904:12345-0@lo:1000:osp_up0-1.0 Request processed in 76us (281us total) trans 4295202593 rc 0/0 00000100:00100000:2.0:1713279306.695061:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98644 00000100:00100000:0.0:1713279306.695094:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200019904:0@lo:1000:osp_up0-1.0 00000004:00010000:2.0:1713279306.695105:0:15482:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007f1d4000 reply state ffff8800981d8000 transno 4295183582 ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.695114:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.695119:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25a:0x0].0x0 (ffff880095863200) 00010000:00010000:2.0:1713279306.695121:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.695122:0:15482:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.695125:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda6f77 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.695132:0:15482:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda6f77 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.695137:0:15482:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x221:0x0] 00000004:00010000:2.0:1713279306.695139:0:15482:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007f1d4000 reply state ffff8800981d8000 transno 4295183582 ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114eda6e43 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7ac4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.695143:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114eda6e43 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7ac4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.695146:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ac4:0x0].0x0 (ffff880090a56400) 00010000:00010000:2.0:1713279306.695147:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.695148:0:15482:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1713279306.695151:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7ac4:0x0]: returning size 4096 00000100:00100000:2.0:1713279306.695181:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3366:11796:x1796503281167360:12345-192.168.203.4@tcp:36:touch.0 Request processed in 7584us (8418us total) trans 4295183582 rc 0/0 00000100:00100000:2.0:1713279306.695187:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784867 00000100:00100000:1.0:1713279306.695548:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+91:15485:x1796503200019136:12345-0@lo:403:mdt00_021.0 Request processed in 3915us (3944us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.695552:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98636 00000100:00100000:2.0:1713279306.695570:0:15485:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-mdtlov_UUID:15485:1796503200019136:0@lo:403:mdt00_021.0 00000100:00100000:0.0:1713279306.695870:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.695897:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281171584 00000100:00100000:1.0:1713279306.695900:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281171584 00000100:00100000:0.0:1713279306.695903:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.695917:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784891 00000100:00100000:1.0:1713279306.695920:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3748:11711:x1796503281171584:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.695925:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.695932:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda708f lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391752b6 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.695960:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281171712 00000100:00100000:3.0:1713279306.695964:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281171712 00010000:00010000:1.0:1713279306.695969:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda7096 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.695974:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda7096 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.695978:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda7096 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.695981:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784892 00010000:00010000:1.0:1713279306.695984:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda709d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.695985:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3366:11834:x1796503281171712:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.695987:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda709d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.695991:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda709d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.695992:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.696001:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114eda70a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391752bd expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713279306.696002:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:1.0:1713279306.696006:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda7096 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.696009:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda7096 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.696012:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda7096 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.696015:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda7096 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.696018:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880130c92640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.696019:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda7096 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.696022:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda7096 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.696026:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880090371e00) 00010000:00010000:1.0:1713279306.696027:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.696029:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda7096 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.696032:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda7096 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.696036:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda709d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.696039:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda709d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.696039:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801222cd440/0xfc4b8e114eda70ab lrc: 3/1,0 mode: --/CR res: [0x240000403:0x757a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.696045:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda709d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.696047:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880130c93cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.696047:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801222cd440/0xfc4b8e114eda70ab lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x757a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.696048:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda709d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.696051:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda709d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.696054:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff88012d067600) 00010000:00010000:3.0:1713279306.696054:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801222cd440/0xfc4b8e114eda70ab lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x757a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.696055:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.696056:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda709d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.696059:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda709d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000004:00200000:3.0:1713279306.696060:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x757a:0x0]: returning size 4096 00000040:00080000:2.0:1713279306.696063:0:15485:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x1b7:0x0].192, 400 off109888 00010000:00010000:1.0:1713279306.696084:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda708f lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752b6 expref: 3749 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.696088:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda708f lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752b6 expref: 3749 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.696093:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c93a80, rc 0) 00010000:00010000:3.0:1713279306.696112:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114eda70a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752bd expref: 3369 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.696114:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3748:11711:x1796503281171584:12345-192.168.203.4@tcp:101:touch.0 Request processed in 193us (244us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.696118:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784891 00010000:00010000:3.0:1713279306.696124:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801222cd440/0xfc4b8e114eda70ab lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x757a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752bd expref: 3368 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.696129:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x757a:0x0].0x0 (ffff88008c725f00) 00010000:00010000:3.0:1713279306.696131:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1713279306.696133:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801222cd440, rc 0) 00000100:00100000:3.0:1713279306.696151:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3368:11834:x1796503281171712:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 164us (247us total) trans 4295183583 rc 0/0 00000100:00100000:3.0:1713279306.696157:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784892 00000040:00080000:2.0:1713279306.696178:0:15485:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0xf2:0x0].677, 480 off478808 00000004:00080000:2.0:1713279306.696182:0:15485:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012ffbb900 with version 29398 00000004:00080000:3.0:1713279306.696192:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29398 rpc_version 29398 00000020:00100000:3.0:1713279306.696203:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.696207:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880098cc9f80 x1796503200020096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1184/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.696218:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc9f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200020096:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.696238:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.696246:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ca45a80 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.696248:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200020096 00000100:00100000:1.0:1713279306.696250:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200020096 00000100:00100000:1.0:1713279306.696259:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98645 00000100:00100000:1.0:1713279306.696261:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+91:8634:x1796503200020096:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.696338:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.696354:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.696367:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281171392 00000100:00100000:0.0:1713279306.696370:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281171392 00000100:00100000:3.0:1713279306.696370:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281172288 00000100:00100000:3.0:1713279306.696374:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281172288 00000100:00100000:0.0:1713279306.696383:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784893 00000100:00100000:0.0:1713279306.696386:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3368:11827:x1796503281171392:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.696389:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784894 00010000:00010000:0.0:1713279306.696392:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.696392:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3748:11794:x1796503281172288:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.696398:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda70b9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391752a8 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.696402:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.696409:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda70c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391752cb expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.696431:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda70c7 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.696437:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda70c7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.696441:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda70c7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.696447:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda70ce lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.696450:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda70ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.696452:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114eda70d5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.696453:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+92:8634:x1796503200020096:12345-0@lo:1000:osp_up1-0.0 Request processed in 190us (214us total) trans 4295183584 rc 0/0 00010000:00010000:0.0:1713279306.696454:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda70ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.696457:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98645 00010000:00010000:3.0:1713279306.696459:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114eda70d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.696465:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114eda70d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.696470:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda70dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.696474:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda70dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.696475:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3180/0xfc4b8e114eda70e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.696477:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda70dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.696481:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc9f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200020096:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713279306.696481:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3180/0xfc4b8e114eda70e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00000004:00010000:0.0:1713279306.696483:0:15473:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda70dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.696486:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3180/0xfc4b8e114eda70e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.696488:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda70c7 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.696492:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda70c7 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.696494:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda70c7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000004:00010000:2.0:1713279306.696496:0:15485:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012e526300 reply state ffff880097425000 transno 4295202594 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5f80/0xfc4b8e114eda6f7e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x23e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.696497:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda70c7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.696500:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe14fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.696501:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda70c7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.696503:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5f80/0xfc4b8e114eda6f7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x23e:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.696505:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda70c7 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.696509:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:2.0:1713279306.696509:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x23e:0x0].0x0 (ffff88012514d100) 00010000:00010000:0.0:1713279306.696510:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.696511:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:0.0:1713279306.696512:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda70c7 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.696513:0:15485:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1713279306.696513:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8516:0x0]: returning size 1 00010000:00010000:0.0:1713279306.696514:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda70c7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.696517:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091dd4480/0xfc4b8e114eda6f85 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x245:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda6f93 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.696519:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda70ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.696520:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114eda70d5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.696522:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda70ce lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.696523:0:15485:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091dd4480/0xfc4b8e114eda6f85 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x245:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda6f93 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.696525:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda70ce lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.696525:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114eda70d5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.696528:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe14900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.696529:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda70ce lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.696530:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114eda70d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00000004:00010000:2.0:1713279306.696531:0:15485:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012e526300 reply state ffff880097425000 transno 4295202594 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.696532:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda70ce lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.696534:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114eda70d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.696535:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3831 (ffff880130675100) 00010000:00010000:0.0:1713279306.696537:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.696537:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.696538:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda70ce lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.696540:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda70ce lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.696542:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8179:0x0].0x0 (ffff88007f389300) 00010000:00010000:3.0:1713279306.696543:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c366880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.696544:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:3.0:1713279306.696545:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114eda70d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.696546:0:15485:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00010000:2.0:1713279306.696548:0:15485:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012e526300 reply state ffff880097425000 transno 4295202594 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda6dbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.696550:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda70b9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752a8 expref: 3370 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.696550:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114eda70d5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.696554:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda6dbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.696555:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda70dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752a8 expref: 3369 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.696556:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:0.0:1713279306.696558:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84ee:0x0].0x0 (ffff88008acd3000) 00010000:00010000:3.0:1713279306.696558:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.696559:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:0.0:1713279306.696560:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713279306.696561:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe161c0, rc 0) 00010000:00010000:3.0:1713279306.696561:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114eda70d5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.696562:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.696563:0:15485:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:3.0:1713279306.696565:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114eda70d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.696571:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3180/0xfc4b8e114eda70e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.696576:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:11827:x1796503281171392:12345-192.168.203.4@tcp:101:touch.0 Request processed in 189us (240us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.696576:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3180/0xfc4b8e114eda70e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.696580:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784893 00010000:00010000:3.0:1713279306.696580:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3180/0xfc4b8e114eda70e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.696584:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008dae3180 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.696585:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:9683:x1796503281165056:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 14527us (14655us total) trans 4295202594 rc 0/0 00010000:00010000:3.0:1713279306.696587:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3180/0xfc4b8e114eda70e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.696591:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784857 00000100:00100000:0.0:1713279306.696592:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.696592:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3180/0xfc4b8e114eda70e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.696597:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3931 (ffff880092a4cf00) 00000100:00100000:0.0:1713279306.696599:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281171456 00010000:00010000:3.0:1713279306.696599:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.696601:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281171456 00010000:00010000:3.0:1713279306.696601:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3180/0xfc4b8e114eda70e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.696606:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3180/0xfc4b8e114eda70e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.696612:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784895 00000100:00100000:0.0:1713279306.696614:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:11374:x1796503281171456:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.696619:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.696623:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.696625:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda70ea lrc: 2/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391752af expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.696625:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda70c0 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752cb expref: 3749 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.696632:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda70c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752cb expref: 3749 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.696634:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.696638:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281171840 00010000:00010000:3.0:1713279306.696639:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c53ad00, rc 0) 00000100:00100000:2.0:1713279306.696641:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281171840 00010000:00010000:0.0:1713279306.696642:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda70f1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.696643:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.696646:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda70f1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.696650:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda70f1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713279306.696654:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281171968 00000100:00100000:2.0:1713279306.696656:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281171968 00000100:00100000:3.0:1713279306.696659:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3748:11794:x1796503281172288:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 265us (306us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.696664:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281172096 00000100:00100000:3.0:1713279306.696664:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784894 00000100:00100000:2.0:1713279306.696665:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281172096 00000100:00100000:2.0:1713279306.696676:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222965 00000100:00100000:2.0:1713279306.696680:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c569850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:10123:x1796503281171840:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.696680:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222966 00000100:00100000:3.0:1713279306.696683:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:11204:x1796503281171968:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:1.0:1713279306.696685:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00200000:0.0:1713279306.696689:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76da:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.696691:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:2.0:1713279306.696693:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222967 00000004:00010000:0.0:1713279306.696696:0:9221:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda70f1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713279306.696697:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:385c4b71-808c-40cf-91de-b076b668d13f+3645:11708:x1796503281172096:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:0.0:1713279306.696705:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda70ea lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752af expref: 3371 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.696710:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda70f1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752af expref: 3370 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.696714:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76da:0x0].0x0 (ffff880130675700) 00010000:00010000:0.0:1713279306.696716:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713279306.696717:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe17a80, rc 0) 00000100:00100000:0.0:1713279306.696731:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3370:11374:x1796503281171456:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 116us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.696735:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784895 00000100:00100000:0.0:1713279306.696741:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281172160 00000100:00100000:0.0:1713279306.696743:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281172160 00000100:00100000:0.0:1713279306.696752:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784896 00000100:00100000:0.0:1713279306.696755:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3748:11695:x1796503281172160:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.696755:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:385c4b71-808c-40cf-91de-b076b668d13f+3646:11708:x1796503281172096:12345-192.168.203.4@tcp:35:touch.0 Request processed in 56us (109us total) trans 4295183585 rc 0/0 00010000:00010000:0.0:1713279306.696759:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.696761:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222967 00010000:00010000:0.0:1713279306.696764:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17600/0xfc4b8e114eda70f8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x86bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391752c4 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.696767:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3729:11204:x1796503281171968:12345-192.168.203.4@tcp:35:touch.0 Request processed in 83us (132us total) trans 4295202595 rc 0/0 00000100:00100000:3.0:1713279306.696773:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222966 00010000:00010000:0.0:1713279306.696776:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17600/0xfc4b8e114eda70f8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x86bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752c4 expref: 3749 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.696781:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17600/0xfc4b8e114eda70f8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x86bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752c4 expref: 3749 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.696784:0:15514:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff8801251daa00 x1796503200019968) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda68af lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x763e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750b0 expref: 3369 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.696787:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86bb:0x0].0x0 (ffff880092a4c900) 00010000:00010000:0.0:1713279306.696788:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1713279306.696789:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe17600, rc 0) 00010000:00010000:2.0:1713279306.696794:0:15514:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda68af lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x763e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750b0 expref: 3369 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.696801:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3749:11695:x1796503281172160:12345-192.168.203.4@tcp:101:touch.0 Request processed in 45us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.696804:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784896 00010000:00010000:2.0:1713279306.696805:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda68af lrc: 0/0,0 mode: --/PW res: [0x240000403:0x763e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750b0 expref: 3369 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.696814:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001_UUID:15514:1796503200019968:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.696821:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x763e:0x0].0x0 (ffff88012fbfeb00) 00010000:00010000:2.0:1713279306.696824:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.696830:0:15514:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.696835:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.696843:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.696848:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.696853:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713279306.696893:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200020160:0@lo:1000:mdt_io00_007.0 00000100:00100000:2.0:1713279306.696909:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.696915:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98000 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.696919:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200020160 00000100:00100000:1.0:1713279306.696922:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200020160 00000100:00100000:1.0:1713279306.696937:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98646 00000100:00100000:2.0:1713279306.696939:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c569850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:10123:x1796503281171840:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 259us (316us total) trans 0 rc -116/-116 00000100:00100000:1.0:1713279306.696940:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+56:15514:x1796503200020160:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:2.0:1713279306.696944:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222965 00000100:00100000:1.0:1713279306.696993:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+56:15514:x1796503200020160:12345-0@lo:1000:mdt_io00_007.0 Request processed in 51us (83us total) trans 0 rc -2/-2 00000100:00100000:1.0:1713279306.696997:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98646 00000100:00100000:3.0:1713279306.697022:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200020160:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.697049:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cca300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200020224:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.697067:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.697088:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ca453c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.697090:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200020224 00000100:00100000:1.0:1713279306.697092:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200020224 00000100:00100000:1.0:1713279306.697104:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98647 00000100:00100000:1.0:1713279306.697106:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+56:15514:x1796503200020224:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.697131:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+56:15514:x1796503200020224:12345-0@lo:1000:mdt_io00_007.0 Request processed in 24us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.697134:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98647 00000100:00100000:3.0:1713279306.697141:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cca300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200020224:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.697167:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cca300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200020288:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.697224:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.697231:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ca45a80 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.697233:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200020288 00000100:00100000:1.0:1713279306.697235:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200020288 00000100:00100000:1.0:1713279306.697246:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98648 00000100:00100000:1.0:1713279306.697248:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+56:15514:x1796503200020288:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.697319:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+56:15514:x1796503200020288:12345-0@lo:1000:mdt_io00_007.0 Request processed in 70us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.697323:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98648 00000100:00100000:3.0:1713279306.697326:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cca300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200020288:0@lo:1000:mdt_io00_007.0 00000100:00100000:0.0:1713279306.697426:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.697433:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cca300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200020352:0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.697437:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281172480 00000100:00100000:0.0:1713279306.697438:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.697439:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281172480 00000100:00100000:1.0:1713279306.697445:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281172608 00000100:00100000:1.0:1713279306.697447:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281172608 00000100:00100000:0.0:1713279306.697448:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784897 00000100:00100000:0.0:1713279306.697452:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3749:11794:x1796503281172480:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:3.0:1713279306.697453:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.697454:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784898 00000100:00100000:1.0:1713279306.697457:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3646:11711:x1796503281172608:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.697458:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.697462:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.697463:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ca453c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.697464:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800943f3600/0xfc4b8e114eda70ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391752d9 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.697469:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda7106 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391752e0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.697490:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda710d lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.697491:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda7114 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.697495:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda710d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.697499:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda7114 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.697499:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda710d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697504:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda711b lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.697505:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda7114 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.697507:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda711b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697510:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda711b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.697514:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda7122 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697520:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda7122 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.697522:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda710d lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.697525:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda7122 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.697525:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda710d lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697528:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda710d lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697531:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda710d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697534:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a5b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.697535:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda710d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697538:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda710d lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697542:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88012d067300) 00010000:00010000:1.0:1713279306.697543:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.697545:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda710d lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697547:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda710d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697552:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda711b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697554:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda711b lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697557:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda711b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697560:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a4d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.697562:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda711b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697565:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda711b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697568:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88012d067700) 00010000:00010000:1.0:1713279306.697569:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.697570:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7129 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.697571:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda711b lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697573:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda711b lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.697579:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7129 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697584:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7129 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.697584:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda7106 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752e0 expref: 3647 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.697588:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda7106 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752e0 expref: 3647 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.697589:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7129 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.697592:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009681c900, rc 0) 00010000:00010000:0.0:1713279306.697594:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a4c86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.697596:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7129 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697602:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7129 lrc: 4/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697608:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7abd:0x0].0x0 (ffff88008c2e7d00) 00010000:00010000:0.0:1713279306.697611:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7129 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.697614:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3646:11711:x1796503281172608:12345-192.168.203.4@tcp:101:touch.0 Request processed in 156us (175us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.697616:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7129 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.697618:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784898 00000004:00200000:0.0:1713279306.697625:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7abd:0x0]: returning size 42048 00000100:00100000:1.0:1713279306.697628:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200020352 00000100:00100000:1.0:1713279306.697629:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200020352 00000100:00100000:1.0:1713279306.697637:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98649 00000100:00100000:1.0:1713279306.697639:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+56:15514:x1796503200020352:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:2.0:1713279306.697648:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.697653:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda7114 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697659:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda7114 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697664:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda7114 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697669:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda7114 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.697670:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+56:15514:x1796503200020352:12345-0@lo:1000:mdt_io00_007.0 Request processed in 30us (217us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.697674:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800950718c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.697676:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda7114 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.697676:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98649 00010000:00010000:0.0:1713279306.697681:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda7114 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.697685:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281172736 00000100:00100000:1.0:1713279306.697686:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281172736 00010000:00010000:0.0:1713279306.697688:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:0.0:1713279306.697691:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.697693:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda7114 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.697694:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784899 00000100:00100000:1.0:1713279306.697696:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3646:11708:x1796503281172736:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.697698:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda7114 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.697700:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cca300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200020352:0@lo:1000:mdt_io00_007.0 00010000:00010000:1.0:1713279306.697701:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.697706:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda7122 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.697706:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda7137 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391752e7 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.697711:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda7122 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697716:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda7122 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697721:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009160a880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.697723:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda7122 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697728:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda7122 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697734:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x33 (ffff880130675500) 00010000:00010000:0.0:1713279306.697736:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.697738:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda7122 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.697740:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda713e lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.697743:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda7122 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.697744:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda713e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697748:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda713e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.697750:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e605f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200020416:0@lo:1000:mdt_io00_007.0 00010000:00010000:1.0:1713279306.697754:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda7145 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.697757:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda7145 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697760:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda7145 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.697766:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.697775:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800968dde40 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.697777:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda714c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.697781:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda714c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697786:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda714c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000004:00200000:1.0:1713279306.697790:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x71e6:0x0]: returning size 0 00010000:00010000:1.0:1713279306.697810:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda713e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697813:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda713e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697816:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda713e lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697819:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda713e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697821:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a7180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.697823:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943f3600/0xfc4b8e114eda70ff lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752d9 expref: 3751 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.697823:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda713e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697826:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda713e lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.697829:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943f3600/0xfc4b8e114eda70ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752d9 expref: 3751 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.697830:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88008c124700) 00010000:00010000:1.0:1713279306.697831:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.697833:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda713e lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697835:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda713e lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.697835:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.697837:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943f3600, rc 0) 00010000:00010000:1.0:1713279306.697840:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda7145 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697845:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda7145 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697848:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda7145 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697850:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801250f6ac0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.697850:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281172864 00010000:00010000:1.0:1713279306.697851:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda7145 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.697852:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3750:11794:x1796503281172480:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 400us (439us total) trans 4295202596 rc 301/301 00000100:00100000:3.0:1713279306.697853:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281172864 00010000:00010000:1.0:1713279306.697854:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda7145 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.697856:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784897 00010000:00010000:1.0:1713279306.697857:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3831 (ffff88012d067c00) 00010000:00010000:1.0:1713279306.697858:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.697859:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda7145 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.697862:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda7145 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.697866:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784900 00000100:00100000:0.0:1713279306.697868:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3750:11829:x1796503281172864:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:1.0:1713279306.697876:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda7137 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752e7 expref: 3649 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.697880:0:9221:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.697881:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda714c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752e7 expref: 3648 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.697885:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71e6:0x0].0x0 (ffff880090bee600) 00010000:00010000:1.0:1713279306.697886:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713279306.697887:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda6ef2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f40:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917524d expref: 3750 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.697887:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801250f7840, rc 0) 00010000:00010000:0.0:1713279306.697893:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f40:0x0].0x0 (ffff88013484f000) 00010000:00010000:0.0:1713279306.697894:0:9221:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.697903:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3648:11708:x1796503281172736:12345-192.168.203.4@tcp:101:touch.0 Request processed in 205us (255us total) trans 4295183586 rc 0/0 00000100:00100000:1.0:1713279306.697907:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784899 00010000:00010000:0.0:1713279306.697909:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0daac0/0xfc4b8e114eda715a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7f40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697914:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0daac0/0xfc4b8e114eda715a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697917:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0daac0/0xfc4b8e114eda715a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.697917:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200020416 00000100:00100000:1.0:1713279306.697919:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200020416 00000100:00100000:1.0:1713279306.697927:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98650 00000100:00100000:1.0:1713279306.697930:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:15514:x1796503200020416:12345-0@lo:1000:mdt_io00_007.0 00000004:00010000:0.0:1713279306.697943:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012e7e8380 reply state ffff880095728000 transno 4295202597 ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0daac0/0xfc4b8e114eda715a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697947:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0daac0/0xfc4b8e114eda715a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7f40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.697950:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f40:0x0].0x0 (ffff88013484f000) 00010000:00010000:0.0:1713279306.697952:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.697953:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713279306.697958:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:15514:x1796503200020416:12345-0@lo:1000:mdt_io00_007.0 Request processed in 27us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.697961:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98650 00000100:00100000:3.0:1713279306.697972:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e605f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200020416:0@lo:1000:mdt_io00_007.0 00000100:00100000:0.0:1713279306.697977:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3751:11829:x1796503281172864:12345-192.168.203.4@tcp:36:touch.0 Request processed in 107us (142us total) trans 4295202597 rc 0/0 00000100:00100000:0.0:1713279306.697980:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784900 00000100:00100000:3.0:1713279306.698003:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e605f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200020480:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.698021:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.698028:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880130ade300 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.698031:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200020480 00000100:00100000:1.0:1713279306.698033:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200020480 00000100:00100000:1.0:1713279306.698040:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98651 00000100:00100000:1.0:1713279306.698042:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:15514:x1796503200020480:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.698078:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:15514:x1796503200020480:12345-0@lo:1000:mdt_io00_007.0 Request processed in 25us (46us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.698081:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98651 00000100:00100000:3.0:1713279306.698092:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e605f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200020480:0@lo:1000:mdt_io00_007.0 00000040:00080000:3.0:1713279306.698243:0:15514:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x1c0:0x0].1539, 1392 off814544 00000040:00080000:3.0:1713279306.698264:0:15514:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xf8:0x0].2147, 1472 off1514808 00000100:00100000:3.0:1713279306.698277:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e605f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200020544:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.698292:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.698311:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880130ade300 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.698323:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200020544 00000100:00100000:1.0:1713279306.698326:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200020544 00000100:00100000:1.0:1713279306.698338:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98652 00000100:00100000:1.0:1713279306.698340:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:15514:x1796503200020544:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.698384:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:15514:x1796503200020544:12345-0@lo:1000:mdt_io00_007.0 Request processed in 43us (92us total) trans 4295010157 rc 0/0 00000100:00100000:1.0:1713279306.698388:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98652 00000100:00100000:3.0:1713279306.698399:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e605f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200020544:0@lo:1000:mdt_io00_007.0 00000004:00080000:3.0:1713279306.698405:0:15514:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800925450c0 with version 31970 00000004:00080000:0.0:1713279306.698430:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31970 rpc_version 31970 00000020:00100000:0.0:1713279306.698443:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.698447:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009387c380 x1796503200020672/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.698455:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200020672:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.698473:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.698481:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549480 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.698483:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200020672 00000100:00100000:1.0:1713279306.698485:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200020672 00000100:00100000:1.0:1713279306.698493:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98653 00000100:00100000:1.0:1713279306.698495:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+56:8074:x1796503200020672:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.698606:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.698623:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.698635:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281173120 00000100:00100000:0.0:1713279306.698638:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281173120 00000100:00100000:3.0:1713279306.698641:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281172928 00000100:00100000:2.0:1713279306.698642:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.698645:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281172928 00000100:00100000:0.0:1713279306.698650:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281173248 00000100:00100000:0.0:1713279306.698652:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281173248 00000100:00100000:3.0:1713279306.698660:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222968 00000100:00100000:2.0:1713279306.698663:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.698664:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3371:11374:x1796503281172928:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:1.0:1713279306.698667:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+57:8074:x1796503200020672:12345-0@lo:1000:osp_up0-1.0 Request processed in 171us (192us total) trans 4295202598 rc 0/0 00000100:00100000:1.0:1713279306.698672:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98653 00000100:00100000:2.0:1713279306.698675:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281173376 00000100:00100000:2.0:1713279306.698677:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281173376 00000100:00100000:1.0:1713279306.698684:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784901 00000100:00100000:0.0:1713279306.698685:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200020672:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.698687:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3371:11204:x1796503281173120:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.698692:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.698693:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784902 00000100:00100000:0.0:1713279306.698696:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784903 00000100:00100000:2.0:1713279306.698697:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:11817:x1796503281173248:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.698698:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda7161 lrc: 2/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391752ee expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.698699:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3751:11830:x1796503281173376:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.698704:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.698705:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.698706:0:15482:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1713279306.698713:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda7168 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391752d2 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.698714:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688480/0xfc4b8e114eda4fb1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x8439:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174a58 expref: 3751 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.698718:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda716f lrc: 3/1,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.698721:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8439:0x0].0x0 (ffff8800938abb00) 00010000:00010000:0.0:1713279306.698723:0:15482:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.698723:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda716f lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.698726:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda716f lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.698727:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7176 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x8439:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391752f5 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.698732:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda717d lrc: 3/1,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.698736:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda717d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.698739:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda717d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.698751:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda716f lrc: 4/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.698754:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda716f lrc: 4/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.698755:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7184 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.698756:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda718b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8439:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.698757:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda716f lrc: 3/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.698760:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda716f lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.698761:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda718b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8439:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.698762:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7184 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.698763:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801250f5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.698764:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda716f lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.698765:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda718b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8439:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.698767:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda716f lrc: 5/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.698768:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7184 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000004:00200000:0.0:1713279306.698769:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8439:0x0]: returning size 45312 00010000:00010000:1.0:1713279306.698771:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xff:0x0].0x0 (ffff880091de1a00) 00010000:00010000:1.0:1713279306.698772:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.698774:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda716f lrc: 3/0,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.698776:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda716f lrc: 0/0,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.698776:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef600/0xfc4b8e114eda7192 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.698781:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda717d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.698781:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef600/0xfc4b8e114eda7192 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.698784:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda717d lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.698786:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef600/0xfc4b8e114eda7192 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.698787:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda717d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.698789:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ceacd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.698791:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda717d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.698796:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7176 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x8439:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752f5 expref: 3753 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.698796:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda717d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.698799:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xff:0x0].0x3431 (ffff88012d067b00) 00010000:00010000:1.0:1713279306.698800:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.698802:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda717d lrc: 2/0,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.698803:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda718b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x8439:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752f5 expref: 3752 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.698804:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda717d lrc: 0/0,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.698806:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8439:0x0].0x0 (ffff8800938abb00) 00010000:00010000:0.0:1713279306.698808:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1713279306.698809:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092540900, rc 0) 00010000:00010000:1.0:1713279306.698815:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda7161 lrc: 1/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752ee expref: 3372 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.698819:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda7161 lrc: 0/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752ee expref: 3372 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.698823:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801250f7a80, rc 0) 00000100:00100000:0.0:1713279306.698825:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3752:11830:x1796503281173376:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 124us (162us total) trans 4295202599 rc 0/0 00000100:00100000:0.0:1713279306.698828:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784903 00000004:00200000:2.0:1713279306.698829:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8292:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.698835:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7184 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.698836:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3371:11204:x1796503281173120:12345-192.168.203.4@tcp:101:touch.0 Request processed in 149us (215us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.698839:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7184 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.698840:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784901 00000100:00100000:0.0:1713279306.698841:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.698844:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7184 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.698846:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281172992 00000100:00100000:1.0:1713279306.698848:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281172992 00010000:00010000:2.0:1713279306.698848:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7184 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.698851:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ecfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.698854:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7184 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.698859:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7184 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.698861:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784904 00000100:00100000:1.0:1713279306.698863:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3730:10123:x1796503281172992:12345-192.168.203.4@tcp:34:lfs.0 00000100:00100000:0.0:1713279306.698864:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.698865:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:2.0:1713279306.698867:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.698869:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7184 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.698875:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7184 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.698879:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda71a0 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.698881:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef600/0xfc4b8e114eda7192 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.698884:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda71a0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.698886:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef600/0xfc4b8e114eda7192 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.698888:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda71a0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.698890:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef600/0xfc4b8e114eda7192 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.698893:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda71a7 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.698894:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ef600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.698896:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda71a7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.698896:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef600/0xfc4b8e114eda7192 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.698899:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef600/0xfc4b8e114eda7192 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.698900:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda71a7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.698904:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x35 (ffff880097910000) 00010000:00010000:2.0:1713279306.698906:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.698907:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef600/0xfc4b8e114eda7192 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.698911:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef600/0xfc4b8e114eda7192 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.698921:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114eda71ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.698923:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.698925:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114eda71ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.698926:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda7168 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752d2 expref: 3730 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.698929:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114eda71ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.698933:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda7168 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752d2 expref: 3730 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.698939:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ed680, rc 0) 00000004:00010000:1.0:1713279306.698942:0:15482:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114eda71ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.698946:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda71a0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.698949:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda71a0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.698950:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281173184 00010000:00010000:1.0:1713279306.698952:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda71a0 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.698952:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281173184 00010000:00010000:1.0:1713279306.698955:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda71a0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.698958:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dca880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.698960:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda71a0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.698963:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda71a0 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.698964:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281173440 00010000:00010000:1.0:1713279306.698966:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff8800909b0e00) 00000100:00100000:2.0:1713279306.698966:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281173440 00010000:00010000:1.0:1713279306.698967:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.698969:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda71a0 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.698971:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda71a0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.698976:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110422 00010000:00010000:1.0:1713279306.698977:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda71a7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.698980:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda71a7 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.698980:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+80:1957:x1796503281173184:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:1.0:1713279306.698983:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda71a7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.698986:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c9b5680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.698987:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda71a7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.698988:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110423 00010000:00010000:1.0:1713279306.698990:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda71a7 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.698993:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x3731 (ffff880089dc3a00) 00000100:00100000:0.0:1713279306.698994:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+80:11824:x1796503281173440:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.698994:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.698995:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda71a7 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.698998:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda71a7 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.699002:0:11415:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.699003:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114eda71ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.699005:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114eda71ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.699008:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114eda71ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.699010:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c9b5200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.699011:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114eda71ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.699012:0:11415:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092540480/0xfc4b8e114eda71b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391752fc expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.699014:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114eda71ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.699017:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f3b:0x0].0x0 (ffff88008d11e100) 00010000:00010000:1.0:1713279306.699018:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.699020:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114eda71ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.699022:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114eda71ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.699027:0:11415:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda3a1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391744a1 expref: 82 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713279306.699035:0:11415:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda5816 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c65 expref: 76 pid: 11415 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713279306.699040:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3729:10123:x1796503281172992:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 176us (198us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.699042:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.699044:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713279306.699044:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784904 00000100:00100000:2.0:1713279306.699044:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+82:1957:x1796503281173184:12345-192.168.203.4@tcp:2:touch.0 Request processed in 62us (178us total) trans 4295010158 rc 0/0 00010000:00010000:0.0:1713279306.699047:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092540480/0xfc4b8e114eda71b5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752fc expref: 82 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.699049:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110422 00010000:00010000:0.0:1713279306.699063:0:11415:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda5816 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c65 expref: 76 pid: 11415 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713279306.699087:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:11817:x1796503281173248:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 389us (443us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.699089:0:11415:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda5816 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c65 expref: 76 pid: 11415 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.699092:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784902 00000100:00100000:0.0:1713279306.699099:0:11415:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11415:1796503200020736:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.699141:0:11415:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda3a1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391744a1 expref: 81 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713279306.699150:0:11415:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda3a1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391744a1 expref: 81 pid: 15499 timeout: 509 lvb_type: 1 00000004:00010000:3.0:1713279306.699179:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007fd8c700 reply state ffff88009572e000 transno 4295183587 ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.699187:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.699193:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x763e:0x0].0x0 (ffff88012fbfeb00) 00010000:00010000:3.0:1713279306.699194:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1713279306.699196:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.699200:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114eda707a lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.699204:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114eda707a lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.699209:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114eda707a lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.699213:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114eda707a lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.699217:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.699219:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114eda707a lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.699223:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114eda707a lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.699228:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x0 (ffff88008da65700) 00010000:00010000:3.0:1713279306.699230:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.699232:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114eda707a lrc: 3/0,0 mode: --/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.699237:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114eda707a lrc: 0/0,0 mode: --/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000004:00010000:3.0:1713279306.699245:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007fd8c700 reply state ffff88009572e000 transno 4295183587 ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114eda7081 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.699250:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114eda7081 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.699254:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x3431 (ffff880089dc2200) 00010000:00010000:3.0:1713279306.699256:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.699257:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1713279306.699259:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00010000:00010000:3.0:1713279306.699277:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114eda7050 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda705e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.699292:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114eda7050 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda705e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.699298:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114eda7050 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda705e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.699305:0:11415:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11415:1796503200020800:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.699310:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.699315:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1713279306.699319:0:6919:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:3.0:1713279306.699319:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00010000:00010000:3.0:1713279306.699323:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6400/0xfc4b8e114eda706c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7073 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.699324:0:11415:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549a80 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.699324:0:6919:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114eda7050 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114eda705e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.699329:0:15514:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6400/0xfc4b8e114eda706c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7073 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.699330:0:6919:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e8900 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:2.0:1713279306.699333:0:6919:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114eda7050 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda705e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.699344:0:6919:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114eda7050 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda705e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.699349:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.699359:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.699360:0:6919:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114eda7050 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda705e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.699365:0:6919:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713279306.699377:0:6919:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114eda7050 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda705e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713279306.699379:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000403:0x863c:0x0] 00000100:00100000:1.0:1713279306.699381:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200020864:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.699382:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114eda7050 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda705e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.699384:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.699390:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.699393:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.699394:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.699396:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.699396:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.699398:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.699403:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281173568 00000100:00100000:0.0:1713279306.699405:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281173824 00010000:00010000:3.0:1713279306.699405:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1713279306.699406:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281173568 00000100:00100000:0.0:1713279306.699408:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281173824 00010000:00010000:1.0:1713279306.699432:0:15544:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713279306.699436:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.699438:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281173696 00000100:00100000:2.0:1713279306.699438:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784905 00000100:00100000:0.0:1713279306.699439:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281173696 00010000:00010000:1.0:1713279306.699440:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6f40 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:1.0:1713279306.699442:0:15544:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.699443:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3753:11711:x1796503281173568:12345-192.168.203.4@tcp:101:touch.0 00000004:00010000:1.0:1713279306.699446:0:15544:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.699450:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3372:10814:x1796503281157184:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 31078us (31112us total) trans 4295183587 rc 0/0 00010000:00010000:2.0:1713279306.699451:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.699456:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14318 00010000:00010000:1.0:1713279306.699457:0:15544:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.699458:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda71bc lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175303 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.699461:0:15544:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713279306.699473:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.699477:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6f40/0xfc4b8e114eda69c0 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda69ce expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.699485:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.699486:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.699487:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279306.699489:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784906 00000100:00100000:1.0:1713279306.699490:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713279306.699492:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3754:11794:x1796503281173824:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:3.0:1713279306.699494:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784907 00000100:00100000:1.0:1713279306.699495:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200020928:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.699499:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda71c3 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.699500:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3648:11708:x1796503281173696:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1713279306.699503:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.699506:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda71c3 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.699509:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda71ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917530a expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.699511:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.699515:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda71c3 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.699517:0:15479:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.699522:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200020864 00000100:00100000:1.0:1713279306.699523:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200020864 00010000:00010000:2.0:1713279306.699523:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda71d1 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.699525:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda714c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752e7 expref: 3648 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.699529:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda71d1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.699531:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda71d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.699534:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda71d1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.699534:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71e6:0x0].0x0 (ffff880090bee600) 00010000:00010000:3.0:1713279306.699536:0:15479:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.699537:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda71d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.699539:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200020928 00000100:00100000:1.0:1713279306.699540:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200020928 00010000:00010000:0.0:1713279306.699542:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda71d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.699546:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114eda69ce lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda69c0 expref: 58 pid: 6934 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713279306.699547:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00000100:00100000:0.0:1713279306.699551:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147212 00010000:00010000:2.0:1713279306.699552:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda71c3 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.699554:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a147a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+58:3493:x1796503200020864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.699558:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda71c3 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.699559:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.699560:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196448 00010000:00010000:0.0:1713279306.699574:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda705e lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda7050 expref: 58 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.699575:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+58:3491:x1796503200020928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.699575:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda71c3 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.699576:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda71df lrc: 3/0,1 mode: --/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.699579:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.699580:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x0 (ffff880092a4c400) 00010000:00010000:2.0:1713279306.699580:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda71c3 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.699582:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114eda69ce lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda69c0 expref: 57 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.699582:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda71df lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.699585:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.699585:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.699587:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda71c3 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.699589:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114eda69ce lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda69c0 expref: 57 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.699592:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda71c3 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.699592:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda71df lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.699595:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.699597:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.699598:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880136671800) 00010000:00010000:2.0:1713279306.699600:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.699601:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.699603:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a147a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+56:3493:x1796503200020864:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (204us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.699603:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda71c3 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.699604:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.699606:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147212 00010000:00010000:1.0:1713279306.699607:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.699607:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda71c3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.699614:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.699614:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda71d1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.699619:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda71d1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.699624:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda71d1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000004:00010000:3.0:1713279306.699625:0:15479:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880090964000 reply state ffff8800726b5000 transno 4295183588 ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda71df lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713279306.699627:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+55:3491:x1796503200020928:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (115us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.699628:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298edd40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.699630:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114eda71e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.699631:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196448 00010000:00010000:2.0:1713279306.699631:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda71d1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.699632:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda71df lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.699635:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114eda71e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.699635:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda71d1 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.699637:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71e6:0x0].0x0 (ffff880090bee600) 00010000:00010000:0.0:1713279306.699638:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114eda71e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.699639:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.699641:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.699641:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880136671a00) 00000100:00100000:3.0:1713279306.699641:0:15479:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.699643:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.699645:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.699645:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda71d1 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.699649:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda71d1 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000004:00200000:0.0:1713279306.699660:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8516:0x0]: returning size 1 00010000:00010000:0.0:1713279306.699666:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda71d8 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.699668:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda71bc lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175303 expref: 3755 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.699668:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3649:11708:x1796503281173696:12345-192.168.203.4@tcp:36:touch.0 Request processed in 168us (307us total) trans 4295183588 rc 0/0 00010000:00010000:0.0:1713279306.699669:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda71d8 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.699672:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda71d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.699674:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784907 00010000:00010000:0.0:1713279306.699675:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda71d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.699677:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d2d58c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.699679:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda71d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.699679:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda71bc lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175303 expref: 3755 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.699682:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda71d8 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.699686:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:2.0:1713279306.699687:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298eef40, rc 0) 00010000:00010000:0.0:1713279306.699688:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.699690:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda71d8 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.699693:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda71d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.699694:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda71ed lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.699697:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114eda71e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.699699:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda71ed lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.699700:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114eda71e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.699702:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda71ed lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.699703:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114eda71e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.699706:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012154d680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.699707:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114eda71e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.699707:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda71f4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x235:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.699707:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3754:11711:x1796503281173568:12345-192.168.203.4@tcp:101:touch.0 Request processed in 264us (396us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.699710:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114eda71e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.699711:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda71f4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.699711:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784905 00010000:00010000:0.0:1713279306.699713:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3931 (ffff880130675a00) 00010000:00010000:0.0:1713279306.699714:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.699714:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda71f4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.699715:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114eda71e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.699718:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114eda71e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.699725:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.699730:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114ed9bda6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391720f9 expref: 3727 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.699731:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda71ca lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917530a expref: 3753 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.699734:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0846c0/0xfc4b8e114ed9bf4a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172154 expref: 3727 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.699736:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda71ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917530a expref: 3753 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.699740:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d866d00, rc 0) 00010000:00010000:1.0:1713279306.699742:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114ed9da39 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391728bd expref: 3752 pid: 15468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.699746:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda6885 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x861c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750a9 expref: 3752 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.699749:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 7/0,1 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.699753:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3752:11794:x1796503281173824:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 260us (404us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.699757:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784906 00010000:00010000:1.0:1713279306.699760:0:6942:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda6885 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x861c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750a9 expref: 3752 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.699765:0:6942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda6885 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x861c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750a9 expref: 3751 pid: 15471 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.699770:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090964a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200020992:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.699784:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.699788:0:6942:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114ed9da39 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391728bd expref: 3751 pid: 15468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.699793:0:6942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114ed9da39 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391728bd expref: 3751 pid: 15468 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.699793:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281173888 00000100:00100000:2.0:1713279306.699796:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281173888 00000100:00100000:1.0:1713279306.699797:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090967800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200021056:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.699808:0:6942:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0846c0/0xfc4b8e114ed9bf4a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172154 expref: 3727 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.699812:0:6942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0846c0/0xfc4b8e114ed9bf4a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172154 expref: 3727 pid: 15481 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.699815:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110424 00000100:00100000:1.0:1713279306.699817:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200021120:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.699820:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+82:1957:x1796503281173888:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:1.0:1713279306.699827:0:6942:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114ed9bda6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391720f9 expref: 3727 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.699831:0:6942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114ed9bda6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391720f9 expref: 3727 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.699836:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090964e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200021184:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.699847:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124ce2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.699866:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200020928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.699870:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281173888:12345-192.168.203.4@tcp:2:touch.0 Request processed in 49us (84us total) trans 4295010159 rc 0/0 00000100:00100000:2.0:1713279306.699875:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110424 00000100:00100000:1.0:1713279306.699878:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200020864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.700222:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.700249:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281174016 00000100:00100000:2.0:1713279306.700253:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281174016 00000100:00100000:2.0:1713279306.700267:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784908 00000100:00100000:2.0:1713279306.700270:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:11204:x1796503281174016:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.700277:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.700285:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda7202 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175311 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.700322:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda7209 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700328:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda7209 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700334:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda7209 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700341:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda7210 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x124:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700345:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda7210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x124:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700350:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda7210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x124:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.700401:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.700409:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.700427:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281174208 00000100:00100000:0.0:1713279306.700429:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281174208 00000100:00100000:0.0:1713279306.700450:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784909 00000100:00100000:0.0:1713279306.700453:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3730:10123:x1796503281174208:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.700459:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.700464:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda7217 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175318 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.700492:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0900/0xfc4b8e114eda721e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7f3b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.700497:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0900/0xfc4b8e114eda721e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f3b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000004:00080000:2.0:1713279306.700499:0:15482:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x11a1:0x0], index 1: 0 00010000:00010000:0.0:1713279306.700501:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0900/0xfc4b8e114eda721e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f3b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000004:00080000:2.0:1713279306.700504:0:15482:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x118d:0x0], index 0: 0 00000004:00200000:0.0:1713279306.700505:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7f3b:0x0]: returning size 0 00010000:00010000:0.0:1713279306.700531:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda7217 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175318 expref: 3733 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.700540:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0900/0xfc4b8e114eda721e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f3b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175318 expref: 3733 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.700544:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f3b:0x0].0x0 (ffff88008d11e100) 00010000:00010000:0.0:1713279306.700545:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1713279306.700547:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800926b0900, rc 0) 00000100:00100000:0.0:1713279306.700562:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3733:10123:x1796503281174208:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 108us (162us total) trans 4295202600 rc 0/0 00010000:00010000:2.0:1713279306.700562:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda722c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x871e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.700566:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784909 00010000:00010000:2.0:1713279306.700568:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda722c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x871e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700574:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda722c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x871e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700588:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda7209 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700593:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda7209 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700597:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda7209 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700601:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda7209 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700606:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ed200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.700608:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda7209 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700612:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda7209 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700618:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x0 (ffff880136671000) 00010000:00010000:2.0:1713279306.700619:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.700622:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda7209 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700626:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda7209 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000004:00010000:2.0:1713279306.700632:0:15482:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880098d2ea00 reply state ffff88008ace6000 transno 4295202601 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda7210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x124:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700637:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda7210 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.700642:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x3431 (ffff880136671500) 00010000:00010000:2.0:1713279306.700644:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.700645:0:15482:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.700657:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda7202 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175311 expref: 3733 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.700666:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda722c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x871e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175311 expref: 3732 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.700672:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x871e:0x0].0x0 (ffff880136671900) 00010000:00010000:2.0:1713279306.700674:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.700676:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ecb40, rc 0) 00000100:00100000:2.0:1713279306.700704:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3733:11204:x1796503281174016:12345-192.168.203.4@tcp:101:touch.0 Request processed in 433us (482us total) trans 4295202601 rc 0/0 00000100:00100000:2.0:1713279306.700710:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784908 00000100:00100000:3.0:1713279306.700727:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3370:11374:x1796503281172928:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 2062us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.700733:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222968 00000100:00100000:2.0:1713279306.700746:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281174144 00000100:00100000:2.0:1713279306.700749:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281174144 00000100:00100000:2.0:1713279306.700764:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147213 00000100:00100000:2.0:1713279306.700768:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3370:1954:x1796503281174144:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.700773:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.700781:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda70dc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752a8 expref: 3370 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.700788:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84ee:0x0].0x0 (ffff88008acd3000) 00010000:00010000:2.0:1713279306.700790:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.700813:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1954:x1796503281174144:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 45us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.700819:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147213 00000100:00100000:0.0:1713279306.701933:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.701976:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281174976 00000100:00100000:3.0:1713279306.701981:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281174976 00000100:00100000:2.0:1713279306.701992:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.701999:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784910 00000100:00100000:2.0:1713279306.702002:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281174272 00000100:00100000:2.0:1713279306.702004:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281174272 00000100:00100000:3.0:1713279306.702005:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3649:11711:x1796503281174976:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.702014:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda5816 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c65 expref: 77 pid: 11415 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.702015:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.702022:0:11415:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11415:1796503200020736:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.702023:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114eda723a lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175326 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.702029:0:11415:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11415:1796503200020800:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.702030:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196449 00000100:00100000:2.0:1713279306.702034:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+77:1956:x1796503281174272:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.702040:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.702041:0:11415:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092540480/0xfc4b8e114eda71b5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752fc expref: 82 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.702050:0:11415:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092540480, rc 0) 00010000:00010000:2.0:1713279306.702051:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda5816 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x105b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c65 expref: 77 pid: 11415 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.702053:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda7241 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.702055:0:6942:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880090964a80 x1796503200020992) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda6885 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x861c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750a9 expref: 3751 pid: 15471 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.702060:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda5816 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x105b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c65 expref: 77 pid: 11415 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.702063:0:6942:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda6885 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x861c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750a9 expref: 3751 pid: 15471 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.702064:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda7241 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.702084:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda6885 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x861c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750a9 expref: 3751 pid: 15471 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.702085:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+82:11824:x1796503281173440:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 3075us (3146us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.702088:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda7241 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.702089:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda5816 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x105b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c65 expref: 77 pid: 11415 timeout: 509 lvb_type: 1 00000100:00100000:1.0:1713279306.702090:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110423 00000100:00100000:0.0:1713279306.702091:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090964a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200020992:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.702097:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda7248 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.702098:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090967800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200021056:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.702099:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.702103:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda7248 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.702108:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda7248 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.702116:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1956:x1796503281174272:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 82us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.702122:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196449 00010000:00010000:3.0:1713279306.702126:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda7241 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.702131:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda7241 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.702136:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda7241 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.702137:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.702141:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda7241 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.702145:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131e35f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.702148:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda7241 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.702149:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281174336 00000100:00100000:2.0:1713279306.702152:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281174336 00010000:00010000:3.0:1713279306.702153:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda7241 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.702154:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.702160:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda3a1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x105b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391744a1 expref: 82 pid: 15499 timeout: 509 lvb_type: 1 00000100:00100000:1.0:1713279306.702163:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.702164:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88012b01f800) 00000100:00100000:0.0:1713279306.702165:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281174400 00010000:00010000:3.0:1713279306.702166:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.702167:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281174400 00010000:00010000:3.0:1713279306.702169:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda7241 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.702170:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281174464 00000100:00100000:1.0:1713279306.702173:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281174464 00010000:00010000:3.0:1713279306.702173:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda7241 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.702181:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196450 00010000:00010000:3.0:1713279306.702181:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda7248 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.702184:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110425 00000100:00100000:2.0:1713279306.702186:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281174336:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.702186:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda7248 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.702188:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281174464:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:3.0:1713279306.702191:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda7248 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.702192:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.702195:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925421c0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.702197:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784911 00010000:00010000:3.0:1713279306.702197:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda7248 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.702199:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda3a1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391744a1 expref: 83 pid: 15499 timeout: 509 lvb_type: 1 00000100:00100000:0.0:1713279306.702200:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3733:11827:x1796503281174400:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.702203:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda7248 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.702207:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda3a1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391744a1 expref: 83 pid: 15499 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.702208:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.702208:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880098d56e00) 00010000:00010000:3.0:1713279306.702210:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.702212:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda7248 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.702213:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda724f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x84ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917531f expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.702217:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda7248 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.702224:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda3a1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391744a1 expref: 83 pid: 15499 timeout: 509 lvb_type: 1 00010000:00010000:2.0:1713279306.702231:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.702232:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b2d00/0xfc4b8e114eda7256 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.702233:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.702234:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114eda723a lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175326 expref: 3650 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.702237:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b2d00/0xfc4b8e114eda7256 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.702238:0:15557:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092540480/0xfc4b8e114eda71b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752fc expref: 83 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.702241:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b2d00/0xfc4b8e114eda7256 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.702241:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114eda723a lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175326 expref: 3650 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.702245:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281174464:12345-192.168.203.4@tcp:2:touch.0 Request processed in 56us (80us total) trans 4295010160 rc 0/0 00010000:00010000:2.0:1713279306.702246:0:15557:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092540480/0xfc4b8e114eda71b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752fc expref: 83 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.702249:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110425 00010000:00010000:3.0:1713279306.702249:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e5f5200, rc 0) 00010000:00010000:2.0:1713279306.702263:0:15557:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092540480/0xfc4b8e114eda71b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752fc expref: 82 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.702266:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3649:11711:x1796503281174976:12345-192.168.203.4@tcp:101:touch.0 Request processed in 262us (333us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.702267:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.702272:0:15557:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d304000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:15557:1796503200021248:192.168.203.4@tcp:105: 00000100:00100000:3.0:1713279306.702272:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784910 00000100:00100000:1.0:1713279306.702278:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00200000:0.0:1713279306.702282:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x84ee:0x0]: returning size 4096 00000100:00100000:3.0:1713279306.702282:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281174528 00000100:00100000:3.0:1713279306.702285:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281174528 00000004:00200000:0.0:1713279306.702286:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:2.0:1713279306.702290:0:15557:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98480 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.702292:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281174592 00000100:00100000:0.0:1713279306.702294:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281174592 00000100:00100000:1.0:1713279306.702296:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.702299:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784912 00010000:00010000:0.0:1713279306.702302:0:15711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114ed9da39 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391728bd expref: 3751 pid: 15468 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.702303:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:10814:x1796503281174528:12345-192.168.203.4@tcp:34:lfs.0 00000100:00100000:1.0:1713279306.702304:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.702313:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196451 00000100:00100000:0.0:1713279306.702316:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3751:1957:x1796503281174592:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.702320:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.702323:0:15711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114ed9da39 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391728bd expref: 3751 pid: 15468 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.702328:0:15711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114ed9da39 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391728bd expref: 3751 pid: 15468 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.702328:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda725d lrc: 3/1,0 mode: --/CR res: [0x240000401:0x134:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.702335:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114ed9da39 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391728bd expref: 3751 pid: 15468 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.702335:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda725d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.702341:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x861c:0x0].0x0 (ffff880136671c00) 00010000:00010000:3.0:1713279306.702341:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda725d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.702343:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.702349:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7264 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x134:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.702354:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7264 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.702360:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7264 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.702379:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.702384:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281175040 00000100:00100000:1.0:1713279306.702386:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281175040 00010000:00010000:3.0:1713279306.702389:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092541d40/0xfc4b8e114eda726b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.702394:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0846c0/0xfc4b8e114ed9bf4a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172154 expref: 3735 pid: 15481 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.702396:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.702396:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092541d40/0xfc4b8e114eda726b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.702400:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.702402:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092541d40/0xfc4b8e114eda726b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.702403:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.702404:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196452 00000100:00100000:1.0:1713279306.702407:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3735:1956:x1796503281175040:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000004:00200000:3.0:1713279306.702409:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x750e:0x0]: returning size 2 00010000:00010000:1.0:1713279306.702426:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.702429:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0846c0/0xfc4b8e114ed9bf4a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172154 expref: 3735 pid: 15481 timeout: 509 lvb_type: 0 00000004:00010000:3.0:1713279306.702431:0:15482:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880092541d40/0xfc4b8e114eda726b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.702435:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3750:1957:x1796503281174592:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 117us (155us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.702435:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0846c0/0xfc4b8e114ed9bf4a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172154 expref: 3735 pid: 15481 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.702446:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196451 00010000:00010000:3.0:1713279306.702449:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda725d lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.702452:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x861c:0x0].0x0 (ffff880136671c00) 00010000:00010000:3.0:1713279306.702453:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda725d lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.702455:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.702458:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda725d lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.702459:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.702462:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.702463:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda725d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.702464:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0846c0/0xfc4b8e114ed9bf4a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172154 expref: 3735 pid: 15481 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.702465:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.702468:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540240 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.702470:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200021120:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.702470:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.702471:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda725d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.702475:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090964e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200021184:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.702475:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda725d lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.702476:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3734:1956:x1796503281175040:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 68us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.702479:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196452 00010000:00010000:3.0:1713279306.702482:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x0 (ffff880089dc2100) 00010000:00010000:3.0:1713279306.702484:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.702485:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281175104 00010000:00010000:3.0:1713279306.702486:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda725d lrc: 3/0,0 mode: --/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.702487:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281175104 00010000:00010000:0.0:1713279306.702490:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x861c:0x0].0x0 (ffff880136671c00) 00010000:00010000:1.0:1713279306.702491:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114ed9bda6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391720f9 expref: 3734 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.702492:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702495:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.702495:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda725d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.702497:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00000100:00100000:1.0:1713279306.702499:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196453 00000100:00100000:1.0:1713279306.702502:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5243c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3734:1955:x1796503281175104:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.702504:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.702504:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.702504:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7264 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.702505:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.702508:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114ed9bda6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391720f9 expref: 3734 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.702509:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7264 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.702513:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114ed9bda6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391720f9 expref: 3734 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.702514:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7264 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.702518:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925433c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.702519:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114ed9bda6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x861c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391720f9 expref: 3735 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.702520:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7264 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.702524:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda724f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x84ee:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917531f expref: 3735 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.702525:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7264 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.702527:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x861c:0x0].0x0 (ffff880136671c00) 00010000:00010000:1.0:1713279306.702529:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702530:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b2d00/0xfc4b8e114eda7256 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917531f expref: 3733 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.702531:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x3331 (ffff8800937ce400) 00010000:00010000:1.0:1713279306.702533:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.702533:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.702534:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84ee:0x0].0x0 (ffff88012b01f000) 00010000:00010000:0.0:1713279306.702535:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1713279306.702535:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.702535:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7264 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.702537:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800926b2d00, rc 0) 00010000:00010000:3.0:1713279306.702540:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7264 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.702546:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.702549:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.702549:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092541d40/0xfc4b8e114eda726b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.702551:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702554:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.702554:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092541d40/0xfc4b8e114eda726b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.702556:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281175168 00000100:00100000:1.0:1713279306.702558:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5243c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3733:1955:x1796503281175104:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 55us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.702559:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281175168 00010000:00010000:3.0:1713279306.702559:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092541d40/0xfc4b8e114eda726b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.702561:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196453 00010000:00010000:3.0:1713279306.702564:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092541d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.702566:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092541d40/0xfc4b8e114eda726b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.702571:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092541d40/0xfc4b8e114eda726b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.702574:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110426 00010000:00010000:3.0:1713279306.702577:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x750e:0x0].0x0 (ffff88007fe82800) 00000100:00100000:2.0:1713279306.702578:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+78:1957:x1796503281175168:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:3.0:1713279306.702579:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.702581:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092541d40/0xfc4b8e114eda726b lrc: 2/0,0 mode: --/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.702586:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092541d40/0xfc4b8e114eda726b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.702594:0:9197:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda7272 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1127:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.702597:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702601:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702604:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702607:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bfcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.702608:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.702608:0:9197:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013076f840/0xfc4b8e114ed7ba8c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39168571 expref: 78 pid: 15781 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713279306.702610:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:10814:x1796503281174528:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 307us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.702611:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.702614:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.702616:0:9197:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114ed9e1ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b02 expref: 74 pid: 15519 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713279306.702616:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784912 00010000:00010000:0.0:1713279306.702619:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x861c:0x0].0x0 (ffff880136671c00) 00010000:00010000:0.0:1713279306.702621:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.702622:0:9197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.702623:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 2/0,0 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.702624:0:9197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713279306.702625:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281175552 00010000:00010000:2.0:1713279306.702626:0:9197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda7272 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.702627:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281175552 00010000:00010000:0.0:1713279306.702628:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda71fb lrc: 0/0,0 mode: --/EX res: [0x200000403:0x861c:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702636:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda71ed lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.702640:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784913 00010000:00010000:0.0:1713279306.702641:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda71ed lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.702641:0:9197:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114ed9e1ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b02 expref: 74 pid: 15519 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713279306.702644:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3750:11810:x1796503281175552:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.702646:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda71ed lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.702650:0:9197:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114ed9e1ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b02 expref: 74 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.702651:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda71ed lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.702651:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.702654:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.702666:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.702667:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda7279 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917532d expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.702668:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda71ed lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.702671:0:9197:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9197:1796503200021312:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.702674:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda71ed lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702680:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff88009588c500) 00010000:00010000:0.0:1713279306.702682:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.702684:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda71ed lrc: 3/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.702686:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281175424 00000100:00100000:3.0:1713279306.702688:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281175424 00010000:00010000:0.0:1713279306.702690:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda71ed lrc: 0/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702699:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda71f4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.702700:0:9197:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013076f840/0xfc4b8e114ed7ba8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39168571 expref: 78 pid: 15781 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713279306.702701:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784914 00010000:00010000:0.0:1713279306.702704:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda71f4 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.702706:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3733:11204:x1796503281175424:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1713279306.702708:0:9197:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013076f840/0xfc4b8e114ed7ba8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39168571 expref: 78 pid: 15781 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.702709:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda71f4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702713:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bd8c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.702715:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda71f4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.702716:0:9197:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9197:1796503200021376:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.702719:0:15479:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.702720:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda71f4 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702726:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x38 (ffff88009588c100) 00010000:00010000:3.0:1713279306.702726:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda722c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x871e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175311 expref: 3733 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.702728:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.702730:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda71f4 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.702734:0:9197:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98000 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.702735:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x871e:0x0].0x0 (ffff880136671900) 00010000:00010000:0.0:1713279306.702736:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda71f4 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.702739:0:15479:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.702747:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702752:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702757:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702762:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.702764:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702769:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.702772:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114eda7280 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x871e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.702774:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:0.0:1713279306.702786:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.702788:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.702789:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114eda7280 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x871e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.702794:0:6942:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.702794:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114eda7280 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x871e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.702799:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290400000020 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.702805:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.702818:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.702823:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda6a84 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.702830:0:6943:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00000004:00010000:3.0:1713279306.702830:0:15479:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880121535500 reply state ffff8800726b6000 transno 4295202602 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114eda7280 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x871e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000004:00020000:0.0:1713279306.702831:0:6942:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200000402:0x7f51:0x0]/8 failed: rc = -114 00010000:00010000:2.0:1713279306.702836:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.702837:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114eda7280 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x871e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.702842:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x871e:0x0].0x0 (ffff880091b35600) 00010000:00010000:3.0:1713279306.702844:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.702846:0:15479:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713279306.702861:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d306680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200021440:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.702868:0:6942:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:385c4b71-808c-40cf-91de-b076b668d13f+3751:11736:x1796503281158848:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 30991us (31018us total) trans 0 rc -114/-114 00000100:00100000:0.0:1713279306.702875:0:6942:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14319 00000100:00100000:3.0:1713279306.702875:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3734:11204:x1796503281175424:12345-192.168.203.4@tcp:36:touch.0 Request processed in 168us (220us total) trans 4295202602 rc 0/0 00000100:00100000:3.0:1713279306.702880:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784914 00000100:00100000:2.0:1713279306.702882:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.702893:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012edd90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.702894:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200021440 00000100:00100000:3.0:1713279306.702894:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281174720 00000100:00100000:1.0:1713279306.702897:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200021440 00000100:00100000:3.0:1713279306.702897:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281174720 00000100:00100000:0.0:1713279306.702900:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3733:11827:x1796503281174400:12345-192.168.203.4@tcp:101:touch.0 Request processed in 697us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.702905:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784911 00000100:00100000:3.0:1713279306.702908:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281174848 00000100:00100000:1.0:1713279306.702909:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98654 00000100:00100000:3.0:1713279306.702911:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281174848 00000100:00100000:1.0:1713279306.702912:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+92:6943:x1796503200021440:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.702919:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281175296 00000100:00100000:3.0:1713279306.702921:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281175296 00000100:00100000:3.0:1713279306.702932:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222969 00000100:00100000:2.0:1713279306.702936:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222970 00000100:00100000:3.0:1713279306.702936:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3753:11695:x1796503281174720:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1713279306.702940:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:385c4b71-808c-40cf-91de-b076b668d13f+3753:11794:x1796503281174848:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1713279306.702943:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+92:6943:x1796503200021440:12345-0@lo:1000:mdt_io00_002.0 Request processed in 31us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.702947:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98654 00000100:00100000:0.0:1713279306.702957:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d306680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200021440:0@lo:1000:mdt_io00_002.0 00000004:00080000:0.0:1713279306.702975:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000403:0x729c:0x0] 00000100:00100000:2.0:1713279306.702980:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222971 00000100:00100000:2.0:1713279306.702985:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c56b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:385c4b71-808c-40cf-91de-b076b668d13f+3755:11829:x1796503281175296:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1713279306.702991:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200021504:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.703004:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3755:11695:x1796503281174720:12345-192.168.203.4@tcp:35:touch.0 Request processed in 67us (706us total) trans 4295202604 rc 0/0 00000100:00100000:0.0:1713279306.703008:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.703010:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222969 00000100:00100000:1.0:1713279306.703016:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200021504 00000100:00100000:0.0:1713279306.703017:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549600 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.703018:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200021504 00000100:00100000:1.0:1713279306.703026:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98655 00000100:00100000:1.0:1713279306.703028:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+92:6943:x1796503200021504:12345-0@lo:1000:mdt_io00_002.0 00010000:00010000:3.0:1713279306.703043:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda7287 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.703044:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c56b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:385c4b71-808c-40cf-91de-b076b668d13f+3755:11829:x1796503281175296:12345-192.168.203.4@tcp:35:touch.0 Request processed in 58us (432us total) trans 4295202605 rc 0/0 00000100:00100000:2.0:1713279306.703050:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222971 00010000:00010000:3.0:1713279306.703051:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda7287 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703057:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda7287 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.703058:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+92:6943:x1796503200021504:12345-0@lo:1000:mdt_io00_002.0 Request processed in 28us (49us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.703062:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98655 00010000:00010000:3.0:1713279306.703066:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda728e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.703082:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200021504:0@lo:1000:mdt_io00_002.0 00010000:00010000:3.0:1713279306.703087:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda728e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703092:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda728e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.703099:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:385c4b71-808c-40cf-91de-b076b668d13f+3754:11794:x1796503281174848:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 159us (793us total) trans 4295202603 rc 0/0 00000100:00100000:2.0:1713279306.703105:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222970 00000004:00200000:3.0:1713279306.703155:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x8179:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.703178:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda7287 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703183:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda7287 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703188:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda7287 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703193:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda7287 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703197:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ad686c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.703199:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda7287 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703203:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda7287 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703209:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.703211:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.703213:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda7287 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703217:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda7287 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703223:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda728e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703227:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda728e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703232:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda728e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703235:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091805440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.703237:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda728e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703241:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda728e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703250:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3031 (ffff880095863700) 00010000:00010000:3.0:1713279306.703251:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.703253:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda728e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703257:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda728e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.703275:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda7279 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917532d expref: 3754 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.703281:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda7279 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917532d expref: 3754 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.703285:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f086f40, rc 0) 00000100:00100000:3.0:1713279306.703308:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3753:11810:x1796503281175552:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 664us (805us total) trans 4295202606 rc 301/301 00000100:00100000:3.0:1713279306.703312:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784913 00000100:00100000:0.0:1713279306.703539:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200021568:0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1713279306.703563:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.703581:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549c00 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.703588:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200021568 00000100:00100000:1.0:1713279306.703591:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200021568 00000100:00100000:1.0:1713279306.703601:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98656 00000100:00100000:1.0:1713279306.703604:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+92:6943:x1796503200021568:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1713279306.704530:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.704595:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281175616 00000100:00100000:2.0:1713279306.704599:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281175616 00000100:00100000:2.0:1713279306.704624:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222972 00000100:00100000:2.0:1713279306.704630:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:11374:x1796503281175616:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:0.0:1713279306.704640:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.704651:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281175744 00000100:00100000:3.0:1713279306.704654:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281175744 00000100:00100000:0.0:1713279306.704662:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.704679:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281176064 00000100:00100000:3.0:1713279306.704681:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281176064 00000100:00100000:0.0:1713279306.704690:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.704692:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222973 00000100:00100000:3.0:1713279306.704696:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:385c4b71-808c-40cf-91de-b076b668d13f+3649:11708:x1796503281176064:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:1.0:1713279306.704700:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+92:6943:x1796503200021568:12345-0@lo:403:mdt_io00_002.0 Request processed in 1094us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.704704:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98656 00000100:00100000:0.0:1713279306.704714:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200021568:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1713279306.704765:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:385c4b71-808c-40cf-91de-b076b668d13f+3650:11708:x1796503281176064:12345-192.168.203.4@tcp:35:touch.0 Request processed in 67us (101us total) trans 4295183589 rc 0/0 00000100:00100000:3.0:1713279306.704771:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222973 00000100:00100000:3.0:1713279306.704785:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281175936 00000100:00100000:3.0:1713279306.704788:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281175936 00000100:00100000:3.0:1713279306.704799:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784915 00000100:00100000:3.0:1713279306.704802:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3753:11843:x1796503281175744:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.704809:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.704811:0:15482:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1713279306.704821:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3a80/0xfc4b8e114ed92c97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7c58:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916f91b expref: 3753 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.704831:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c58:0x0].0x0 (ffff880092139d00) 00010000:00010000:3.0:1713279306.704833:0:15482:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.704840:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda729c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x7c58:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175334 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.704878:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda72a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7c58:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.704885:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda72a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7c58:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.704891:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda72a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7c58:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000004:00200000:3.0:1713279306.704897:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7c58:0x0]: returning size 0 00010000:00010000:3.0:1713279306.704931:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda729c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7c58:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175334 expref: 3755 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.704940:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda72a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7c58:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175334 expref: 3754 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.704945:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c58:0x0].0x0 (ffff880092139d00) 00010000:00010000:3.0:1713279306.704948:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713279306.704950:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2d7a80, rc 0) 00000100:00100000:3.0:1713279306.704970:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3754:11843:x1796503281175744:12345-192.168.203.4@tcp:101:touch.0 Request processed in 166us (330us total) trans 4295202607 rc 0/0 00000100:00100000:3.0:1713279306.704975:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784915 00000100:00100000:3.0:1713279306.704984:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784916 00000100:00100000:3.0:1713279306.704988:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3650:11838:x1796503281175936:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.704993:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.705000:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda72b1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175342 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.705032:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e39440/0xfc4b8e114eda72b8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.705039:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131e39440/0xfc4b8e114eda72b8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x7b9c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.705045:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131e39440/0xfc4b8e114eda72b8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x7b9c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000004:00200000:3.0:1713279306.705050:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7b9c:0x0]: returning size 15538 00010000:00010000:3.0:1713279306.705106:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda72b1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175342 expref: 3653 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.705116:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e39440/0xfc4b8e114eda72b8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7b9c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175342 expref: 3652 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.705122:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b9c:0x0].0x0 (ffff88009588c000) 00010000:00010000:3.0:1713279306.705124:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1713279306.705126:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e39440, rc 0) 00000100:00100000:3.0:1713279306.705144:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3652:11838:x1796503281175936:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 155us (454us total) trans 4295183590 rc 0/0 00000100:00100000:3.0:1713279306.705150:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784916 00010000:00010000:0.0:1713279306.705299:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda72c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x149:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.705307:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda72c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.705314:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda72c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.705398:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3840/0xfc4b8e114eda72cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x149:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.705406:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3840/0xfc4b8e114eda72cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00000100:00100000:1.0:1713279306.705431:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.705434:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3840/0xfc4b8e114eda72cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00000100:00100000:3.0:1713279306.705452:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281176640 00000100:00100000:3.0:1713279306.705456:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281176640 00010000:00010000:0.0:1713279306.705457:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00000100:00100000:2.0:1713279306.705457:0:15557:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d304000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:15557:1796503200021248:192.168.203.4@tcp:105: 00010000:00010000:0.0:1713279306.705466:0:6943:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda6b41 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x826a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175151 expref: 3732 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.705480:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.705481:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784917 00010000:00010000:0.0:1713279306.705482:0:6943:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00000100:00100000:3.0:1713279306.705485:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3652:11695:x1796503281176640:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.705492:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.705496:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+82:1956:x1796503281174336:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 3310us (3359us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.705497:0:6943:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda6b41 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x826a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175151 expref: 3732 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.705500:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda72db lrc: 2/0,0 mode: --/CW res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175357 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.705502:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196450 00010000:00010000:0.0:1713279306.705506:0:6943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda6b41 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x826a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175151 expref: 3732 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.705515:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6943:1796503200021632:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.705528:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda72e2 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.705535:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda72e2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.705536:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549c00 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.705537:0:9197:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9197:1796503200021312:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.705539:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.705541:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda72e2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.705549:0:6942:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281176256 00010000:00010000:3.0:1713279306.705551:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda72e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.705552:0:6942:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281176256 00010000:00010000:3.0:1713279306.705557:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda72e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.705562:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda72e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.705568:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.705574:0:6942:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14322 00000100:00100000:2.0:1713279306.705577:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281176320 00000100:00100000:0.0:1713279306.705579:0:6942:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3371:10814:x1796503281176256:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:2.0:1713279306.705579:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281176320 00010000:00010000:2.0:1713279306.705589:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114ed9e1ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b02 expref: 75 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.705598:0:6942:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.705603:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196454 00000100:00100000:2.0:1713279306.705607:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+75:1957:x1796503281176320:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.705610:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e7ba400/0xfc4b8e114ed987eb lrc: 0/0,0 mode: --/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39171266 expref: 3371 pid: 15659 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.705614:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.705618:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x750e:0x0].0x0 (ffff88007fe82800) 00010000:00010000:0.0:1713279306.705621:0:6942:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.705621:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114eda72f0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x777b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.705622:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114ed9e1ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1127:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b02 expref: 75 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:2.0:1713279306.705631:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114ed9e1ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1127:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b02 expref: 75 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.705632:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114eda72f0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x777b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.705638:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.705638:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114eda72f0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x777b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.705643:0:6942:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.705643:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114ed9e1ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1127:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b02 expref: 75 pid: 15519 timeout: 509 lvb_type: 1 00000004:00200000:3.0:1713279306.705644:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x777b:0x0]: returning size 13303808 00010000:00010000:0.0:1713279306.705650:0:6942:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.705652:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.705659:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200021696:0@lo:101:mdt_io00_001.0 00000100:00100000:2.0:1713279306.705670:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+74:1957:x1796503281176320:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 61us (101us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.705671:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda72e2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.705676:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda72e2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.705677:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.705679:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196454 00010000:00010000:3.0:1713279306.705681:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda72e2 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.705686:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549600 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.705686:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda72e2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.705691:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.705693:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda72e2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.705698:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda72e2 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.705699:0:9197:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9197:1796503200021376:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.705702:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200021696 00000100:00100000:1.0:1713279306.705704:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200021696 00010000:00010000:3.0:1713279306.705706:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff88007fcb8a00) 00010000:00010000:3.0:1713279306.705708:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.705711:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda72e2 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.705712:0:9197:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda7272 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1127:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.705715:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98657 00010000:00010000:3.0:1713279306.705716:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114eda72e2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.705718:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+55:6942:x1796503200021696:12345-0@lo:101:mdt_io00_001.0 00000100:00100000:0.0:1713279306.705719:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.705725:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.705727:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda72e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.705730:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7305 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda72f7 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.705732:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda72e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.705737:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda72e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.705738:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281176384 00010000:00010000:1.0:1713279306.705739:0:15542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:2.0:1713279306.705740:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281176384 00010000:00010000:3.0:1713279306.705741:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.705743:0:15542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7305 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda72f7 expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.705744:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda72e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.705748:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda72e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.705749:0:15542:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.705749:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013076f840/0xfc4b8e114ed7ba8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1127:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39168571 expref: 79 pid: 15781 timeout: 509 lvb_type: 1 00000100:00100000:0.0:1713279306.705750:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.705754:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7305 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda72f7 expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.705754:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x3931 (ffff880091d49100) 00010000:00010000:3.0:1713279306.705756:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.705758:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:3.0:1713279306.705758:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda72e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.705760:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.705761:0:15542:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00000100:00100000:2.0:1713279306.705762:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196455 00010000:00010000:3.0:1713279306.705763:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321440/0xfc4b8e114eda72e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.705764:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935beac0, rc 0) 00000100:00100000:2.0:1713279306.705766:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+79:1957:x1796503281176384:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.705772:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.705778:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+56:6942:x1796503200021696:12345-0@lo:101:mdt_io00_001.0 Request processed in 60us (101us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.705778:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013076f840/0xfc4b8e114ed7ba8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39168571 expref: 79 pid: 15781 timeout: 509 lvb_type: 1 00000100:00100000:1.0:1713279306.705781:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98657 00010000:00010000:3.0:1713279306.705784:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda72db lrc: 0/0,0 mode: --/CW res: [0x240000400:0x237:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175357 expref: 3655 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.705786:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013076f840/0xfc4b8e114ed7ba8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39168571 expref: 79 pid: 15781 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.705792:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114eda72f0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x777b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175357 expref: 3654 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.705796:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200021696:0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1713279306.705797:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013076f840/0xfc4b8e114ed7ba8c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39168571 expref: 79 pid: 15781 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.705799:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x777b:0x0].0x0 (ffff880097e7bf00) 00010000:00010000:3.0:1713279306.705801:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713279306.705803:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d322400, rc 0) 00010000:00010000:2.0:1713279306.705805:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.705806:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.705807:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.705809:0:15557:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda7272 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1127:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.705814:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.705821:0:15557:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda7272 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1127:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.705822:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3654:11695:x1796503281176640:12345-192.168.203.4@tcp:101:touch.0 Request processed in 336us (390us total) trans 4295183591 rc 0/0 00000100:00100000:3.0:1713279306.705827:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784917 00010000:00010000:2.0:1713279306.705833:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.705836:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281176512 00000100:00100000:3.0:1713279306.705838:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281176512 00000100:00100000:2.0:1713279306.705845:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+78:1957:x1796503281176384:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 78us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.705851:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196455 00000100:00100000:3.0:1713279306.705854:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784918 00000100:00100000:3.0:1713279306.705858:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3733:11204:x1796503281176512:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.705864:0:9197:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda7272 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1127:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.705865:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.705871:0:9197:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda7272 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1127:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.705871:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322d00/0xfc4b8e114eda730c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x871e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175350 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.705881:0:9197:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda7272 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1127:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.705887:0:9197:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda7272 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1127:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.705889:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322d00/0xfc4b8e114eda730c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x871e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175350 expref: 3734 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.705894:0:9197:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda7272 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1127:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.705897:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322d00/0xfc4b8e114eda730c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x871e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175350 expref: 3734 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.705899:0:9197:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ee880 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:2.0:1713279306.705902:0:9197:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda7272 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1127:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.705907:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x871e:0x0].0x0 (ffff880091b35600) 00010000:00010000:3.0:1713279306.705909:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713279306.705911:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d322d00, rc 0) 00010000:00010000:2.0:1713279306.705912:0:9197:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda7272 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1127:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.705921:0:9197:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda7272 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1127:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.705927:0:9197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda7272 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1127:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.705929:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3734:11204:x1796503281176512:12345-192.168.203.4@tcp:101:touch.0 Request processed in 70us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.705934:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784918 00000100:00100000:2.0:1713279306.705957:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+77:1957:x1796503281175168:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 3378us (3410us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.705963:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110426 00000100:00100000:2.0:1713279306.706395:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.706404:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.706453:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.706455:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281176896 00000100:00100000:3.0:1713279306.706459:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281176896 00000100:00100000:3.0:1713279306.706473:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222974 00000100:00100000:3.0:1713279306.706478:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3754:11736:x1796503281176896:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.706510:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3754:11736:x1796503281176896:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 31us (106us total) trans 0 rc -116/-116 00000100:00100000:3.0:1713279306.706515:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222974 00000100:00100000:3.0:1713279306.706557:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281176704 00010000:00010000:1.0:1713279306.706560:0:6943:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880098d2df80 x1796503200021632) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda6b41 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x826a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175151 expref: 3733 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.706560:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281176704 00010000:00010000:1.0:1713279306.706570:0:6943:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda6b41 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x826a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175151 expref: 3733 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.706572:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281176832 00000100:00100000:3.0:1713279306.706574:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281176832 00010000:00010000:1.0:1713279306.706579:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda6b41 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x826a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175151 expref: 3733 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.706583:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784919 00000100:00100000:1.0:1713279306.706586:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6943:1796503200021632:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.706586:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3754:11711:x1796503281176704:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.706592:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.706594:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x826a:0x0].0x0 (ffff880091553000) 00010000:00010000:1.0:1713279306.706597:0:6943:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706599:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320000/0xfc4b8e114eda7313 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175349 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.706601:0:6943:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.706604:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.706611:0:6943:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.706615:0:6943:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.706618:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706643:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda731a lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.706650:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda731a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.706655:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda731a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706662:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706664:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7321 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706666:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.706669:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706669:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7321 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706672:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b0480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.706673:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706673:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7321 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706676:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.706680:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x826a:0x0].0x0 (ffff880091553000) 00010000:00010000:1.0:1713279306.706681:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1713279306.706683:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.706686:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda72d4 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x826a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00000004:00200000:3.0:1713279306.706688:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:1.0:1713279306.706692:0:6943:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda72c6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706693:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda731a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706696:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda72c6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706698:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda731a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706699:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda72c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.706702:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda72c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706702:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda731a lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706704:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b21c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.706705:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda72c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706706:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda731a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706708:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda72c6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706709:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.706711:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x149:0x0].0x0 (ffff88012d397a00) 00010000:00010000:1.0:1713279306.706712:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.706712:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda731a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706713:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda72c6 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.706716:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda72c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706716:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda731a lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706721:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3840/0xfc4b8e114eda72cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706721:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88008ea88d00) 00010000:00010000:1.0:1713279306.706724:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3840/0xfc4b8e114eda72cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706724:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.706726:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda731a lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706727:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3840/0xfc4b8e114eda72cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.706729:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b3840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.706730:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda731a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706731:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3840/0xfc4b8e114eda72cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.706734:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3840/0xfc4b8e114eda72cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706737:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7321 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706738:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x149:0x0].0x32 (ffff88012d397c00) 00010000:00010000:1.0:1713279306.706739:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.706740:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3840/0xfc4b8e114eda72cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706741:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7321 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706743:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3840/0xfc4b8e114eda72cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x149:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00000004:00080000:1.0:1713279306.706749:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000403:0x729c:0x0] 00010000:00010000:3.0:1713279306.706749:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7321 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706752:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706752:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d3218c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.706754:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7321 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706755:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.706758:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706758:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7321 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706760:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.706762:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706763:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff88008e720f00) 00010000:00010000:1.0:1713279306.706764:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706765:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.706766:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7321 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706768:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00000100:00100000:0.0:1713279306.706769:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.706769:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.706770:0:6943:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.706770:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7321 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.706774:0:6943:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290400000020 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.706777:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290400000020 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.706781:0:6943:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7305 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda72f7 expref: 55 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.706782:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281177024 00000100:00100000:0.0:1713279306.706785:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281177024 00010000:00010000:3.0:1713279306.706787:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320000/0xfc4b8e114eda7313 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175349 expref: 3755 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.706790:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.706793:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda6d9b lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.706793:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320000/0xfc4b8e114eda7313 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175349 expref: 3755 pid: 6929 timeout: 0 lvb_type: 0 00000004:00020000:1.0:1713279306.706797:0:6943:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x240000403:0x729c:0x0]/2 failed: rc = -114 00010000:00010000:3.0:1713279306.706800:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d320000, rc 0) 00000100:00100000:0.0:1713279306.706801:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784920 00000100:00100000:0.0:1713279306.706805:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3655:11708:x1796503281176832:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.706814:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.706819:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3754:11711:x1796503281176704:12345-192.168.203.4@tcp:101:touch.0 Request processed in 232us (423us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.706820:0:6943:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3732:9807:x1796503281164096:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 25381us (25675us total) trans 0 rc -114/-114 00010000:00010000:0.0:1713279306.706823:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda7328 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917535e expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.706824:0:6943:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14320 00000100:00100000:3.0:1713279306.706825:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784919 00000100:00100000:3.0:1713279306.706835:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784921 00010000:00010000:1.0:1713279306.706838:0:15507:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00000100:00100000:3.0:1713279306.706838:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3656:11695:x1796503281177024:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:1.0:1713279306.706842:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.706853:0:6929:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.706860:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121535180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200021760:0@lo:1000:mdt_io00_005.0 00010000:00010000:3.0:1713279306.706860:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114eda72f0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x777b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175357 expref: 3656 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.706868:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x777b:0x0].0x0 (ffff880097e7bf00) 00010000:00010000:3.0:1713279306.706870:0:6929:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.706873:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda732f lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.706875:0:15507:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.706881:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda732f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.706882:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124ce2d80 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.706888:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda732f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.706889:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200021760 00000100:00100000:1.0:1713279306.706891:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200021760 00010000:00010000:3.0:1713279306.706893:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda7336 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x777b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.706898:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda733d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.706899:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda7336 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00000100:00100000:1.0:1713279306.706902:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98658 00010000:00010000:0.0:1713279306.706903:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda733d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.706904:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda7336 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:1.0:1713279306.706905:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+92:15507:x1796503200021760:12345-0@lo:1000:mdt_io00_005.0 00010000:00010000:0.0:1713279306.706909:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda733d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.706927:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:11374:x1796503281175616:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 2296us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.706933:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+92:15507:x1796503200021760:12345-0@lo:1000:mdt_io00_005.0 Request processed in 27us (57us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.706934:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7344 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x71ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:2.0:1713279306.706934:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222972 00000100:00100000:1.0:1713279306.706937:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98658 00000004:00010000:3.0:1713279306.706938:0:6929:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012c369500 reply state ffff8800726b2000 transno 4295183592 ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda7336 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.706941:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7344 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x71ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.706946:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7344 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x71ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.706946:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda7336 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00000100:00100000:1.0:1713279306.706949:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121535180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200021760:0@lo:1000:mdt_io00_005.0 00010000:00010000:3.0:1713279306.706951:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x777b:0x0].0x0 (ffff880097e7bf00) 00000004:00200000:0.0:1713279306.706952:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x71ea:0x0]: returning size 0 00010000:00010000:3.0:1713279306.706953:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.706955:0:6929:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1713279306.706959:0:15507:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000403:0x76b7:0x0] 00000100:00100000:1.0:1713279306.706969:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121535180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200021824:0@lo:1000:mdt_io00_005.0 00000100:00100000:1.0:1713279306.706980:0:15507:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.706981:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3658:11695:x1796503281177024:12345-192.168.203.4@tcp:36:touch.0 Request processed in 141us (213us total) trans 4295183592 rc 0/0 00010000:00010000:0.0:1713279306.706983:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda732f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.706986:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784921 00000100:00100000:1.0:1713279306.706987:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124ce2b40 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.706989:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda732f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.706993:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200021824 00010000:00010000:0.0:1713279306.706995:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda732f lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.706995:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200021824 00010000:00010000:0.0:1713279306.707000:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda732f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.707004:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c04480 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.707005:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98659 00010000:00010000:0.0:1713279306.707007:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda732f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.707007:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+92:15507:x1796503200021824:12345-0@lo:1000:mdt_io00_005.0 00010000:00010000:0.0:1713279306.707012:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda732f lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.707019:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88008c124700) 00010000:00010000:0.0:1713279306.707021:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.707024:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda732f lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.707029:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda732f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.707033:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+92:15507:x1796503200021824:12345-0@lo:1000:mdt_io00_005.0 Request processed in 25us (52us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.707036:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98659 00010000:00010000:0.0:1713279306.707037:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda733d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.707042:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda733d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.707047:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda733d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.707051:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205440 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.707051:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121535180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200021824:0@lo:1000:mdt_io00_005.0 00010000:00010000:0.0:1713279306.707053:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda733d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.707062:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda733d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.707081:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3931 (ffff8800977d9700) 00010000:00010000:0.0:1713279306.707083:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.707086:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda733d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.707091:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda733d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.707113:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda7328 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917535e expref: 3658 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.707124:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7344 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x71ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917535e expref: 3657 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.707130:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71ea:0x0].0x0 (ffff8800925a8100) 00010000:00010000:0.0:1713279306.707132:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713279306.707134:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122205b00, rc 0) 00000100:00100000:0.0:1713279306.707152:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3657:11708:x1796503281176832:12345-192.168.203.4@tcp:101:touch.0 Request processed in 346us (699us total) trans 4295183593 rc 0/0 00000100:00100000:0.0:1713279306.707158:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784920 00000100:00100000:1.0:1713279306.707338:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.707344:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.707363:0:6943:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281177152 00000100:00100000:1.0:1713279306.707365:0:6943:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281177152 00000100:00100000:0.0:1713279306.707366:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281177472 00000100:00100000:0.0:1713279306.707369:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281177472 00000100:00100000:1.0:1713279306.707382:0:6943:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14323 00000100:00100000:0.0:1713279306.707384:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784922 00000100:00100000:1.0:1713279306.707385:0:6943:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3732:10123:x1796503281177152:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:0.0:1713279306.707390:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3754:11736:x1796503281177472:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:2.0:1713279306.707390:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d304000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200021888:0@lo:403:mdt_io00_005.0 00010000:00010000:0.0:1713279306.707402:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.707403:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.707409:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda7359 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x8125:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917536c expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.707410:0:6943:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7305 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda72f7 expref: 55 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.707432:0:15507:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.707433:0:6943:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.707445:0:6943:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7305 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda72f7 expref: 55 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.707447:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760480 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.707449:0:6943:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00000100:00100000:3.0:1713279306.707452:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200021888 00000100:00100000:3.0:1713279306.707455:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200021888 00000100:00100000:1.0:1713279306.707467:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.707470:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98660 00010000:00010000:0.0:1713279306.707474:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda7360 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x8125:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.707474:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+92:15507:x1796503200021888:12345-0@lo:403:mdt_io00_005.0 00000100:00100000:1.0:1713279306.707478:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.707481:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281177536 00010000:00010000:0.0:1713279306.707483:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda7360 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x8125:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.707484:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281177536 00010000:00010000:0.0:1713279306.707490:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda7360 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x8125:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000004:00200000:0.0:1713279306.707497:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x8125:0x0]: returning size 0 00000100:00100000:1.0:1713279306.707497:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.707506:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281177280 00000100:00100000:2.0:1713279306.707508:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281177280 00000100:00100000:1.0:1713279306.707513:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.707517:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281177600 00000100:00100000:2.0:1713279306.707520:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784923 00000100:00100000:3.0:1713279306.707520:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281177600 00000100:00100000:2.0:1713279306.707524:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3758:11826:x1796503281177536:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:1.0:1713279306.707526:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.707531:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.707533:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281177216 00000100:00100000:3.0:1713279306.707533:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784924 00010000:00010000:0.0:1713279306.707535:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda7359 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x8125:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917536c expref: 3759 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.707536:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281177216 00000100:00100000:3.0:1713279306.707536:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3759:11810:x1796503281177280:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.707538:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda736e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917533b expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.707542:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.707546:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda7360 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x8125:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917536c expref: 3759 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.707546:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281177344 00000100:00100000:1.0:1713279306.707547:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281177344 00010000:00010000:3.0:1713279306.707548:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda7375 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x23e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175365 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.707552:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8125:0x0].0x0 (ffff8800940f8f00) 00010000:00010000:0.0:1713279306.707554:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:1.0:1713279306.707555:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110427 00010000:00010000:0.0:1713279306.707557:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122206400, rc 0) 00000100:00100000:1.0:1713279306.707558:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+77:1954:x1796503281177216:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:3.0:1713279306.707567:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323600/0xfc4b8e114eda737c lrc: 3/1,0 mode: --/PR res: [0x200000400:0x23e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.707574:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3760:11736:x1796503281177472:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 184us (236us total) trans 4295202608 rc 0/0 00010000:00010000:3.0:1713279306.707574:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323600/0xfc4b8e114eda737c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x23e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.707579:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda7383 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.707580:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784922 00010000:00010000:3.0:1713279306.707580:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323600/0xfc4b8e114eda737c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x23e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.707586:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda7383 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.707592:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784925 00010000:00010000:2.0:1713279306.707592:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda7383 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.707596:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3733:11828:x1796503281177600:12345-192.168.203.4@tcp:101:lfs.0 00000004:00200000:3.0:1713279306.707597:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x23e:0x0]: returning size 4096 00000004:00200000:3.0:1713279306.707600:0:6929:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1713279306.707601:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda738a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.707603:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.707606:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda738a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.707611:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda7391 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175238 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.707612:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda738a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.707614:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda7375 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175365 expref: 3760 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.707623:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323600/0xfc4b8e114eda737c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x23e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175365 expref: 3759 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.707629:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x23e:0x0].0x0 (ffff88012514d100) 00000100:00100000:1.0:1713279306.707631:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+78:1954:x1796503281177216:12345-192.168.203.4@tcp:2:touch.0 Request processed in 72us (116us total) trans 4295010099 rc 0/0 00010000:00010000:3.0:1713279306.707631:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713279306.707633:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d323600, rc 0) 00000100:00100000:1.0:1713279306.707635:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110427 00000100:00100000:1.0:1713279306.707642:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110428 00000100:00100000:1.0:1713279306.707644:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1954:x1796503281177344:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:0.0:1713279306.707648:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda7398 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.707650:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3759:11810:x1796503281177280:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 112us (171us total) trans 0 rc 0/0 00000004:00200000:2.0:1713279306.707651:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x863c:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.707656:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda7398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.707657:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda7383 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:3.0:1713279306.707659:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784924 00010000:00010000:0.0:1713279306.707662:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda7398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.707663:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda7383 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.707667:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda7383 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00000004:00200000:0.0:1713279306.707668:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7ff8:0x0]: returning size 13836 00010000:00010000:2.0:1713279306.707676:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda7383 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.707680:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.707682:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda7383 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.707687:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda7383 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.707693:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00000100:00100000:1.0:1713279306.707695:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+77:1954:x1796503281177344:12345-192.168.203.4@tcp:2:touch.0 Request processed in 49us (168us total) trans 4295010161 rc 0/0 00010000:00010000:2.0:1713279306.707695:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.707697:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda7383 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713279306.707701:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110428 00010000:00010000:2.0:1713279306.707701:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda7383 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.707704:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda7391 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175238 expref: 3736 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.707708:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda738a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.707712:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda738a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.707715:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda7398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175238 expref: 3735 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.707716:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda738a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.707719:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ef3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.707721:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ff8:0x0].0x0 (ffff880089dc3f00) 00010000:00010000:2.0:1713279306.707721:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda738a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.707723:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713279306.707725:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880089fe1680, rc 0) 00010000:00010000:2.0:1713279306.707725:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda738a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.707733:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3131 (ffff88008bde0b00) 00010000:00010000:2.0:1713279306.707735:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.707737:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda738a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.707741:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda738a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.707742:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3735:11828:x1796503281177600:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 145us (244us total) trans 4295202609 rc 0/0 00000100:00100000:0.0:1713279306.707748:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784925 00010000:00010000:2.0:1713279306.707756:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda736e lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917533b expref: 3758 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.707761:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda736e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917533b expref: 3758 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.707767:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298edb00, rc 0) 00000100:00100000:2.0:1713279306.707785:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3757:11826:x1796503281177536:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 260us (317us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.707790:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784923 00000100:00100000:0.0:1713279306.708694:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.708715:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.708716:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281177792 00000100:00100000:2.0:1713279306.708720:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281177792 00000100:00100000:2.0:1713279306.708735:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110429 00000100:00100000:2.0:1713279306.708739:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+82:1954:x1796503281177792:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:3.0:1713279306.708808:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+92:15507:x1796503200021888:12345-0@lo:403:mdt_io00_005.0 Request processed in 1333us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.708814:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98660 00000100:00100000:0.0:1713279306.708817:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d304000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200021888:0@lo:403:mdt_io00_005.0 00002000:00010000:2.0:1713279306.708866:0:9197:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb size from disk: 27670 -> 27670 00002000:00010000:2.0:1713279306.708869:0:9197:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.708871:0:9197:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1713279306.708873:0:9197:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.708875:0:9197:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb blocks from disk: 56 -> 80 00000100:00100000:2.0:1713279306.708903:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+83:1954:x1796503281177792:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 162us (208us total) trans 4295010162 rc 0/0 00000100:00100000:2.0:1713279306.708908:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110429 00000100:00100000:2.0:1713279306.708921:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281177856 00000100:00100000:2.0:1713279306.708923:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281177856 00000100:00100000:2.0:1713279306.708941:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784926 00000100:00100000:2.0:1713279306.708945:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3757:11844:x1796503281177856:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.708952:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.708960:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda73a6 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917537a expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.708987:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda73ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7fb7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.708993:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda73ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7fb7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.708999:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda73ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7fb7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.709012:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.709023:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.709028:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281177728 00000100:00100000:3.0:1713279306.709031:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281177728 00000100:00100000:1.0:1713279306.709038:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.709041:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281178240 00000100:00100000:2.0:1713279306.709043:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281178240 00000100:00100000:3.0:1713279306.709048:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281177984 00000100:00100000:3.0:1713279306.709050:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281177984 00000100:00100000:1.0:1713279306.709058:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.709063:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222975 00000100:00100000:2.0:1713279306.709077:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3736:9807:x1796503281178240:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1713279306.709085:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.709093:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281178368 00000100:00100000:3.0:1713279306.709096:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281178368 00000100:00100000:3.0:1713279306.709104:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281178112 00000100:00100000:3.0:1713279306.709106:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281178112 00000100:00100000:2.0:1713279306.709113:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3737:9807:x1796503281178240:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 45us (89us total) trans 0 rc -116/-116 00000100:00100000:3.0:1713279306.709117:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784927 00000100:00100000:2.0:1713279306.709119:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222975 00000100:00100000:3.0:1713279306.709121:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:11845:x1796503281177728:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.709127:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.709136:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda73b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175373 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.709140:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784928 00000100:00100000:2.0:1713279306.709144:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3736:11827:x1796503281177984:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.709150:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.709151:0:15479:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1713279306.709160:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342880/0xfc4b8e114ed99a4b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39171752 expref: 3736 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.709168:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22f:0x0].0x0 (ffff8800934f8c00) 00010000:00010000:3.0:1713279306.709170:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114eda73bb lrc: 3/1,0 mode: --/CR res: [0x240000403:0x757a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.709172:0:15479:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.709178:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda73c2 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175381 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.709178:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114eda73bb lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x757a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.709184:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114eda73bb lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x757a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000004:00200000:3.0:1713279306.709189:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x757a:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.709202:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda73d0 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.709208:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda73d0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.709214:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda73d0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.709223:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114eda73d7 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22f:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.709223:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda73b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175373 expref: 3372 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.709229:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114eda73d7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22f:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.709234:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114eda73d7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22f:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.709239:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114eda73bb lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x757a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175373 expref: 3371 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.709245:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x757a:0x0].0x0 (ffff88008c725f00) 00010000:00010000:3.0:1713279306.709247:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1713279306.709249:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda73d0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.709249:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d321f80, rc 0) 00010000:00010000:2.0:1713279306.709254:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda73d0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.709259:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda73d0 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.709264:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda73d0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.709268:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68a640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.709270:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda73d0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.709275:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda73d0 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00000100:00100000:3.0:1713279306.709276:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3371:11845:x1796503281177728:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 154us (265us total) trans 4295183594 rc 0/0 00000100:00100000:3.0:1713279306.709281:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784927 00010000:00010000:2.0:1713279306.709282:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22f:0x0].0x0 (ffff88011f2c2200) 00010000:00010000:2.0:1713279306.709284:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.709286:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda73d0 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.709291:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda73d0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:3.0:1713279306.709292:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784929 00000100:00100000:3.0:1713279306.709295:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3657:11708:x1796503281178368:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1713279306.709298:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114eda73d7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22f:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.709303:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114eda73d7 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22f:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.709308:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880095249d40/0xfc4b8e114eda73de lrc: 3/0,1 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.709308:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114eda73d7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22f:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.709309:0:15482:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.709312:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.709314:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114eda73d7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22f:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.709316:0:15507:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880095249d40/0xfc4b8e114eda73de lrc: 3/0,1 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.709316:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7344 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x71ea:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917535e expref: 3657 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.709321:0:15507:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880095249d40/0xfc4b8e114eda73de lrc: 3/0,1 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.709323:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114eda73d7 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22f:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.709324:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71ea:0x0].0x0 (ffff8800925a8100) 00010000:00010000:3.0:1713279306.709326:0:15482:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.709328:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200022016:0@lo:101:mdt_io00_005.0 00010000:00010000:2.0:1713279306.709328:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22f:0x0].0x3931 (ffff880136671e00) 00010000:00010000:2.0:1713279306.709330:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.709332:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114eda73d7 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22f:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.709337:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114eda73d7 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22f:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.709343:0:15507:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.709348:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda73e5 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x71ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.709351:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549a80 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.709353:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda73c2 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175381 expref: 3736 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.709355:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda73e5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x71ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.709360:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda73c2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175381 expref: 3736 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.709361:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda73e5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x71ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.709362:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784930 00000100:00100000:0.0:1713279306.709365:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3736:11846:x1796503281178112:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.709368:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f3f3c0, rc 0) 00010000:00010000:0.0:1713279306.709371:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.709377:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda73ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175388 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.709389:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3736:11827:x1796503281177984:12345-192.168.203.4@tcp:101:touch.0 Request processed in 244us (349us total) trans 0 rc 301/301 00000004:00010000:3.0:1713279306.709393:0:15482:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008c161f80 reply state ffff880091dc3000 transno 4295183595 ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda73e5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x71ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.709395:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784928 00010000:00010000:3.0:1713279306.709401:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda73e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x71ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.709406:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71ea:0x0].0x0 (ffff8800925a8100) 00010000:00010000:0.0:1713279306.709407:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda73f3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.709408:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:2.0:1713279306.709409:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7fb7:0x0]: returning size 4096 00000100:00100000:3.0:1713279306.709409:0:15482:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.709428:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda73f3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000004:00200000:2.0:1713279306.709430:0:15658:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:0.0:1713279306.709433:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda73f3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000004:00200000:0.0:1713279306.709438:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7fe9:0x0]: returning size 46934 00000100:00100000:3.0:1713279306.709459:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3658:11708:x1796503281178368:12345-192.168.203.4@tcp:36:touch.0 Request processed in 161us (398us total) trans 4295183595 rc 0/0 00000100:00100000:3.0:1713279306.709463:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784929 00010000:00010000:0.0:1713279306.709468:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda73ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175388 expref: 3737 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.709475:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e1c0/0xfc4b8e114eda73f3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175388 expref: 3736 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.709479:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200022016 00000100:00100000:3.0:1713279306.709481:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200022016 00010000:00010000:0.0:1713279306.709483:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:0.0:1713279306.709484:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1713279306.709486:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942e1c0, rc 0) 00000100:00100000:3.0:1713279306.709493:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98661 00000100:00100000:3.0:1713279306.709497:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+92:15507:x1796503200022016:12345-0@lo:101:mdt_io00_005.0 00000100:00100000:0.0:1713279306.709502:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3736:11846:x1796503281178112:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 136us (417us total) trans 4295202610 rc 0/0 00010000:00010000:3.0:1713279306.709502:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.709506:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784930 00010000:00010000:3.0:1713279306.709511:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3206c0/0xfc4b8e114eda7401 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda73de expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.709520:0:15658:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda73ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7fb7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.709522:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3206c0/0xfc4b8e114eda7401 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda73de expref: 93 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.709530:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3206c0/0xfc4b8e114eda7401 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda73de expref: 93 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.709534:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda73a6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917537a expref: 3759 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.709536:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x0 (ffff880097622200) 00010000:00010000:3.0:1713279306.709538:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.709540:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3206c0, rc 0) 00010000:00010000:2.0:1713279306.709544:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24ef40/0xfc4b8e114eda73ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7fb7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917537a expref: 3758 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.709549:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7fb7:0x0].0x0 (ffff88007f389900) 00010000:00010000:2.0:1713279306.709551:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713279306.709553:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c24ef40, rc 0) 00000100:00100000:3.0:1713279306.709561:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+93:15507:x1796503200022016:12345-0@lo:101:mdt_io00_005.0 Request processed in 63us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.709569:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200022016:0@lo:101:mdt_io00_005.0 00000100:00100000:3.0:1713279306.709569:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98661 00000100:00100000:2.0:1713279306.709570:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3758:11844:x1796503281177856:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 624us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.709574:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784926 00010000:00010000:0.0:1713279306.709576:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880095249d40/0xfc4b8e114eda73de lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7401 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.709581:0:15507:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880095249d40/0xfc4b8e114eda73de lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7401 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.709591:0:15507:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x261:0x0] 00010000:00010000:0.0:1713279306.709603:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008942e400/0xfc4b8e114eda7408 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x261:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.709609:0:15507:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008942e400/0xfc4b8e114eda7408 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x261:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.709615:0:15507:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008942e400/0xfc4b8e114eda7408 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x261:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15507 initiator: MDT0 00000100:00100000:0.0:1713279306.709625:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200022080:0@lo:101:mdt_io00_005.0 00000100:00100000:0.0:1713279306.709643:0:15507:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.709657:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200022080 00000100:00100000:3.0:1713279306.709660:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200022080 00000100:00100000:3.0:1713279306.709670:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98662 00000100:00100000:3.0:1713279306.709674:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+93:15507:x1796503200022080:12345-0@lo:101:mdt_io00_005.0 00010000:00010000:3.0:1713279306.709680:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.709687:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda740f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x261:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda7408 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.709698:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda740f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x261:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda7408 expref: 94 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.709705:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda740f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x261:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda7408 expref: 94 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.709711:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x34 (ffff88008e766400) 00010000:00010000:3.0:1713279306.709713:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.709714:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d322f40, rc 0) 00000100:00100000:0.0:1713279306.709958:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549a80 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.709965:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.709967:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+94:15507:x1796503200022080:12345-0@lo:101:mdt_io00_005.0 Request processed in 293us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.709970:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98662 00000100:00100000:0.0:1713279306.709971:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200022080:0@lo:101:mdt_io00_005.0 00010000:00010000:0.0:1713279306.709981:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008942e400/0xfc4b8e114eda7408 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x261:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda740f expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.709994:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.709999:0:15507:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008942e400/0xfc4b8e114eda7408 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x261:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda740f expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.710003:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.710010:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281178688 00000004:00080000:0.0:1713279306.710011:0:15507:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x261:0x0] 00000100:00100000:1.0:1713279306.710012:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.710013:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281178688 00000100:00100000:3.0:1713279306.710015:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281178560 00000100:00100000:3.0:1713279306.710018:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281178560 00000100:00100000:1.0:1713279306.710020:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.710021:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda7416 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.710027:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda7416 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00000100:00100000:3.0:1713279306.710029:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222976 00000100:00100000:1.0:1713279306.710033:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.710033:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281178816 00000100:00100000:3.0:1713279306.710033:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3736:11204:x1796503281178560:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:0.0:1713279306.710034:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda7416 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:2.0:1713279306.710035:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281178816 00000100:00100000:1.0:1713279306.710041:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.710042:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda741d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x139:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00000100:00100000:2.0:1713279306.710044:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281179072 00000100:00100000:2.0:1713279306.710046:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281179072 00010000:00010000:0.0:1713279306.710048:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda741d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00000100:00100000:1.0:1713279306.710051:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110430 00010000:00010000:0.0:1713279306.710053:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda741d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:1.0:1713279306.710056:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+84:1957:x1796503281178816:12345-192.168.203.4@tcp:1:lfs.0 00000100:00100000:2.0:1713279306.710066:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110431 00000100:00100000:2.0:1713279306.710083:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+84:1957:x1796503281179072:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:1.0:1713279306.710084:0:15500:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7424 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1145:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.710085:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7c03:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.710094:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800978861c0/0xfc4b8e114ed14837 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39148f2a expref: 3757 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.710094:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009175d200/0xfc4b8e114ed9c1f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1145:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391721fc expref: 76 pid: 15539 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713279306.710099:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092541b00/0xfc4b8e114ed9dcee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1145:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917295e expref: 84 pid: 15538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713279306.710100:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.710103:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.710104:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.710106:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7424 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1145:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.710118:0:15507:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800978861c0/0xfc4b8e114ed14837 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39148f2a expref: 3757 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.710118:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092541b00/0xfc4b8e114ed9dcee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1145:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917295e expref: 84 pid: 15538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713279306.710124:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092541b00/0xfc4b8e114ed9dcee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1145:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917295e expref: 85 pid: 15538 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.710127:0:15507:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800978861c0/0xfc4b8e114ed14837 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39148f2a expref: 3757 pid: 15483 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.710131:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c161500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200022208:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.710134:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3737:11204:x1796503281178560:12345-192.168.203.4@tcp:35:touch.0 Request processed in 99us (127us total) trans 4295202611 rc 0/0 00000100:00100000:0.0:1713279306.710135:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200022144:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.710143:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281179072:12345-192.168.203.4@tcp:2:touch.0 Request processed in 60us (101us total) trans 4295010163 rc 0/0 00000100:00100000:3.0:1713279306.710143:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222976 00000100:00100000:2.0:1713279306.710148:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110431 00010000:00010000:1.0:1713279306.710150:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009175d200/0xfc4b8e114ed9c1f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1145:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391721fc expref: 76 pid: 15539 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713279306.710155:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009175d200/0xfc4b8e114ed9c1f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1145:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391721fc expref: 76 pid: 15539 timeout: 509 lvb_type: 1 00000100:00100000:0.0:1713279306.710156:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549a80 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.710157:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281178432 00000100:00100000:1.0:1713279306.710159:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c160a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200022272:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.710160:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281178752 00000100:00100000:3.0:1713279306.710160:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281178432 00000100:00100000:2.0:1713279306.710162:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281178752 00000100:00100000:0.0:1713279306.710167:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281178880 00000100:00100000:1.0:1713279306.710167:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff880130637840 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.710171:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281178880 00000100:00100000:3.0:1713279306.710172:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784931 00000100:00100000:3.0:1713279306.710177:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3659:11711:x1796503281178688:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.710181:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784932 00000100:00100000:2.0:1713279306.710185:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3371:11374:x1796503281178432:12345-192.168.203.4@tcp:34:lfs.0 00000100:00100000:3.0:1713279306.710187:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784933 00000100:00100000:3.0:1713279306.710190:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3659:11695:x1796503281178752:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.710192:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784934 00000100:00100000:0.0:1713279306.710196:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3737:9807:x1796503281178880:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1713279306.710196:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.710203:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320fc0/0xfc4b8e114eda7432 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x777b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175396 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.710205:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7439 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.710211:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.710212:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7439 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.710220:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ed00/0xfc4b8e114eda7440 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x149:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.710222:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320fc0/0xfc4b8e114eda7432 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x777b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175396 expref: 3660 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.710223:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7439 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.710228:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ed00/0xfc4b8e114eda7440 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.710230:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320fc0/0xfc4b8e114eda7432 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x777b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175396 expref: 3660 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.710233:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281179008 00010000:00010000:0.0:1713279306.710234:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ed00/0xfc4b8e114eda7440 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.710235:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281179008 00010000:00010000:3.0:1713279306.710239:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x777b:0x0].0x0 (ffff880097e7bf00) 00010000:00010000:3.0:1713279306.710241:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1713279306.710243:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c480/0xfc4b8e114eda7447 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.710243:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d320fc0, rc 0) 00010000:00010000:0.0:1713279306.710248:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c480/0xfc4b8e114eda7447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.710249:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784935 00000100:00100000:2.0:1713279306.710252:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3661:11825:x1796503281179008:12345-192.168.203.4@tcp:36:mkdir.0 00010000:00010000:0.0:1713279306.710254:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c480/0xfc4b8e114eda7447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000100:00100000:3.0:1713279306.710260:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3661:11695:x1796503281178752:12345-192.168.203.4@tcp:101:touch.0 Request processed in 69us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.710265:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784933 00010000:00010000:3.0:1713279306.710282:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.710287:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda744e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.710288:0:15479:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d307800 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-mdtlov_UUID:15479:1796503200022336:0@lo:1000:mdt00_015.0 00010000:00010000:3.0:1713279306.710290:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda7455 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917538f expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.710294:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda744e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.710299:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda744e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000004:00200000:0.0:1713279306.710307:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8264:0x0]: returning size 2 00000100:00100000:2.0:1713279306.710311:0:15479:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1713279306.710313:0:15753:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda744e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.710320:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ed00/0xfc4b8e114eda7440 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.710320:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114eda745c lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.710321:0:15479:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760a80 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.710325:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ed00/0xfc4b8e114eda7440 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.710327:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114eda745c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.710330:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ed00/0xfc4b8e114eda7440 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.710332:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7463 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25c:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.710333:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114eda745c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.710335:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ed00/0xfc4b8e114eda7440 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.710338:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7463 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.710339:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942ed00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.710342:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ed00/0xfc4b8e114eda7440 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.710343:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7463 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.710343:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda746a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.710347:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ed00/0xfc4b8e114eda7440 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.710348:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda746a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.710353:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda746a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.710354:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x149:0x0].0x0 (ffff880096b8ec00) 00010000:00010000:0.0:1713279306.710357:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.710359:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ed00/0xfc4b8e114eda7440 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.710364:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ed00/0xfc4b8e114eda7440 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.710368:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114eda745c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.710370:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7471 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7892:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.710373:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c480/0xfc4b8e114eda7447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.710373:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114eda745c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.710376:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7471 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7892:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.710378:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c480/0xfc4b8e114eda7447 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.710378:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114eda745c lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.710382:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7471 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7892:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.710382:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114eda745c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.710383:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c480/0xfc4b8e114eda7447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.710387:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d3221c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.710388:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.710390:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c480/0xfc4b8e114eda7447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.710390:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114eda745c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.710395:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c480/0xfc4b8e114eda7447 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00000004:00010000:2.0:1713279306.710398:0:9221:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7471 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7892:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.710398:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114eda745c lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.710404:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88008e766000) 00010000:00010000:2.0:1713279306.710405:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7439 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.710406:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.710409:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114eda745c lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.710410:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7439 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.710433:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7439 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.710433:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114eda745c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.710438:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7439 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.710442:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.710442:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda746a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.710444:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7439 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.710447:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda746a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.710449:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7439 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.710462:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda746a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.710466:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25c:0x0].0x0 (ffff88011eea5300) 00010000:00010000:3.0:1713279306.710466:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.710468:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.710468:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda746a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.710470:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7439 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.710473:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda746a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.710475:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7439 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.710479:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff8800954bed00) 00010000:00010000:3.0:1713279306.710481:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.710482:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7463 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.710483:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda746a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.710487:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7463 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.710488:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320480/0xfc4b8e114eda746a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.710492:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7463 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.710496:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e6886c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.710498:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7463 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.710503:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7463 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.710504:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x149:0x0].0x3331 (ffff880096b8e500) 00010000:00010000:3.0:1713279306.710505:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda7455 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917538f expref: 3661 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.710507:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.710509:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25c:0x0].0x3531 (ffff88008f645700) 00010000:00010000:0.0:1713279306.710510:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c480/0xfc4b8e114eda7447 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.710511:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.710512:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda7455 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917538f expref: 3661 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.710513:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.710513:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7463 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.710515:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c480/0xfc4b8e114eda7447 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.710518:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7463 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.710520:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d321680, rc 0) 00010000:00010000:0.0:1713279306.710525:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda744e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00000100:00100000:1.0:1713279306.710525:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.710526:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7471 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7892:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.710531:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda744e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.710532:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7471 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7892:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.710536:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda744e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.710537:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7471 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7892:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.710537:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3660:11711:x1796503281178688:12345-192.168.203.4@tcp:101:touch.0 Request processed in 359us (572us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.710541:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942cb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.710542:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68b840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.710543:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda744e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00000100:00100000:3.0:1713279306.710543:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784931 00010000:00010000:2.0:1713279306.710544:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7471 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7892:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.710549:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda744e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.710549:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7471 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7892:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.710551:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281179264 00000100:00100000:3.0:1713279306.710554:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281179264 00010000:00010000:2.0:1713279306.710555:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7892:0x0].0x0 (ffff88008d7fcd00) 00010000:00010000:2.0:1713279306.710557:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.710559:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7471 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x7892:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.710565:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.710568:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7471 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7892:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.710568:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784936 00000100:00100000:3.0:1713279306.710574:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3372:11849:x1796503281179264:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:3.0:1713279306.710581:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281179392 00000100:00100000:2.0:1713279306.710582:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281179136 00000100:00100000:1.0:1713279306.710583:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.710583:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281179392 00000100:00100000:2.0:1713279306.710584:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281179136 00000100:00100000:3.0:1713279306.710593:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281179520 00000100:00100000:3.0:1713279306.710595:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281179520 00000100:00100000:2.0:1713279306.710600:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147214 00000100:00100000:2.0:1713279306.710604:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3739:1957:x1796503281179136:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.710604:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222977 00000100:00100000:3.0:1713279306.710607:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c56ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3739:11828:x1796503281179392:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:2.0:1713279306.710610:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.710617:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda7398 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175238 expref: 3739 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.710618:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8264:0x0].0x0 (ffff880096b8e700) 00010000:00010000:0.0:1713279306.710620:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.710623:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda744e lrc: 2/0,0 mode: --/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000100:00100000:1.0:1713279306.710624:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.710626:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ff8:0x0].0x0 (ffff880089dc3f00) 00010000:00010000:0.0:1713279306.710628:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda744e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.710628:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.710646:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3739:1957:x1796503281179136:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 41us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.710652:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147214 00000100:00100000:0.0:1713279306.710657:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3739:9807:x1796503281178880:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 459us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.710663:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c56ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3738:11828:x1796503281179392:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 54us (96us total) trans 4295202612 rc 0/0 00000100:00100000:0.0:1713279306.710664:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784934 00000100:00100000:3.0:1713279306.710669:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222977 00000100:00100000:2.0:1713279306.710673:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3372:11374:x1796503281178432:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 488us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.710689:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784932 00000100:00100000:3.0:1713279306.710705:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281179648 00000100:00100000:3.0:1713279306.710708:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281179648 00000100:00100000:3.0:1713279306.710720:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222978 00000100:00100000:3.0:1713279306.710723:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:385c4b71-808c-40cf-91de-b076b668d13f+3660:11824:x1796503281179520:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:0.0:1713279306.710730:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222979 00000100:00100000:0.0:1713279306.710735:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3758:11810:x1796503281179648:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.710787:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:385c4b71-808c-40cf-91de-b076b668d13f+3661:11824:x1796503281179520:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 62us (203us total) trans 4295183596 rc 0/0 00000100:00100000:3.0:1713279306.710791:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222978 00000100:00100000:0.0:1713279306.710804:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3759:11810:x1796503281179648:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 67us (177us total) trans 4295202613 rc 0/0 00010000:00010000:3.0:1713279306.710807:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.710811:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222979 00010000:00010000:3.0:1713279306.710813:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114eda7478 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917539d expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.710865:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c61c0/0xfc4b8e114eda747f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x685c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.710870:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c61c0/0xfc4b8e114eda747f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x685c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.710874:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c61c0/0xfc4b8e114eda747f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x685c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000004:00200000:3.0:1713279306.710888:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x685c:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.710911:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114eda7478 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917539d expref: 3374 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.710918:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c61c0/0xfc4b8e114eda747f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x685c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917539d expref: 3373 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.710922:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x685c:0x0].0x0 (ffff88007f14b100) 00010000:00010000:3.0:1713279306.710923:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1713279306.710925:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312c61c0, rc 0) 00000100:00100000:3.0:1713279306.710938:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3373:11849:x1796503281179264:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 365us (426us total) trans 4295183597 rc 0/0 00000100:00100000:3.0:1713279306.710944:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784936 00000100:00100000:3.0:1713279306.710955:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200022336 00000100:00100000:3.0:1713279306.710957:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200022336 00000100:00100000:3.0:1713279306.710965:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98663 00000100:00100000:3.0:1713279306.710968:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+56:15479:x1796503200022336:12345-0@lo:1000:mdt00_015.0 00000100:00100000:1.0:1713279306.711008:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.711016:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+56:15479:x1796503200022336:12345-0@lo:1000:mdt00_015.0 Request processed in 46us (704us total) trans 0 rc 1/1 00000100:00100000:3.0:1713279306.711022:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98663 00000100:00100000:3.0:1713279306.711034:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281179968 00000100:00100000:3.0:1713279306.711037:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281179968 00000100:00100000:2.0:1713279306.711043:0:15479:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d307800 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-mdtlov_UUID:15479:1796503200022336:0@lo:1000:mdt00_015.0 00000100:00100000:0.0:1713279306.711044:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.711048:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784937 00000100:00100000:3.0:1713279306.711052:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3737:11204:x1796503281179968:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.711055:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281179776 00000100:00100000:1.0:1713279306.711058:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281179776 00010000:00010000:3.0:1713279306.711058:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.711065:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114eda748d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391753a4 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.711084:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200022144:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.711089:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222980 00010000:00010000:0.0:1713279306.711093:0:15507:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:1.0:1713279306.711093:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3661:11708:x1796503281179776:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1713279306.711094:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3661:11825:x1796503281179008:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 839us (881us total) trans 0 rc -17/-17 00000100:00100000:2.0:1713279306.711100:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784935 00000100:00100000:0.0:1713279306.711109:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.711114:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7494 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.711120:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7494 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.711125:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.711126:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7494 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.711131:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281179904 00000100:00100000:2.0:1713279306.711133:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281179904 00010000:00010000:3.0:1713279306.711136:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda749b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.711141:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda749b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.711142:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092541b00/0xfc4b8e114ed9dcee lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x1145:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917295e expref: 85 pid: 15538 timeout: 509 lvb_type: 1 00000100:00100000:0.0:1713279306.711147:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.711147:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda749b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.711149:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3661:11708:x1796503281179776:12345-192.168.203.4@tcp:35:touch.0 Request processed in 55us (105us total) trans 4295183598 rc 0/0 00000100:00100000:1.0:1713279306.711153:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222980 00000100:00100000:2.0:1713279306.711156:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281180032 00000100:00100000:2.0:1713279306.711158:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281180032 00010000:00010000:3.0:1713279306.711164:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7494 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.711165:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281180096 00010000:00010000:2.0:1713279306.711165:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800978861c0/0xfc4b8e114ed14837 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39148f2a expref: 3759 pid: 15483 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.711168:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281180096 00010000:00010000:3.0:1713279306.711170:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7494 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.711174:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7494 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.711175:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009175d200/0xfc4b8e114ed9c1f8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x1145:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391721fc expref: 77 pid: 15539 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.711177:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196456 00010000:00010000:3.0:1713279306.711180:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7494 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.711181:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281179904:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.711183:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196457 00010000:00010000:3.0:1713279306.711184:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f557840 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.711186:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196458 00000100:00100000:0.0:1713279306.711187:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3759:1957:x1796503281180032:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.711187:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.711187:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7494 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.711189:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+77:1956:x1796503281180096:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.711192:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7494 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.711193:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.711193:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.711195:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092541b00/0xfc4b8e114ed9dcee lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x1145:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917295e expref: 85 pid: 15538 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.711197:0:15711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800978861c0/0xfc4b8e114ed14837 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39148f2a expref: 3759 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.711198:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:1.0:1713279306.711199:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009175d200/0xfc4b8e114ed9c1f8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x1145:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391721fc expref: 77 pid: 15539 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.711200:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.711203:0:15711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800978861c0/0xfc4b8e114ed14837 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39148f2a expref: 3759 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.711203:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7494 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.711204:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092541b00/0xfc4b8e114ed9dcee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1145:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917295e expref: 85 pid: 15538 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.711208:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7494 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.711211:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800978861c0/0xfc4b8e114ed14837 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7c03:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39148f2a expref: 3759 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.711212:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009175d200/0xfc4b8e114ed9c1f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1145:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391721fc expref: 77 pid: 15539 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.711215:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda749b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.711217:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c03:0x0].0x0 (ffff880131200900) 00010000:00010000:0.0:1713279306.711219:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.711220:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda749b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.711222:0:15711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.711224:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda749b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.711225:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.711226:0:15711:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.711226:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.711228:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008be63600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.711229:0:15557:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1145:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.711230:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda749b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.711233:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.711235:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda749b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.711237:0:15557:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7424 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1145:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.711240:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3531 (ffff8800960e8000) 00010000:00010000:3.0:1713279306.711242:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.711243:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.711244:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3758:1957:x1796503281180032:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 56us (118us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.711244:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda749b lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.711246:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.711248:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196457 00010000:00010000:3.0:1713279306.711248:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda749b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.711253:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+77:1956:x1796503281180096:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 63us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.711256:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196458 00010000:00010000:0.0:1713279306.711259:0:15507:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:2.0:1713279306.711261:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281179904:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 79us (151us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.711263:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.711264:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114eda748d lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753a4 expref: 3738 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.711267:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196456 00010000:00010000:3.0:1713279306.711270:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114eda748d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753a4 expref: 3738 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.711275:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092541b00/0xfc4b8e114ed9dcee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1145:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917295e expref: 84 pid: 15538 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.711277:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312c58c0, rc 0) 00000100:00100000:1.0:1713279306.711285:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c161500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200022208:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.711288:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200022400:0@lo:1000:mdt_io00_005.0 00000100:00100000:3.0:1713279306.711291:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3737:11204:x1796503281179968:12345-192.168.203.4@tcp:101:touch.0 Request processed in 238us (282us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.711292:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009175d200/0xfc4b8e114ed9c1f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1145:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391721fc expref: 76 pid: 15539 timeout: 509 lvb_type: 1 00000100:00100000:1.0:1713279306.711297:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c160a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200022272:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.711297:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784937 00000100:00100000:0.0:1713279306.711305:0:15507:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.711305:0:15500:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.711309:0:15500:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.711313:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008e45fa80 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.711313:0:15500:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.711320:0:15500:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.711323:0:15500:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7424 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.711326:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200022400 00010000:00010000:1.0:1713279306.711327:0:15500:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7424 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.711329:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200022400 00010000:00010000:1.0:1713279306.711331:0:15500:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bc6c0 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:1.0:1713279306.711333:0:15500:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7424 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.711337:0:15500:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7424 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.711343:0:15500:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7424 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.711344:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98664 00010000:00010000:1.0:1713279306.711346:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7424 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.711347:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+94:15507:x1796503200022400:12345-0@lo:1000:mdt_io00_005.0 00000100:00100000:1.0:1713279306.711367:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281178816:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 1312us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.711371:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110430 00000100:00100000:3.0:1713279306.711404:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+94:15507:x1796503200022400:12345-0@lo:1000:mdt_io00_005.0 Request processed in 56us (98us total) trans 0 rc -2/-2 00000100:00100000:3.0:1713279306.711408:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98664 00000100:00100000:0.0:1713279306.711436:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200022400:0@lo:1000:mdt_io00_005.0 00000100:00100000:0.0:1713279306.711464:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200022464:0@lo:1000:mdt_io00_005.0 00000100:00100000:0.0:1713279306.711483:0:15507:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.711493:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008e45f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.711494:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200022464 00000100:00100000:3.0:1713279306.711497:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200022464 00000100:00100000:3.0:1713279306.711504:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98665 00000100:00100000:3.0:1713279306.711507:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+94:15507:x1796503200022464:12345-0@lo:1000:mdt_io00_005.0 00000100:00100000:3.0:1713279306.711532:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+94:15507:x1796503200022464:12345-0@lo:1000:mdt_io00_005.0 Request processed in 24us (48us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.711535:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98665 00000100:00100000:0.0:1713279306.711544:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200022464:0@lo:1000:mdt_io00_005.0 00000100:00100000:0.0:1713279306.711574:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200022528:0@lo:1000:mdt_io00_005.0 00000100:00100000:0.0:1713279306.711636:0:15507:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.711646:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008e45fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.711646:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200022528 00000100:00100000:3.0:1713279306.711648:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200022528 00000100:00100000:3.0:1713279306.711660:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98666 00000100:00100000:3.0:1713279306.711663:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+94:15507:x1796503200022528:12345-0@lo:1000:mdt_io00_005.0 00000100:00100000:3.0:1713279306.711733:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+94:15507:x1796503200022528:12345-0@lo:1000:mdt_io00_005.0 Request processed in 69us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.711737:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98666 00000100:00100000:0.0:1713279306.711749:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000-mdtlov_UUID:15507:1796503200022528:0@lo:1000:mdt_io00_005.0 00000100:00100000:2.0:1713279306.712009:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.712009:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.712029:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281180224 00000100:00100000:3.0:1713279306.712032:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281180224 00000100:00100000:2.0:1713279306.712039:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.712049:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281180352 00000100:00100000:2.0:1713279306.712051:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281180352 00000100:00100000:3.0:1713279306.712056:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14324 00000100:00100000:3.0:1713279306.712060:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3737:9807:x1796503281180224:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:2.0:1713279306.712062:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281180544 00000100:00100000:2.0:1713279306.712063:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281180544 00000100:00100000:2.0:1713279306.712087:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784938 00000100:00100000:2.0:1713279306.712091:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3373:11374:x1796503281180352:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.712095:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.712098:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.712103:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114eda74a9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7892:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391753ab expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.712106:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.712111:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.712120:0:15514:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00000040:00080000:0.0:1713279306.712124:0:15507:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x1b7:0x0].193, 904 off110792 00010000:00010000:3.0:1713279306.712126:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.712133:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda74b0 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7892:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.712139:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda74b0 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7892:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.712141:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784939 00010000:00010000:2.0:1713279306.712145:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda74b0 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7892:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.712145:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3758:11711:x1796503281180544:12345-192.168.203.4@tcp:101:touch.0 00000004:00200000:2.0:1713279306.712151:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7892:0x0]: returning size 5 00010000:00010000:3.0:1713279306.712151:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.712158:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecfc0/0xfc4b8e114eda74b7 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391753b2 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.712186:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114eda74a9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7892:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ab expref: 3376 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.712196:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda74b0 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7892:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ab expref: 3375 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.712201:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda74c5 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.712202:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7892:0x0].0x0 (ffff88008d7fcd00) 00010000:00010000:2.0:1713279306.712204:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00000040:00080000:0.0:1713279306.712207:0:15507:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0xf2:0x0].678, 984 off479792 00010000:00010000:2.0:1713279306.712207:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68a1c0, rc 0) 00010000:00010000:3.0:1713279306.712208:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda74c5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00000004:00080000:0.0:1713279306.712211:0:15507:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88008e45fa80 with version 29399 00010000:00010000:3.0:1713279306.712214:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda74c5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712221:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda74cc lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000004:00080000:1.0:1713279306.712222:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29399 rpc_version 29399 00000100:00100000:2.0:1713279306.712226:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3375:11374:x1796503281180352:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 133us (217us total) trans 4295183599 rc 0/0 00010000:00010000:3.0:1713279306.712227:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda74cc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.712231:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784938 00000020:00100000:1.0:1713279306.712235:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1713279306.712236:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda74cc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.712239:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880099669f80 x1796503200022656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1713279306.712248:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200022656:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.712249:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00200000:3.0:1713279306.712250:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:3.0:1713279306.712256:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda74c5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712261:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda74c5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.712264:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.712266:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda74c5 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.712269:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.712271:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda74c5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.712274:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281180672 00000100:00100000:1.0:1713279306.712276:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880130637840 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.712276:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ef180 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.712277:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281180672 00010000:00010000:3.0:1713279306.712278:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda74c5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.712283:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281180416 00010000:00010000:3.0:1713279306.712283:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda74c5 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.712286:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281180416 00000100:00100000:2.0:1713279306.712290:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784940 00010000:00010000:3.0:1713279306.712290:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8800960e8f00) 00010000:00010000:3.0:1713279306.712292:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.712294:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3661:11708:x1796503281180672:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.712294:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda74c5 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.712296:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110432 00000100:00100000:1.0:1713279306.712299:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+74:1956:x1796503281180416:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:3.0:1713279306.712299:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda74c5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.712301:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.712307:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda74d3 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391753b9 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.712307:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda74cc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712315:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda74cc lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712320:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda74cc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712324:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ed8c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.712326:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda74cc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712331:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda74cc lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712336:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff8800960e8700) 00010000:00010000:3.0:1713279306.712338:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.712341:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda74cc lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712345:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda74cc lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.712346:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda74da lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.712352:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda74da lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.712358:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda74da lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713279306.712359:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+75:1956:x1796503281180416:12345-192.168.203.4@tcp:2:touch.0 Request processed in 59us (111us total) trans 4295010100 rc 0/0 00000100:00100000:1.0:1713279306.712364:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110432 00010000:00010000:3.0:1713279306.712364:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecfc0/0xfc4b8e114eda74b7 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753b2 expref: 3759 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.712366:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda74e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3032 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.712371:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecfc0/0xfc4b8e114eda74b7 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753b2 expref: 3759 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.712372:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda74e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713279306.712373:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200022656 00000100:00100000:1.0:1713279306.712375:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200022656 00010000:00010000:2.0:1713279306.712377:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda74e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.712379:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ecfc0, rc 0) 00000100:00100000:1.0:1713279306.712385:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98667 00000100:00100000:1.0:1713279306.712387:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac44b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:8634:x1796503200022656:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.712396:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3758:11711:x1796503281180544:12345-192.168.203.4@tcp:101:touch.0 Request processed in 250us (356us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.712399:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda74e8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x71eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:3.0:1713279306.712402:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784939 00000100:00100000:0.0:1713279306.712403:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.712406:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda74e8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x71eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.712429:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281180736 00010000:00010000:2.0:1713279306.712430:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda74e8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x71eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.712432:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281180736 00000004:00200000:2.0:1713279306.712436:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x71eb:0x0]: returning size 0 00000100:00100000:3.0:1713279306.712446:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784941 00000100:00100000:3.0:1713279306.712450:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3758:11825:x1796503281180736:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:3.0:1713279306.712456:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.712462:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda74da lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.712462:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda74f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391753c0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.712468:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda74da lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.712472:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda74da lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.712477:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda74da lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.712481:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.712483:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda74fd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.712484:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda74da lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.712489:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda74da lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.712489:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda74fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712495:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda74fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.712496:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88008c124700) 00010000:00010000:2.0:1713279306.712498:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.712501:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda74da lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.712503:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7504 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.712505:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda74da lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.712509:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712514:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.712517:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda74e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.712521:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda74e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.712526:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda74e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.712530:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.712533:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda74e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.712534:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114eda750b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.712537:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda74e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.712541:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114eda750b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.712543:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3032 (ffff8800909b0e00) 00010000:00010000:2.0:1713279306.712545:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.712546:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114eda750b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.712547:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda74e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.712552:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda74e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.712571:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda74d3 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753b9 expref: 3664 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.712580:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda74e8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x71eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753b9 expref: 3663 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.712586:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71eb:0x0].0x0 (ffff88008d3fed00) 00010000:00010000:2.0:1713279306.712588:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.712590:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68aac0, rc 0) 00000004:00200000:3.0:1713279306.712590:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00000004:00200000:3.0:1713279306.712593:0:15482:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713279306.712601:0:15482:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114eda750b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712607:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda74fd lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712612:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda74fd lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712617:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda74fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.712618:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3663:11708:x1796503281180672:12345-192.168.203.4@tcp:101:touch.0 Request processed in 324us (354us total) trans 4295183600 rc 0/0 00010000:00010000:3.0:1713279306.712622:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda74fd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.712624:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784940 00010000:00010000:3.0:1713279306.712626:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ec900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.712628:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda74fd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712633:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda74fd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.712638:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac44b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+95:8634:x1796503200022656:12345-0@lo:1000:osp_up1-0.0 Request processed in 249us (367us total) trans 4295183601 rc 0/0 00010000:00010000:3.0:1713279306.712640:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.712642:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.712643:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98667 00010000:00010000:3.0:1713279306.712644:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda74fd lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712649:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda74fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712656:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712662:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7504 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712666:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712670:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936eed00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.712673:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712677:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7504 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712684:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff8800960e8a00) 00010000:00010000:3.0:1713279306.712686:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.712687:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7504 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712690:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7504 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.712703:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda74f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753c0 expref: 3760 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.712711:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114eda750b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753c0 expref: 3759 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.712716:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:3.0:1713279306.712718:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713279306.712720:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936efcc0, rc 0) 00000100:00100000:0.0:1713279306.712732:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.712738:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3759:11825:x1796503281180736:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 287us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.712744:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784941 00000100:00100000:2.0:1713279306.712745:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281180992 00000100:00100000:2.0:1713279306.712749:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281180992 00000100:00100000:2.0:1713279306.712763:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784942 00000100:00100000:2.0:1713279306.712767:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3375:11204:x1796503281180992:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.712774:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.712782:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688b40/0xfc4b8e114eda7512 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391753c7 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.712815:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda7519 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.712821:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda7519 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.712826:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200022656:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1713279306.712827:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda7519 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.712834:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114eda7520 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20b:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000004:00010000:0.0:1713279306.712838:0:15507:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008be58000 reply state ffff88008a012000 transno 4295202614 ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.712839:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114eda7520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.712843:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114eda7520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.712845:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.712849:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c03:0x0].0x0 (ffff880131200900) 00010000:00010000:0.0:1713279306.712850:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1713279306.712852:0:15507:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.712854:0:15507:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda7416 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.712857:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda7416 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.712861:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda7416 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.712864:0:15507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda7416 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.712866:0:15507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942c240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.712868:0:15507:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda7416 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.712871:0:15507:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda7416 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.712875:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x0 (ffff880131204d00) 00010000:00010000:0.0:1713279306.712876:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.712877:0:15507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda7416 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.712880:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda7416 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00000100:00100000:2.0:1713279306.712885:0:15658:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965180 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-mdtlov_UUID:15658:1796503200022720:0@lo:1000:mdt00_029.0 00000004:00010000:0.0:1713279306.712889:0:15507:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008be58000 reply state ffff88008a012000 transno 4295202614 ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda741d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.712894:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda741d lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.712897:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x34 (ffff880131204400) 00010000:00010000:0.0:1713279306.712898:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.712899:0:15507:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1713279306.712900:0:15507:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x261:0x0] 00000100:00100000:2.0:1713279306.712906:0:15658:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.712915:0:15658:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760180 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.712917:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200022720 00000100:00100000:1.0:1713279306.712919:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200022720 00000100:00100000:1.0:1713279306.712929:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98668 00000100:00100000:1.0:1713279306.712932:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+56:15658:x1796503200022720:12345-0@lo:1000:mdt00_029.0 00000100:00100000:2.0:1713279306.712933:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.712948:0:15525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281180864 00000100:00100000:1.0:1713279306.712950:0:15525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281180864 00000100:00100000:1.0:1713279306.712965:0:15525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14325 00000100:00100000:1.0:1713279306.712967:0:15525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:385c4b71-808c-40cf-91de-b076b668d13f+3759:11736:x1796503281180864:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:0.0:1713279306.712977:0:15507:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880095249d40/0xfc4b8e114eda73de lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7401 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.712981:0:15525:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.712982:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880095249d40/0xfc4b8e114eda73de lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda7401 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.712985:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880095249d40/0xfc4b8e114eda73de lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda7401 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.712989:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114ed9dafd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391728e7 expref: 3759 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.712990:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.712993:0:15507:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1713279306.712995:0:15507:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x261:0x0] 00010000:00010000:1.0:1713279306.712996:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8125:0x0].0x0 (ffff8800940f8f00) 00010000:00010000:0.0:1713279306.712998:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008942e400/0xfc4b8e114eda7408 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x261:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda740f expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.712998:0:15525:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.713001:0:15507:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008942e400/0xfc4b8e114eda7408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x261:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda740f expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.713003:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.713011:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.713014:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.713019:0:15525:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713279306.713020:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.713021:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281181248 00010000:00010000:1.0:1713279306.713023:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.713024:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281181248 00000100:00100000:1.0:1713279306.713031:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281181056 00000100:00100000:1.0:1713279306.713033:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281181056 00000100:00100000:2.0:1713279306.713039:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784943 00000100:00100000:1.0:1713279306.713042:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222981 00000100:00100000:2.0:1713279306.713044:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3760:11819:x1796503281181248:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:1.0:1713279306.713045:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3760:11810:x1796503281181056:12345-192.168.203.4@tcp:33:lfs.0 00010000:00010000:2.0:1713279306.713054:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.713061:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda752e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391753ce expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.713084:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+56:15658:x1796503200022720:12345-0@lo:1000:mdt00_029.0 Request processed in 151us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.713088:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98668 00000004:00080000:0.0:1713279306.713090:0:15507:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000403:0x76b7:0x0] 00010000:00010000:0.0:1713279306.713096:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.713106:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.713111:0:15507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00000004:00200000:3.0:1713279306.713114:0:15527:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x8179:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.713115:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7535 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.713116:0:15507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d4b3180 already unused, calling callback (ffffffffa0f0d730) 00000004:00200000:3.0:1713279306.713117:0:15527:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713279306.713118:0:15507:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.713123:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7535 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.713124:0:15507:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.713129:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7535 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.713131:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:0.0:1713279306.713133:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.713137:0:15507:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7305 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda72f7 expref: 55 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713138:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda753c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.713142:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3761:11810:x1796503281181056:12345-192.168.203.4@tcp:33:lfs.0 Request processed in 94us (120us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.713144:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda753c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.713145:0:15507:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7305 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda72f7 expref: 55 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.713148:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222981 00010000:00010000:2.0:1713279306.713149:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda753c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.713151:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7305 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda72f7 expref: 55 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.713157:0:15507:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.713172:0:15507:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7305 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda72f7 expref: 55 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.713181:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df06d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200022784:0@lo:105: 00000004:00200000:2.0:1713279306.713199:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8297:0x0]: returning size 4096 00000100:00100000:0.0:1713279306.713202:0:15507:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.713204:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7535 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.713212:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7535 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.713213:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98000 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.713217:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7535 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.713221:0:9213:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1713279306.713221:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7535 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.713222:0:6918:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1713279306.713225:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200022784 00010000:00010000:2.0:1713279306.713225:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d866d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.713226:0:6918:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880095249d40/0xfc4b8e114eda73de lrc: 2/0,0 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114eda7401 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.713227:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200022784 00010000:00010000:2.0:1713279306.713227:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7535 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.713231:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7535 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.713232:0:6918:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095249d40 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:0.0:1713279306.713236:0:6918:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880095249d40/0xfc4b8e114eda73de lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda7401 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.713237:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33424 00010000:00010000:2.0:1713279306.713237:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:2.0:1713279306.713239:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.713240:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fafc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15507:x1796503200022784:12345-0@lo:105: 00010000:00010000:2.0:1713279306.713241:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7535 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000004:00010000:0.0:1713279306.713242:0:6918:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880095249d40/0xfc4b8e114eda73de lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda7401 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.713245:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713245:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7535 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.713250:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713251:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda753c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.713255:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda753c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.713257:0:6918:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880095249d40/0xfc4b8e114eda73de lrc: 2/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7401 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.713258:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713260:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda753c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.713262:0:9213:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.713263:0:6918:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713279306.713264:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012154ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.713265:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713266:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda753c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.713268:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713270:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda753c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.713272:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.713274:0:6918:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880095249d40/0xfc4b8e114eda73de lrc: 1/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7401 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713275:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x39 (ffff88012ee68d00) 00010000:00010000:2.0:1713279306.713277:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.713278:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda753c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.713280:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880095249d40/0xfc4b8e114eda73de lrc: 0/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7401 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.713280:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88008ea5f180) 00010000:00010000:2.0:1713279306.713282:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda753c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.713294:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fafc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15507:x1796503200022784:12345-0@lo:105: Request processed in 53us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.713297:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33424 00010000:00010000:2.0:1713279306.713297:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda752e lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ce expref: 3760 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713303:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda752e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ce expref: 3760 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713309:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e688240, rc 0) 00000100:00100000:1.0:1713279306.713322:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200022848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.713323:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3759:11819:x1796503281181248:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 279us (334us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.713328:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784943 00000100:00100000:1.0:1713279306.713334:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.713346:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200022848 00000100:00100000:1.0:1713279306.713347:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200022848 00010000:00010000:0.0:1713279306.713348:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.713350:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279306.713350:0:15658:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965180 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-mdtlov_UUID:15658:1796503200022720:0@lo:1000:mdt00_029.0 00010000:00010000:0.0:1713279306.713351:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.713362:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.713362:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.713363:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147215 00000100:00100000:1.0:1713279306.713365:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1478450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+95:3491:x1796503200022848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.713369:0:6942:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.713369:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.713372:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281181568 00010000:00010000:1.0:1713279306.713375:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3206c0/0xfc4b8e114eda7401 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda73de expref: 95 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.713375:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281181568 00010000:00010000:1.0:1713279306.713383:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x0 (ffff880097622200) 00000004:00080000:0.0:1713279306.713385:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1713279306.713386:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.713389:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784944 00000100:00100000:3.0:1713279306.713391:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.713393:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3739:11847:x1796503281181568:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:1.0:1713279306.713400:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1478450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+94:3491:x1796503200022848:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (65us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.713400:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.713403:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147215 00000100:00100000:0.0:1713279306.713407:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df04380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200022912:0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1713279306.713407:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114eda7543 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391753d5 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.713446:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.713449:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200022848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.713455:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98480 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.713457:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281181120 00000100:00100000:1.0:1713279306.713459:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281181120 00000100:00100000:0.0:1713279306.713465:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200022912 00000100:00100000:0.0:1713279306.713469:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200022912 00000100:00100000:1.0:1713279306.713472:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110433 00000100:00100000:1.0:1713279306.713474:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1956:x1796503281181120:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:2.0:1713279306.713480:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda754a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.713487:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda754a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.713488:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98669 00002000:00010000:1.0:1713279306.713490:0:15500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0xffe:0x0] initial LVB size: 5, mtime: 0x661e9144, atime: 0x0, ctime: 0x661e9144, blocks: 0x8 00000100:00100000:0.0:1713279306.713493:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+56:6942:x1796503200022912:12345-0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1713279306.713493:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda754a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.713494:0:15500:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7551 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xffe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.713496:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.713499:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.713500:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.713502:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713503:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7558 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.713507:0:15500:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713509:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.713512:0:15500:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.713512:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.713514:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.713516:0:15500:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.713520:0:15500:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.713521:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281181376 00010000:00010000:1.0:1713279306.713524:0:15500:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be880 already unused, calling callback (ffffffffa085fb20) 00000100:00100000:3.0:1713279306.713524:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281181376 00010000:00010000:1.0:1713279306.713525:0:15500:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.713529:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+56:6942:x1796503200022912:12345-0@lo:1000:mdt_io00_001.0 Request processed in 35us (83us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.713529:0:15500:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7551 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.713535:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98669 00010000:00010000:1.0:1713279306.713535:0:15500:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7551 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.713538:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222982 00010000:00010000:1.0:1713279306.713539:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7551 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.713542:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3663:11695:x1796503281181376:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1713279306.713553:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df04380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200022912:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1713279306.713558:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1956:x1796503281181120:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 82us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.713561:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110433 00000004:00200000:2.0:1713279306.713562:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7e4f:0x0]: returning size 4096 00000004:00080000:0.0:1713279306.713567:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000403:0x863c:0x0] 00010000:00010000:2.0:1713279306.713569:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda754a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.713574:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda754a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.713575:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df06d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200022784:0@lo:105: 00010000:00010000:2.0:1713279306.713579:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda754a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.713581:0:15507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 15507 initiator: MDT0 00000100:00100000:0.0:1713279306.713582:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df04380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200022976:0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1713279306.713584:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda754a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.713585:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7065 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.713588:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d2d58c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.713591:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda754a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.713596:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda754a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.713600:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3664:11695:x1796503281181376:12345-192.168.203.4@tcp:35:touch.0 Request processed in 57us (87us total) trans 4295183602 rc 0/0 00010000:00010000:2.0:1713279306.713602:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00000100:00100000:0.0:1713279306.713604:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.713604:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3741:11666:x1796503281171008:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 19084us (19617us total) trans 4295202614 rc 0/0 00010000:00010000:2.0:1713279306.713604:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.713606:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222982 00010000:00010000:2.0:1713279306.713607:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda754a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.713608:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14321 00010000:00010000:2.0:1713279306.713611:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda754a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.713613:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98180 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.713617:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200022976 00000100:00100000:1.0:1713279306.713619:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200022976 00010000:00010000:2.0:1713279306.713619:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.713619:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281181696 00000100:00100000:3.0:1713279306.713622:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281181696 00010000:00010000:2.0:1713279306.713624:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7558 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.713628:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98670 00010000:00010000:2.0:1713279306.713628:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7558 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.713630:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:6942:x1796503200022976:12345-0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1713279306.713633:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092542880 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.713634:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784945 00010000:00010000:2.0:1713279306.713635:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7558 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.713638:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3664:11711:x1796503281181696:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.713640:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7558 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.713644:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.713646:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.713646:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x31 (ffff88011eea5b00) 00010000:00010000:2.0:1713279306.713648:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.713650:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7558 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.713651:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda755f lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391753e3 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713655:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7558 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.713666:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:6942:x1796503200022976:12345-0@lo:1000:mdt_io00_001.0 Request processed in 35us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.713670:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98670 00010000:00010000:2.0:1713279306.713672:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114eda7543 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753d5 expref: 3740 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.713674:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df04380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200022976:0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1713279306.713679:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114eda7543 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753d5 expref: 3740 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.713680:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ec000/0xfc4b8e114eda7566 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.713686:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ec000/0xfc4b8e114eda7566 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.713687:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012154d680, rc 0) 00010000:00010000:3.0:1713279306.713692:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ec000/0xfc4b8e114eda7566 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.713699:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda756d lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.713702:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3739:11847:x1796503281181568:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 308us (340us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.713705:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda756d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713279306.713708:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784944 00010000:00010000:3.0:1713279306.713711:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda756d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713279306.713716:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281181504 00000100:00100000:2.0:1713279306.713719:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281181504 00010000:00010000:3.0:1713279306.713726:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ec000/0xfc4b8e114eda7566 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.713732:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ec000/0xfc4b8e114eda7566 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713279306.713734:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784946 00000100:00100000:2.0:1713279306.713737:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3377:11841:x1796503281181504:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.713737:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ec000/0xfc4b8e114eda7566 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.713742:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ec000/0xfc4b8e114eda7566 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.713744:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.713746:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ec000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.713749:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ec000/0xfc4b8e114eda7566 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.713750:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda7574 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391753dc expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.713757:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ec000/0xfc4b8e114eda7566 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.713764:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff8800960e8100) 00010000:00010000:3.0:1713279306.713766:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.713768:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ec000/0xfc4b8e114eda7566 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.713771:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda757b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.713773:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ec000/0xfc4b8e114eda7566 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.713778:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda757b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.713780:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda756d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.713784:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda757b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.713785:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda756d lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.713789:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda756d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.713793:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda7582 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.713793:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ef600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.713796:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda756d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.713798:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda7582 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.713800:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda756d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.713804:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda7582 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.713806:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff8800960e8800) 00010000:00010000:3.0:1713279306.713808:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.713810:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda756d lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.713813:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef600/0xfc4b8e114eda756d lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.713829:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7589 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.713829:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda755f lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753e3 expref: 3665 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713835:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7589 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.713836:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda755f lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753e3 expref: 3665 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713840:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7589 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.713843:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ed200, rc 0) 00000004:00200000:2.0:1713279306.713857:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x753e:0x0]: returning size 15382 00000004:00200000:2.0:1713279306.713859:0:15479:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1713279306.713859:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3664:11711:x1796503281181696:12345-192.168.203.4@tcp:101:touch.0 Request processed in 220us (363us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.713864:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784945 00000004:00010000:2.0:1713279306.713866:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7589 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.713872:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7589 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.713877:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda757b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.713882:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda757b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.713887:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda757b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.713891:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda757b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.713895:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.713898:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009160a880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.713901:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda757b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.713906:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda757b lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.713906:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281181824 00000100:00100000:3.0:1713279306.713908:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281181824 00010000:00010000:2.0:1713279306.713913:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:2.0:1713279306.713915:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.713917:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda757b lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.713920:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784947 00010000:00010000:2.0:1713279306.713922:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda757b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.713924:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3664:11708:x1796503281181824:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1713279306.713929:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda7582 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.713934:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda7582 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.713939:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda7582 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.713940:0:15482:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.713943:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800950718c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.713945:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda7582 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.713947:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda74e8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x71eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753b9 expref: 3664 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.713950:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda7582 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.713954:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71eb:0x0].0x0 (ffff88008d3fed00) 00010000:00010000:2.0:1713279306.713956:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3031 (ffff880090371e00) 00010000:00010000:3.0:1713279306.713957:0:15482:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.713958:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.713960:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda7582 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.713965:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda7582 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.713979:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda7574 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753dc expref: 3379 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.713980:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda7590 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x71eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.713986:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda7590 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x71eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.713988:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7589 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753dc expref: 3378 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.713992:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda7590 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x71eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.713994:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x753e:0x0].0x0 (ffff880095b48100) 00010000:00010000:2.0:1713279306.713996:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.713998:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a4c86c0, rc 0) 00000100:00100000:2.0:1713279306.714014:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3378:11841:x1796503281181504:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 275us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.714019:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784946 00000004:00010000:3.0:1713279306.714024:0:15482:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008bd41c00 reply state ffff88009782e000 transno 4295183603 ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda7590 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x71eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.714031:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda7590 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x71eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.714036:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71eb:0x0].0x0 (ffff88008d3fed00) 00010000:00010000:3.0:1713279306.714038:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.714040:0:15482:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713279306.714062:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df04380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200023040:0@lo:403:mdt_io00_001.0 00000100:00100000:3.0:1713279306.714067:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3665:11708:x1796503281181824:12345-192.168.203.4@tcp:36:touch.0 Request processed in 141us (171us total) trans 4295183603 rc 0/0 00000100:00100000:3.0:1713279306.714088:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784947 00000100:00100000:0.0:1713279306.714094:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.714107:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98180 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.714122:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200023040 00000100:00100000:1.0:1713279306.714125:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200023040 00000100:00100000:1.0:1713279306.714137:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98671 00000100:00100000:1.0:1713279306.714140:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+56:6942:x1796503200023040:12345-0@lo:403:mdt_io00_001.0 00000004:00080000:2.0:1713279306.714163:0:15658:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x1076:0x0], index 0: 0 00000004:00080000:2.0:1713279306.714169:0:15658:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x1083:0x0], index 1: 0 00010000:00010000:2.0:1713279306.714224:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda7597 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x76e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714231:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda7597 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76e5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.714237:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda7597 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76e5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.714250:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda7519 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.714258:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda7519 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.714263:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda7519 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.714267:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda7519 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.714271:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.714273:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda7519 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.714277:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda7519 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.714282:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:2.0:1713279306.714284:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.714286:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda7519 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.714290:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda7519 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000004:00010000:2.0:1713279306.714296:0:15658:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008df07480 reply state ffff880096ff0000 transno 4295183604 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114eda7520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.714302:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114eda7520 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.714306:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3531 (ffff88012ee68400) 00010000:00010000:2.0:1713279306.714308:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.714310:0:15658:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.714321:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688b40/0xfc4b8e114eda7512 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753c7 expref: 3379 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.714329:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda7597 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76e5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753c7 expref: 3378 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.714335:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76e5:0x0].0x0 (ffff88009426dd00) 00010000:00010000:2.0:1713279306.714337:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.714338:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c9b5200, rc 0) 00000100:00100000:2.0:1713279306.714368:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3379:11204:x1796503281180992:12345-192.168.203.4@tcp:101:touch.0 Request processed in 1599us (1635us total) trans 4295183604 rc 0/0 00000100:00100000:2.0:1713279306.714373:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784942 00000100:00100000:2.0:1713279306.714441:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.714441:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.714457:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281181888 00000100:00100000:0.0:1713279306.714461:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281181888 00000100:00100000:2.0:1713279306.714461:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.714473:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281182080 00000100:00100000:2.0:1713279306.714476:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281182080 00000100:00100000:0.0:1713279306.714481:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147216 00000100:00100000:0.0:1713279306.714486:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:385c4b71-808c-40cf-91de-b076b668d13f+3760:1957:x1796503281181888:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.714490:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784948 00010000:00010000:0.0:1713279306.714493:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.714495:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3760:11840:x1796503281182080:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.714503:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114eda750b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753c0 expref: 3760 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.714505:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.714511:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda75a5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391753ea expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.714512:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:0.0:1713279306.714515:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.714534:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:385c4b71-808c-40cf-91de-b076b668d13f+3760:1957:x1796503281181888:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 47us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.714540:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147216 00010000:00010000:2.0:1713279306.714546:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda75ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714553:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda75ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714558:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda75ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714567:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114eda75b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714572:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114eda75b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714577:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114eda75b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000004:00200000:2.0:1713279306.714601:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.714606:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda75ac lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714611:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda75ac lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714615:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda75ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714620:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda75ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714623:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dca880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.714625:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda75ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714630:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda75ac lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714635:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:2.0:1713279306.714637:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.714639:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda75ac lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714647:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114eda75ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714653:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114eda75b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714658:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114eda75b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714662:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114eda75b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714666:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ceacd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.714667:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114eda75b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714672:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114eda75b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714676:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff88009606b800) 00010000:00010000:2.0:1713279306.714678:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.714679:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114eda75b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714683:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114eda75b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.714696:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda75a5 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ea expref: 3759 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.714702:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda75a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ea expref: 3759 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.714712:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c9b5680, rc 0) 00000100:00100000:2.0:1713279306.714739:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3758:11840:x1796503281182080:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 243us (298us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.714745:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784948 00000100:00100000:2.0:1713279306.714963:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.714965:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.714979:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281182464 00000100:00100000:3.0:1713279306.714983:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281182464 00000100:00100000:2.0:1713279306.714984:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.714997:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222983 00000100:00100000:3.0:1713279306.715002:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c56b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3758:11810:x1796503281182464:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.715063:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c56b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3759:11810:x1796503281182464:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 60us (99us total) trans 4295202615 rc 0/0 00000100:00100000:3.0:1713279306.715083:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222983 00000100:00100000:0.0:1713279306.715090:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.715110:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281182208 00000100:00100000:3.0:1713279306.715113:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281182208 00000100:00100000:3.0:1713279306.715130:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281182336 00000100:00100000:0.0:1713279306.715133:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.715133:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281182336 00000100:00100000:1.0:1713279306.715143:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+56:6942:x1796503200023040:12345-0@lo:403:mdt_io00_001.0 Request processed in 1001us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.715144:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784949 00000100:00100000:1.0:1713279306.715147:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98671 00000100:00100000:3.0:1713279306.715148:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3740:11827:x1796503281182208:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.715152:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df04380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200023040:0@lo:403:mdt_io00_001.0 00000100:00100000:2.0:1713279306.715152:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784950 00010000:00010000:3.0:1713279306.715155:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.715156:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3740:11852:x1796503281182336:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.715157:0:9221:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1713279306.715162:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.715167:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda66d3 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x242:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175032 expref: 3740 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.715168:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281181952 00010000:00010000:2.0:1713279306.715169:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda75ba lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391753f8 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.715170:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281181952 00010000:00010000:3.0:1713279306.715175:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x242:0x0].0x0 (ffff88009e797800) 00010000:00010000:3.0:1713279306.715180:0:9221:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.715182:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281182656 00000100:00100000:1.0:1713279306.715183:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281182656 00010000:00010000:3.0:1713279306.715186:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936edf80/0xfc4b8e114eda75c1 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x242:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391753f1 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.715191:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110434 00000100:00100000:1.0:1713279306.715195:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110435 00000100:00100000:2.0:1713279306.715196:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+83:1955:x1796503281181952:12345-192.168.203.4@tcp:1:lfs.0 00000100:00100000:1.0:1713279306.715198:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+75:1957:x1796503281182656:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:2.0:1713279306.715210:0:15499:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda75c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.715219:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda75cf lrc: 3/0,1 mode: --/CW res: [0x200000400:0x242:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.715220:0:15499:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008245c900/0xfc4b8e114eda6322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->40959) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f28 expref: 75 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.715226:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.715226:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda75cf lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.715228:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.715230:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda75c8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.715232:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda75cf lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.715240:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda75d6 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x242:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.715245:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda75d6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x242:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.715248:0:15499:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008245c900/0xfc4b8e114eda6322 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->40959) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f28 expref: 75 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.715251:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+76:1957:x1796503281182656:12345-192.168.203.4@tcp:2:touch.0 Request processed in 52us (118us total) trans 4295010101 rc 0/0 00010000:00010000:3.0:1713279306.715251:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda75d6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x242:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.715255:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110435 00010000:00010000:2.0:1713279306.715257:0:15499:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008245c900/0xfc4b8e114eda6322 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->40959) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f28 expref: 75 pid: 11415 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.715264:0:15507:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281182592 00000100:00100000:1.0:1713279306.715266:0:15507:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281182592 00000100:00100000:2.0:1713279306.715266:0:15499:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:15499:1796503200023104:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.715275:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14326 00000100:00100000:1.0:1713279306.715278:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3379:11374:x1796503281182592:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:2.0:1713279306.715284:0:15499:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760600 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.715289:0:15507:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1713279306.715296:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd46c0/0xfc4b8e114eda6c0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x262:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175189 expref: 3379 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.715303:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x262:0x0].0x0 (ffff88012fbfed00) 00010000:00010000:1.0:1713279306.715310:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda70f1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752af expref: 3378 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.715314:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76da:0x0].0x0 (ffff880130675700) 00010000:00010000:1.0:1713279306.715317:0:15507:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.715322:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda75dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.715328:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.715330:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda75dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.715331:0:15507:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.715335:0:15507:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.715336:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda75dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.715342:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0001-mdtlov_UUID:15507:1796503200023168:0@lo:101:mdt_io00_005.0 00010000:00010000:2.0:1713279306.715344:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda75eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.715349:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda75eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.715354:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda75eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.715355:0:15507:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.715361:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff880130637840 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.715369:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200023168 00000100:00100000:1.0:1713279306.715371:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200023168 00000100:00100000:1.0:1713279306.715379:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98672 00000100:00100000:1.0:1713279306.715381:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+56:15507:x1796503200023168:12345-0@lo:101:mdt_io00_005.0 00010000:00010000:1.0:1713279306.715386:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.715391:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda75f2 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda75e4 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.715398:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000004:00200000:2.0:1713279306.715400:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8292:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.715402:0:15516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda75f2 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda75e4 expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.715407:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda75dd lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.715408:0:15516:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00000004:00080000:3.0:1713279306.715409:0:9221:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x11a2:0x0], index 1: 0 00010000:00010000:1.0:1713279306.715428:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda75f2 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda75e4 expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.715429:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda75dd lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.715432:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.715433:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.715434:0:15516:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.715434:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda75dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.715437:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bdb00, rc 0) 00010000:00010000:2.0:1713279306.715438:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda75dd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.715443:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880130c93cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.715445:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda75dd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.715451:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+57:15507:x1796503200023168:12345-0@lo:101:mdt_io00_005.0 Request processed in 68us (95us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.715451:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda75dd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.715454:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98672 00010000:00010000:2.0:1713279306.715458:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:2.0:1713279306.715460:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.715462:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda75dd lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.715478:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0001-mdtlov_UUID:15507:1796503200023168:0@lo:101:mdt_io00_005.0 00010000:00010000:2.0:1713279306.715478:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda75dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.715484:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.715485:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda75eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.715488:0:15507:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.715490:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda75eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.715495:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda75eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.715499:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880130c92640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.715500:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda75f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8725:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.715502:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda75eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.715507:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda75f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8725:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.715510:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda75eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.715516:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x35 (ffff88008fcbec00) 00010000:00010000:3.0:1713279306.715516:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda75f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8725:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.715517:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.715520:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda75eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.715524:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda75eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.715531:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda75cf lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.715547:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda75cf lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.715549:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda75ba lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753f8 expref: 3742 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.715552:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda75cf lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.715555:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda75ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753f8 expref: 3742 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.715558:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda75cf lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.715562:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009681c900, rc 0) 00010000:00010000:3.0:1713279306.715562:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ee880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.715564:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda75cf lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.715568:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda75cf lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.715574:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x242:0x0].0x0 (ffff880136671a00) 00010000:00010000:3.0:1713279306.715576:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.715578:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda75cf lrc: 3/0,0 mode: --/CW res: [0x200000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.715582:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3741:11852:x1796503281182336:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 425us (598us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.715583:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda75cf lrc: 0/0,0 mode: --/CW res: [0x200000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.715587:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784950 00000004:00010000:3.0:1713279306.715590:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880135efea00 reply state ffff880090e80000 transno 4295202616 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda75d6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x242:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.715601:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda75d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x242:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.715605:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x242:0x0].0x3931 (ffff880136671800) 00010000:00010000:3.0:1713279306.715607:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.715609:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713279306.715621:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.715621:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936edf80/0xfc4b8e114eda75c1 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x242:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753f1 expref: 3741 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.715630:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281183040 00010000:00010000:3.0:1713279306.715631:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda75f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8725:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753f1 expref: 3740 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.715632:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281183040 00000100:00100000:1.0:1713279306.715633:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.715637:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8725:0x0].0x0 (ffff880136671000) 00010000:00010000:3.0:1713279306.715639:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713279306.715641:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ed200, rc 0) 00000100:00100000:2.0:1713279306.715648:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281182784 00000100:00100000:2.0:1713279306.715650:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281182784 00000100:00100000:1.0:1713279306.715654:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.715658:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3741:11827:x1796503281182208:12345-192.168.203.4@tcp:101:touch.0 Request processed in 509us (696us total) trans 4295202616 rc 0/0 00000100:00100000:2.0:1713279306.715660:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281182912 00000100:00100000:2.0:1713279306.715662:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281182912 00000100:00100000:3.0:1713279306.715664:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784949 00010000:00010000:0.0:1713279306.715671:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942e880/0xfc4b8e114eda7607 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.715671:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784951 00000100:00100000:3.0:1713279306.715674:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784952 00000100:00100000:2.0:1713279306.715675:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3378:11204:x1796503281183040:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1713279306.715676:0:6942:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942e880/0xfc4b8e114eda7607 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6942 initiator: MDT1 00000100:00100000:3.0:1713279306.715678:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3760:11695:x1796503281182784:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.715680:0:6942:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942e880/0xfc4b8e114eda7607 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.715685:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.715687:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df04380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200023232:0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1713279306.715692:0:15479:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.715692:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda760e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391753ff expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.715700:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.715700:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda7597 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x76e5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753c7 expref: 3378 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.715707:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98180 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.715708:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76e5:0x0].0x0 (ffff88009426dd00) 00000100:00100000:1.0:1713279306.715710:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200023232 00000100:00100000:1.0:1713279306.715713:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200023232 00010000:00010000:2.0:1713279306.715713:0:15479:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.715715:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7615 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.715719:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784953 00010000:00010000:3.0:1713279306.715721:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7615 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.715723:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3761:11711:x1796503281182912:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.715724:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98673 00000100:00100000:1.0:1713279306.715726:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+57:6942:x1796503200023232:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:3.0:1713279306.715726:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7615 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.715730:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.715731:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.715735:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda7623 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175406 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.715735:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda761c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.715737:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda762a lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda7607 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.715738:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda7631 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x76e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.715740:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda761c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.715744:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda7631 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.715745:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda762a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda7607 expref: 58 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.715745:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda761c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.715749:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda7631 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.715751:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda762a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda7607 expref: 58 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.715755:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x0 (ffff880096b8e300) 00010000:00010000:1.0:1713279306.715756:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.715758:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bf180, rc 0) 00000100:00100000:1.0:1713279306.715778:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+58:6942:x1796503200023232:12345-0@lo:101:mdt_io00_001.0 Request processed in 51us (77us total) trans 0 rc 0/0 00000004:00010000:2.0:1713279306.715779:0:15479:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009966b100 reply state ffff880097714000 transno 4295183605 ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda7631 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713279306.715781:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98673 00010000:00010000:3.0:1713279306.715782:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda7638 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x86db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.715786:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df04380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200023232:0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1713279306.715787:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda7631 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.715787:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda7638 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x86db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.715792:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942e880/0xfc4b8e114eda7607 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda762a expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.715792:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76e5:0x0].0x0 (ffff880096051f00) 00010000:00010000:3.0:1713279306.715793:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda7638 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x86db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.715795:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.715796:0:15479:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.715797:0:6942:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942e880/0xfc4b8e114eda7607 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda762a expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713279306.715798:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x86db:0x0]: returning size 0 00000004:00080000:0.0:1713279306.715803:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00010000:00010000:0.0:1713279306.715812:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942eac0/0xfc4b8e114eda7646 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.715815:0:6942:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942eac0/0xfc4b8e114eda7646 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279306.715818:0:6942:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942eac0/0xfc4b8e114eda7646 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.715822:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7615 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.715825:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df04380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200023296:0@lo:101:mdt_io00_001.0 00000100:00100000:2.0:1713279306.715825:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3379:11204:x1796503281183040:12345-192.168.203.4@tcp:36:touch.0 Request processed in 148us (204us total) trans 4295183605 rc 0/0 00010000:00010000:3.0:1713279306.715828:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7615 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.715831:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784951 00010000:00010000:3.0:1713279306.715832:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7615 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.715837:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7615 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.715838:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.715842:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298edd40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.715845:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7615 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.715850:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7615 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.715851:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200023296 00000100:00100000:0.0:1713279306.715852:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98180 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.715854:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200023296 00010000:00010000:3.0:1713279306.715856:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x0 (ffff88008d729700) 00010000:00010000:3.0:1713279306.715858:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.715859:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda764d lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.715860:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7615 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.715863:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98674 00010000:00010000:0.0:1713279306.715864:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda764d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.715865:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+58:6942:x1796503200023296:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:3.0:1713279306.715865:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7615 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.715868:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda764d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.715870:0:6934:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.715872:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda761c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.715873:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda7654 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.715875:0:6934:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda765b lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda7646 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.715876:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda761c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.715877:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda7654 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.715880:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda7654 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.715881:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda761c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.715883:0:6934:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda765b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda7646 expref: 59 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.715884:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.715886:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda761c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.715888:0:6934:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda765b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda7646 expref: 59 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.715890:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda761c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000004:00200000:0.0:1713279306.715891:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:1.0:1713279306.715892:0:6934:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x3331 (ffff880096b8e200) 00010000:00010000:1.0:1713279306.715893:0:6934:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.715894:0:6934:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bc900, rc 0) 00010000:00010000:3.0:1713279306.715895:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x3032 (ffff88007fcb8200) 00010000:00010000:0.0:1713279306.715896:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda764d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.715896:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.715898:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda761c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.715899:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda764d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.715901:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda764d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.715905:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda764d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.715905:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda761c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.715909:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f29b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.715911:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda764d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.715913:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+59:6942:x1796503200023296:12345-0@lo:101:mdt_io00_001.0 Request processed in 47us (75us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.715914:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda764d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.715916:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98674 00010000:00010000:0.0:1713279306.715918:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880090aa0400) 00010000:00010000:0.0:1713279306.715920:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.715921:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda764d lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.715922:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda760e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x139:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ff expref: 3764 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.715924:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda764d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.715931:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda7638 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x86db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ff expref: 3763 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.715932:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda7654 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.715935:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda7654 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.715936:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86db:0x0].0x0 (ffff88008eba0d00) 00010000:00010000:0.0:1713279306.715938:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda7654 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.715938:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713279306.715940:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f2b3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.715940:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ed680, rc 0) 00010000:00010000:0.0:1713279306.715942:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda7654 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.715944:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda7654 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.715947:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880090aa0a00) 00010000:00010000:0.0:1713279306.715948:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.715950:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda7654 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.715952:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda7654 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.715958:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3763:11695:x1796503281182784:12345-192.168.203.4@tcp:101:touch.0 Request processed in 279us (323us total) trans 4295202617 rc 0/0 00000100:00100000:3.0:1713279306.715963:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784952 00010000:00010000:0.0:1713279306.715966:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda7623 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175406 expref: 3763 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.715970:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda7623 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175406 expref: 3762 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.715975:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942db00, rc 0) 00000100:00100000:0.0:1713279306.715989:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df04380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200023296:0@lo:101:mdt_io00_001.0 00010000:00010000:0.0:1713279306.715997:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942eac0/0xfc4b8e114eda7646 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda765b expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.716004:0:6942:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942eac0/0xfc4b8e114eda7646 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda765b expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.716013:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00010000:00010000:0.0:1713279306.716022:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda7662 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x134:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.716029:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda7662 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279306.716035:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda7662 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279306.716043:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda7669 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x134:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.716049:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda7669 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279306.716055:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda7669 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279306.716088:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x750e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.716096:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda0876 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173662 expref: 3664 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.716102:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279306.716121:0:6942:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda0876 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173662 expref: 3664 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.716129:0:6942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda0876 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173662 expref: 3664 pid: 15471 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.716138:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d182d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001_UUID:6942:1796503200023360:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.716247:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98180 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.716265:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.716268:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3761:11711:x1796503281182912:12345-192.168.203.4@tcp:101:touch.0 Request processed in 543us (612us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.716275:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784953 00000100:00100000:3.0:1713279306.716293:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281183168 00000100:00100000:3.0:1713279306.716296:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281183168 00000100:00100000:3.0:1713279306.716315:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222984 00000100:00100000:3.0:1713279306.716320:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3665:11708:x1796503281183168:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:3.0:1713279306.716376:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3666:11708:x1796503281183168:12345-192.168.203.4@tcp:35:touch.0 Request processed in 55us (110us total) trans 4295183606 rc 0/0 00000100:00100000:3.0:1713279306.716382:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222984 00000100:00100000:0.0:1713279306.717102:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.717144:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281183680 00000100:00100000:2.0:1713279306.717148:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281183680 00000100:00100000:2.0:1713279306.717175:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784954 00000100:00100000:2.0:1713279306.717180:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3666:11711:x1796503281183680:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.717190:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.717201:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114eda7677 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175414 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.717231:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda767e lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.717238:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda767e lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717244:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda767e lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717251:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7685 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.717257:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7685 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717262:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7685 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717278:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda767e lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717282:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda767e lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717287:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda767e lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717291:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda767e lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717295:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093691440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.717298:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda767e lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717303:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda767e lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717309:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880096051900) 00010000:00010000:2.0:1713279306.717312:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.717314:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda767e lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717319:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda767e lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717327:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7685 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717330:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7685 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717333:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7685 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717336:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.717337:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7685 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717340:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7685 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717343:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88008c1d2100) 00010000:00010000:2.0:1713279306.717345:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.717346:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7685 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717351:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7685 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.717364:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114eda7677 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175414 expref: 3667 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.717368:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.717369:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114eda7677 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175414 expref: 3667 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.717374:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093693a80, rc 0) 00000100:00100000:0.0:1713279306.717395:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.717402:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281183232 00000100:00100000:2.0:1713279306.717403:0:15499:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:15499:1796503200023104:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.717406:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281183232 00000100:00100000:0.0:1713279306.717408:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.717429:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281183296 00010000:00010000:2.0:1713279306.717430:0:15499:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda75c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.717431:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281183296 00000100:00100000:0.0:1713279306.717440:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d182d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001_UUID:6942:1796503200023360:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.717449:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00000100:00100000:3.0:1713279306.717453:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222985 00000100:00100000:2.0:1713279306.717454:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3666:11711:x1796503281183680:12345-192.168.203.4@tcp:101:touch.0 Request processed in 273us (351us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.717458:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3380:11834:x1796503281183296:12345-192.168.203.4@tcp:33:lfs.0 00000100:00100000:2.0:1713279306.717460:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784954 00000100:00100000:0.0:1713279306.717462:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.717473:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281183360 00000100:00100000:1.0:1713279306.717477:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281183360 00000004:00200000:3.0:1713279306.717486:0:15527:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x757a:0x0]: returning size 4096 00000004:00200000:3.0:1713279306.717489:0:15527:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1713279306.717491:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008245c900/0xfc4b8e114eda6322 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->40959) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f28 expref: 76 pid: 11415 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.717504:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.717504:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281183424 00000100:00100000:1.0:1713279306.717506:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281183424 00010000:00010000:1.0:1713279306.717511:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda0876 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173662 expref: 3666 pid: 15471 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.717514:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3380:11834:x1796503281183296:12345-192.168.203.4@tcp:33:lfs.0 Request processed in 55us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.717518:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281183552 00000100:00100000:1.0:1713279306.717519:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196459 00000100:00100000:2.0:1713279306.717520:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281183552 00000100:00100000:3.0:1713279306.717520:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222985 00000100:00100000:1.0:1713279306.717523:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1954:x1796503281183360:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.717529:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.717534:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784955 00000100:00100000:3.0:1713279306.717534:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196460 00010000:00010000:1.0:1713279306.717536:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008245c900/0xfc4b8e114eda6322 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->40959) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f28 expref: 76 pid: 11415 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.717539:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3761:11695:x1796503281183552:12345-192.168.203.4@tcp:36:touch.0 00000100:00100000:3.0:1713279306.717539:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3666:1956:x1796503281183424:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.717543:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008245c900/0xfc4b8e114eda6322 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->40959) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f28 expref: 76 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.717546:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.717550:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda0876 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173662 expref: 3666 pid: 15471 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.717553:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008245c900/0xfc4b8e114eda6322 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->40959) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f28 expref: 76 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.717554:0:15485:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.717559:0:15492:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.717559:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda0876 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173662 expref: 3666 pid: 15471 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.717560:0:15492:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.717561:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda7638 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x86db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ff expref: 3761 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.717562:0:15492:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda75c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.717566:0:15492:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda75c8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.717570:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86db:0x0].0x0 (ffff88008eba0d00) 00010000:00010000:3.0:1713279306.717570:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda0876 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x750e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173662 expref: 3666 pid: 15471 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.717573:0:15485:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.717577:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x750e:0x0].0x0 (ffff88007fe82800) 00010000:00010000:3.0:1713279306.717579:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.717583:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.717585:0:15557:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.717587:0:15499:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda75c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.717590:0:15557:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.717594:0:15499:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda75c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.717599:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1954:x1796503281183360:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 75us (190us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.717601:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.717603:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196459 00010000:00010000:0.0:1713279306.717604:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.717605:0:15499:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda75c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.717608:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.717611:0:15499:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda75c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.717616:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3665:1956:x1796503281183424:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 76us (152us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.717617:0:15499:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda75c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.717622:0:15499:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880130c93a80 already unused, calling callback (ffffffffa085fb20) 00000100:00100000:3.0:1713279306.717622:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196460 00010000:00010000:2.0:1713279306.717625:0:15499:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda75c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.717632:0:15499:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda75c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.717634:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d181880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200023424:0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1713279306.717641:0:15499:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda75c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.717643:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784956 00000100:00100000:3.0:1713279306.717647:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3379:11204:x1796503281183232:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.717648:0:15499:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c93a80/0xfc4b8e114eda75c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.717654:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.717656:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.717661:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef600/0xfc4b8e114eda768c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x76e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917540d expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.717665:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98480 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.717667:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200023424 00000100:00100000:1.0:1713279306.717669:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200023424 00000100:00100000:1.0:1713279306.717677:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98675 00010000:00010000:3.0:1713279306.717679:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef600/0xfc4b8e114eda768c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x76e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917540d expref: 3380 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.717680:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+59:6942:x1796503200023424:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1713279306.717683:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+83:1955:x1796503281181952:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 2487us (3221us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.717688:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef600/0xfc4b8e114eda768c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x76e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917540d expref: 3380 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.717689:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110434 00010000:00010000:3.0:1713279306.717699:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76e5:0x0].0x0 (ffff880096051f00) 00010000:00010000:3.0:1713279306.717701:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713279306.717703:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ef600, rc 0) 00000100:00100000:3.0:1713279306.717716:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3380:11204:x1796503281183232:12345-192.168.203.4@tcp:101:touch.0 Request processed in 68us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.717721:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784956 00010000:00010000:2.0:1713279306.717726:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda7693 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x86db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.717733:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+59:6942:x1796503200023424:12345-0@lo:1000:mdt_io00_001.0 Request processed in 52us (77us total) trans 0 rc -2/-2 00010000:00010000:2.0:1713279306.717733:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda7693 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.717737:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98675 00010000:00010000:2.0:1713279306.717739:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda7693 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.717741:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d181880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200023424:0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1713279306.717768:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d181880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200023488:0@lo:1000:mdt_io00_001.0 00000004:00010000:2.0:1713279306.717774:0:15485:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d180380 reply state ffff8800928d8000 transno 4295202618 ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda7693 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.717781:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda7693 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.717786:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.717786:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86db:0x0].0x0 (ffff88008eba0d00) 00010000:00010000:2.0:1713279306.717788:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.717789:0:15485:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713279306.717795:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98480 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.717797:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200023488 00000100:00100000:1.0:1713279306.717799:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200023488 00000100:00100000:1.0:1713279306.717807:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98676 00000100:00100000:1.0:1713279306.717809:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+59:6942:x1796503200023488:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1713279306.717818:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3762:11695:x1796503281183552:12345-192.168.203.4@tcp:36:touch.0 Request processed in 278us (313us total) trans 4295202618 rc 0/0 00000100:00100000:2.0:1713279306.717823:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784955 00000100:00100000:1.0:1713279306.717841:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+59:6942:x1796503200023488:12345-0@lo:1000:mdt_io00_001.0 Request processed in 30us (54us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.717844:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98676 00000100:00100000:0.0:1713279306.717866:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d181880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200023488:0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1713279306.717895:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d181880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200023552:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1713279306.718018:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.718034:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.718036:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.718049:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200023552 00000100:00100000:0.0:1713279306.718050:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98480 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.718051:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200023552 00000100:00100000:2.0:1713279306.718051:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281183872 00000100:00100000:3.0:1713279306.718051:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281183744 00000100:00100000:2.0:1713279306.718054:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281183872 00000100:00100000:3.0:1713279306.718054:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281183744 00000100:00100000:1.0:1713279306.718061:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98677 00000100:00100000:1.0:1713279306.718063:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+59:6942:x1796503200023552:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1713279306.718080:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784957 00000100:00100000:3.0:1713279306.718082:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110436 00000100:00100000:2.0:1713279306.718085:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3665:11842:x1796503281183872:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:3.0:1713279306.718086:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+78:1957:x1796503281183744:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:2.0:1713279306.718094:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.718102:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda769a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917541b expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.718134:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+59:6942:x1796503200023552:12345-0@lo:1000:mdt_io00_001.0 Request processed in 69us (101us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.718137:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.718138:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98677 00010000:00010000:2.0:1713279306.718145:0:15485:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90d80/0xfc4b8e114eda4b43 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174940 expref: 3666 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.718148:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d181880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200023552:0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1713279306.718151:0:15485:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7589 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753dc expref: 3379 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.718157:0:15485:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 5/0,1 mode: --/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.718171:0:15485:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7589 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753dc expref: 3379 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.718179:0:15485:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7589 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753dc expref: 3379 pid: 15479 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.718187:0:15485:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efed80 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001_UUID:15485:1796503200023616:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.718214:0:15485:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90d80/0xfc4b8e114eda4b43 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174940 expref: 3666 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.718222:0:15485:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90d80/0xfc4b8e114eda4b43 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174940 expref: 3666 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.718236:0:15485:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135effb80 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001_UUID:15485:1796503200023680:192.168.203.4@tcp:104: 00002000:00010000:3.0:1713279306.718246:0:15499:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb size from disk: 46934 -> 46934 00000100:00100000:2.0:1713279306.718249:0:15485:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760180 going to sleep for 11 seconds 00002000:00010000:3.0:1713279306.718249:0:15499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.718251:0:15499:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:3.0:1713279306.718253:0:15499:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.718255:0:15499:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb blocks from disk: 96 -> 48 00000100:00100000:3.0:1713279306.718271:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+79:1957:x1796503281183744:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 183us (251us total) trans 4295010102 rc 0/0 00000100:00100000:3.0:1713279306.718277:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110436 00000100:00100000:2.0:1713279306.718410:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.718435:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.718438:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281184000 00000100:00100000:3.0:1713279306.718441:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281184000 00000100:00100000:2.0:1713279306.718444:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281184064 00000100:00100000:2.0:1713279306.718446:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281184064 00000100:00100000:1.0:1713279306.718447:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.718456:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281184128 00000100:00100000:3.0:1713279306.718456:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784958 00000100:00100000:2.0:1713279306.718458:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281184128 00000040:00080000:0.0:1713279306.718461:0:6942:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x1c0:0x0].1540, 904 off815448 00000100:00100000:1.0:1713279306.718461:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.718461:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3762:11711:x1796503281184000:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.718468:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.718476:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110437 00010000:00010000:3.0:1713279306.718476:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda76a8 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175422 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.718481:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110438 00000100:00100000:2.0:1713279306.718481:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b42d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1955:x1796503281184064:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:1.0:1713279306.718484:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+79:1955:x1796503281184128:12345-192.168.203.4@tcp:2:touch.0 00000040:00080000:0.0:1713279306.718490:0:6942:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xf8:0x0].2148, 984 off1515792 00000004:00080000:0.0:1713279306.718494:0:6942:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880129a98180 with version 31971 00000004:00080000:0.0:1713279306.718504:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31971 rpc_version 31971 00000020:00100000:0.0:1713279306.718517:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1713279306.718521:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda76af lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.718523:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d181880 x1796503200023808/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1713279306.718528:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda76af lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.718534:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda76af lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.718535:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d181880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200023808:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.718541:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda76b6 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.718546:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda76b6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.718551:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda76b6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.718556:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+80:1955:x1796503281184128:12345-192.168.203.4@tcp:2:touch.0 Request processed in 71us (108us total) trans 4295010103 rc 0/0 00000100:00100000:2.0:1713279306.718557:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b42d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1955:x1796503281184064:12345-192.168.203.4@tcp:2:touch.0 Request processed in 75us (122us total) trans 4295010164 rc 0/0 00000100:00100000:1.0:1713279306.718561:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110438 00000100:00100000:0.0:1713279306.718562:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.718564:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110437 00000004:00200000:3.0:1713279306.718568:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00000100:00100000:0.0:1713279306.718571:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880130ade6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.718574:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda76af lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.718579:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda76af lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.718583:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200023808 00010000:00010000:3.0:1713279306.718583:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda76af lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.718586:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200023808 00010000:00010000:3.0:1713279306.718588:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda76af lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.718592:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ecb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.718594:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda76af lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.718599:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda76af lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.718601:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98678 00000100:00100000:0.0:1713279306.718605:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+59:8074:x1796503200023808:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.718605:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88007fcb8700) 00010000:00010000:3.0:1713279306.718607:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.718610:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda76af lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.718614:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecb40/0xfc4b8e114eda76af lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.718621:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda76b6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.718625:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda76b6 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.718633:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda76b6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.718637:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.718640:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda76b6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.718643:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281184192 00000100:00100000:2.0:1713279306.718645:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281184192 00010000:00010000:3.0:1713279306.718645:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda76b6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.718650:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff88007fcb8400) 00010000:00010000:3.0:1713279306.718652:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.718654:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda76b6 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.718658:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784959 00010000:00010000:3.0:1713279306.718659:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689440/0xfc4b8e114eda76b6 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.718662:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3764:11695:x1796503281184192:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.718669:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.718675:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8480/0xfc4b8e114eda76bd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x86db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175429 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.718678:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda76a8 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175422 expref: 3764 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.718684:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda76a8 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175422 expref: 3765 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.718692:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8480/0xfc4b8e114eda76bd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x86db:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175429 expref: 3764 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.718692:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ecfc0, rc 0) 00010000:00010000:2.0:1713279306.718700:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8480/0xfc4b8e114eda76bd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x86db:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175429 expref: 3764 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.718711:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3764:11711:x1796503281184000:12345-192.168.203.4@tcp:101:touch.0 Request processed in 250us (302us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.718715:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86db:0x0].0x0 (ffff88008eba0d00) 00010000:00010000:2.0:1713279306.718717:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1713279306.718717:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784958 00010000:00010000:2.0:1713279306.718719:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba8480, rc 0) 00000100:00100000:2.0:1713279306.718733:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3763:11695:x1796503281184192:12345-192.168.203.4@tcp:101:touch.0 Request processed in 70us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.718738:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784959 00000100:00100000:0.0:1713279306.718816:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+60:8074:x1796503200023808:12345-0@lo:1000:osp_up0-1.0 Request processed in 208us (252us total) trans 4295202619 rc 0/0 00000100:00100000:0.0:1713279306.718822:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98678 00000100:00100000:2.0:1713279306.718832:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d181880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200023808:0@lo:1000:osp_up0-1.0 00000004:00010000:3.0:1713279306.718846:0:6942:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880121537100 reply state ffff88009e68b000 transno 4295183607 ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.718858:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.718863:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x750e:0x0].0x0 (ffff88007fe82800) 00010000:00010000:3.0:1713279306.718865:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1713279306.718866:0:6942:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.718870:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda7662 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.718881:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda7662 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.718885:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda7662 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.718890:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda7662 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.718893:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f286c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.718895:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda7662 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.718900:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda7662 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.718904:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x0 (ffff880094e7b100) 00010000:00010000:3.0:1713279306.718906:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.718908:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda7662 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.718912:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda7662 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00000004:00010000:3.0:1713279306.718922:0:6942:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880121537100 reply state ffff88009e68b000 transno 4295183607 ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda7669 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.718928:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda7669 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.718933:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x3331 (ffff88008f645100) 00010000:00010000:3.0:1713279306.718934:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.718935:0:6942:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1713279306.718937:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00010000:00010000:3.0:1713279306.718957:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942e880/0xfc4b8e114eda7607 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda762a expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.718962:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942e880/0xfc4b8e114eda7607 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda762a expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.718966:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942e880/0xfc4b8e114eda7607 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda762a expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.718980:0:6942:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1713279306.718983:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00010000:00010000:3.0:1713279306.718987:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942eac0/0xfc4b8e114eda7646 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda765b expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.718993:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.718993:0:6942:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942eac0/0xfc4b8e114eda7646 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda765b expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.718998:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942e880/0xfc4b8e114eda7607 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114eda762a expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.719003:0:9214:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e880 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:2.0:1713279306.719006:0:9214:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942e880/0xfc4b8e114eda7607 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda762a expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.719012:0:9214:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942e880/0xfc4b8e114eda7607 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda762a expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.719038:0:9214:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942e880/0xfc4b8e114eda7607 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda762a expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.719044:0:9214:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000004:00080000:3.0:1713279306.719052:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000403:0x863c:0x0] 00010000:00010000:3.0:1713279306.719058:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.719067:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942e880/0xfc4b8e114eda7607 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda762a expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.719079:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.719083:0:9214:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942e880/0xfc4b8e114eda7607 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda762a expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.719085:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.719087:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200023872:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.719096:0:6942:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1713279306.719097:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713279306.719100:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.719102:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.719104:0:9214:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ea5f180 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:2.0:1713279306.719107:0:9214:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.719113:0:9214:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.719122:0:6942:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3381:10814:x1796503281176256:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 13541us (13581us total) trans 4295183607 rc 0/0 00010000:00010000:2.0:1713279306.719125:0:9214:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.719127:0:6942:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14322 00010000:00010000:2.0:1713279306.719130:0:9214:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1713279306.719142:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200023872 00000100:00100000:0.0:1713279306.719144:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200023936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.719145:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200023872 00010000:00010000:2.0:1713279306.719146:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.719152:0:9214:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008ea5f180/0xfc4b8e114eda72f7 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda7305 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.719158:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147217 00010000:00010000:2.0:1713279306.719160:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.719162:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279306.719162:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+60:3492:x1796503200023872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.719163:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.719167:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.719167:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.719175:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda762a lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda7607 expref: 60 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.719182:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x0 (ffff880096b8e300) 00010000:00010000:3.0:1713279306.719186:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.719207:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+59:3492:x1796503200023872:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.719210:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.719212:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147217 00000100:00100000:1.0:1713279306.719213:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200023872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.719219:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200023936 00000100:00100000:3.0:1713279306.719221:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200023936 00010000:00010000:3.0:1713279306.719228:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7305 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda72f7 expref: 59 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.719242:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196461 00000100:00100000:3.0:1713279306.719245:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+59:3493:x1796503200023936:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.719249:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.719249:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.719253:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7305 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda72f7 expref: 59 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.719258:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281184320 00000100:00100000:2.0:1713279306.719261:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281184320 00010000:00010000:3.0:1713279306.719263:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7305 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda72f7 expref: 59 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.719270:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:3.0:1713279306.719273:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00000100:00100000:2.0:1713279306.719275:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784960 00000100:00100000:2.0:1713279306.719279:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3381:11855:x1796503281184320:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.719279:0:15557:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.719284:0:15557:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.719287:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.719288:0:15752:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1713279306.719290:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.719296:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda7034 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917529a expref: 3381 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.719299:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.719304:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88008c124700) 00010000:00010000:1.0:1713279306.719307:0:6943:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.719309:0:15752:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.719311:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.719316:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda76c4 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175430 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.719317:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+58:3493:x1796503200023936:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.719323:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196461 00010000:00010000:2.0:1713279306.719364:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda76cb lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.719366:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc000/0xfc4b8e114eda76d2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00000100:00100000:0.0:1713279306.719370:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200023936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.719371:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc000/0xfc4b8e114eda76d2 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.719371:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda76cb lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.719375:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc000/0xfc4b8e114eda76d2 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.719377:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda76cb lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.719380:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda76d9 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x235:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.719384:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda76d9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.719385:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda76e0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.719387:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda76d9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.719391:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda76e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.719397:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda76e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.719399:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.719404:0:6943:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb840/0xfc4b8e114ed813b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a0d0 expref: 3740 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.719409:0:6943:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda0909 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917368c expref: 3762 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.719432:0:6943:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0900/0xfc4b8e114eda721e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7f3b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175318 expref: 3740 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.719436:0:6943:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 6/0,1 mode: --/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.719441:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114eda76ee lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.719447:0:6943:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0900/0xfc4b8e114eda721e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f3b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175318 expref: 3740 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.719449:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114eda76ee lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.719452:0:6943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0900/0xfc4b8e114eda721e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7f3b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175318 expref: 3740 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.719454:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114eda76ee lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.719458:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e524380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6943:1796503200024000:192.168.203.4@tcp:104: 00000004:00200000:2.0:1713279306.719460:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x6ed2:0x0]: returning size 2490368 00010000:00010000:1.0:1713279306.719479:0:6943:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda0909 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917368c expref: 3762 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.719484:0:6943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda0909 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917368c expref: 3762 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.719486:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda76cb lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.719488:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e525180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6943:1796503200024064:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.719491:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda76cb lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.719493:0:15485:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efed80 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001_UUID:15485:1796503200023616:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.719496:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda76cb lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.719499:0:6943:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb840/0xfc4b8e114ed813b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a0d0 expref: 3740 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.719501:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda76cb lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.719501:0:15485:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135effb80 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001_UUID:15485:1796503200023680:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.719504:0:6943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb840/0xfc4b8e114ed813b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a0d0 expref: 3740 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.719505:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8d80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.719508:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cde300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6943:1796503200024128:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.719508:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda76cb lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.719513:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda76cb lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.719514:0:15485:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.719516:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a3c28cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.719520:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff8800977d9700) 00010000:00010000:2.0:1713279306.719522:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.719524:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda76cb lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.719529:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda76cb lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.719536:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda76e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.719544:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda76e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.719549:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda76e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.719552:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baa880 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.719553:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.719554:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda76e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.719559:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda76e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.719564:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x35 (ffff88008e8c9200) 00010000:00010000:2.0:1713279306.719565:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.719566:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281184384 00010000:00010000:2.0:1713279306.719567:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda76e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.719569:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281184384 00010000:00010000:2.0:1713279306.719572:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda76e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.719578:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90d80/0xfc4b8e114eda4b43 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174940 expref: 3667 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.719590:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda76c4 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175430 expref: 3383 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.719593:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196462 00000100:00100000:3.0:1713279306.719597:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3667:1956:x1796503281184384:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.719600:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114eda76ee lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175430 expref: 3382 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.719602:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.719606:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6ed2:0x0].0x0 (ffff8800939e3a00) 00010000:00010000:3.0:1713279306.719606:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90d80/0xfc4b8e114eda4b43 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174940 expref: 3667 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.719608:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.719610:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba9f80, rc 0) 00010000:00010000:3.0:1713279306.719613:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90d80/0xfc4b8e114eda4b43 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174940 expref: 3667 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.719623:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90d80/0xfc4b8e114eda4b43 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174940 expref: 3667 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.719629:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3382:11855:x1796503281184320:12345-192.168.203.4@tcp:101:touch.0 Request processed in 349us (379us total) trans 4295183608 rc 0/0 00010000:00010000:3.0:1713279306.719631:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x753e:0x0].0x0 (ffff880095b48100) 00010000:00010000:3.0:1713279306.719633:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.719635:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784960 00010000:00010000:3.0:1713279306.719639:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.719644:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.719658:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3666:1956:x1796503281184384:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 59us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.719666:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196462 00000100:00100000:2.0:1713279306.719786:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.719803:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281184576 00000100:00100000:0.0:1713279306.719807:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281184576 00000100:00100000:1.0:1713279306.719818:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.719821:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281184448 00000100:00100000:0.0:1713279306.719823:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281184448 00000100:00100000:2.0:1713279306.719830:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784961 00000100:00100000:1.0:1713279306.719834:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.719835:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3666:11711:x1796503281184576:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.719835:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784962 00000100:00100000:3.0:1713279306.719839:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3382:10814:x1796503281184448:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:2.0:1713279306.719842:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.719848:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281184704 00010000:00010000:2.0:1713279306.719850:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaac0/0xfc4b8e114eda76fc lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175437 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.719851:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281184704 00000100:00100000:1.0:1713279306.719853:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.719871:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222986 00000100:00100000:3.0:1713279306.719874:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3383:11204:x1796503281184704:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:2.0:1713279306.719890:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7703 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.719897:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7703 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.719903:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7703 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.719911:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114eda770a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.719917:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114eda770a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.719923:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114eda770a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.719936:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7703 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.719941:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7703 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.719950:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7703 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.719954:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3384:11204:x1796503281184704:12345-192.168.203.4@tcp:35:touch.0 Request processed in 78us (118us total) trans 4295183609 rc 0/0 00010000:00010000:2.0:1713279306.719955:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7703 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.719959:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8240 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.719960:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222986 00010000:00010000:2.0:1713279306.719962:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7703 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.719967:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7703 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.719973:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88008a21ee00) 00000100:00100000:3.0:1713279306.719973:0:6942:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281184832 00010000:00010000:2.0:1713279306.719975:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.719975:0:6942:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281184832 00010000:00010000:2.0:1713279306.719978:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7703 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.719982:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7703 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.719988:0:6942:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14327 00010000:00010000:2.0:1713279306.719990:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114eda770a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.719991:0:6942:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:385c4b71-808c-40cf-91de-b076b668d13f+3763:11830:x1796503281184832:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:2.0:1713279306.719995:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114eda770a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.719999:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114eda770a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.720004:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baa1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.720006:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114eda770a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.720011:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.720014:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114eda770a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.720019:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88008ea88d00) 00010000:00010000:3.0:1713279306.720019:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda75f2 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda75e4 expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.720021:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.720023:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114eda770a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.720025:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.720028:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114eda770a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.720039:0:6942:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda75f2 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda75e4 expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.720045:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaac0/0xfc4b8e114eda76fc lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175437 expref: 3667 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.720046:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.720052:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaac0/0xfc4b8e114eda76fc lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175437 expref: 3667 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.720060:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baaac0, rc 0) 00010000:00010000:3.0:1713279306.720086:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086f40/0xfc4b8e114eda7718 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x134:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.720093:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086f40/0xfc4b8e114eda7718 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.720095:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3666:11711:x1796503281184576:12345-192.168.203.4@tcp:101:touch.0 Request processed in 260us (309us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.720099:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086f40/0xfc4b8e114eda7718 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.720101:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784961 00010000:00010000:3.0:1713279306.720107:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda771f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x134:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.720112:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda771f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720118:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda771f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720145:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda7726 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7644:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.720150:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda7726 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7644:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720155:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda7726 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7644:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000004:00010000:3.0:1713279306.720170:0:15658:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda7726 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7644:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720176:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086f40/0xfc4b8e114eda7718 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720180:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086f40/0xfc4b8e114eda7718 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720185:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086f40/0xfc4b8e114eda7718 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720189:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086f40/0xfc4b8e114eda7718 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720193:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f086f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.720195:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086f40/0xfc4b8e114eda7718 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720199:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086f40/0xfc4b8e114eda7718 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720204:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x0 (ffff88012d397c00) 00010000:00010000:3.0:1713279306.720206:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.720208:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086f40/0xfc4b8e114eda7718 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720212:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086f40/0xfc4b8e114eda7718 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720219:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda771f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720223:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda771f lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720228:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda771f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720232:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f0846c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.720234:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda771f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720242:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda771f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720246:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x3731 (ffff88012d397a00) 00010000:00010000:3.0:1713279306.720247:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.720249:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda771f lrc: 2/0,0 mode: --/PR res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720252:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda771f lrc: 0/0,0 mode: --/PR res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720257:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda7726 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7644:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720259:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda7726 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x7644:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720262:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda7726 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7644:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720264:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f084d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.720266:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda7726 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7644:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720269:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda7726 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x7644:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720272:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7644:0x0].0x0 (ffff88008e766f00) 00010000:00010000:3.0:1713279306.720273:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.720274:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda7726 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x7644:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.720277:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda7726 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7644:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.720306:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3383:10814:x1796503281184448:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 466us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.720309:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784962 00000100:00100000:0.0:1713279306.720738:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.720765:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281185152 00000100:00100000:3.0:1713279306.720767:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281185152 00000100:00100000:3.0:1713279306.720784:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784963 00000100:00100000:3.0:1713279306.720788:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3764:11848:x1796503281185152:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.720796:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.720803:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda772d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917543e expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.720837:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013585d200/0xfc4b8e114eda7734 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.720844:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013585d200/0xfc4b8e114eda7734 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7ff8:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.720850:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013585d200/0xfc4b8e114eda7734 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7ff8:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000004:00200000:3.0:1713279306.720855:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7ff8:0x0]: returning size 13836 00010000:00010000:3.0:1713279306.720889:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114eda772d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917543e expref: 3767 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.720896:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013585d200/0xfc4b8e114eda7734 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7ff8:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917543e expref: 3766 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.720899:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ff8:0x0].0x0 (ffff880089dc3f00) 00010000:00010000:3.0:1713279306.720901:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1713279306.720903:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013585d200, rc 0) 00000100:00100000:3.0:1713279306.720926:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3766:11848:x1796503281185152:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 137us (189us total) trans 4295202620 rc 0/0 00000100:00100000:3.0:1713279306.720930:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784963 00000100:00100000:0.0:1713279306.720937:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.720970:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.720973:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281184896 00000100:00100000:2.0:1713279306.720977:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281184896 00000100:00100000:3.0:1713279306.720983:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281185024 00000100:00100000:3.0:1713279306.720985:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281185024 00000100:00100000:0.0:1713279306.720992:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.720992:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110439 00000100:00100000:2.0:1713279306.720996:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+76:1957:x1796503281184896:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:3.0:1713279306.720998:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784964 00010000:00010000:1.0:1713279306.721003:0:6943:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff88012e524380 x1796503200024000) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0900/0xfc4b8e114eda721e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7f3b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175318 expref: 3741 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.721003:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3741:11827:x1796503281185024:12345-192.168.203.4@tcp:36:touch.0 00000100:00100000:3.0:1713279306.721011:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281185216 00010000:00010000:1.0:1713279306.721012:0:6943:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0900/0xfc4b8e114eda721e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f3b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175318 expref: 3741 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.721013:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281185216 00010000:00010000:3.0:1713279306.721021:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda0909 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917368c expref: 3766 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.721022:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0900/0xfc4b8e114eda721e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7f3b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175318 expref: 3741 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.721029:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e524380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6943:1796503200024000:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.721035:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e525180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6943:1796503200024064:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.721039:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cde300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6943:1796503200024128:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.721043:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.721043:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196463 00000100:00100000:3.0:1713279306.721047:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1479c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3766:1955:x1796503281185216:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.721049:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f3b:0x0].0x0 (ffff88008d11e100) 00010000:00010000:1.0:1713279306.721051:0:6943:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721054:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.721055:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281185280 00010000:00010000:1.0:1713279306.721056:0:6943:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00000100:00100000:0.0:1713279306.721058:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281185280 00010000:00010000:1.0:1713279306.721058:0:6943:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721058:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda0909 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917368c expref: 3766 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.721062:0:6943:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00000100:00100000:2.0:1713279306.721062:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+77:1957:x1796503281184896:12345-192.168.203.4@tcp:2:touch.0 Request processed in 65us (125us total) trans 4295010104 rc 0/0 00010000:00010000:3.0:1713279306.721066:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda0909 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917368c expref: 3766 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.721083:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb840/0xfc4b8e114ed813b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a0d0 expref: 3741 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.721083:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110439 00010000:00010000:3.0:1713279306.721092:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda0909 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917368c expref: 3766 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.721100:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f3b:0x0].0x0 (ffff88008d11e100) 00010000:00010000:3.0:1713279306.721103:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721109:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721113:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721118:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.721136:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1479c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3765:1955:x1796503281185216:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 87us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.721143:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196463 00000100:00100000:0.0:1713279306.721161:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196464 00000100:00100000:1.0:1713279306.721166:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.721167:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3741:1956:x1796503281185280:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.721174:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.721179:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb840/0xfc4b8e114ed813b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a0d0 expref: 3741 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.721179:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281185408 00000100:00100000:3.0:1713279306.721182:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281185408 00010000:00010000:0.0:1713279306.721191:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb840/0xfc4b8e114ed813b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a0d0 expref: 3741 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.721200:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784965 00010000:00010000:0.0:1713279306.721203:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb840/0xfc4b8e114ed813b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f3b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a0d0 expref: 3741 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.721204:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3765:11711:x1796503281185408:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.721212:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f3b:0x0].0x0 (ffff88008d11e100) 00010000:00010000:3.0:1713279306.721212:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.721216:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721219:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda7742 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175445 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.721222:0:15557:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.721227:0:15557:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.721238:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.721244:0:6943:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.721248:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00000100:00100000:0.0:1713279306.721255:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3740:1956:x1796503281185280:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 88us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.721261:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196464 00010000:00010000:3.0:1713279306.721261:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda7749 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.721268:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda7749 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.721274:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda7749 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.721283:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114eda7750 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.721288:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114eda7750 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721290:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.721294:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721294:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114eda7750 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721297:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.721299:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bfa80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.721301:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.721304:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00000004:00200000:3.0:1713279306.721307:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:1.0:1713279306.721309:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f3b:0x0].0x0 (ffff88008d11e100) 00010000:00010000:1.0:1713279306.721310:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1713279306.721312:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721313:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda7749 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721314:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda76e7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7f3b:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721317:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda7749 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721320:0:6943:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc000/0xfc4b8e114eda76d2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721322:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda7749 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721325:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc000/0xfc4b8e114eda76d2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721326:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda7749 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721328:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc000/0xfc4b8e114eda76d2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721330:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed51f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.721331:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc000/0xfc4b8e114eda76d2 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.721333:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bc000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.721333:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda7749 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721335:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc000/0xfc4b8e114eda76d2 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.721337:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc000/0xfc4b8e114eda76d2 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721337:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda7749 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721340:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff88012ee68b00) 00010000:00010000:1.0:1713279306.721342:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.721343:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc000/0xfc4b8e114eda76d2 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721343:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880091553000) 00010000:00010000:3.0:1713279306.721344:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.721345:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc000/0xfc4b8e114eda76d2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721346:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda7749 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.721350:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda7749 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721351:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda76d9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.721353:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda76d9 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.721356:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda76d9 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721357:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114eda7750 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721358:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bf3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.721360:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda76d9 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.721363:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda76d9 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721364:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114eda7750 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721366:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x3731 (ffff880097622300) 00010000:00010000:1.0:1713279306.721367:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.721368:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114eda7750 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721369:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda76d9 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.721371:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda76d9 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721372:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.721374:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114eda7750 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721377:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721378:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114eda7750 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721380:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.721382:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721382:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff8800958c9500) 00010000:00010000:3.0:1713279306.721384:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.721385:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.721385:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114eda7750 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721386:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.721389:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721389:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5440/0xfc4b8e114eda7750 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.721392:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.721393:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.721395:0:6943:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.721401:0:6943:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.721404:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.721405:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda7742 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175445 expref: 3766 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.721407:0:6943:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.721435:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.721437:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda7742 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175445 expref: 3766 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.721438:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7352 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6943 initiator: MDT0 00000004:00020000:1.0:1713279306.721442:0:6943:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200000402:0x7f51:0x0]/17 failed: rc = -114 00010000:00010000:3.0:1713279306.721447:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f192ac0, rc 0) 00010000:00010000:0.0:1713279306.721451:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.721458:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00000100:00100000:1.0:1713279306.721466:0:6943:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3739:10123:x1796503281177152:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 14079us (14123us total) trans 0 rc -114/-114 00000100:00100000:1.0:1713279306.721470:0:6943:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14323 00000100:00100000:3.0:1713279306.721470:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3765:11711:x1796503281185408:12345-192.168.203.4@tcp:101:touch.0 Request processed in 264us (303us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.721475:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784965 00000100:00100000:0.0:1713279306.721484:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000-mdtlov_UUID:15514:1796503200024256:0@lo:1000:mdt_io00_007.0 00000100:00100000:0.0:1713279306.721506:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.721516:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ca459c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.721518:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200024256 00000100:00100000:1.0:1713279306.721521:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200024256 00010000:00010000:3.0:1713279306.721526:0:15658:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.721532:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98679 00010000:00010000:3.0:1713279306.721533:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda75f9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8725:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753f1 expref: 3738 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.721535:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+94:15514:x1796503200024256:12345-0@lo:1000:mdt_io00_007.0 00010000:00010000:3.0:1713279306.721540:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8725:0x0].0x0 (ffff880136671000) 00010000:00010000:3.0:1713279306.721544:0:15658:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.721566:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+94:15514:x1796503200024256:12345-0@lo:1000:mdt_io00_007.0 Request processed in 30us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.721569:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98679 00010000:00010000:3.0:1713279306.721572:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda7757 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8725:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.721578:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda7757 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8725:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.721581:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000-mdtlov_UUID:15514:1796503200024256:0@lo:1000:mdt_io00_007.0 00010000:00010000:3.0:1713279306.721584:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda7757 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8725:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000004:00080000:0.0:1713279306.721599:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000403:0x729c:0x0] 00000004:00010000:3.0:1713279306.721612:0:15658:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008df04380 reply state ffff88009e52a000 transno 4295202621 ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda7757 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8725:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.721614:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000-mdtlov_UUID:15514:1796503200024320:0@lo:1000:mdt_io00_007.0 00010000:00010000:3.0:1713279306.721617:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda7757 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8725:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.721620:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8725:0x0].0x0 (ffff88007fe41800) 00010000:00010000:3.0:1713279306.721621:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.721622:0:15658:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713279306.721690:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.721696:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3739:11827:x1796503281185024:12345-192.168.203.4@tcp:36:touch.0 Request processed in 691us (723us total) trans 4295202621 rc 0/0 00000100:00100000:0.0:1713279306.721701:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ca45000 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.721701:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784964 00000100:00100000:1.0:1713279306.721712:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.721722:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.721730:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281185664 00000100:00100000:3.0:1713279306.721733:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281185664 00000100:00100000:1.0:1713279306.721736:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.721745:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200024320 00000100:00100000:3.0:1713279306.721745:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281185600 00000100:00100000:3.0:1713279306.721747:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281185600 00000100:00100000:1.0:1713279306.721748:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200024320 00000100:00100000:2.0:1713279306.721749:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281185792 00000100:00100000:2.0:1713279306.721751:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281185792 00000100:00100000:0.0:1713279306.721757:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784966 00000100:00100000:1.0:1713279306.721758:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98680 00000100:00100000:1.0:1713279306.721761:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+94:15514:x1796503200024320:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.721761:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784967 00000100:00100000:0.0:1713279306.721762:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008acced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3666:11839:x1796503281185664:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.721766:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3383:11204:x1796503281185600:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.721771:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.721773:0:15752:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1713279306.721773:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.721776:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784968 00000100:00100000:2.0:1713279306.721780:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3765:11836:x1796503281185792:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.721780:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114eda775e lrc: 2/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917544c expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.721786:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.721792:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda7765 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917545a expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.721793:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+94:15514:x1796503200024320:12345-0@lo:1000:mdt_io00_007.0 Request processed in 32us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.721796:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98680 00010000:00010000:3.0:1713279306.721805:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda776c lrc: 3/1,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.721809:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000-mdtlov_UUID:15514:1796503200024320:0@lo:1000:mdt_io00_007.0 00010000:00010000:3.0:1713279306.721812:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda776c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.721819:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda776c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.721827:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda7773 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.721829:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114eda777a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.721833:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda7773 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.721835:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114eda777a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.721838:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda7773 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.721841:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114eda777a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.721848:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda7781 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.721853:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda776c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.721854:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda7781 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.721858:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda776c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.721859:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda7781 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.721863:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda776c lrc: 3/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.721867:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda776c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.721874:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf5680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.721877:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda776c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.721881:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda776c lrc: 5/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.721888:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xff:0x0].0x0 (ffff880091de1a00) 00010000:00010000:3.0:1713279306.721891:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.721893:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda776c lrc: 3/0,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.721895:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eba80/0xfc4b8e114eda6b72 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175158 expref: 3666 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.721898:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda776c lrc: 0/0,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.721905:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda7773 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.721906:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7afa:0x0].0x0 (ffff88012d067d00) 00000004:00200000:2.0:1713279306.721907:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7ccb:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.721910:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda7773 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.721911:0:15752:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.721913:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114eda777a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.721915:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda7773 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.721918:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114eda777a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.721919:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda7788 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175453 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.721920:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf5b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.721922:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda7773 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.721923:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114eda777a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.721927:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda7773 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.721929:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114eda777a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.721932:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xff:0x0].0x3631 (ffff88007fe41200) 00010000:00010000:2.0:1713279306.721933:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091bab180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.721934:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.721935:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114eda777a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.721937:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda7773 lrc: 2/0,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.721940:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114eda777a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.721942:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda7773 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.721946:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:2.0:1713279306.721948:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.721950:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114eda777a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.721955:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114eda777a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.721957:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda778f lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.721957:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114eda775e lrc: 1/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917544c expref: 3384 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.721961:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda7781 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.721963:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda778f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.721963:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114eda775e lrc: 0/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917544c expref: 3384 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.721966:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda7781 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.721967:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda778f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.721970:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf5d40, rc 0) 00010000:00010000:2.0:1713279306.721971:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda7781 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.721973:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114eda7796 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7afa:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.721975:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091bab600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.721976:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114eda7796 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7afa:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.721977:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda7781 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.721980:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114eda7796 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7afa:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.721981:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda7781 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.721989:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3383:11204:x1796503281185600:12345-192.168.203.4@tcp:101:touch.0 Request processed in 223us (265us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.721990:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x30 (ffff8800902cc200) 00010000:00010000:2.0:1713279306.721992:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.721995:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda7781 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.721995:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784967 00010000:00010000:2.0:1713279306.721999:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda7781 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.722012:0:15752:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-mdtlov_UUID:15752:1796503200024384:0@lo:1000:mdt00_034.0 00010000:00010000:2.0:1713279306.722015:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda7765 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917545a expref: 3766 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.722022:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda7765 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917545a expref: 3766 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.722028:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba8b40, rc 0) 00000100:00100000:0.0:1713279306.722029:0:15752:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.722036:0:15752:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ca459c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.722044:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200024384 00000100:00100000:2.0:1713279306.722044:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3765:11836:x1796503281185792:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 263us (306us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.722046:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200024384 00000100:00100000:3.0:1713279306.722048:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.722050:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784968 00000100:00100000:0.0:1713279306.722059:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98681 00000100:00100000:2.0:1713279306.722059:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281185920 00000100:00100000:0.0:1713279306.722062:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+58:15752:x1796503200024384:12345-0@lo:1000:mdt00_034.0 00000100:00100000:2.0:1713279306.722062:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281185920 00000100:00100000:2.0:1713279306.722091:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784969 00000100:00100000:3.0:1713279306.722092:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.722095:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3383:10814:x1796503281185920:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.722103:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.722103:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281186048 00000100:00100000:3.0:1713279306.722105:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281186048 00000100:00100000:0.0:1713279306.722108:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+58:15752:x1796503200024384:12345-0@lo:1000:mdt00_034.0 Request processed in 45us (78us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.722110:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda779d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x7644:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175461 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.722112:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98681 00000100:00100000:3.0:1713279306.722126:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222987 00000100:00100000:0.0:1713279306.722127:0:15752:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-mdtlov_UUID:15752:1796503200024384:0@lo:1000:mdt00_034.0 00000100:00100000:3.0:1713279306.722130:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3765:11695:x1796503281186048:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:1.0:1713279306.722151:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e524700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000-mdtlov_UUID:15514:1796503200024448:0@lo:403:mdt_io00_007.0 00010000:00010000:2.0:1713279306.722155:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114eda77a4 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x7644:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.722166:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114eda77a4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7644:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.722169:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.722172:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114eda77a4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7644:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.722177:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a3c28cc0 going to sleep for 11 seconds 00000004:00200000:2.0:1713279306.722178:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7644:0x0]: returning size 0 00000100:00100000:1.0:1713279306.722184:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200024448 00000100:00100000:3.0:1713279306.722184:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3766:11695:x1796503281186048:12345-192.168.203.4@tcp:35:touch.0 Request processed in 53us (92us total) trans 4295202622 rc 0/0 00000100:00100000:1.0:1713279306.722186:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200024448 00000100:00100000:3.0:1713279306.722190:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222987 00000100:00100000:1.0:1713279306.722202:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98682 00000100:00100000:1.0:1713279306.722205:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+94:15514:x1796503200024448:12345-0@lo:403:mdt_io00_007.0 00010000:00010000:2.0:1713279306.722212:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda779d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x7644:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175461 expref: 3386 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.722222:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114eda77a4 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x7644:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175461 expref: 3385 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.722228:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7644:0x0].0x0 (ffff88008e766f00) 00010000:00010000:2.0:1713279306.722230:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:0.0:1713279306.722232:0:15752:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x1077:0x0], index 0: 0 00010000:00010000:2.0:1713279306.722232:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bab840, rc 0) 00000100:00100000:2.0:1713279306.722249:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3385:10814:x1796503281185920:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 152us (200us total) trans 4295183610 rc 0/0 00000100:00100000:2.0:1713279306.722254:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784969 00000100:00100000:3.0:1713279306.722264:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.722269:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281186112 00000100:00100000:2.0:1713279306.722271:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281186112 00010000:00010000:0.0:1713279306.722279:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda77b2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7d80:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.722283:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784970 00010000:00010000:0.0:1713279306.722284:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda77b2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7d80:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.722287:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3739:11860:x1796503281186112:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.722288:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda77b2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7d80:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.722294:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.722299:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda778f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.722301:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda77c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175468 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.722302:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda778f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.722308:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda778f lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.722311:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda778f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.722314:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f28000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.722315:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda778f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.722318:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda778f lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.722322:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7afa:0x0].0x0 (ffff88008e720f00) 00010000:00010000:0.0:1713279306.722324:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.722324:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda77c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.722325:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda778f lrc: 3/0,0 mode: --/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.722328:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda778f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.722331:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda77c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000004:00010000:0.0:1713279306.722333:0:15752:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008acced80 reply state ffff880131cea000 transno 4295183611 ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114eda7796 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7afa:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.722337:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda77c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.722339:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114eda7796 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7afa:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.722344:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7afa:0x0].0x37 (ffff880091b1c700) 00010000:00010000:0.0:1713279306.722346:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.722348:0:15752:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.722363:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda7788 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175453 expref: 3668 pid: 15752 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713279306.722377:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7f51:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.722379:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda77b2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7d80:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175453 expref: 3667 pid: 15752 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713279306.722380:0:15473:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713279306.722385:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d80:0x0].0x0 (ffff88012061f800) 00000004:00010000:2.0:1713279306.722386:0:15473:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda77c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.722387:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713279306.722389:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942cd80, rc 0) 00010000:00010000:2.0:1713279306.722398:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda77c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175468 expref: 3741 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.722406:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda77c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175468 expref: 3740 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.722426:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f51:0x0].0x0 (ffff8800940a8800) 00010000:00010000:2.0:1713279306.722428:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713279306.722430:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091babcc0, rc 0) 00000100:00100000:0.0:1713279306.722431:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008acced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3668:11839:x1796503281185664:12345-192.168.203.4@tcp:101:touch.0 Request processed in 648us (697us total) trans 4295183611 rc 0/0 00000100:00100000:0.0:1713279306.722438:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784966 00000100:00100000:2.0:1713279306.722448:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3740:11860:x1796503281186112:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 159us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.722453:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784970 00000100:00100000:1.0:1713279306.723271:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+94:15514:x1796503200024448:12345-0@lo:403:mdt_io00_007.0 Request processed in 1064us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.723275:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98682 00000100:00100000:2.0:1713279306.723288:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e524700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000-mdtlov_UUID:15514:1796503200024448:0@lo:403:mdt_io00_007.0 00000100:00100000:0.0:1713279306.723456:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.723472:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.723485:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281186240 00000100:00100000:0.0:1713279306.723488:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281186240 00000100:00100000:3.0:1713279306.723493:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.723506:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281186368 00000100:00100000:0.0:1713279306.723507:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281186368 00000100:00100000:3.0:1713279306.723515:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222988 00000100:00100000:3.0:1713279306.723520:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3741:10123:x1796503281186240:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1713279306.723522:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222989 00000100:00100000:0.0:1713279306.723525:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130147c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3741:11846:x1796503281186368:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:3.0:1713279306.723562:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3741:10123:x1796503281186240:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 41us (90us total) trans 0 rc -116/-116 00000100:00100000:3.0:1713279306.723568:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222988 00000100:00100000:0.0:1713279306.723604:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130147c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3741:11846:x1796503281186368:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 77us (109us total) trans 4295202623 rc 0/0 00000100:00100000:0.0:1713279306.723608:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222989 00010000:00010000:2.0:1713279306.723764:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda77ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x149:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723770:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda77ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723776:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda77ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723782:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114eda77d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x149:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723785:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114eda77d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723788:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114eda77d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723801:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114eda77dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8264:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723804:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114eda77dc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8264:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723807:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114eda77dc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8264:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723829:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114eda77dc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8264:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723832:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114eda77dc lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x8264:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723835:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114eda77dc lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x8264:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723838:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076e880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.723840:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114eda77dc lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x8264:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723845:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114eda77dc lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x8264:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723849:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8264:0x0].0x0 (ffff88009542ca00) 00010000:00010000:2.0:1713279306.723851:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.723852:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114eda77dc lrc: 2/0,0 mode: --/EX res: [0x200000403:0x8264:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723855:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114eda77dc lrc: 0/0,0 mode: --/EX res: [0x200000403:0x8264:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723860:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda77ce lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723863:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda77ce lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723866:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda77ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723869:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda77ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723871:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076f840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.723873:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda77ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723875:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda77ce lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723878:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x149:0x0].0x0 (ffff8800902cc600) 00010000:00010000:2.0:1713279306.723879:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.723881:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda77ce lrc: 3/0,0 mode: --/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723884:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda77ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723889:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114eda77d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723891:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114eda77d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723894:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114eda77d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723896:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076e1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.723897:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114eda77d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723900:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114eda77d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723903:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x149:0x0].0x3331 (ffff8800902ccf00) 00010000:00010000:2.0:1713279306.723904:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.723905:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114eda77d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723908:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114eda77d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000004:00080000:2.0:1713279306.723913:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000403:0x729c:0x0] 00010000:00010000:2.0:1713279306.723916:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723919:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723924:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723926:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008be61680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.723927:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723930:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723933:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:2.0:1713279306.723934:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.723935:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.723939:0:15514:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.723941:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.723945:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda75f2 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda75e4 expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.723962:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.723965:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be61680/0xfc4b8e114eda74a2 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15514 initiator: MDT0 00000004:00020000:2.0:1713279306.723968:0:15514:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x240000403:0x729c:0x0]/13 failed: rc = -114 00010000:00010000:1.0:1713279306.723976:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.723981:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.723996:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3740:9807:x1796503281180224:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 11934us (11987us total) trans 0 rc -114/-114 00000100:00100000:2.0:1713279306.724002:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14324 00000100:00100000:2.0:1713279306.724018:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281186496 00000100:00100000:2.0:1713279306.724020:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281186496 00010000:00010000:1.0:1713279306.724041:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda77e3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.724046:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda77e3 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.724052:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda77e3 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.724053:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784971 00010000:00010000:1.0:1713279306.724058:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda77ea lrc: 3/0,1 mode: --/PW res: [0x200000400:0x235:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.724058:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3668:11711:x1796503281186496:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.724061:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda77ea lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.724064:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda77ea lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.724065:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.724086:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda77f1 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917546f expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.724089:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.724095:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008af30000/0xfc4b8e114ed9c070 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391721a8 expref: 3739 pid: 15657 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.724100:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114ed9c32c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172288 expref: 3739 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.724104:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114ed9df56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391729f1 expref: 3765 pid: 15657 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.724108:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda7360 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x8125:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917536c expref: 3765 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.724111:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 7/0,1 mode: --/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.724111:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076cb40/0xfc4b8e114eda77ff lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724117:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013076cb40/0xfc4b8e114eda77ff lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.724121:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda7360 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x8125:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917536c expref: 3765 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.724124:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013076cb40/0xfc4b8e114eda77ff lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.724127:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda7360 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x8125:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917536c expref: 3765 pid: 9221 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.724130:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda7806 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.724133:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e524380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200024512:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.724133:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda7806 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.724136:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda7806 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.724147:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076cb40/0xfc4b8e114eda77ff lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.724150:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076cb40/0xfc4b8e114eda77ff lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.724153:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013076cb40/0xfc4b8e114eda77ff lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.724154:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114ed9df56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391729f1 expref: 3765 pid: 15657 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.724156:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013076cb40/0xfc4b8e114eda77ff lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.724158:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114ed9df56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391729f1 expref: 3765 pid: 15657 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.724158:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076cb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.724160:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076cb40/0xfc4b8e114eda77ff lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.724163:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e524700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200024576:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.724163:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076cb40/0xfc4b8e114eda77ff lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.724166:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88009811e600) 00010000:00010000:2.0:1713279306.724167:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.724169:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013076cb40/0xfc4b8e114eda77ff lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.724172:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114ed9c32c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172288 expref: 3739 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.724172:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076cb40/0xfc4b8e114eda77ff lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.724176:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114ed9c32c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172288 expref: 3739 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.724176:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda7806 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.724179:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda7806 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.724180:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f1d5180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200024640:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.724182:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda7806 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.724184:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.724186:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda7806 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.724189:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008af30000/0xfc4b8e114ed9c070 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391721a8 expref: 3739 pid: 15657 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.724191:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda7806 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.724193:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008af30000/0xfc4b8e114ed9c070 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391721a8 expref: 3739 pid: 15657 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.724194:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88009811e100) 00010000:00010000:2.0:1713279306.724195:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.724196:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda7806 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.724197:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f1d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200024704:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.724199:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda7806 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.724205:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a3c28cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.724209:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda77f1 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917546f expref: 3669 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.724213:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda77f1 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917546f expref: 3669 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.724218:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013076d200, rc 0) 00000100:00100000:2.0:1713279306.724232:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3668:11711:x1796503281186496:12345-192.168.203.4@tcp:101:touch.0 Request processed in 174us (777us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.724235:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784971 00000100:00100000:1.0:1713279306.724257:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.724262:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.724267:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281186624 00000100:00100000:2.0:1713279306.724271:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281186624 00000100:00100000:2.0:1713279306.724278:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281186688 00000100:00100000:2.0:1713279306.724280:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281186688 00000100:00100000:2.0:1713279306.724292:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110440 00000100:00100000:2.0:1713279306.724296:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1954:x1796503281186688:12345-192.168.203.4@tcp:1:lfs.0 00000100:00100000:0.0:1713279306.724301:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.724312:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281186752 00000100:00100000:1.0:1713279306.724314:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281186752 00002000:00010000:2.0:1713279306.724317:0:15499:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x105f:0x0] initial LVB size: 0, mtime: 0x661e9148, atime: 0x661e9148, ctime: 0x661e9148, blocks: 0x0 00010000:00010000:2.0:1713279306.724324:0:15499:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092342880/0xfc4b8e114eda780d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x105f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.724327:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784972 00000100:00100000:1.0:1713279306.724330:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3741:10123:x1796503281186752:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:2.0:1713279306.724330:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.724332:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.724335:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092342880/0xfc4b8e114eda780d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x105f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.724343:0:15499:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092342880/0xfc4b8e114eda780d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x105f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.724346:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda7814 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724351:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda7814 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.724352:0:15499:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092342880/0xfc4b8e114eda780d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x105f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.724355:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda7814 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.724358:0:15499:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092342880/0xfc4b8e114eda780d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x105f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.724360:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda781b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724364:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda781b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.724365:0:15499:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092342880/0xfc4b8e114eda780d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.724367:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda781b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.724370:0:15499:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342880 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:2.0:1713279306.724373:0:15499:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092342880/0xfc4b8e114eda780d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.724378:0:15499:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092342880/0xfc4b8e114eda780d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x105f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.724387:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7822 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.724387:0:15499:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092342880/0xfc4b8e114eda780d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x105f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.724391:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.724393:0:15499:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092342880/0xfc4b8e114eda780d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x105f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.724394:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000004:00010000:1.0:1713279306.724425:0:15752:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724431:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda7814 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724434:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda7814 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724436:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda7814 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724439:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda7814 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724442:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bfcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.724443:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda7814 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724446:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda7814 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.724448:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1954:x1796503281186688:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 150us (186us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.724451:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff880091d49100) 00010000:00010000:1.0:1713279306.724452:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.724454:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda7814 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.724454:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110440 00010000:00010000:1.0:1713279306.724456:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda7814 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724461:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda781b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724464:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda781b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724467:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda781b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724470:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bc240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.724472:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda781b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724474:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda781b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724477:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x3231 (ffff880098d56e00) 00010000:00010000:1.0:1713279306.724478:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.724480:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda781b lrc: 2/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.724480:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784973 00010000:00010000:1.0:1713279306.724482:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc240/0xfc4b8e114eda781b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.724484:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3741:11204:x1796503281186624:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.724487:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724490:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7822 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.724490:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.724493:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7822 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724495:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.724496:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7822 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.724498:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda7829 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175476 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.724499:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7822 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724503:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f29:0x0].0x0 (ffff880089f68e00) 00010000:00010000:1.0:1713279306.724504:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.724505:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7822 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.724508:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7822 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.724529:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3742:10123:x1796503281186752:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 198us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.724533:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784972 00010000:00010000:2.0:1713279306.724534:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda7830 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724539:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda7830 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724543:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda7830 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724550:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda7837 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x124:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724553:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda7837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x124:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724556:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda7837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x124:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00080000:2.0:1713279306.724681:0:15473:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x118e:0x0], index 0: 0 00000004:00080000:2.0:1713279306.724685:0:15473:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x11a3:0x0], index 1: 0 00010000:00010000:2.0:1713279306.724731:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda783e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8727:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724736:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda783e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8727:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724740:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda783e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8727:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724751:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda7830 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724754:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda7830 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724758:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda7830 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724760:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda7830 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724763:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800923421c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.724764:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda7830 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724767:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda7830 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724771:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x0 (ffff880096696800) 00010000:00010000:2.0:1713279306.724772:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.724774:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda7830 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724777:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda7830 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000004:00010000:2.0:1713279306.724782:0:15473:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880123a41180 reply state ffff88008bf34000 transno 4295202624 ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda7837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x124:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724786:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda7837 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.724789:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x3631 (ffff88008e59ca00) 00010000:00010000:2.0:1713279306.724791:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.724792:0:15473:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.724801:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda7829 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175476 expref: 3743 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.724808:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda783e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8727:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175476 expref: 3742 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.724811:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8727:0x0].0x0 (ffff88011eea4e00) 00010000:00010000:2.0:1713279306.724812:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.724813:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092342400, rc 0) 00000100:00100000:2.0:1713279306.724840:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3743:11204:x1796503281186624:12345-192.168.203.4@tcp:101:touch.0 Request processed in 355us (583us total) trans 4295202624 rc 0/0 00000100:00100000:2.0:1713279306.724846:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784973 00000100:00100000:0.0:1713279306.725262:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.725273:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281187264 00000100:00100000:2.0:1713279306.725277:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281187264 00000100:00100000:2.0:1713279306.725298:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784974 00000100:00100000:3.0:1713279306.725299:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.725303:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3743:10123:x1796503281187264:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:0.0:1713279306.725312:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281186816 00010000:00010000:2.0:1713279306.725313:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.725315:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281186816 00010000:00010000:2.0:1713279306.725320:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda784c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7f29:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917547d expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.725333:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784975 00000100:00100000:0.0:1713279306.725337:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3385:9807:x1796503281186816:12345-192.168.203.4@tcp:34:lfs.0 00000100:00100000:3.0:1713279306.725341:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.725356:0:15525:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff88012e524380 x1796503200024512) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda7360 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x8125:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917536c expref: 3765 pid: 9221 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.725359:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281186880 00000100:00100000:0.0:1713279306.725360:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281186880 00010000:00010000:2.0:1713279306.725362:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923406c0/0xfc4b8e114eda7853 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7f29:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.725366:0:15525:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda7360 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x8125:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917536c expref: 3766 pid: 9221 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.725367:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.725368:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114ed9df56 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391729f1 expref: 3766 pid: 15657 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.725369:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800923406c0/0xfc4b8e114eda7853 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f29:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.725375:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda7360 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x8125:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917536c expref: 3766 pid: 9221 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.725376:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923406c0/0xfc4b8e114eda7853 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f29:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.725379:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281186944 00000100:00100000:0.0:1713279306.725380:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281186944 00000100:00100000:1.0:1713279306.725383:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e524380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200024512:192.168.203.4@tcp:104: 00000004:00200000:2.0:1713279306.725383:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7f29:0x0]: returning size 0 00010000:00010000:0.0:1713279306.725385:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114ed9c32c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172288 expref: 3745 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.725386:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.725389:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e524700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200024576:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.725393:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281187008 00000100:00100000:0.0:1713279306.725394:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281187008 00000100:00100000:1.0:1713279306.725394:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f1d5180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200024640:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.725398:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f1d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200024704:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.725400:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196465 00000100:00100000:3.0:1713279306.725405:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3765:1957:x1796503281186880:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.725408:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8125:0x0].0x0 (ffff8800940f8f00) 00010000:00010000:1.0:1713279306.725427:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.725429:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.725432:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.725433:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda784c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7f29:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917547d expref: 3748 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.725433:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114ed9df56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391729f1 expref: 3765 pid: 15657 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.725435:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.725438:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.725441:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114ed9df56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391729f1 expref: 3765 pid: 15657 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.725443:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923406c0/0xfc4b8e114eda7853 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f29:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917547d expref: 3747 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.725449:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f29:0x0].0x0 (ffff880089f68e00) 00010000:00010000:0.0:1713279306.725451:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008af30000/0xfc4b8e114ed9c070 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391721a8 expref: 3747 pid: 15657 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.725451:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1713279306.725452:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114ed9df56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391729f1 expref: 3765 pid: 15657 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.725453:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923406c0, rc 0) 00010000:00010000:3.0:1713279306.725460:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8125:0x0].0x0 (ffff8800940f8f00) 00000100:00100000:1.0:1713279306.725461:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196466 00010000:00010000:3.0:1713279306.725463:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000100:00100000:0.0:1713279306.725464:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196467 00000100:00100000:1.0:1713279306.725465:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3747:1956:x1796503281186944:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.725468:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3747:1954:x1796503281187008:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.725468:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.725471:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.725473:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.725473:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3747:10123:x1796503281187264:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 169us (212us total) trans 4295202625 rc 0/0 00010000:00010000:3.0:1713279306.725473:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.725475:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114ed9c32c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172288 expref: 3747 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.725476:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008af30000/0xfc4b8e114ed9c070 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391721a8 expref: 3747 pid: 15657 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.725478:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.725479:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784974 00010000:00010000:1.0:1713279306.725480:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114ed9c32c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172288 expref: 3747 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.725485:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008af30000/0xfc4b8e114ed9c070 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391721a8 expref: 3746 pid: 15657 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.725491:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3764:1957:x1796503281186880:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 85us (149us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.725494:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114ed9c32c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172288 expref: 3746 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.725497:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196465 00010000:00010000:0.0:1713279306.725498:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008af30000/0xfc4b8e114ed9c070 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8125:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391721a8 expref: 3746 pid: 15657 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.725500:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8125:0x0].0x0 (ffff8800940f8f00) 00010000:00010000:1.0:1713279306.725501:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.725506:0:15492:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.725509:0:15492:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.725510:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.725513:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8125:0x0].0x0 (ffff8800940f8f00) 00010000:00010000:0.0:1713279306.725515:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.725519:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.725522:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281187200 00000100:00100000:2.0:1713279306.725525:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281187200 00000100:00100000:0.0:1713279306.725529:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3744:1954:x1796503281187008:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 61us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.725533:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196467 00000100:00100000:1.0:1713279306.725533:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3744:1956:x1796503281186944:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 68us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.725538:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196466 00000100:00100000:2.0:1713279306.725541:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14328 00000100:00100000:2.0:1713279306.725546:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3386:10814:x1796503281187200:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:3.0:1713279306.725550:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.725551:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.725555:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725556:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda7861 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x254:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.725561:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda7861 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.725565:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda7861 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.725571:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7868 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x254:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.725574:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7868 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.725574:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.725577:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7868 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.725580:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.725586:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.725594:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.725596:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200024768:0@lo:101:mdt_io00_007.0 00010000:00010000:0.0:1713279306.725598:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda7876 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.725598:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725601:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda7876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725601:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.725604:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.725605:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda7876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725605:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.725608:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00000004:00010000:0.0:1713279306.725611:0:15480:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda7876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725613:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8125:0x0].0x0 (ffff8800940f8f00) 00000100:00100000:2.0:1713279306.725613:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.725614:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1713279306.725616:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda7861 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725616:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.725618:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda77f8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x8125:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.725620:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800968dd000 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.725622:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda7861 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725624:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda77e3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725625:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda7861 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725627:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda77e3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725628:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda7861 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.725628:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281187392 00010000:00010000:1.0:1713279306.725630:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda77e3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.725630:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281187392 00010000:00010000:0.0:1713279306.725631:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801251d5b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.725632:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda7861 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725633:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda77e3 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725635:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda7861 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725635:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bc480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.725636:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda77e3 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725639:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x254:0x0].0x0 (ffff88012061fc00) 00010000:00010000:1.0:1713279306.725639:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda77e3 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725640:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.725642:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda7861 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725642:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff880091d49100) 00010000:00010000:1.0:1713279306.725643:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.725644:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda77e3 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725645:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda7861 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725647:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda77e3 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725651:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7868 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.725651:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784976 00010000:00010000:1.0:1713279306.725653:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda77ea lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725654:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7868 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.725655:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3764:11711:x1796503281187392:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.725656:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda77ea lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725657:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7868 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725658:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda77ea lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725659:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.725661:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7868 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725661:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bd8c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.725662:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.725663:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda77ea lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725664:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7868 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725666:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda77ea lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725668:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x254:0x0].0x39 (ffff88012061fd00) 00010000:00010000:0.0:1713279306.725669:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.725669:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x34 (ffff880095863700) 00010000:00010000:0.0:1713279306.725670:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7868 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725670:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.725670:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092340fc0/0xfc4b8e114eda787d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175484 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.725671:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda77ea lrc: 2/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725673:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122205b00/0xfc4b8e114eda7868 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725674:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda77ea lrc: 0/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725678:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda7876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725680:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725681:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda7876 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.725683:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda7876 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725683:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.725685:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725686:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801222058c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.725687:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda7876 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725687:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bd440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.725689:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725690:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda7876 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725691:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.725693:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f28:0x0].0x0 (ffff880136671900) 00010000:00010000:0.0:1713279306.725695:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713279306.725695:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:0.0:1713279306.725696:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda7876 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725696:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.725699:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda75f2 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda75e4 expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.725701:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda7876 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.725703:0:15525:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda75f2 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda75e4 expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.725707:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda75f2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda75e4 expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.725711:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.725711:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7884 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.725718:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7884 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.725721:0:15525:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda75f2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda75e4 expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.725723:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7884 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.725727:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a42680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200024832:0@lo:105: 00010000:00010000:2.0:1713279306.725731:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda788b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.725737:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda788b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.725743:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.725743:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda788b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.725751:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a3c28cc0 going to sleep for 11 seconds 00000004:00200000:2.0:1713279306.725752:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:2.0:1713279306.725756:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7884 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.725760:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7884 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.725761:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200024832 00000100:00100000:1.0:1713279306.725763:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200024832 00010000:00010000:2.0:1713279306.725765:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7884 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.725768:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3386:9807:x1796503281186816:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 430us (469us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.725770:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7884 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.725773:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784975 00000100:00100000:1.0:1713279306.725774:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33425 00010000:00010000:2.0:1713279306.725774:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092340d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.725776:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7884 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.725777:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15525:x1796503200024832:12345-0@lo:105: 00010000:00010000:2.0:1713279306.725781:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7884 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.725782:0:6913:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.725787:0:6913:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.725788:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880097a5f200) 00010000:00010000:2.0:1713279306.725790:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.725791:0:6913:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.725792:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7884 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.725797:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7884 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.725798:0:6913:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.725798:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.725802:0:6913:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.725805:0:6913:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.725809:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281187520 00010000:00010000:1.0:1713279306.725809:0:6913:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.725809:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda788b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.725811:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281187520 00010000:00010000:2.0:1713279306.725813:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda788b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.725815:0:6913:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800935bcfc0) 00010000:00010000:2.0:1713279306.725818:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda788b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.725822:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092343840 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.725824:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784977 00010000:00010000:2.0:1713279306.725824:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda788b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.725826:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3743:11204:x1796503281187520:12345-192.168.203.4@tcp:36:touch.0 00000100:00100000:1.0:1713279306.725828:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15525:x1796503200024832:12345-0@lo:105: Request processed in 50us (84us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.725829:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda788b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.725831:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33425 00010000:00010000:2.0:1713279306.725835:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff88007f3afd00) 00010000:00010000:2.0:1713279306.725837:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.725839:0:15480:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.725839:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda788b lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.725839:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.725841:0:15507:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.725843:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda788b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.725845:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda783e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8727:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175476 expref: 3743 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.725845:0:15507:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.725850:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281187648 00010000:00010000:0.0:1713279306.725851:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8727:0x0].0x0 (ffff88011eea4e00) 00000004:00080000:1.0:1713279306.725852:0:15507:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1713279306.725853:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281187648 00010000:00010000:0.0:1713279306.725855:0:15480:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.725863:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340fc0/0xfc4b8e114eda787d lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175484 expref: 3766 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.725867:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784978 00010000:00010000:2.0:1713279306.725870:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092340fc0/0xfc4b8e114eda787d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175484 expref: 3766 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.725871:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3766:11843:x1796503281187648:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1713279306.725878:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda7892 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8727:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.725878:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092340fc0, rc 0) 00010000:00010000:0.0:1713279306.725882:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda7892 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8727:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.725886:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda7892 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8727:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.725889:0:15482:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.725895:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3765:11711:x1796503281187392:12345-192.168.203.4@tcp:101:touch.0 Request processed in 239us (344us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.725899:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda72a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7c58:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175334 expref: 3765 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.725901:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784976 00010000:00010000:1.0:1713279306.725903:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda7899 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x262:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.725907:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c58:0x0].0x0 (ffff880092139d00) 00010000:00010000:1.0:1713279306.725908:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda7899 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.725910:0:15482:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.725912:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda7899 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00000004:00010000:0.0:1713279306.725913:0:15480:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d183100 reply state ffff880095991000 transno 4295202626 ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda7892 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8727:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.725918:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda7892 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8727:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.725919:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda78a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x262:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.725921:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8727:0x0].0x0 (ffff880135caad00) 00010000:00010000:1.0:1713279306.725922:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda78a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x262:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.725923:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.725924:0:15480:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713279306.725925:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda78a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x262:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.725930:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.725935:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6d40 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751cf expref: 3385 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.725939:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 4/0,1 mode: --/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.725939:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7c58:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.725946:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3744:11204:x1796503281187520:12345-192.168.203.4@tcp:36:touch.0 Request processed in 118us (148us total) trans 4295202626 rc 0/0 00010000:00010000:3.0:1713279306.725947:0:15482:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134926f40/0xfc4b8e114ed9118c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7c58:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916f02a expref: 3744 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.725948:0:15507:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6d40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751cf expref: 3385 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.725949:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784977 00010000:00010000:3.0:1713279306.725953:0:15482:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.725954:0:15507:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6d40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751cf expref: 3385 pid: 15749 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.725960:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f1d5180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0001_UUID:15507:1796503200024896:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.725967:0:15482:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134926f40/0xfc4b8e114ed9118c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7c58:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916f02a expref: 3743 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.725973:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800b5264000 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.725979:0:15482:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134926f40/0xfc4b8e114ed9118c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7c58:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916f02a expref: 3743 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.725987:0:15482:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000_UUID:15482:1796503200024960:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.725992:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a42680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200024832:0@lo:105: 00010000:00010000:1.0:1713279306.725999:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.726005:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda7527 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 15525 initiator: MDT0 00000100:00100000:3.0:1713279306.726008:0:15482:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549e40 going to sleep for 11 seconds 00000004:00020000:1.0:1713279306.726009:0:15525:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200000402:0x7f51:0x0]/4 failed: rc = -114 00000100:00100000:1.0:1713279306.726026:0:15525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:385c4b71-808c-40cf-91de-b076b668d13f+3763:11736:x1796503281180864:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 13057us (13094us total) trans 0 rc -114/-114 00000100:00100000:1.0:1713279306.726030:0:15525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14325 00000100:00100000:1.0:1713279306.726042:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200024768 00000100:00100000:1.0:1713279306.726043:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200024768 00000100:00100000:1.0:1713279306.726053:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98683 00000100:00100000:1.0:1713279306.726055:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+58:15514:x1796503200024768:12345-0@lo:101:mdt_io00_007.0 00010000:00010000:1.0:1713279306.726061:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.726065:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda78b5 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda786f expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.726091:0:15542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.726095:0:15542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda78b5 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda786f expref: 59 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.726101:0:15542:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.726105:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda78b5 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda786f expref: 59 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.726109:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.726111:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.726113:0:15542:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.726116:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d322400, rc 0) 00000100:00100000:1.0:1713279306.726132:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+59:15514:x1796503200024768:12345-0@lo:101:mdt_io00_007.0 Request processed in 76us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.726135:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98683 00000100:00100000:2.0:1713279306.726146:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200024768:0@lo:101:mdt_io00_007.0 00010000:00010000:2.0:1713279306.726153:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.726158:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.727125:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.727146:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.727159:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281187840 00000100:00100000:3.0:1713279306.727162:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281187840 00000100:00100000:3.0:1713279306.727176:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281187776 00000100:00100000:3.0:1713279306.727178:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281187776 00000100:00100000:2.0:1713279306.727188:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.727190:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784979 00000100:00100000:3.0:1713279306.727194:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3744:11827:x1796503281187840:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.727196:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281187904 00000100:00100000:1.0:1713279306.727200:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281187904 00000100:00100000:0.0:1713279306.727201:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784980 00010000:00010000:3.0:1713279306.727202:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.727205:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3668:11854:x1796503281187776:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.727209:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6f40/0xfc4b8e114eda78bc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x8725:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175492 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.727213:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.727218:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784981 00010000:00010000:0.0:1713279306.727220:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda78c3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917548b expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.727222:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3746:10123:x1796503281187904:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.727229:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.727229:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6f40/0xfc4b8e114eda78bc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x8725:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175492 expref: 3746 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.727235:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320000/0xfc4b8e114eda78ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7f29:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175499 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.727237:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6f40/0xfc4b8e114eda78bc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x8725:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175492 expref: 3746 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.727246:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8725:0x0].0x0 (ffff88007fe41800) 00010000:00010000:3.0:1713279306.727248:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713279306.727250:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf6f40, rc 0) 00010000:00010000:1.0:1713279306.727253:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320000/0xfc4b8e114eda78ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7f29:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175499 expref: 3747 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.727260:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320000/0xfc4b8e114eda78ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7f29:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175499 expref: 3747 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.727267:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f29:0x0].0x0 (ffff880089f68e00) 00000100:00100000:3.0:1713279306.727267:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3747:11827:x1796503281187840:12345-192.168.203.4@tcp:101:touch.0 Request processed in 71us (141us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.727268:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1713279306.727269:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d320000, rc 0) 00000100:00100000:3.0:1713279306.727273:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784979 00010000:00010000:0.0:1713279306.727281:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda78d1 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x7213:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.727285:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3746:10123:x1796503281187904:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 63us (98us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.727288:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda78d1 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x7213:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.727289:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784981 00010000:00010000:0.0:1713279306.727292:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda78d1 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x7213:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:0.0:1713279306.727297:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7213:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.727327:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda78c3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917548b expref: 3671 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.727334:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda78d1 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x7213:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917548b expref: 3670 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.727341:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7213:0x0].0x0 (ffff880124f55f00) 00010000:00010000:0.0:1713279306.727343:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1713279306.727344:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c04480, rc 0) 00000100:00100000:0.0:1713279306.727361:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3670:11854:x1796503281187776:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 156us (217us total) trans 4295183612 rc 0/0 00000100:00100000:0.0:1713279306.727365:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784980 00000100:00100000:2.0:1713279306.727511:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.727523:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281188096 00000100:00100000:0.0:1713279306.727526:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281188096 00000100:00100000:3.0:1713279306.727527:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.727536:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281187968 00000100:00100000:0.0:1713279306.727537:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281187968 00000100:00100000:1.0:1713279306.727541:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784982 00000100:00100000:1.0:1713279306.727544:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3670:11863:x1796503281188096:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:2.0:1713279306.727546:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.727546:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784983 00000100:00100000:0.0:1713279306.727550:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281188224 00010000:00010000:1.0:1713279306.727551:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.727551:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3746:9807:x1796503281187968:12345-192.168.203.4@tcp:34:lfs.0 00000100:00100000:0.0:1713279306.727552:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281188224 00010000:00010000:1.0:1713279306.727556:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114eda78df lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391754a0 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.727560:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784984 00000100:00100000:0.0:1713279306.727563:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3672:11711:x1796503281188224:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.727570:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.727574:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda78e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.727575:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda78ed lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391754a7 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.727581:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda78e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.727586:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.727587:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda78e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.727592:0:15752:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda609e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174eaa expref: 3673 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.727594:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda78fb lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.727596:0:15752:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 4/0,1 mode: --/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.727599:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda78fb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.727603:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda78fb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.727607:0:15752:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda609e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174eaa expref: 3673 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.727607:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda78e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.727608:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda7902 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.727612:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda7902 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.727612:0:15752:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda609e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174eaa expref: 3673 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.727612:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda78e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.727615:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda7902 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.727617:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda78e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.727618:0:15752:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a42680 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001_UUID:15752:1796503200025024:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.727620:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf6400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.727623:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda78e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.727627:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda78fb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.727627:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda78e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.727630:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda78fb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.727632:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda78fb lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.727632:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f28:0x0].0x0 (ffff88011eea4600) 00010000:00010000:3.0:1713279306.727634:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1713279306.727635:0:15752:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a3c28cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.727636:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda78fb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.727636:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda78e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.727639:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f29b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.727640:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda78fb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.727641:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda78e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f28:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.727643:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda78fb lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.727647:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880091b34600) 00010000:00010000:0.0:1713279306.727649:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.727650:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda78fb lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.727653:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda78fb lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.727657:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda7902 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.727661:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda7902 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.727664:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda7902 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.727665:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3746:9807:x1796503281187968:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 113us (137us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.727666:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095249d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.727667:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda7902 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.727670:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda7902 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.727672:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784983 00010000:00010000:0.0:1713279306.727673:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880091b34800) 00010000:00010000:0.0:1713279306.727674:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.727675:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda7902 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.727678:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda7902 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.727688:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda78ed lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754a7 expref: 3673 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.727692:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda78ed lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754a7 expref: 3673 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.727697:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f2b3c0, rc 0) 00000100:00100000:0.0:1713279306.727712:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3672:11711:x1796503281188224:12345-192.168.203.4@tcp:101:touch.0 Request processed in 148us (166us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.727716:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784984 00000100:00100000:0.0:1713279306.729675:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.729713:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.729730:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.729748:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.729749:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281188288 00000100:00100000:1.0:1713279306.729753:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281188416 00000100:00100000:3.0:1713279306.729754:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281188288 00000100:00100000:1.0:1713279306.729757:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281188416 00000100:00100000:2.0:1713279306.729762:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.729781:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281188736 00000100:00100000:3.0:1713279306.729784:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281188736 00000100:00100000:0.0:1713279306.729786:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281188544 00000100:00100000:0.0:1713279306.729789:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281188544 00000100:00100000:2.0:1713279306.729789:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281188800 00000100:00100000:2.0:1713279306.729791:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281188800 00000100:00100000:1.0:1713279306.729792:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784985 00000100:00100000:1.0:1713279306.729796:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3746:11204:x1796503281188288:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.729804:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.729809:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784986 00010000:00010000:1.0:1713279306.729820:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda7909 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x8727:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391754ae expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.729823:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3765:11856:x1796503281188416:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.729826:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784987 00000100:00100000:0.0:1713279306.729830:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3765:11844:x1796503281188736:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:2.0:1713279306.729831:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784988 00010000:00010000:3.0:1713279306.729832:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.729834:0:9221:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:2.0:1713279306.729835:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3765:11850:x1796503281188544:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.729838:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.729841:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.729842:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda7909 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x8727:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754ae expref: 3747 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.729844:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800978861c0/0xfc4b8e114eda7910 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x236:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391754ca expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.729846:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda6e58 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x246:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917523f expref: 3765 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.729848:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320480/0xfc4b8e114eda7909 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x8727:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754ae expref: 3747 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.729848:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092341d40/0xfc4b8e114eda7917 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391754bc expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.729855:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8727:0x0].0x0 (ffff880135caad00) 00010000:00010000:1.0:1713279306.729857:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713279306.729857:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x246:0x0].0x0 (ffff880089dc2800) 00010000:00010000:1.0:1713279306.729858:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d320480, rc 0) 00010000:00010000:3.0:1713279306.729862:0:9221:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.729864:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda791e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x236:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.729868:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda7925 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x246:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391754b5 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.729869:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda791e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x236:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.729874:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda791e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x236:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.729876:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3747:11204:x1796503281188288:12345-192.168.203.4@tcp:101:touch.0 Request processed in 79us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.729880:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784985 00000004:00200000:0.0:1713279306.729889:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x236:0x0]: returning size 4096 00000100:00100000:1.0:1713279306.729890:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784989 00000004:00200000:0.0:1713279306.729891:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:1.0:1713279306.729893:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3672:11861:x1796503281188800:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.729897:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.729898:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda792c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.729902:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800978861c0/0xfc4b8e114eda7910 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x236:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754ca expref: 3768 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.729903:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114eda7933 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391754d1 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.729906:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda792c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.729909:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942db00/0xfc4b8e114eda791e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x236:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754ca expref: 3767 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.729911:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda793a lrc: 3/1,0 mode: --/CR res: [0x200000400:0x246:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.729913:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x236:0x0].0x0 (ffff88008e735300) 00010000:00010000:2.0:1713279306.729913:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda792c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.729915:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713279306.729916:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942db00, rc 0) 00010000:00010000:3.0:1713279306.729917:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda793a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x246:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.729918:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7941 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.729922:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7941 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.729922:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342ac0/0xfc4b8e114eda7948 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.729923:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda793a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x246:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.729926:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7941 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.729927:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092342ac0/0xfc4b8e114eda7948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.729932:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092342ac0/0xfc4b8e114eda7948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.729932:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda794f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x246:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.729937:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda794f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x246:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000004:00200000:1.0:1713279306.729940:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x233:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.729942:0:6929:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1713279306.729943:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda794f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x246:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.729953:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114eda7933 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d1 expref: 3674 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.729961:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7941 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d1 expref: 3673 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.729965:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88008d597100) 00010000:00010000:1.0:1713279306.729966:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713279306.729967:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7956 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x824e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.729968:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3218c0, rc 0) 00000004:00200000:2.0:1713279306.729973:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7ccb:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.729973:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x824e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.729979:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda792c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.729979:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x824e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000004:00200000:3.0:1713279306.729984:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x824e:0x0]: returning size 0 00010000:00010000:2.0:1713279306.729985:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda792c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.729989:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda792c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.729994:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda792c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.729999:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092343a80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.730000:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3768:11844:x1796503281188736:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 169us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.730001:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3673:11861:x1796503281188800:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 107us (239us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.730001:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda792c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713279306.730004:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784989 00010000:00010000:2.0:1713279306.730006:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda792c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.730007:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784987 00010000:00010000:3.0:1713279306.730010:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda793a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x246:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.730013:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.730015:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda793a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x246:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.730016:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.730019:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda792c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.730020:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda793a lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x246:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.730024:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.730025:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda793a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x246:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.730027:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda792c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.730029:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf46c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.730032:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda793a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x246:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.730035:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281188672 00010000:00010000:2.0:1713279306.730035:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342ac0/0xfc4b8e114eda7948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713279306.730037:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281188672 00010000:00010000:3.0:1713279306.730037:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda793a lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x246:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.730040:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092342ac0/0xfc4b8e114eda7948 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.730043:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x246:0x0].0x0 (ffff880089dc2100) 00010000:00010000:2.0:1713279306.730045:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092342ac0/0xfc4b8e114eda7948 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.730045:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.730048:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda793a lrc: 3/0,0 mode: --/CR res: [0x200000400:0x246:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.730049:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.730051:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342ac0/0xfc4b8e114eda7948 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713279306.730052:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784990 00010000:00010000:3.0:1713279306.730052:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda793a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x246:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.730055:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3747:11853:x1796503281188672:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.730056:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342ac0/0xfc4b8e114eda7948 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.730059:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda794f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x246:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.730060:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.730061:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x30 (ffff88007f3afb00) 00010000:00010000:2.0:1713279306.730063:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.730064:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda794f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x246:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.730065:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda7964 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391754c3 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.730065:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092342ac0/0xfc4b8e114eda7948 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.730082:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda794f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x246:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.730086:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342ac0/0xfc4b8e114eda7948 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.730087:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012154ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.730089:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda794f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x246:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.730094:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda794f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x246:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.730100:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x246:0x0].0x3631 (ffff880135caaa00) 00000100:00100000:1.0:1713279306.730102:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f1d5180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0001_UUID:15507:1796503200024896:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.730102:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.730104:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092341d40/0xfc4b8e114eda7917 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754bc expref: 3767 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.730115:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda794f lrc: 2/0,0 mode: --/PR res: [0x200000400:0x246:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.730120:0:15507:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.730120:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092341d40/0xfc4b8e114eda7917 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754bc expref: 3767 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.730120:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154ef40/0xfc4b8e114eda794f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x246:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.730127:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.730130:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092341d40, rc 0) 00000100:00100000:0.0:1713279306.730136:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281189056 00000100:00100000:0.0:1713279306.730138:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281189056 00010000:00010000:3.0:1713279306.730139:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda7925 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x246:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754b5 expref: 3767 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.730149:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784991 00010000:00010000:3.0:1713279306.730149:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7956 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x824e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754b5 expref: 3766 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.730150:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3766:11850:x1796503281188544:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 314us (400us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.730152:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3749:9807:x1796503281189056:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.730153:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda796b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.730155:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x824e:0x0].0x0 (ffff88009588ce00) 00000100:00100000:2.0:1713279306.730156:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784988 00010000:00010000:3.0:1713279306.730157:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.730158:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda796b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.730159:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d866d00, rc 0) 00010000:00010000:0.0:1713279306.730160:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.730162:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda796b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.730165:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda7972 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7f28:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391754d8 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.730169:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda7979 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.730172:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda7979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00000100:00100000:3.0:1713279306.730174:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3765:11856:x1796503281188416:12345-192.168.203.4@tcp:101:touch.0 Request processed in 351us (469us total) trans 4295202627 rc 0/0 00010000:00010000:1.0:1713279306.730176:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda7979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000100:00100000:3.0:1713279306.730180:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784986 00010000:00010000:1.0:1713279306.730192:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3206c0/0xfc4b8e114eda7980 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.730196:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.730196:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3206c0/0xfc4b8e114eda7980 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.730200:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3206c0/0xfc4b8e114eda7980 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.730202:0:15483:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda46dc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7f28:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174813 expref: 3764 pid: 15752 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713279306.730203:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8430:0x0]: returning size 3214 00000100:00100000:3.0:1713279306.730203:0:15482:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000_UUID:15482:1796503200024960:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.730206:0:15483:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.730212:0:15482:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.730216:0:15483:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda46dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7f28:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174813 expref: 3764 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.730221:0:15483:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda46dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7f28:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174813 expref: 3764 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.730227:0:15483:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd29f80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:15483:1796503200025088:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.730227:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda796b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.730230:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda796b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.730233:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda796b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.730236:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda796b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.730239:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.730241:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda796b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00000100:00100000:0.0:1713279306.730242:0:15483:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800924b4cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.730244:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda796b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.730248:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:1.0:1713279306.730250:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.730251:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda796b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000100:00100000:3.0:1713279306.730251:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.730254:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda796b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.730261:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda7979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.730264:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda7979 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.730267:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda7979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.730269:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.730270:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda7979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.730273:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda7979 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.730276:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x38 (ffff88007fcb8200) 00010000:00010000:1.0:1713279306.730277:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.730278:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda7979 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.730283:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda7979 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000100:00100000:3.0:1713279306.730283:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.730295:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281188928 00000100:00100000:0.0:1713279306.730297:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281188928 00010000:00010000:1.0:1713279306.730298:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda7964 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754c3 expref: 3752 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.730298:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.730304:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3206c0/0xfc4b8e114eda7980 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754c3 expref: 3752 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.730306:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134926f40/0xfc4b8e114ed9118c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7c58:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916f02a expref: 3752 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.730308:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8430:0x0].0x0 (ffff8800920e4400) 00010000:00010000:1.0:1713279306.730309:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1713279306.730310:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3206c0, rc 0) 00000100:00100000:0.0:1713279306.730315:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281188864 00000100:00100000:0.0:1713279306.730316:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281188864 00000100:00100000:1.0:1713279306.730319:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281189120 00010000:00010000:0.0:1713279306.730320:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6d40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751cf expref: 3386 pid: 15749 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.730321:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281189120 00000100:00100000:3.0:1713279306.730321:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.730328:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196468 00010000:00010000:1.0:1713279306.730328:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda609e lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174eaa expref: 3673 pid: 15474 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.730331:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3752:1956:x1796503281188928:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.730335:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.730337:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134926f40/0xfc4b8e114ed9118c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7c58:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916f02a expref: 3752 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.730342:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134926f40/0xfc4b8e114ed9118c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7c58:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916f02a expref: 3752 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.730348:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196469 00010000:00010000:0.0:1713279306.730349:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134926f40/0xfc4b8e114ed9118c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7c58:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916f02a expref: 3752 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.730351:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3386:1956:x1796503281188864:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.730352:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281189184 00000100:00100000:3.0:1713279306.730354:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196470 00010000:00010000:0.0:1713279306.730355:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c58:0x0].0x0 (ffff880092139d00) 00010000:00010000:1.0:1713279306.730355:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.730356:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281189184 00010000:00010000:0.0:1713279306.730357:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.730358:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6d40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751cf expref: 3386 pid: 15749 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.730359:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1479850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3673:1956:x1796503281189120:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.730361:0:15492:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.730363:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6d40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751cf expref: 3386 pid: 15749 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.730366:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.730367:0:15492:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.730370:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda6d40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751cf expref: 3386 pid: 15749 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.730371:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110441 00010000:00010000:3.0:1713279306.730371:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda609e lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174eaa expref: 3673 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.730374:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.730375:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1956:x1796503281189184:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:1.0:1713279306.730378:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25c:0x0].0x0 (ffff88011eea5300) 00010000:00010000:1.0:1713279306.730380:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.730384:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.730384:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda609e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174eaa expref: 3673 pid: 15474 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.730386:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3751:1956:x1796503281188928:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 54us (137us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.730386:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15507 initiator: MDT1 00000100:00100000:0.0:1713279306.730390:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196468 00010000:00010000:2.0:1713279306.730390:0:15499:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7995 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x110d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.730393:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b9c:0x0].0x0 (ffff88009588c000) 00010000:00010000:1.0:1713279306.730394:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.730396:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.730400:0:15499:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012baf6ac0/0xfc4b8e114ed7b9eb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x110d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916852b expref: 76 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713279306.730402:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.730405:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3385:1956:x1796503281188864:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 54us (122us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.730406:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.730408:0:15499:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092343cc0/0xfc4b8e114ed9e235 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x110d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b09 expref: 82 pid: 15500 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713279306.730409:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196469 00010000:00010000:2.0:1713279306.730434:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.730435:0:15507:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.730435:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.730436:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.730439:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.730439:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7995 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x110d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.730445:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda609e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174eaa expref: 3673 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.730446:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936efcc0/0xfc4b8e114eda799c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25c:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.730449:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936efcc0/0xfc4b8e114eda799c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00000100:00100000:0.0:1713279306.730451:0:15752:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a42680 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001_UUID:15752:1796503200025024:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.730451:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1479850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3672:1956:x1796503281189120:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 91us (152us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.730453:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936efcc0/0xfc4b8e114eda799c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.730454:0:15499:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092343cc0/0xfc4b8e114ed9e235 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x110d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b09 expref: 82 pid: 15500 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713279306.730457:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196470 00010000:00010000:0.0:1713279306.730458:0:15752:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.730462:0:15752:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.730462:0:15499:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092343cc0/0xfc4b8e114ed9e235 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x110d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b09 expref: 82 pid: 15500 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.730465:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.730469:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7892:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00000004:00200000:0.0:1713279306.730471:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7b9c:0x0]: returning size 15538 00000100:00100000:2.0:1713279306.730471:0:15499:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:15499:1796503200025152:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.730487:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda74b0 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x7892:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ab expref: 3384 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.730491:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.730499:0:15482:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.730501:0:15507:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda74b0 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7892:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ab expref: 3384 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.730505:0:15499:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012baf6ac0/0xfc4b8e114ed7b9eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x110d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916852b expref: 76 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713279306.730505:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.730506:0:15507:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda74b0 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7892:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ab expref: 3384 pid: 15479 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.730512:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a42680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0001_UUID:15507:1796503200025216:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.730513:0:15499:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012baf6ac0/0xfc4b8e114ed7b9eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x110d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916852b expref: 76 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.730514:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114eda78df lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754a0 expref: 3673 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.730521:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754a0 expref: 3672 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.730521:0:15499:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:15499:1796503200025280:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.730525:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b9c:0x0].0x0 (ffff88009588c000) 00010000:00010000:0.0:1713279306.730526:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:1.0:1713279306.730526:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff880130637840 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.730528:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d321680, rc 0) 00000100:00100000:2.0:1713279306.730535:0:15499:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800968dd000 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.730537:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3750:11853:x1796503281188672:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 482us (512us total) trans 4295202628 rc 0/0 00000100:00100000:0.0:1713279306.730541:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3672:11863:x1796503281188096:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 2996us (3032us total) trans 4295183613 rc 0/0 00000100:00100000:1.0:1713279306.730541:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784990 00000004:00010000:3.0:1713279306.730542:0:15482:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d182a00 reply state ffff880098197000 transno 4295202629 ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.730545:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784982 00010000:00010000:3.0:1713279306.730550:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.730556:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c58:0x0].0x0 (ffff880092139d00) 00010000:00010000:3.0:1713279306.730558:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.730560:0:15482:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713279306.730590:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3766:11843:x1796503281187648:12345-192.168.203.4@tcp:36:touch.0 Request processed in 4718us (4750us total) trans 4295202629 rc 0/0 00000100:00100000:3.0:1713279306.730596:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784978 00000100:00100000:0.0:1713279306.731043:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.731063:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.731090:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281189504 00000100:00100000:2.0:1713279306.731096:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281189504 00000100:00100000:0.0:1713279306.731111:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.731116:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784992 00000100:00100000:2.0:1713279306.731121:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3766:11711:x1796503281189504:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.731126:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281189312 00000100:00100000:1.0:1713279306.731131:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281189312 00010000:00010000:2.0:1713279306.731132:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.731151:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281189376 00010000:00010000:2.0:1713279306.731152:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda79b1 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391754df expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.731155:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281189376 00000100:00100000:1.0:1713279306.731159:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222990 00000100:00100000:1.0:1713279306.731163:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3768:11736:x1796503281189312:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.731173:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110442 00000100:00100000:3.0:1713279306.731178:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+80:1954:x1796503281189376:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:1.0:1713279306.731197:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3768:11736:x1796503281189312:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 32us (132us total) trans 0 rc -116/-116 00000100:00100000:1.0:1713279306.731201:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222990 00010000:00010000:2.0:1713279306.731204:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda79b8 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731211:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda79b8 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731217:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda79b8 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731237:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009175d200/0xfc4b8e114eda79bf lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731242:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009175d200/0xfc4b8e114eda79bf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731248:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009175d200/0xfc4b8e114eda79bf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000004:00200000:2.0:1713279306.731262:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:2.0:1713279306.731269:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda79b8 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731275:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda79b8 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.731275:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+81:1954:x1796503281189376:12345-192.168.203.4@tcp:2:touch.0 Request processed in 96us (163us total) trans 4295010105 rc 0/0 00010000:00010000:2.0:1713279306.731279:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda79b8 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.731281:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110442 00010000:00010000:2.0:1713279306.731284:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda79b8 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731289:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bc6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.731292:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda79b8 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731297:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda79b8 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731304:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880090aa0400) 00010000:00010000:2.0:1713279306.731307:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.731309:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda79b8 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731314:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda79b8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731325:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009175d200/0xfc4b8e114eda79bf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731330:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009175d200/0xfc4b8e114eda79bf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731334:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009175d200/0xfc4b8e114eda79bf lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731338:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009175d200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.731340:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009175d200/0xfc4b8e114eda79bf lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731344:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009175d200/0xfc4b8e114eda79bf lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731349:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880090aa0a00) 00010000:00010000:2.0:1713279306.731350:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.731352:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009175d200/0xfc4b8e114eda79bf lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731356:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009175d200/0xfc4b8e114eda79bf lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.731376:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda79b1 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754df expref: 3767 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.731380:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.731381:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda79b1 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754df expref: 3767 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.731386:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935be880, rc 0) 00000100:00100000:0.0:1713279306.731390:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281189632 00000100:00100000:0.0:1713279306.731393:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281189632 00000100:00100000:2.0:1713279306.731400:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3766:11711:x1796503281189504:12345-192.168.203.4@tcp:101:touch.0 Request processed in 280us (359us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.731405:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784992 00000100:00100000:1.0:1713279306.731406:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.731408:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784993 00000100:00100000:0.0:1713279306.731428:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3385:11841:x1796503281189632:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.731435:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.731439:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281189696 00010000:00010000:0.0:1713279306.731442:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda79c6 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391754ed expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.731443:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281189696 00010000:00010000:3.0:1713279306.731454:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7589 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753dc expref: 3387 pid: 15479 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.731462:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.731468:0:15752:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.731469:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196471 00010000:00010000:0.0:1713279306.731471:0:15752:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 4/1,0 mode: --/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.731473:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3387:1955:x1796503281189696:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.731477:0:15752:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.731480:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.731481:0:15752:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.731483:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7589 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753dc expref: 3387 pid: 15479 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.731486:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.731491:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7589 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753dc expref: 3387 pid: 15479 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.731497:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281189952 00000100:00100000:1.0:1713279306.731499:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281189952 00010000:00010000:3.0:1713279306.731502:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7589 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753dc expref: 3388 pid: 15479 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.731509:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784994 00000100:00100000:1.0:1713279306.731512:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3387:11855:x1796503281189952:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:3.0:1713279306.731514:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x753e:0x0].0x0 (ffff880095b48100) 00010000:00010000:3.0:1713279306.731517:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.731524:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.731526:0:15753:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.731528:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.731533:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.731535:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114eda76ee lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175430 expref: 3387 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.731537:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.731541:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.731543:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6ed2:0x0].0x0 (ffff8800939e3a00) 00010000:00010000:1.0:1713279306.731545:0:15753:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.731551:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.731560:0:15485:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.731566:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.731573:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda79d4 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6ed2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000004:00200000:2.0:1713279306.731575:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x753e:0x0]: returning size 15382 00010000:00010000:1.0:1713279306.731579:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda79d4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.731583:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda79d4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.731597:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.731609:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3387:1955:x1796503281189696:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 134us (201us total) trans 0 rc 0/0 00000004:00010000:1.0:1713279306.731614:0:15753:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012e524380 reply state ffff880097cf8000 transno 4295183615 ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda79d4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:3.0:1713279306.731615:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196471 00010000:00010000:1.0:1713279306.731619:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda79d4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.731620:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda769a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917541b expref: 3673 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.731622:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6ed2:0x0].0x0 (ffff8800939e3a00) 00010000:00010000:1.0:1713279306.731623:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.731625:0:15753:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.731632:0:15485:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917541b expref: 3672 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.731639:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917541b expref: 3672 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.731644:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baba80, rc 0) 00000100:00100000:1.0:1713279306.731649:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3387:11855:x1796503281189952:12345-192.168.203.4@tcp:36:touch.0 Request processed in 135us (162us total) trans 4295183615 rc 0/0 00000100:00100000:0.0:1713279306.731651:0:15483:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd29f80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:15483:1796503200025088:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.731655:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784994 00010000:00010000:0.0:1713279306.731659:0:15483:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.731659:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3672:11842:x1796503281183872:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 13574us (13622us total) trans 4295183614 rc 0/0 00000100:00100000:1.0:1713279306.731662:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281189824 00000100:00100000:1.0:1713279306.731664:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281189824 00000100:00100000:2.0:1713279306.731664:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784957 00000100:00100000:2.0:1713279306.731675:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784995 00000100:00100000:2.0:1713279306.731679:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3387:11835:x1796503281189824:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.731686:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.731693:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114eda79e2 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391754f4 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.731723:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.731735:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094fe5b00/0xfc4b8e114eda79e9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.731737:0:15499:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:15499:1796503200025152:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.731739:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.731744:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094fe5b00/0xfc4b8e114eda79e9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.731747:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281190016 00000100:00100000:1.0:1713279306.731748:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281190080 00000100:00100000:3.0:1713279306.731749:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281190016 00000100:00100000:1.0:1713279306.731750:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281190080 00010000:00010000:2.0:1713279306.731750:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094fe5b00/0xfc4b8e114eda79e9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.731758:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda79f0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.731759:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092343cc0/0xfc4b8e114ed9e235 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x110d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b09 expref: 83 pid: 15500 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.731759:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda46dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7f28:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174813 expref: 3766 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.731764:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda79f0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.731768:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196472 00010000:00010000:2.0:1713279306.731769:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda79f0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.731771:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281190080:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.731773:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196473 00010000:00010000:1.0:1713279306.731776:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.731777:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3766:1957:x1796503281190016:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.731782:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.731783:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092343cc0/0xfc4b8e114ed9e235 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x110d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b09 expref: 83 pid: 15500 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.731786:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda46dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7f28:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174813 expref: 3766 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.731789:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092343cc0/0xfc4b8e114ed9e235 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x110d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b09 expref: 83 pid: 15500 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.731794:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda46dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7f28:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174813 expref: 3766 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.731797:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092343cc0/0xfc4b8e114ed9e235 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x110d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b09 expref: 83 pid: 15500 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.731803:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.731804:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda46dc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7f28:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174813 expref: 3766 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.731812:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f28:0x0].0x0 (ffff88011eea4600) 00010000:00010000:3.0:1713279306.731815:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.731816:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+82:1956:x1796503281190080:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 44us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.731820:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196472 00010000:00010000:3.0:1713279306.731821:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15483 initiator: MDT0 00000004:00200000:2.0:1713279306.731824:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76b7:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.731825:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.731830:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094fe5b00/0xfc4b8e114eda79e9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.731835:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094fe5b00/0xfc4b8e114eda79e9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.731836:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.731840:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094fe5b00/0xfc4b8e114eda79e9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.731843:0:15483:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.731845:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880094fe5b00/0xfc4b8e114eda79e9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.731848:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.731850:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094fe5b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.731852:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094fe5b00/0xfc4b8e114eda79e9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.731854:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3765:1957:x1796503281190016:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 76us (130us total) trans 0 rc 0/0 00000004:00200000:1.0:1713279306.731855:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7f28:0x0]: returning size 2928 00010000:00010000:2.0:1713279306.731857:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094fe5b00/0xfc4b8e114eda79e9 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.731860:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196473 00010000:00010000:2.0:1713279306.731867:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:2.0:1713279306.731870:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.731872:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880094fe5b00/0xfc4b8e114eda79e9 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.731877:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094fe5b00/0xfc4b8e114eda79e9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.731884:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda79f0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.731885:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda7972 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d8 expref: 3751 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.731888:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda79f0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.731892:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d8 expref: 3750 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.731893:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda79f0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.731896:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f28:0x0].0x0 (ffff88011eea4600) 00010000:00010000:2.0:1713279306.731897:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800958d6ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.731898:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1713279306.731898:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda79f0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.731899:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942cb40, rc 0) 00010000:00010000:2.0:1713279306.731902:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda79f0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.731907:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff880096b8e500) 00010000:00010000:2.0:1713279306.731909:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.731911:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda79f0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.731913:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3750:9807:x1796503281189056:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1761us (1787us total) trans 4295202630 rc 0/0 00010000:00010000:2.0:1713279306.731915:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda79f0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.731917:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784991 00010000:00010000:2.0:1713279306.731929:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114eda79e2 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754f4 expref: 3388 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.731936:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114eda79e2 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754f4 expref: 3388 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.731942:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919a0000, rc 0) 00000100:00100000:2.0:1713279306.731957:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3387:11835:x1796503281189824:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 277us (360us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.731962:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784995 00010000:00010000:1.0:1713279306.731976:0:15507:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880123a42680 x1796503200025216) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda74b0 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7892:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ab expref: 3386 pid: 15479 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.731983:0:15507:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda74b0 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7892:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ab expref: 3386 pid: 15479 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.731990:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda74b0 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x7892:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391753ab expref: 3386 pid: 15479 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.731996:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a42680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0001_UUID:15507:1796503200025216:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.731997:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.732003:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7892:0x0].0x0 (ffff88008d7fcd00) 00010000:00010000:1.0:1713279306.732005:0:15507:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00000100:00100000:3.0:1713279306.732005:0:15499:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:15499:1796503200025280:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.732009:0:15507:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15507 initiator: MDT1 00000100:00100000:2.0:1713279306.732011:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.732012:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.732018:0:15507:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.732019:0:15499:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7995 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x110d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.732022:0:15507:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00000100:00100000:2.0:1713279306.732022:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.732024:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00000100:00100000:0.0:1713279306.732034:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281190144 00000100:00100000:3.0:1713279306.732036:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281190208 00000100:00100000:0.0:1713279306.732037:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281190144 00000100:00100000:3.0:1713279306.732039:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281190208 00010000:00010000:3.0:1713279306.732047:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012baf6ac0/0xfc4b8e114ed7b9eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x110d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916852b expref: 77 pid: 15519 timeout: 509 lvb_type: 1 00000100:00100000:0.0:1713279306.732048:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281190272 00000100:00100000:0.0:1713279306.732049:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281190272 00000100:00100000:0.0:1713279306.732057:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784996 00000100:00100000:0.0:1713279306.732060:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3766:11844:x1796503281190144:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:3.0:1713279306.732062:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196474 00000100:00100000:3.0:1713279306.732066:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+77:1957:x1796503281190208:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.732067:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.732080:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.732083:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.732086:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda79fe lrc: 2/0,0 mode: --/CR res: [0x200000400:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391754fb expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.732092:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012baf6ac0/0xfc4b8e114ed7b9eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x110d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916852b expref: 77 pid: 15519 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.732096:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784997 00010000:00010000:3.0:1713279306.732100:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012baf6ac0/0xfc4b8e114ed7b9eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x110d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916852b expref: 77 pid: 15519 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.732101:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3767:11736:x1796503281190272:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1713279306.732112:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3840/0xfc4b8e114eda7a05 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.732117:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3840/0xfc4b8e114eda7a05 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x21d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.732121:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3840/0xfc4b8e114eda7a05 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x21d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.732123:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012baf6ac0/0xfc4b8e114ed7b9eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x110d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916852b expref: 77 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.732131:0:15655:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.732133:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d5440/0xfc4b8e114eda7a0c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.732133:0:15655:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00200000:0.0:1713279306.732136:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x21d:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.732136:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x110d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713279306.732138:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:2.0:1713279306.732139:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d5440/0xfc4b8e114eda7a0c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.732142:0:15655:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7995 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x110d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.732145:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d5440/0xfc4b8e114eda7a0c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000004:00010000:1.0:1713279306.732148:0:15507:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008df05f80 reply state ffff88009e68e000 transno 4295183616 ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.732149:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda79fe lrc: 0/0,0 mode: --/CR res: [0x200000400:0x21d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754fb expref: 3768 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.732154:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.732154:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092455d40/0xfc4b8e114eda7a13 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.732154:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.732156:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3840/0xfc4b8e114eda7a05 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x21d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754fb expref: 3767 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.732158:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7892:0x0].0x0 (ffff88008d7fcd00) 00010000:00010000:1.0:1713279306.732159:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.732159:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092455d40/0xfc4b8e114eda7a13 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.732160:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x21d:0x0].0x0 (ffff88008e735700) 00000100:00100000:1.0:1713279306.732161:0:15507:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.732162:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713279306.732163:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800926b3840, rc 0) 00010000:00010000:1.0:1713279306.732163:0:15507:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.732164:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092455d40/0xfc4b8e114eda7a13 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.732166:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.732169:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00000100:00100000:3.0:1713279306.732169:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1957:x1796503281190208:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 102us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.732174:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196474 00010000:00010000:1.0:1713279306.732176:0:15507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00000100:00100000:0.0:1713279306.732178:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3767:11844:x1796503281190144:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 116us (181us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.732179:0:15507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.732180:0:15507:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00000100:00100000:0.0:1713279306.732181:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784996 00010000:00010000:1.0:1713279306.732183:0:15507:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.732187:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25c:0x0].0x0 (ffff88011eea5300) 00010000:00010000:1.0:1713279306.732188:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.732188:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281190336 00010000:00010000:1.0:1713279306.732189:0:15507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00000100:00100000:3.0:1713279306.732190:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281190336 00010000:00010000:1.0:1713279306.732192:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114eda78a7 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.732195:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda7a1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000004:00010000:1.0:1713279306.732199:0:15507:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008df05f80 reply state ffff88009e68e000 transno 4295183616 ns: mdt-lustre-MDT0001_UUID lock: ffff8800936efcc0/0xfc4b8e114eda799c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.732202:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936efcc0/0xfc4b8e114eda799c lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.732202:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda7a1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.732202:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110443 00010000:00010000:1.0:1713279306.732205:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25c:0x0].0x3531 (ffff8800960e8100) 00010000:00010000:1.0:1713279306.732206:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.732206:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+81:11853:x1796503281190336:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:1.0:1713279306.732207:0:15507:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1713279306.732208:0:15507:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda7899 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.732208:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda7a1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.732211:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda7899 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.732212:0:9197:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.732217:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda7899 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.732219:0:15507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda7899 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.732221:0:9197:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda7a21 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175502 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.732222:0:15507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092345440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.732223:0:15507:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda7899 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.732226:0:15507:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda7899 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00000004:00010000:2.0:1713279306.732227:0:15485:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda7a1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.732229:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x262:0x0].0x0 (ffff8800938abd00) 00010000:00010000:1.0:1713279306.732230:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.732231:0:15507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda7899 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.732233:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d5440/0xfc4b8e114eda7a0c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.732234:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda7899 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x262:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.732234:0:9197:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094550d80/0xfc4b8e114ed9c540 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->57343) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172314 expref: 76 pid: 15539 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713279306.732238:0:15507:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008df05f80 reply state ffff88009e68e000 transno 4295183616 ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda78a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x262:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.732239:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d5440/0xfc4b8e114eda7a0c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.732239:0:9197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.732241:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda78a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.732241:0:9197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.732243:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d5440/0xfc4b8e114eda7a0c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.732244:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x262:0x0].0x3531 (ffff8800938ab300) 00010000:00010000:3.0:1713279306.732244:0:9197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda7a21 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [20480->49151] (req 20480->49151) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175502 expref: 82 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.732245:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.732246:0:15507:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:2.0:1713279306.732248:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d5440/0xfc4b8e114eda7a0c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.732249:0:15507:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.732252:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800958d5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.732255:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d5440/0xfc4b8e114eda7a0c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.732256:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.732257:0:9197:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094550d80/0xfc4b8e114ed9c540 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->57343) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172314 expref: 76 pid: 15539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.732259:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.732260:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d5440/0xfc4b8e114eda7a0c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.732265:0:9197:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094550d80/0xfc4b8e114ed9c540 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->57343) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172314 expref: 76 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.732266:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff880096b8e700) 00010000:00010000:2.0:1713279306.732269:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.732273:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d5440/0xfc4b8e114eda7a0c lrc: 3/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.732273:0:9197:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121535180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9197:1796503200025344:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.732274:0:15507:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1713279306.732278:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d5440/0xfc4b8e114eda7a0c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.732286:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092455d40/0xfc4b8e114eda7a13 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.732291:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092455d40/0xfc4b8e114eda7a13 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.732291:0:9197:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549e40 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.732295:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3387:11374:x1796503281182592:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 17016us (17205us total) trans 4295183616 rc 0/0 00010000:00010000:2.0:1713279306.732296:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092455d40/0xfc4b8e114eda7a13 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.732299:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14326 00010000:00010000:2.0:1713279306.732300:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092455d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.732300:0:15499:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x110d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.732303:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092455d40/0xfc4b8e114eda7a13 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.732307:0:15499:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x110d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.732308:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092455d40/0xfc4b8e114eda7a13 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.732313:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x3531 (ffff88009e797800) 00010000:00010000:2.0:1713279306.732315:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.732317:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092455d40/0xfc4b8e114eda7a13 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.732317:0:15499:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x110d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.732322:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092455d40/0xfc4b8e114eda7a13 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.732323:0:15499:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x110d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.732329:0:15499:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7995 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x110d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.732331:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda7a1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.732335:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda7a1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.732335:0:15499:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d4b3180 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:3.0:1713279306.732338:0:15499:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7995 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x110d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.732343:0:15499:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7995 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x110d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.732344:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda7a1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.732349:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fca86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.732351:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda7a1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.732352:0:15499:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7995 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x110d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.732355:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda7a1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.732358:0:15499:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7995 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x110d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.732361:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f37:0x0].0x0 (ffff88008c2e7500) 00010000:00010000:2.0:1713279306.732363:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.732365:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda7a1a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.732370:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda7a1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.732372:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.732384:0:6919:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1713279306.732386:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1956:x1796503281189184:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 2010us (2064us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.732389:0:6919:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.732392:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110441 00010000:00010000:2.0:1713279306.732394:0:6919:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcfc0 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:2.0:1713279306.732397:0:6919:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.732401:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281190400 00000100:00100000:3.0:1713279306.732403:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281190400 00000004:00010000:2.0:1713279306.732404:0:6919:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.732432:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110444 00000100:00100000:1.0:1713279306.732436:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1955:x1796503281190400:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:2.0:1713279306.732437:0:6919:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.732447:0:6919:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1713279306.732456:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.732460:0:6919:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.732462:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200025408:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.732466:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bcfc0/0xfc4b8e114eda75e4 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda75f2 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.732473:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.732475:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.732476:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279306.732479:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.732494:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3766:11736:x1796503281190272:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 391us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.732500:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784997 00000100:00100000:3.0:1713279306.732502:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200025408 00000100:00100000:1.0:1713279306.732505:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1955:x1796503281190400:12345-192.168.203.4@tcp:2:touch.0 Request processed in 68us (133us total) trans 4295010165 rc 0/0 00000100:00100000:3.0:1713279306.732505:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200025408 00000100:00100000:0.0:1713279306.732507:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.732509:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110444 00000100:00100000:2.0:1713279306.732509:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281190656 00000100:00100000:2.0:1713279306.732511:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281190656 00000100:00100000:0.0:1713279306.732514:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281190464 00010000:00010000:3.0:1713279306.732515:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda75f2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda75e4 expref: 59 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.732517:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281190464 00000100:00100000:2.0:1713279306.732523:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784998 00000100:00100000:2.0:1713279306.732527:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3672:11711:x1796503281190656:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.732527:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196475 00000100:00100000:3.0:1713279306.732530:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+59:3490:x1796503200025408:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.732532:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110445 00000100:00100000:0.0:1713279306.732535:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+83:1955:x1796503281190464:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:2.0:1713279306.732535:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.732536:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.732540:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda75f2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda75e4 expref: 59 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.732542:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca9b00/0xfc4b8e114eda7a28 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175509 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.732550:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda75f2 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda75e4 expref: 59 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.732552:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.732558:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:3.0:1713279306.732561:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.732566:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290400000020 pid: 6942 initiator: MDT0 00000100:00100000:1.0:1713279306.732567:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.732568:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda7a2f lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.732571:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290400000020 pid: 6942 initiator: MDT0 00000100:00100000:1.0:1713279306.732574:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281190592 00010000:00010000:2.0:1713279306.732574:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda7a2f lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.732576:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281190592 00010000:00010000:3.0:1713279306.732578:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda78b5 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda786f expref: 58 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.732580:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda7a2f lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.732586:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281190784 00000100:00100000:1.0:1713279306.732588:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281190784 00010000:00010000:2.0:1713279306.732591:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133317840/0xfc4b8e114eda7a36 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.732594:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.732596:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784999 00010000:00010000:2.0:1713279306.732596:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133317840/0xfc4b8e114eda7a36 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.732599:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3766:11832:x1796503281190592:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.732601:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133317840/0xfc4b8e114eda7a36 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.732605:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.732611:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114eda7a3d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391754e6 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.732614:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+58:3490:x1796503200025408:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (133us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.732617:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda7a2f lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.732620:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196475 00010000:00010000:2.0:1713279306.732622:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda7a2f lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.732627:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda7a2f lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.732632:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda7a2f lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.732635:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.732636:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133315b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.732638:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda7a2f lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.732652:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.732654:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda7a2f lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.732659:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda7a44 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.732660:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88012b01f800) 00010000:00010000:2.0:1713279306.732662:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.732664:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda7a2f lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.732665:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda7a44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.732669:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda7a44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.732669:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda7a2f lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.732676:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda7a4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.732677:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133317840/0xfc4b8e114eda7a36 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.732679:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda7a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.732682:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda7a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.732683:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133317840/0xfc4b8e114eda7a36 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.732687:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133317840/0xfc4b8e114eda7a36 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.732688:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7a52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.732691:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133317840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.732694:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133317840/0xfc4b8e114eda7a36 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.732695:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7a52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.732698:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133317840/0xfc4b8e114eda7a36 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.732700:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7a59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.732701:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7a52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.732704:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880136671a00) 00010000:00010000:1.0:1713279306.732705:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7a59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.732706:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.732707:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133317840/0xfc4b8e114eda7a36 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.732720:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7a59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.732720:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda7a60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.732722:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133317840/0xfc4b8e114eda7a36 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.732723:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7a59 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.732724:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+84:1955:x1796503281190464:12345-192.168.203.4@tcp:2:touch.0 Request processed in 187us (215us total) trans 4295010106 rc 0/0 00010000:00010000:1.0:1713279306.732726:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936eed00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.732726:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda7a60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.732727:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7a59 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.732728:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110445 00010000:00010000:1.0:1713279306.732731:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7a59 lrc: 4/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.732731:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda7a60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.732735:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7abd:0x0].0x0 (ffff88008c2e7d00) 00010000:00010000:1.0:1713279306.732737:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7a59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.732739:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114eda7a59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.732740:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca9b00/0xfc4b8e114eda7a28 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175509 expref: 3674 pid: 15485 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713279306.732745:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7abd:0x0]: returning size 42048 00000100:00100000:0.0:1713279306.732746:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200025408:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.732747:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca9b00/0xfc4b8e114eda7a28 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175509 expref: 3674 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.732749:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda7a67 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.732755:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda7a67 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.732756:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785000 00010000:00010000:2.0:1713279306.732756:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fca9b00, rc 0) 00000100:00100000:0.0:1713279306.732759:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3673:11839:x1796503281190784:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:1.0:1713279306.732763:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda7a44 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.732763:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda7a67 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.732766:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda7a44 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.732769:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda7a44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.732772:0:15483:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.732772:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda7a44 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.732772:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3673:11711:x1796503281190656:12345-192.168.203.4@tcp:101:touch.0 Request processed in 244us (316us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.732784:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ec000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.732784:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.732786:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda7a44 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.732788:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda7a44 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.732788:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784998 00010000:00010000:0.0:1713279306.732789:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda77b2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7d80:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175453 expref: 3673 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.732791:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda718b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x8439:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752f5 expref: 3768 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.732792:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.732793:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.732795:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda7a44 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.732796:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d80:0x0].0x0 (ffff88012061f800) 00010000:00010000:3.0:1713279306.732797:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.732798:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda7a44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.732800:0:15483:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.732802:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda7a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.732805:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda7a4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.732808:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda7a4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.732810:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ecb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.732811:0:6942:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda718b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x8439:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752f5 expref: 3768 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.732812:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda7a4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.732814:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda7a4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.732817:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x33 (ffff8800960e8000) 00010000:00010000:1.0:1713279306.732818:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.732819:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda7a4b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.732819:0:6942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda718b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x8439:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752f5 expref: 3768 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.732822:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda7a4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.732827:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121536d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200025472:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.732829:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114eda7a7c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7d80:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.732834:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114eda7a7c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d80:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.732834:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114eda7a3d lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754e6 expref: 3768 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.732838:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114eda7a7c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d80:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.732838:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114eda7a3d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754e6 expref: 3768 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.732842:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75f6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.732846:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ef600, rc 0) 00000100:00100000:1.0:1713279306.732859:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3767:11832:x1796503281190592:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 258us (306us total) trans 4295202631 rc 301/301 00000004:00010000:0.0:1713279306.732861:0:15483:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801251d8000 reply state ffff880095992000 transno 4295183617 ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114eda7a7c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d80:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.732863:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784999 00010000:00010000:0.0:1713279306.732866:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114eda7a7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7d80:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.732870:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d80:0x0].0x0 (ffff88008e735000) 00010000:00010000:0.0:1713279306.732871:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.732872:0:15483:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713279306.732883:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.732891:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.732895:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3673:11839:x1796503281190784:12345-192.168.203.4@tcp:36:touch.0 Request processed in 134us (326us total) trans 4295183617 rc 0/0 00000100:00100000:1.0:1713279306.732897:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.732898:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785000 00000100:00100000:1.0:1713279306.732903:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281190976 00000100:00100000:1.0:1713279306.732905:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281190976 00000100:00100000:0.0:1713279306.732906:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281190912 00000100:00100000:0.0:1713279306.732907:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281190912 00000100:00100000:1.0:1713279306.732912:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281191040 00000100:00100000:1.0:1713279306.732913:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281191040 00000100:00100000:0.0:1713279306.732917:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785001 00000100:00100000:3.0:1713279306.732918:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110446 00000100:00100000:0.0:1713279306.732920:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3750:11851:x1796503281190912:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:3.0:1713279306.732921:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+84:1956:x1796503281190976:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:0.0:1713279306.732925:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.732929:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda7a83 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175510 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.732933:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110447 00000100:00100000:1.0:1713279306.732935:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1957:x1796503281191040:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:3.0:1713279306.732936:0:15499:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda7a8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.732946:0:15499:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935be400/0xfc4b8e114eda48a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917487c expref: 76 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.732947:0:15500:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda7a91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.732954:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012baf4900/0xfc4b8e114ed95d04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39170737 expref: 81 pid: 15539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.732956:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda7a98 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.732957:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.732958:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.732958:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.732959:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.732960:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda7a91 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.732961:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda7a98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.732961:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda7a8a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.732965:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda7a98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.732971:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda7a9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.732971:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012baf4900/0xfc4b8e114ed95d04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39170737 expref: 81 pid: 15539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.732974:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda7a9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.732975:0:15499:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800935be400/0xfc4b8e114eda48a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917487c expref: 76 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.732977:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda7a9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.732980:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012baf4900/0xfc4b8e114ed95d04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39170737 expref: 81 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.732983:0:15499:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800935be400/0xfc4b8e114eda48a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917487c expref: 76 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.732985:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114eda7aa6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.732985:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200025536:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.732989:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114eda7aa6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.732991:0:15499:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:15499:1796503200025600:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.732992:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114eda7aa6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.732997:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda7a98 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.732998:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77a80 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.733000:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda7a98 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.733002:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda7a98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.733004:0:15499:0:(client.c:2539:ptlrpc_set_wait()) set ffff880094f8ef00 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.733005:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda7a98 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.733008:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b3cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.733010:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda7a98 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.733014:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda7a98 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.733017:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00000100:00100000:1.0:1713279306.733017:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.733019:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.733020:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda7a98 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.733023:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda7a98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.733028:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda7a9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.733030:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda7a9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.733033:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda7a9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.733036:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b1b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.733037:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda7a9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.733040:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda7a9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.733043:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x36 (ffff88008e735100) 00010000:00010000:0.0:1713279306.733044:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.733045:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda7a9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.733046:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281191104 00010000:00010000:0.0:1713279306.733048:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda7a9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.733050:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281191104 00000100:00100000:1.0:1713279306.733057:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.733058:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda7a83 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175510 expref: 3752 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.733064:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114eda7aa6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175510 expref: 3751 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.733065:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110448 00000100:00100000:2.0:1713279306.733082:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+85:1956:x1796503281191104:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:0.0:1713279306.733083:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7afa:0x0].0x0 (ffff88008d729100) 00010000:00010000:0.0:1713279306.733085:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713279306.733086:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd88240, rc 0) 00000100:00100000:3.0:1713279306.733090:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281191168 00000100:00100000:3.0:1713279306.733093:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281191168 00000100:00100000:0.0:1713279306.733097:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3751:11851:x1796503281190912:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 176us (206us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.733098:0:15538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda7aad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.733101:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785001 00010000:00010000:3.0:1713279306.733102:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917541b expref: 3673 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.733108:0:15538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c90240/0xfc4b8e114ed95fa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391707ca expref: 76 pid: 15539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.733113:0:15538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1713279306.733114:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196476 00010000:00010000:2.0:1713279306.733115:0:15538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.733117:0:15538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda7aad lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.733118:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3673:1954:x1796503281191168:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.733124:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.733127:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917541b expref: 3673 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.733131:0:15538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c90240/0xfc4b8e114ed95fa4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391707ca expref: 76 pid: 15539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.733135:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917541b expref: 3673 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.733139:0:15538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c90240/0xfc4b8e114ed95fa4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391707ca expref: 76 pid: 15539 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.733148:0:15538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:15538:1796503200025664:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.733150:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda76a1 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917541b expref: 3673 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.733158:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x753e:0x0].0x0 (ffff880095b48100) 00010000:00010000:3.0:1713279306.733161:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.733165:0:15538:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800968dd540 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.733167:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.733172:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.733190:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.733204:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3672:1954:x1796503281191168:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 85us (147us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.733208:0:15752:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.733210:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196476 00010000:00010000:1.0:1713279306.733212:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000004:00200000:1.0:1713279306.733227:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x753e:0x0]: returning size 15382 00000004:00200000:1.0:1713279306.733229:0:15752:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1713279306.733231:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00010000:1.0:1713279306.733234:0:15752:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.733237:0:9197:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121535180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9197:1796503200025344:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.733238:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281191232 00010000:00010000:1.0:1713279306.733239:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.733240:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281191232 00000100:00100000:0.0:1713279306.733244:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.733248:0:9197:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda7a21 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [20480->49151] (req 20480->49151) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175502 expref: 85 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.733248:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094550d80/0xfc4b8e114ed9c540 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->57343) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172314 expref: 77 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.733250:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda79c6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754ed expref: 3387 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.733257:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754ed expref: 3386 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.733257:0:9197:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880089fe1680, rc 0) 00010000:00010000:1.0:1713279306.733261:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x753e:0x0].0x0 (ffff880095b48100) 00000100:00100000:3.0:1713279306.733261:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196477 00000100:00100000:0.0:1713279306.733263:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.733263:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.733264:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942ed00, rc 0) 00000100:00100000:3.0:1713279306.733265:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1478050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+77:1957:x1796503281191232:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.733270:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.733271:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281191424 00000100:00100000:2.0:1713279306.733272:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+85:11853:x1796503281190336:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 1065us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.733273:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281191424 00000100:00100000:1.0:1713279306.733273:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281191360 00000100:00100000:1.0:1713279306.733275:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281191360 00000100:00100000:2.0:1713279306.733277:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110443 00010000:00010000:3.0:1713279306.733278:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094550d80/0xfc4b8e114ed9c540 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->57343) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172314 expref: 77 pid: 15539 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.733284:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785002 00000100:00100000:1.0:1713279306.733286:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222991 00000100:00100000:0.0:1713279306.733287:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3388:11666:x1796503281191424:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.733289:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3388:11374:x1796503281191360:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:3.0:1713279306.733291:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094550d80/0xfc4b8e114ed9c540 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->57343) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172314 expref: 77 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.733292:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.733297:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114eda7ab4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175517 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.733302:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094550d80/0xfc4b8e114ed9c540 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->57343) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172314 expref: 77 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.733309:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.733311:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.733315:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7abb lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.733315:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda7a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175502 expref: 84 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.733320:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7abb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.733321:0:6916:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda7a21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175502 expref: 84 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.733324:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7abb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733329:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114eda7ac2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.733332:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114eda7ac2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733335:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114eda7ac2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.733335:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3390:11374:x1796503281191360:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 44us (89us total) trans 4295183618 rc 0/0 00010000:00010000:3.0:1713279306.733335:0:6916:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda7a21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175502 expref: 84 pid: 9197 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.733339:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222991 00000100:00100000:3.0:1713279306.733343:0:6916:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200025728:192.168.203.4@tcp:105: 00000100:00100000:1.0:1713279306.733353:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3389:11841:x1796503281189632:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1940us (1974us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.733356:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda7ac9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.733356:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784993 00010000:00010000:0.0:1713279306.733360:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda7ac9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00000100:00100000:3.0:1713279306.733360:0:6916:0:(client.c:2539:ptlrpc_set_wait()) set ffff880094f8e840 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.733363:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda7ac9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000004:00200000:0.0:1713279306.733388:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76b7:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.733390:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:0.0:1713279306.733396:0:15483:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda7ac9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733400:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7abb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733403:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7abb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733408:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7abb lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733431:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7abb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733434:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023ed00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.733435:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7abb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733439:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7abb lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733443:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:0.0:1713279306.733444:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.733446:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7abb lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733449:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7abb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733454:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114eda7ac2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733457:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114eda7ac2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733460:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114eda7ac2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733462:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.733463:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114eda7ac2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733469:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114eda7ac2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733472:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff88008e735c00) 00010000:00010000:0.0:1713279306.733473:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.733474:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114eda7ac2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733477:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114eda7ac2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.733487:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114eda7ab4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175517 expref: 3389 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.733493:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda7ac9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175517 expref: 3388 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.733496:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76b7:0x0].0x0 (ffff88012d067100) 00010000:00010000:0.0:1713279306.733497:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1713279306.733498:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023eac0, rc 0) 00000100:00100000:0.0:1713279306.733511:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3388:11666:x1796503281191424:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 223us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.733514:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785002 00000100:00100000:0.0:1713279306.733540:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.733550:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.733552:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281191488 00000100:00100000:2.0:1713279306.733556:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281191488 00000100:00100000:0.0:1713279306.733572:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.733576:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281191552 00000100:00100000:2.0:1713279306.733577:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110449 00000100:00100000:1.0:1713279306.733579:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281191552 00000100:00100000:2.0:1713279306.733582:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+77:1957:x1796503281191488:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:1.0:1713279306.733590:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785003 00000100:00100000:1.0:1713279306.733593:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3767:11843:x1796503281191552:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.733598:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.733604:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecfc0/0xfc4b8e114eda7ad0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7c58:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917551e expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.733619:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecfc0/0xfc4b8e114eda7ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7c58:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917551e expref: 3768 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.733624:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecfc0/0xfc4b8e114eda7ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7c58:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917551e expref: 3768 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.733631:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c58:0x0].0x0 (ffff880092139d00) 00010000:00010000:1.0:1713279306.733632:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1713279306.733634:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ecfc0, rc 0) 00002000:00010000:2.0:1713279306.733641:0:9197:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb size from disk: 15382 -> 15382 00002000:00010000:2.0:1713279306.733644:0:9197:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb mtime from disk: 1713279304 -> 1713279304 00002000:00010000:2.0:1713279306.733646:0:9197:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb atime from disk: 1713279304 -> 1713279304 00000100:00100000:1.0:1713279306.733648:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3768:11843:x1796503281191552:12345-192.168.203.4@tcp:101:touch.0 Request processed in 54us (97us total) trans 0 rc 0/0 00002000:00010000:2.0:1713279306.733648:0:9197:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.733650:0:9197:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:1.0:1713279306.733651:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785003 00000100:00100000:1.0:1713279306.733661:0:15507:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281191680 00000100:00100000:1.0:1713279306.733662:0:15507:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281191680 00000100:00100000:2.0:1713279306.733667:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+78:1957:x1796503281191488:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 84us (125us total) trans 4295010107 rc 0/0 00000100:00100000:1.0:1713279306.733670:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14329 00000100:00100000:2.0:1713279306.733672:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110449 00000100:00100000:1.0:1713279306.733673:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3751:10123:x1796503281191680:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:1.0:1713279306.733687:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.733693:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda78b5 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda786f expref: 57 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.733696:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.733708:0:15507:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda78b5 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda786f expref: 57 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.733714:0:15507:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:0.0:1713279306.733898:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.733923:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281191744 00000100:00100000:1.0:1713279306.733925:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281191744 00000100:00100000:1.0:1713279306.733941:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785004 00000100:00100000:1.0:1713279306.733944:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3672:11844:x1796503281191744:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.733950:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.733957:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114eda7ade lrc: 2/0,0 mode: --/CR res: [0x240000401:0x125:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175525 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.733973:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda7ae5 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x125:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.733977:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda7ae5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.733981:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda7ae5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000004:00200000:1.0:1713279306.733995:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x125:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.733997:0:15752:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:1.0:1713279306.734006:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114eda7ade lrc: 0/0,0 mode: --/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175525 expref: 3674 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734012:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda7ae5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175525 expref: 3673 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734016:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x125:0x0].0x0 (ffff8800960e8700) 00010000:00010000:1.0:1713279306.734017:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1713279306.734018:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312c58c0, rc 0) 00000100:00100000:1.0:1713279306.734040:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3673:11844:x1796503281191744:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 95us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.734043:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785004 00000100:00100000:0.0:1713279306.734273:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.734296:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281191872 00000100:00100000:1.0:1713279306.734299:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281191872 00000100:00100000:2.0:1713279306.734305:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.734314:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785005 00000100:00100000:1.0:1713279306.734317:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3768:11736:x1796503281191872:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.734322:0:6942:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880121536d80 x1796503200025472) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda718b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x8439:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752f5 expref: 3768 pid: 15482 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.734323:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281192000 00010000:00010000:1.0:1713279306.734324:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.734325:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281192000 00010000:00010000:1.0:1713279306.734329:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda7aec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7f37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917552c expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734332:0:6942:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda718b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x8439:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752f5 expref: 3768 pid: 15482 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.734339:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222992 00000100:00100000:2.0:1713279306.734343:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3752:11204:x1796503281192000:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:3.0:1713279306.734344:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda718b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x8439:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752f5 expref: 3769 pid: 15482 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.734353:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121536d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200025472:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.734356:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7af3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7f37:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.734361:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7af3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f37:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.734362:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8439:0x0].0x0 (ffff8800938abb00) 00010000:00010000:1.0:1713279306.734365:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7af3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f37:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.734366:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00000004:00200000:1.0:1713279306.734369:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7f37:0x0]: returning size 0 00010000:00010000:3.0:1713279306.734372:0:6942:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.734377:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.734386:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.734392:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.734394:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda7aec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7f37:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917552c expref: 3770 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734396:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.734400:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7af3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f37:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917552c expref: 3769 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734404:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f37:0x0].0x0 (ffff88008c2e7500) 00010000:00010000:1.0:1713279306.734405:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1713279306.734407:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f557840, rc 0) 00000100:00100000:1.0:1713279306.734437:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3769:11736:x1796503281191872:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 119us (164us total) trans 4295202632 rc 0/0 00000100:00100000:1.0:1713279306.734440:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785005 00000100:00100000:2.0:1713279306.734445:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3753:11204:x1796503281192000:12345-192.168.203.4@tcp:35:touch.0 Request processed in 100us (140us total) trans 4295202633 rc 0/0 00000100:00100000:2.0:1713279306.734451:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222992 00010000:00010000:3.0:1713279306.734459:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.734464:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.734469:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.734474:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68ad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.734476:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.734481:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.734481:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.734488:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8439:0x0].0x0 (ffff8800938abb00) 00010000:00010000:3.0:1713279306.734490:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1713279306.734493:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281192064 00010000:00010000:3.0:1713279306.734493:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.734496:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281192064 00010000:00010000:3.0:1713279306.734497:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda7a75 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x8439:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00000100:00100000:1.0:1713279306.734505:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.734505:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda7a67 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.734508:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110450 00010000:00010000:3.0:1713279306.734510:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda7a67 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.734512:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121536d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+82:11832:x1796503281192064:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.734515:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda7a67 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.734519:0:9197:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.734519:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.734521:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda7a67 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00000100:00100000:1.0:1713279306.734525:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200025536:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.734526:0:9197:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009181db00/0xfc4b8e114eda7b01 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175533 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734526:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda7a67 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.734532:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x233:0x0].0x0 (ffff880096d67b00) 00010000:00010000:1.0:1713279306.734533:0:15500:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda7a91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734533:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.734534:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.734535:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda7a67 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.734540:0:9197:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda47ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174836 expref: 76 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734540:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda7a67 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00000100:00100000:1.0:1713279306.734542:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281192192 00000100:00100000:0.0:1713279306.734543:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.734544:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281192192 00010000:00010000:2.0:1713279306.734546:0:9197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.734547:0:9197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1713279306.734549:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281192256 00010000:00010000:2.0:1713279306.734550:0:9197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009181db00/0xfc4b8e114eda7b01 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [12288->36863] (req 12288->36863) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175533 expref: 83 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734551:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7a52 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.734552:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281192256 00000100:00100000:1.0:1713279306.734556:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785006 00010000:00010000:3.0:1713279306.734556:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7a52 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00000100:00100000:1.0:1713279306.734558:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3769:11711:x1796503281192192:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.734560:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012baf4900/0xfc4b8e114ed95d04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39170737 expref: 84 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.734561:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7a52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.734564:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.734564:0:9197:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda47ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174836 expref: 76 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734566:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7a52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.734569:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281192320 00010000:00010000:1.0:1713279306.734569:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda7b08 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917553a expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734570:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131f3f3c0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.734571:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281192320 00010000:00010000:2.0:1713279306.734572:0:9197:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda47ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174836 expref: 76 pid: 15519 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.734572:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7a52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.734575:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800935be400/0xfc4b8e114eda48a3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917487c expref: 78 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.734577:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7a52 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.734581:0:9197:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121535180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9197:1796503200025856:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.734582:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196478 00010000:00010000:3.0:1713279306.734582:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.734584:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.734585:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+84:1957:x1796503281192256:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.734586:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7a52 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.734589:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.734591:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7a52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.734596:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012baf4900/0xfc4b8e114ed95d04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1835008->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39170737 expref: 84 pid: 15539 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.734596:0:9197:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800968dd000 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.734598:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda7a60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.734601:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012baf4900/0xfc4b8e114ed95d04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1835008->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39170737 expref: 84 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.734602:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda7a60 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.734605:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda7b0f lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.734607:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda7a60 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.734609:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda7b0f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.734610:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012baf4900/0xfc4b8e114ed95d04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1835008->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39170737 expref: 84 pid: 15539 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.734612:0:15538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:15538:1796503200025664:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.734612:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68aac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.734613:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda7b0f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.734614:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda7a60 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.734616:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.734617:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.734619:0:15557:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda7a91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734619:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda7b16 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.734619:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda7a60 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.734622:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda7b16 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.734622:0:15538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda7aad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734625:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda7b16 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.734625:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3531 (ffff8800937ce400) 00010000:00010000:0.0:1713279306.734627:0:15557:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda7a91 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734627:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.734629:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda7a60 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00000004:00200000:1.0:1713279306.734633:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:3.0:1713279306.734634:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda7a60 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.734635:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.734637:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda7b0f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.734639:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda7b0f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.734643:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda7b0f lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.734645:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.734646:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281192256:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 60us (113us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.734646:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda7b0f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.734649:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938fcfc0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.734650:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196478 00010000:00010000:1.0:1713279306.734650:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda7b0f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.734650:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.734653:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda7b0f lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.734655:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.734657:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196479 00010000:00010000:1.0:1713279306.734657:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8800960e8a00) 00000100:00100000:2.0:1713279306.734657:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.734658:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.734659:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+78:1957:x1796503281192320:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.734659:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda7b0f lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.734659:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097887cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.734661:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.734662:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda7b0f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.734663:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.734666:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.734667:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800935be400/0xfc4b8e114eda48a3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917487c expref: 78 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.734667:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda7b16 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.734670:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda7b16 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.734672:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800935be400/0xfc4b8e114eda48a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917487c expref: 78 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.734673:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda7b16 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.734673:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.734675:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091805440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.734675:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.734677:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda7b16 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.734678:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda78b5 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda786f expref: 57 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.734679:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.734679:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.734681:0:15557:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda7a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734682:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda7b16 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.734685:0:15557:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda7a8a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734685:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff8800960e8f00) 00010000:00010000:3.0:1713279306.734685:0:6942:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda78b5 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda786f expref: 57 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734686:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.734687:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda7b16 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.734690:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda7b16 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.734691:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.734691:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda78b5 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda786f expref: 57 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734697:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:0.0:1713279306.734698:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+78:1957:x1796503281192320:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 39us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.734702:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196479 00010000:00010000:1.0:1713279306.734702:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda7b08 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917553a expref: 3770 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.734705:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.734706:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281192384 00010000:00010000:1.0:1713279306.734706:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda7b08 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917553a expref: 3770 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.734708:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281192384 00010000:00010000:1.0:1713279306.734711:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b25440, rc 0) 00010000:00010000:3.0:1713279306.734711:0:6942:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda78b5 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda786f expref: 57 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.734712:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c90240/0xfc4b8e114ed95fa4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391707ca expref: 78 pid: 15539 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.734720:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c0a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200025920:0@lo:105: 00000100:00100000:1.0:1713279306.734723:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3769:11711:x1796503281192192:12345-192.168.203.4@tcp:101:touch.0 Request processed in 164us (219us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.734727:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196480 00000100:00100000:1.0:1713279306.734727:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785006 00000100:00100000:0.0:1713279306.734730:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+78:1954:x1796503281192384:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.734733:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.734737:0:15500:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda7a91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.734738:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c90240/0xfc4b8e114ed95fa4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391707ca expref: 78 pid: 15539 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.734740:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.734742:0:15500:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda7a91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.734743:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c90240/0xfc4b8e114ed95fa4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391707ca expref: 78 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.734749:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c90240/0xfc4b8e114ed95fa4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391707ca expref: 78 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.734749:0:15500:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda7a91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.734750:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75f6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.734755:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.734756:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.734756:0:15500:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda7a91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.734757:0:15557:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda7aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.734759:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281192448 00010000:00010000:1.0:1713279306.734760:0:15500:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda7a91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.734761:0:15557:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda7aad lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.734762:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281192448 00010000:00010000:1.0:1713279306.734763:0:15500:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ec900 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:1.0:1713279306.734764:0:15500:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda7a91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734768:0:15500:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda7a91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.734771:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.734774:0:15500:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda7a91 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734777:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda7a91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x111a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.734779:0:15538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda7aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.734779:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110451 00000100:00100000:0.0:1713279306.734781:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+77:1954:x1796503281192384:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 50us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.734784:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+85:1957:x1796503281192448:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:0.0:1713279306.734785:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196480 00010000:00010000:2.0:1713279306.734786:0:15538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda7aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.734794:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1957:x1796503281191040:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 1858us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.734797:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110447 00010000:00010000:2.0:1713279306.734797:0:15538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda7aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.734804:0:15538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda7aad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.734806:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200025920 00000100:00100000:1.0:1713279306.734808:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200025920 00010000:00010000:2.0:1713279306.734810:0:15538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda7aad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.734815:0:15538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181ed00 already unused, calling callback (ffffffffa085fb20) 00000100:00100000:1.0:1713279306.734817:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33426 00010000:00010000:2.0:1713279306.734818:0:15538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda7aad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.734820:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6942:x1796503200025920:12345-0@lo:105: 00010000:00010000:1.0:1713279306.734824:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.734824:0:15538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda7aad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734829:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713279306.734830:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000400:0xf84:0x0] updating lvb size from disk: 0 -> 2490368 00010000:00010000:1.0:1713279306.734833:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713279306.734833:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xf84:0x0] updating lvb mtime from disk: 1713279289 -> 1713279305 00010000:00010000:2.0:1713279306.734834:0:15538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda7aad lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713279306.734835:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000400:0xf84:0x0] updating lvb atime from disk: 1713279289 -> 1713279305 00010000:00010000:1.0:1713279306.734837:0:9213:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713279306.734837:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000400:0xf84:0x0] updating lvb ctime from disk: 1713279289 -> 1713279305 00002000:00010000:3.0:1713279306.734839:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000400:0xf84:0x0] updating lvb blocks from disk: 0 -> 4864 00010000:00010000:1.0:1713279306.734840:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734843:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.734844:0:15538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda7aad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x112f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734847:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734854:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800923433c0) 00000100:00100000:3.0:1713279306.734858:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1957:x1796503281192448:12345-192.168.203.4@tcp:2:touch.0 Request processed in 74us (152us total) trans 4295010108 rc 0/0 00000100:00100000:3.0:1713279306.734867:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110451 00000100:00100000:2.0:1713279306.734868:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1956:x1796503281191104:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 1798us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.734870:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6942:x1796503200025920:12345-0@lo:105: Request processed in 49us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.734873:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33426 00000100:00100000:2.0:1713279306.734873:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110448 00010000:00010000:2.0:1713279306.734885:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734890:0:15499:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935be400/0xfc4b8e114eda48a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917487c expref: 76 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.734892:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.734898:0:15499:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:15499:1796503200025600:192.168.203.4@tcp:104: 00000004:00080000:2.0:1713279306.734904:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1713279306.734906:0:15499:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda7a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734912:0:15499:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda7a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734918:0:15499:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda7a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.734926:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200025984:0@lo:1000:mdt_io00_007.0 00010000:00010000:3.0:1713279306.734927:0:15499:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda7a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.734933:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.734933:0:15499:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda7a8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734939:0:15499:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda7a8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.734940:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281192704 00000100:00100000:1.0:1713279306.734942:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281192704 00010000:00010000:3.0:1713279306.734945:0:15499:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688fc0 already unused, calling callback (ffffffffa085fb20) 00000100:00100000:2.0:1713279306.734946:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.734947:0:15499:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda7a8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.734951:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785007 00000100:00100000:1.0:1713279306.734954:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3769:11870:x1796503281192704:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:2.0:1713279306.734956:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549e40 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.734958:0:15499:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda7a8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.734960:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.734961:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.734965:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda7b1d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917554f expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.734965:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200025984 00000100:00100000:2.0:1713279306.734968:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200025984 00010000:00010000:3.0:1713279306.734968:0:15499:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda7a8a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.734973:0:15499:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda7a8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1124:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.734984:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98684 00000100:00100000:2.0:1713279306.734988:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+58:15514:x1796503200025984:12345-0@lo:1000:mdt_io00_007.0 00010000:00010000:1.0:1713279306.734996:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda7b24 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.735000:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda7b24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.735002:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+84:1956:x1796503281190976:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 2079us (2117us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.735004:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda7b24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.735007:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110446 00010000:00010000:1.0:1713279306.735010:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7b2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.735013:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.735017:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.735028:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+58:15514:x1796503200025984:12345-0@lo:1000:mdt_io00_007.0 Request processed in 39us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.735028:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c0a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200025920:0@lo:105: 00000100:00100000:2.0:1713279306.735034:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98684 00010000:00010000:3.0:1713279306.735037:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.735043:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda7711 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6942 initiator: MDT0 00000004:00200000:1.0:1713279306.735045:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x863c:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.735049:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda7b24 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000004:00020000:3.0:1713279306.735050:0:6942:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200000402:0x2:0x0]/15 failed: rc = -114 00000100:00100000:2.0:1713279306.735051:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200025984:0@lo:1000:mdt_io00_007.0 00010000:00010000:1.0:1713279306.735052:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda7b24 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.735055:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda7b24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.735058:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda7b24 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.735063:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e5f5200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.735065:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda7b24 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000004:00080000:2.0:1713279306.735066:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000403:0x863c:0x0] 00010000:00010000:1.0:1713279306.735083:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda7b24 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.735087:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.735089:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.735089:0:6942:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:385c4b71-808c-40cf-91de-b076b668d13f+3770:11830:x1796503281184832:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 15096us (15234us total) trans 0 rc -114/-114 00010000:00010000:1.0:1713279306.735090:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda7b24 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.735093:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda7b24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.735095:0:6942:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14327 00000100:00100000:2.0:1713279306.735097:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200026048:0@lo:1000:mdt_io00_007.0 00010000:00010000:1.0:1713279306.735099:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.735101:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7b2b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.735104:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7b2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.735107:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092542880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.735108:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7b2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.735111:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7b2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.735114:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3131 (ffff8800960e8300) 00010000:00010000:1.0:1713279306.735115:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.735116:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.735117:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7b2b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.735119:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda7b2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.735125:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012edd9900 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.735130:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200026048 00010000:00010000:1.0:1713279306.735131:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda7b1d lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917554f expref: 3769 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.735132:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200026048 00010000:00010000:1.0:1713279306.735135:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda7b1d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917554f expref: 3769 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.735140:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ad686c0, rc 0) 00000100:00100000:3.0:1713279306.735145:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98685 00000100:00100000:3.0:1713279306.735149:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+58:15514:x1796503200026048:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.735155:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3768:11870:x1796503281192704:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 200us (222us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.735159:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785007 00000100:00100000:1.0:1713279306.735165:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281192896 00000100:00100000:1.0:1713279306.735167:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281192896 00000100:00100000:1.0:1713279306.735175:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785008 00000100:00100000:1.0:1713279306.735177:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3388:11851:x1796503281192896:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.735182:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.735186:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+58:15514:x1796503200026048:12345-0@lo:1000:mdt_io00_007.0 Request processed in 36us (69us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.735187:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda7b32 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175556 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.735192:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98685 00000100:00100000:2.0:1713279306.735198:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200026048:0@lo:1000:mdt_io00_007.0 00000004:00200000:1.0:1713279306.735211:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7afa:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.735218:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda7b32 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175556 expref: 3389 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.735223:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda7b32 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175556 expref: 3389 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.735229:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092541b00, rc 0) 00000100:00100000:1.0:1713279306.735243:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3388:11851:x1796503281192896:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 65us (283us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.735246:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785008 00000100:00100000:1.0:1713279306.735275:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.735285:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281192512 00000100:00100000:1.0:1713279306.735285:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.735288:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281192512 00000100:00100000:1.0:1713279306.735293:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.735300:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281192576 00000100:00100000:0.0:1713279306.735301:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281192576 00000100:00100000:3.0:1713279306.735304:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281192768 00000100:00100000:3.0:1713279306.735307:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281192768 00000100:00100000:0.0:1713279306.735308:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785009 00000100:00100000:0.0:1713279306.735311:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3673:11839:x1796503281192512:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.735315:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785010 00010000:00010000:0.0:1713279306.735316:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.735318:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3388:11374:x1796503281192576:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.735322:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d200/0xfc4b8e114eda7b39 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7d80:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175541 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.735322:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147218 00010000:00010000:1.0:1713279306.735325:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.735325:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3753:1956:x1796503281192768:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.735330:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092541d40/0xfc4b8e114eda7b40 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175548 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.735331:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.735336:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d200/0xfc4b8e114eda7b39 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7d80:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175541 expref: 3674 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.735339:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114eda7aa6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175510 expref: 3753 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.735342:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d200/0xfc4b8e114eda7b39 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7d80:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175541 expref: 3674 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.735347:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7b47 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.735347:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7afa:0x0].0x0 (ffff88008d729100) 00010000:00010000:0.0:1713279306.735348:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d80:0x0].0x0 (ffff88008e735000) 00010000:00010000:0.0:1713279306.735349:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713279306.735349:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.735351:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023d200, rc 0) 00010000:00010000:1.0:1713279306.735352:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7b47 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.735356:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7b47 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.735361:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda7b4e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:0.0:1713279306.735365:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3674:11839:x1796503281192512:12345-192.168.203.4@tcp:101:touch.0 Request processed in 53us (88us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.735365:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda7b4e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00000100:00100000:3.0:1713279306.735366:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3752:1956:x1796503281192768:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 38us (70us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.735368:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda7b4e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.735369:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785009 00000100:00100000:3.0:1713279306.735371:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147218 00010000:00010000:1.0:1713279306.735381:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7b47 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.735384:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7b47 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.735387:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7b47 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.735389:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7b47 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00000100:00100000:3.0:1713279306.735389:0:6916:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200025728:192.168.203.4@tcp:105: 00010000:00010000:1.0:1713279306.735392:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925433c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.735393:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7b47 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.735395:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.735396:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7b47 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.735400:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012514dc00) 00010000:00010000:1.0:1713279306.735401:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.735402:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7b47 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.735405:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda7b47 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00000100:00100000:3.0:1713279306.735407:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1478050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+75:1957:x1796503281191232:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 2142us (2177us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.735410:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda7b4e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.735428:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda7b4e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.735431:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda7b4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00000100:00100000:3.0:1713279306.735432:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196477 00010000:00010000:1.0:1713279306.735434:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.735436:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda7b4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.735439:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda7b4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.735442:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3531 (ffff8800909b0e00) 00010000:00010000:1.0:1713279306.735443:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.735444:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda7b4e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.735447:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda7b4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.735457:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092541d40/0xfc4b8e114eda7b40 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175548 expref: 3389 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.735461:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092541d40/0xfc4b8e114eda7b40 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175548 expref: 3389 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.735465:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092541d40, rc 0) 00000100:00100000:1.0:1713279306.735480:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3388:11374:x1796503281192576:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 161us (195us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.735484:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785010 00000100:00100000:2.0:1713279306.735616:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200026112:0@lo:403:mdt_io00_007.0 00000100:00100000:2.0:1713279306.735634:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.735650:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800968dd540 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.735664:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200026112 00000100:00100000:3.0:1713279306.735667:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200026112 00000100:00100000:3.0:1713279306.735680:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98686 00000100:00100000:3.0:1713279306.735684:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+58:15514:x1796503200026112:12345-0@lo:403:mdt_io00_007.0 00000100:00100000:0.0:1713279306.735813:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.735833:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.735841:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281193024 00000100:00100000:1.0:1713279306.735843:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281193024 00000100:00100000:0.0:1713279306.735844:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281193152 00000100:00100000:0.0:1713279306.735847:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281193152 00000100:00100000:1.0:1713279306.735859:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785011 00000100:00100000:1.0:1713279306.735862:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3768:11856:x1796503281193024:12345-192.168.203.4@tcp:36:touch.0 00000100:00100000:0.0:1713279306.735863:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785012 00000100:00100000:0.0:1713279306.735866:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3388:11666:x1796503281193152:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.735872:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.735877:0:15753:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.735884:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda7956 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x824e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754b5 expref: 3768 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.735890:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x824e:0x0].0x0 (ffff88009588ce00) 00010000:00010000:1.0:1713279306.735891:0:15753:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.735912:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114eda7b5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x824e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.735916:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114eda7b5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x824e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.735917:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda7b55 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917555d expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.735920:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114eda7b5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x824e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.735941:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114eda7b63 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.735945:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114eda7b63 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000004:00010000:1.0:1713279306.735945:0:15753:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012ee30380 reply state ffff880095771000 transno 4295202634 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114eda7b5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x824e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.735949:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114eda7b63 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.735949:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114eda7b5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x824e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.735952:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x824e:0x0].0x0 (ffff88009588ce00) 00010000:00010000:1.0:1713279306.735954:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.735955:0:15753:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.735956:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7b6a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.735960:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7b6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.735963:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7b6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.735979:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3769:11856:x1796503281193024:12345-192.168.203.4@tcp:36:touch.0 Request processed in 115us (166us total) trans 4295202634 rc 0/0 00000100:00100000:1.0:1713279306.735982:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785011 00000100:00100000:1.0:1713279306.736005:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00200000:0.0:1713279306.736006:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x6e09:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.736026:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114eda7b63 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.736029:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114eda7b63 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.736032:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114eda7b63 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.736038:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114eda7b63 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.736039:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281193792 00010000:00010000:0.0:1713279306.736041:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.736042:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114eda7b63 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.736042:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281193792 00010000:00010000:0.0:1713279306.736045:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114eda7b63 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.736050:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff88007fcb8a00) 00010000:00010000:0.0:1713279306.736051:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.736053:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114eda7b63 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.736053:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785013 00010000:00010000:0.0:1713279306.736055:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114eda7b63 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.736056:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3391:11204:x1796503281193792:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.736060:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7b6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.736062:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.736063:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7b6a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.736066:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7b6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.736080:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda7b78 lrc: 2/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917556b expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.736102:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114eda7b7f lrc: 3/1,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.736106:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114eda7b7f lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736110:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114eda7b7f lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736115:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda7b86 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.736119:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda7b86 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736122:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda7b86 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736134:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114eda7b7f lrc: 4/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736137:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114eda7b7f lrc: 4/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736139:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114eda7b7f lrc: 3/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736143:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114eda7b7f lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736148:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094e34b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.736149:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114eda7b7f lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736152:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114eda7b7f lrc: 5/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736156:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xff:0x0].0x0 (ffff880091de1a00) 00010000:00010000:1.0:1713279306.736157:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.736159:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114eda7b7f lrc: 3/0,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736161:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114eda7b7f lrc: 0/0,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736166:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda7b86 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.736169:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023cfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.736169:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda7b86 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.736171:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7b6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.736172:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda7b86 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736174:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a5f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.736175:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7b6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.736176:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda7b86 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736179:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda7b86 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.736182:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x3131 (ffff880096b90f00) 00010000:00010000:1.0:1713279306.736182:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xff:0x0].0x3731 (ffff88008d597700) 00010000:00010000:1.0:1713279306.736183:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.736184:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.736184:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda7b86 lrc: 2/0,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.736185:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7b6a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.736187:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda7b86 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.736188:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7b6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.736197:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda7b78 lrc: 1/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917556b expref: 3392 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.736201:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda7b78 lrc: 0/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917556b expref: 3392 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.736205:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda7b55 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917555d expref: 3391 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.736205:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e35f80, rc 0) 00010000:00010000:0.0:1713279306.736209:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda7b55 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917555d expref: 3391 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.736211:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.736214:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023dd40, rc 0) 00000100:00100000:1.0:1713279306.736220:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3390:11204:x1796503281193792:12345-192.168.203.4@tcp:101:touch.0 Request processed in 163us (215us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.736224:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785013 00000100:00100000:0.0:1713279306.736227:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3390:11666:x1796503281193152:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 361us (395us total) trans 4295183619 rc 301/301 00000100:00100000:0.0:1713279306.736232:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785012 00000100:00100000:1.0:1713279306.736246:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.736254:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.736258:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281193344 00000100:00100000:2.0:1713279306.736262:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281193344 00000100:00100000:1.0:1713279306.736263:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.736268:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281193536 00000100:00100000:1.0:1713279306.736269:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281193216 00000100:00100000:0.0:1713279306.736270:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281193536 00000100:00100000:1.0:1713279306.736271:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281193216 00000100:00100000:1.0:1713279306.736278:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281193408 00000100:00100000:1.0:1713279306.736279:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281193408 00000100:00100000:2.0:1713279306.736280:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222993 00000100:00100000:0.0:1713279306.736284:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222994 00000100:00100000:2.0:1713279306.736285:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3674:11842:x1796503281193344:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:1.0:1713279306.736286:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110452 00000100:00100000:0.0:1713279306.736287:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3752:11827:x1796503281193536:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:1.0:1713279306.736289:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281193216:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:1.0:1713279306.736300:0:15519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7b8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.736307:0:15519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801245b6400/0xfc4b8e114ed9c850 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391723e6 expref: 75 pid: 15539 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713279306.736316:0:15519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800926b0240/0xfc4b8e114ed9dfdb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a3e expref: 83 pid: 15538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713279306.736320:0:15519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131f3c240/0xfc4b8e114ed9e0d0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172ab5 expref: 83 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713279306.736323:0:15519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.736324:0:15519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.736325:0:15519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7b8d lrc: 6/0,1 mode: --/PW res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.736335:0:15519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131f3c240/0xfc4b8e114ed9e0d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172ab5 expref: 83 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713279306.736340:0:15519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131f3c240/0xfc4b8e114ed9e0d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172ab5 expref: 83 pid: 15519 timeout: 509 lvb_type: 1 00000100:00100000:1.0:1713279306.736346:0:15519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15519:1796503200026176:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.736352:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3753:11827:x1796503281193536:12345-192.168.203.4@tcp:35:touch.0 Request processed in 64us (96us total) trans 4295202635 rc 0/0 00000100:00100000:0.0:1713279306.736356:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222994 00010000:00010000:1.0:1713279306.736362:0:15519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800926b0240/0xfc4b8e114ed9dfdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a3e expref: 83 pid: 15538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713279306.736367:0:15519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800926b0240/0xfc4b8e114ed9dfdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a3e expref: 83 pid: 15538 timeout: 509 lvb_type: 1 00000100:00100000:1.0:1713279306.736371:0:15519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15519:1796503200026240:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.736383:0:15519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801245b6400/0xfc4b8e114ed9c850 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391723e6 expref: 75 pid: 15539 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713279306.736383:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3675:11842:x1796503281193344:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 96us (135us total) trans 4295183620 rc 0/0 00010000:00010000:1.0:1713279306.736388:0:15519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801245b6400/0xfc4b8e114ed9c850 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391723e6 expref: 75 pid: 15539 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.736390:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222993 00000100:00100000:1.0:1713279306.736393:0:15519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15519:1796503200026304:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.736399:0:15519:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77300 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.736408:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110453 00000100:00100000:2.0:1713279306.736433:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+84:1956:x1796503281193408:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.736439:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.736440:0:15538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.736448:0:15538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009181c480/0xfc4b8e114eda7b94 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x105e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175564 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.736450:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281193600 00000100:00100000:0.0:1713279306.736453:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281193600 00000100:00100000:1.0:1713279306.736455:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.736463:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110454 00000100:00100000:1.0:1713279306.736464:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.736465:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+75:1956:x1796503281193600:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:1.0:1713279306.736473:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.736473:0:15538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:15538:1796503200026368:192.168.203.4@tcp:106: 00000100:00100000:1.0:1713279306.736481:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.736488:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281194112 00000100:00100000:2.0:1713279306.736489:0:15538:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012edd9900 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.736490:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281194112 00000100:00100000:1.0:1713279306.736500:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110455 00000100:00100000:1.0:1713279306.736502:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1957:x1796503281194112:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:2.0:1713279306.736504:0:9197:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121535180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9197:1796503200025856:192.168.203.4@tcp:104: 00002000:00010000:0.0:1713279306.736509:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000400:0xf82:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1713279306.736511:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xf82:0x0] updating lvb mtime from disk: 1713279288 -> 1713279305 00002000:00010000:0.0:1713279306.736512:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000400:0xf82:0x0] updating lvb atime from disk: 1713279288 -> 1713279305 00002000:00010000:0.0:1713279306.736514:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000400:0xf82:0x0] updating lvb ctime from disk: 1713279288 -> 1713279305 00010000:00010000:2.0:1713279306.736514:0:9197:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009181db00/0xfc4b8e114eda7b01 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [12288->36863] (req 12288->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175533 expref: 83 pid: 9197 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713279306.736515:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000400:0xf82:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1713279306.736522:0:9197:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009181db00, rc 0) 00000100:00100000:0.0:1713279306.736528:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+76:1956:x1796503281193600:12345-192.168.203.4@tcp:2:touch.0 Request processed in 61us (88us total) trans 4295010109 rc 0/0 00000100:00100000:0.0:1713279306.736532:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110454 00000100:00100000:2.0:1713279306.736533:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121536d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+83:11832:x1796503281192064:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 2020us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.736538:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110450 00002000:00010000:1.0:1713279306.736546:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb size from disk: 3214 -> 3214 00002000:00010000:1.0:1713279306.736548:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb mtime from disk: 1713279304 -> 1713279304 00002000:00010000:1.0:1713279306.736550:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb atime from disk: 1713279299 -> 1713279299 00002000:00010000:1.0:1713279306.736551:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb ctime from disk: 1713279304 -> 1713279304 00002000:00010000:1.0:1713279306.736552:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1713279306.736563:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+87:1957:x1796503281194112:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 59us (80us total) trans 4295010110 rc 0/0 00000100:00100000:1.0:1713279306.736567:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110455 00000100:00100000:2.0:1713279306.736590:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.736602:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281194368 00000100:00100000:1.0:1713279306.736603:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.736604:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281194368 00000100:00100000:0.0:1713279306.736611:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281193920 00000100:00100000:0.0:1713279306.736614:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281193920 00000100:00100000:1.0:1713279306.736614:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.736617:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222995 00000100:00100000:2.0:1713279306.736620:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c56a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3770:11830:x1796503281194368:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1713279306.736622:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281194240 00000100:00100000:0.0:1713279306.736624:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281194240 00000100:00100000:1.0:1713279306.736628:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.736631:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281194432 00000100:00100000:0.0:1713279306.736633:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281194432 00000100:00100000:0.0:1713279306.736638:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281194624 00000100:00100000:0.0:1713279306.736639:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281194624 00000100:00100000:2.0:1713279306.736643:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c56a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3770:11830:x1796503281194368:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 22us (54us total) trans 0 rc -116/-116 00000100:00100000:1.0:1713279306.736644:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.736648:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222995 00000100:00100000:1.0:1713279306.736655:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785014 00000100:00100000:1.0:1713279306.736658:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3769:11844:x1796503281193920:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:2.0:1713279306.736673:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785015 00000100:00100000:2.0:1713279306.736677:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3390:11833:x1796503281194240:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.736683:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.736688:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785016 00010000:00010000:2.0:1713279306.736689:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114eda7b9b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175572 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.736691:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3390:11374:x1796503281194432:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.736691:0:15753:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d306a00 pname:cluuid:pid:xid:nid:opc:job mdt00_035:lustre-MDT0000-mdtlov_UUID:15753:1796503200026432:0@lo:1000:mdt00_035.0 00010000:00010000:0.0:1713279306.736697:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.736703:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda7ba2 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175579 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.736707:0:15753:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.736713:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda7ba9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.736714:0:15753:0:(client.c:2539:ptlrpc_set_wait()) set ffff880130637840 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.736719:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda7ba9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.736720:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200026432 00010000:00010000:0.0:1713279306.736721:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda7bb0 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.736722:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200026432 00010000:00010000:0.0:1713279306.736726:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda7bb0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.736728:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda7ba9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.736732:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda7bb0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.736735:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98687 00010000:00010000:2.0:1713279306.736736:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda7bb7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.736737:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:15753:x1796503200026432:12345-0@lo:1000:mdt00_035.0 00010000:00010000:0.0:1713279306.736739:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda7bbe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.736741:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda7bb7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.736742:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda7bbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.736746:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda7bbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.736746:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda7bb7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.736768:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7bc5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.736769:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:15753:x1796503200026432:12345-0@lo:1000:mdt00_035.0 Request processed in 31us (62us total) trans 0 rc 1/1 00010000:00010000:2.0:1713279306.736770:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda7ba9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.736771:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7bc5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.736773:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98687 00010000:00010000:2.0:1713279306.736774:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda7ba9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.736775:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7bc5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.736778:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda7ba9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.736783:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda7ba9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.736786:0:15753:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d306a00 pname:cluuid:pid:xid:nid:opc:job mdt00_035:lustre-MDT0000-mdtlov_UUID:15753:1796503200026432:0@lo:1000:mdt00_035.0 00010000:00010000:2.0:1713279306.736786:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ea5f180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.736789:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda7ba9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.736793:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda7ba9 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00000004:00200000:0.0:1713279306.736798:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76da:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.736798:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00000004:00200000:0.0:1713279306.736800:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1713279306.736801:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.736803:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda7ba9 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000004:00010000:0.0:1713279306.736805:0:15483:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7bc5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.736806:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3769:11844:x1796503281193920:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 147us (342us total) trans 0 rc -17/-17 00010000:00010000:2.0:1713279306.736807:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda7ba9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.736809:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda7bb0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.736809:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785014 00010000:00010000:0.0:1713279306.736812:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda7bb0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.736814:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda7bb7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.736815:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda7bb0 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.736816:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785017 00000100:00100000:1.0:1713279306.736818:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3675:11711:x1796503281194624:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.736818:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda7bb7 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.736821:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda7bb0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.736822:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda7bb7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.736823:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.736824:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023e880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.736825:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda7bb0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.736825:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.736827:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda7bb7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.736828:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda7bb0 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.736829:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda7bcc lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175580 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.736831:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda7bb7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.736832:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00010000:00010000:0.0:1713279306.736834:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.736835:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda7bb0 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.736836:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3631 (ffff880097622200) 00010000:00010000:0.0:1713279306.736838:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda7bb0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.736838:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.736839:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda7bb7 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.736843:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda7bbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.736843:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda7bb7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.736846:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda7bbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.736849:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda7bbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.736849:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7bd3 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.736851:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096a2fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.736852:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda7bbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.736853:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7bd3 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.736855:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda7bbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.736857:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7bd3 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.736858:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114eda7b9b lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175572 expref: 3392 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.736861:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x3531 (ffff88012514d700) 00010000:00010000:0.0:1713279306.736862:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.736862:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7bda lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.736863:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda7bbe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.736864:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114eda7b9b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175572 expref: 3392 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.736865:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7bda lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.736866:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda7bbe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.736868:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7bda lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.736870:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009181ef40, rc 0) 00010000:00010000:0.0:1713279306.736876:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda7ba2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175579 expref: 3392 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.736879:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7bd3 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.736882:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7bc5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175579 expref: 3391 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.736882:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7bd3 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.736882:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3391:11833:x1796503281194240:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 204us (278us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.736885:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76da:0x0].0x0 (ffff88012514d600) 00010000:00010000:1.0:1713279306.736885:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7bd3 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.736887:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:2.0:1713279306.736887:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785015 00010000:00010000:0.0:1713279306.736888:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009435e880, rc 0) 00010000:00010000:1.0:1713279306.736888:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7bd3 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736890:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a5b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.736892:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7bd3 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736897:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7bd3 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.736898:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3390:11374:x1796503281194432:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 206us (283us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.736901:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88008c2e7e00) 00000100:00100000:0.0:1713279306.736902:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785016 00010000:00010000:1.0:1713279306.736902:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.736903:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7bd3 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736906:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7bd3 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736911:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7bda lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736913:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7bda lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736916:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7bda lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.736918:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281194496 00010000:00010000:1.0:1713279306.736919:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a4b40 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.736920:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281194496 00010000:00010000:1.0:1713279306.736920:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7bda lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736923:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7bda lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736926:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88008eb46900) 00010000:00010000:1.0:1713279306.736927:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.736928:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7bda lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.736933:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7bda lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.736936:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110456 00000100:00100000:0.0:1713279306.736938:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281194496:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:1.0:1713279306.736943:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda7bcc lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175580 expref: 3676 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.736948:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda7bcc lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175580 expref: 3676 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.736952:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.736953:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4a4d80, rc 0) 00000100:00100000:1.0:1713279306.736966:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3675:11711:x1796503281194624:12345-192.168.203.4@tcp:101:touch.0 Request processed in 147us (338us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.736969:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785017 00000100:00100000:1.0:1713279306.736975:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281194752 00000100:00100000:1.0:1713279306.736976:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281194752 00000100:00100000:3.0:1713279306.736981:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+58:15514:x1796503200026112:12345-0@lo:403:mdt_io00_007.0 Request processed in 1295us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.736985:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785018 00000100:00100000:1.0:1713279306.736987:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3675:11873:x1796503281194752:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:3.0:1713279306.736988:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98686 00000100:00100000:2.0:1713279306.736990:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200026112:0@lo:403:mdt_io00_007.0 00000100:00100000:0.0:1713279306.736992:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+84:1956:x1796503281194496:12345-192.168.203.4@tcp:2:touch.0 Request processed in 53us (347us total) trans 4295010166 rc 0/0 00010000:00010000:1.0:1713279306.736992:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.736996:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110456 00010000:00010000:1.0:1713279306.736996:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda7be1 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175587 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.737010:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281193664 00000100:00100000:3.0:1713279306.737012:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281193664 00010000:00010000:1.0:1713279306.737017:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda7be8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.737021:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda47ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174836 expref: 76 pid: 15519 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.737022:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.737022:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda7be8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.737025:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda7be8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.737031:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7bef lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:3.0:1713279306.737034:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196481 00010000:00010000:1.0:1713279306.737035:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7bef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.737038:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.737038:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7bef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:3.0:1713279306.737038:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1957:x1796503281193664:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.737044:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.737045:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281194944 00010000:00010000:1.0:1713279306.737045:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda7bf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6672:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:0.0:1713279306.737047:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281194944 00010000:00010000:1.0:1713279306.737049:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda7bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6672:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.737051:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda47ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174836 expref: 76 pid: 15519 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.737052:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda7bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6672:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.737056:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785019 00010000:00010000:1.0:1713279306.737056:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda7be8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.737059:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3769:11856:x1796503281194944:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.737059:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda7be8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.737059:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda47ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174836 expref: 76 pid: 15519 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.737062:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda7be8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.737064:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.737064:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda7be8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.737067:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134927180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.737083:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda7be8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.737083:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda47ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174836 expref: 76 pid: 15519 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.737084:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009435c900/0xfc4b8e114eda7bfd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x824e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917558e expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.737087:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda7be8 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.737091:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.737093:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:3.0:1713279306.737093:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.737094:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.737096:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda7be8 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.737097:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009181db00/0xfc4b8e114eda7b01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175533 expref: 83 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.737099:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009435c900/0xfc4b8e114eda7bfd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x824e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917558e expref: 3770 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.737099:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda7be8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.737103:0:6916:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009181db00/0xfc4b8e114eda7b01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175533 expref: 83 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.737104:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009435c900/0xfc4b8e114eda7bfd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x824e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917558e expref: 3770 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.737104:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7bef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.737107:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7bef lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.737110:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7bef lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.737111:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x824e:0x0].0x0 (ffff88009588ce00) 00010000:00010000:0.0:1713279306.737112:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1713279306.737112:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094550fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.737113:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009435c900, rc 0) 00010000:00010000:1.0:1713279306.737113:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7bef lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.737116:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7bef lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.737117:0:6916:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009181db00/0xfc4b8e114eda7b01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175533 expref: 83 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.737119:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x32 (ffff880096b8ef00) 00010000:00010000:1.0:1713279306.737120:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.737121:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7bef lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.737122:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3770:11856:x1796503281194944:12345-192.168.203.4@tcp:101:touch.0 Request processed in 63us (84us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.737124:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7bef lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00000100:00100000:3.0:1713279306.737125:0:6916:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e524700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6916:1796503200026496:192.168.203.4@tcp:105: 00000100:00100000:0.0:1713279306.737126:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785019 00010000:00010000:1.0:1713279306.737135:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda7be1 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175587 expref: 3677 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.737139:0:6916:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d98f3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.737141:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda7bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6672:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175587 expref: 3676 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.737144:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6672:0x0].0x0 (ffff88008e766600) 00010000:00010000:1.0:1713279306.737145:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713279306.737146:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094552ac0, rc 0) 00000100:00100000:3.0:1713279306.737149:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281194880 00000100:00100000:3.0:1713279306.737151:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281194880 00000100:00100000:1.0:1713279306.737156:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3676:11873:x1796503281194752:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 168us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.737159:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785018 00000100:00100000:3.0:1713279306.737165:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222996 00000100:00100000:3.0:1713279306.737169:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3390:11855:x1796503281194880:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:3.0:1713279306.737223:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3391:11855:x1796503281194880:12345-192.168.203.4@tcp:35:touch.0 Request processed in 52us (200us total) trans 4295183621 rc 0/0 00000100:00100000:3.0:1713279306.737228:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222996 00000100:00100000:3.0:1713279306.737241:0:6942:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281194048 00000100:00100000:3.0:1713279306.737244:0:6942:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281194048 00000100:00100000:3.0:1713279306.737255:0:6942:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14330 00000100:00100000:3.0:1713279306.737258:0:6942:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3753:9807:x1796503281194048:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1713279306.737276:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.737282:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.737286:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.737293:0:6942:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.737300:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.737537:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda7c0b lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.737544:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda7c0b lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.737550:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda7c0b lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713279306.737558:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200026560:0@lo:101:mdt_io00_007.0 00000100:00100000:2.0:1713279306.737574:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.737591:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800968dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.737603:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200026560 00000100:00100000:1.0:1713279306.737605:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200026560 00000100:00100000:1.0:1713279306.737621:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98688 00000100:00100000:1.0:1713279306.737623:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+58:15514:x1796503200026560:12345-0@lo:101:mdt_io00_007.0 00010000:00010000:1.0:1713279306.737628:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.737635:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123732400/0xfc4b8e114eda7c12 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda7c0b expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.737643:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123732400/0xfc4b8e114eda7c12 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda7c0b expref: 59 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.737649:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880123732400/0xfc4b8e114eda7c12 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda7c0b expref: 59 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.737652:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x0 (ffff880096b8ec00) 00010000:00010000:1.0:1713279306.737653:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.737654:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123732400, rc 0) 00000100:00100000:1.0:1713279306.737673:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+59:15514:x1796503200026560:12345-0@lo:101:mdt_io00_007.0 Request processed in 49us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.737676:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98688 00000100:00100000:3.0:1713279306.737689:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200026560:0@lo:101:mdt_io00_007.0 00010000:00010000:3.0:1713279306.737699:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda7c0b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7c12 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.737706:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda7c0b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7c12 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713279306.737716:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00010000:00010000:3.0:1713279306.737730:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008e68ba80/0xfc4b8e114eda7c19 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.737735:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008e68ba80/0xfc4b8e114eda7c19 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.737741:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008e68ba80/0xfc4b8e114eda7c19 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713279306.737749:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200026624:0@lo:101:mdt_io00_007.0 00000100:00100000:3.0:1713279306.737765:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.737773:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880094f8ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.737775:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200026624 00000100:00100000:1.0:1713279306.737777:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200026624 00000100:00100000:1.0:1713279306.737784:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98689 00000100:00100000:1.0:1713279306.737786:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+59:15514:x1796503200026624:12345-0@lo:101:mdt_io00_007.0 00010000:00010000:1.0:1713279306.737790:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.737796:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114eda7c20 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda7c19 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.737803:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114eda7c20 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda7c19 expref: 60 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.737808:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114eda7c20 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda7c19 expref: 60 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.737811:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x3731 (ffff88008e766000) 00010000:00010000:1.0:1713279306.737813:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.737814:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd46c0, rc 0) 00000100:00100000:1.0:1713279306.737826:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+60:15514:x1796503200026624:12345-0@lo:101:mdt_io00_007.0 Request processed in 39us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.737829:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98689 00000100:00100000:3.0:1713279306.737836:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200026624:0@lo:101:mdt_io00_007.0 00010000:00010000:3.0:1713279306.737843:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008e68ba80/0xfc4b8e114eda7c19 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7c20 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.737849:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008e68ba80/0xfc4b8e114eda7c19 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7c20 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713279306.737858:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00010000:00010000:3.0:1713279306.737866:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7c27 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x134:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.737871:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7c27 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.737877:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7c27 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.737883:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7c2e lrc: 3/0,1 mode: --/PW res: [0x240000401:0x134:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.737888:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7c2e lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.737892:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7c2e lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.737909:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7644:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.737916:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114eda77a4 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x7644:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175461 expref: 3390 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.737921:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.737933:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114eda77a4 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x7644:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175461 expref: 3390 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.737941:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114eda77a4 lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x7644:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175461 expref: 3390 pid: 15482 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.737947:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001_UUID:15514:1796503200026688:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.737969:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880094f8ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.738454:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.738480:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281195200 00000100:00100000:3.0:1713279306.738482:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281195200 00000100:00100000:3.0:1713279306.738501:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785020 00000100:00100000:3.0:1713279306.738504:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3754:11204:x1796503281195200:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.738510:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.738516:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114eda7c3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175595 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.738552:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda7c43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x124:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738556:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda7c43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738560:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda7c43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738566:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda7c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x124:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738569:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda7c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x124:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738572:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda7c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x124:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738588:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114eda7c51 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738592:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114eda7c51 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8541:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738595:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114eda7c51 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8541:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000004:00200000:3.0:1713279306.738601:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8541:0x0]: returning size 0 00010000:00010000:3.0:1713279306.738620:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda7c43 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738624:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda7c43 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738627:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda7c43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738630:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda7c43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738632:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68a640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.738634:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda7c43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738637:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda7c43 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738641:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x0 (ffff88008bde0b00) 00010000:00010000:3.0:1713279306.738642:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.738644:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda7c43 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738646:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda7c43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738651:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda7c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x124:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738654:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda7c4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x124:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738659:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda7c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x124:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738662:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.738663:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda7c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x124:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738666:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda7c4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x124:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738669:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x3731 (ffff880093598400) 00010000:00010000:3.0:1713279306.738670:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.738671:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda7c4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x124:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738674:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda7c4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x124:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.738687:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114eda7c3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175595 expref: 3757 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.738694:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114eda7c51 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8541:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175595 expref: 3756 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.738697:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8541:0x0].0x0 (ffff880090aa0900) 00010000:00010000:3.0:1713279306.738698:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713279306.738700:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e689200, rc 0) 00000100:00100000:3.0:1713279306.738724:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3756:11204:x1796503281195200:12345-192.168.203.4@tcp:101:touch.0 Request processed in 218us (270us total) trans 4295202636 rc 0/0 00000100:00100000:3.0:1713279306.738729:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785020 00000100:00100000:2.0:1713279306.738796:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.738824:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281195072 00000100:00100000:3.0:1713279306.738828:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281195072 00000100:00100000:2.0:1713279306.738840:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.738845:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222997 00000100:00100000:3.0:1713279306.738849:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3391:11666:x1796503281195072:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1713279306.738852:0:15519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15519:1796503200026176:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.738857:0:15519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15519:1796503200026240:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.738863:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.738875:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281195264 00000100:00100000:0.0:1713279306.738877:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281195264 00000100:00100000:1.0:1713279306.738885:0:15519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15519:1796503200026304:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.738886:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f3c240/0xfc4b8e114ed9e0d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172ab5 expref: 84 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.738895:0:15519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7b8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.738898:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281195328 00000100:00100000:0.0:1713279306.738899:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281195328 00000100:00100000:2.0:1713279306.738902:0:15538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:15538:1796503200026368:192.168.203.4@tcp:106: 00010000:00010000:0.0:1713279306.738904:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800926b0240/0xfc4b8e114ed9dfdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a3e expref: 85 pid: 15538 timeout: 509 lvb_type: 1 00000100:00100000:0.0:1713279306.738914:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196482 00010000:00010000:2.0:1713279306.738914:0:15538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009181c480/0xfc4b8e114eda7b94 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x105e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175564 expref: 86 pid: 15538 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713279306.738914:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3392:11666:x1796503281195072:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 63us (118us total) trans 4295183622 rc 0/0 00000100:00100000:0.0:1713279306.738916:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281195264:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.738920:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196483 00000100:00100000:3.0:1713279306.738920:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222997 00010000:00010000:0.0:1713279306.738921:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.738923:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b25efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+85:1954:x1796503281195328:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.738923:0:15538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009181c480/0xfc4b8e114eda7b94 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x105e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175564 expref: 86 pid: 15538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713279306.738927:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f3c240/0xfc4b8e114ed9e0d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172ab5 expref: 85 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.738929:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.738931:0:15538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009181c480, rc 0) 00010000:00010000:0.0:1713279306.738932:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f3c240/0xfc4b8e114ed9e0d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172ab5 expref: 85 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.738938:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800926b0240/0xfc4b8e114ed9dfdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a3e expref: 85 pid: 15538 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.738940:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f3c240/0xfc4b8e114ed9e0d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172ab5 expref: 85 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.738944:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800926b0240/0xfc4b8e114ed9dfdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a3e expref: 85 pid: 15538 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.738946:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+85:1956:x1796503281193408:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2532us (2681us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.738948:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.738951:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110453 00010000:00010000:1.0:1713279306.738952:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800926b0240/0xfc4b8e114ed9dfdb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a3e expref: 84 pid: 15538 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.738958:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.738960:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281195264:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 43us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.738964:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196482 00000100:00100000:1.0:1713279306.738970:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b25efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+82:1954:x1796503281195328:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 47us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.738974:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196483 00000100:00100000:2.0:1713279306.738974:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.738981:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281195456 00000100:00100000:3.0:1713279306.738984:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281195456 00000100:00100000:3.0:1713279306.738999:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785021 00000100:00100000:1.0:1713279306.739003:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.739004:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3756:11872:x1796503281195456:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.739011:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.739012:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281195392 00000100:00100000:0.0:1713279306.739013:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281195392 00010000:00010000:3.0:1713279306.739019:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda7c5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917559c expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.739020:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801245b6400/0xfc4b8e114ed9c850 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391723e6 expref: 76 pid: 15539 timeout: 509 lvb_type: 1 00000100:00100000:0.0:1713279306.739031:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196484 00000100:00100000:0.0:1713279306.739034:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+76:1957:x1796503281195392:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.739038:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.739041:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda7c66 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.739042:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801245b6400/0xfc4b8e114ed9c850 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391723e6 expref: 76 pid: 15539 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.739047:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801245b6400/0xfc4b8e114ed9c850 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391723e6 expref: 76 pid: 15539 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.739048:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda7c66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.739054:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda7c66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.739055:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801245b6400/0xfc4b8e114ed9c850 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1111:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391723e6 expref: 76 pid: 15539 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.739060:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.739061:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.739063:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7b8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1111:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.739063:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda7c6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.739080:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7b8d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1111:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.739081:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda7c6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.739087:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda7c6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.739090:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.739096:0:15519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7b8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1111:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.739101:0:15519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7b8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1111:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.739102:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1957:x1796503281195392:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 67us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.739105:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196484 00010000:00010000:1.0:1713279306.739109:0:15519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7b8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1111:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.739113:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.739116:0:15519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7b8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1111:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.739120:0:15519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7b8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1111:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.739121:0:15658:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114eda69ab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750ef expref: 3769 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.739123:0:15519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a7180 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:1.0:1713279306.739125:0:15519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7b8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1111:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.739127:0:15658:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.739128:0:15519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7b8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1111:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.739135:0:15519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7b8d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1111:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.739138:0:15519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7b8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1111:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.739139:0:15658:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114eda69ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750ef expref: 3769 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.739146:0:15658:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114eda69ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750ef expref: 3769 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.739154:0:15658:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000_UUID:15658:1796503200026752:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.739162:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+81:1957:x1796503281193216:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 2872us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.739165:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110452 00000100:00100000:3.0:1713279306.739172:0:15658:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.739205:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.739216:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281195584 00000100:00100000:1.0:1713279306.739218:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281195584 00000100:00100000:0.0:1713279306.739221:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.739227:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281196096 00000100:00100000:1.0:1713279306.739229:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281196096 00000100:00100000:0.0:1713279306.739232:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785022 00000100:00100000:0.0:1713279306.739235:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3771:11830:x1796503281195584:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.739238:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785023 00000100:00100000:1.0:1713279306.739241:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3771:11711:x1796503281196096:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.739244:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.739246:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.739249:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008245cfc0/0xfc4b8e114eda7c7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391755a3 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.739252:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda7c82 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391755aa expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.739270:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008245f840/0xfc4b8e114eda7c89 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.739275:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008245f840/0xfc4b8e114eda7c89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.739279:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008245f840/0xfc4b8e114eda7c89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.739285:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7c90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.739286:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7c97 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.739288:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7c90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.739290:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7c97 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.739291:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7c90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.739294:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7c97 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739299:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda7c9e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739303:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda7c9e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739306:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda7c9e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000004:00200000:1.0:1713279306.739313:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:1.0:1713279306.739318:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7c97 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739321:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7c97 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739324:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7c97 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739330:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7c97 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739333:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.739334:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7c97 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739337:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7c97 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739341:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8800954bed00) 00010000:00010000:1.0:1713279306.739342:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.739343:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7c97 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739346:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7c97 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739350:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda7c9e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739353:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda7c9e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739356:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda7c9e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739358:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.739360:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008245f840/0xfc4b8e114eda7c89 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.739360:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda7c9e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.739362:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda7c9e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.739364:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008245f840/0xfc4b8e114eda7c89 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.739366:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.739367:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008245f840/0xfc4b8e114eda7c89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.739368:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880096da6900) 00010000:00010000:1.0:1713279306.739369:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.739370:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda7c9e lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.739373:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008245f840/0xfc4b8e114eda7c89 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.739373:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda7c9e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.739376:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008245f840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.739377:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008245f840/0xfc4b8e114eda7c89 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.739380:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008245f840/0xfc4b8e114eda7c89 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.739385:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:1.0:1713279306.739385:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda7c82 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755aa expref: 3773 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.739386:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.739387:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008245f840/0xfc4b8e114eda7c89 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.739389:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda7c82 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755aa expref: 3773 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.739390:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008245f840/0xfc4b8e114eda7c89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.739392:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281195712 00010000:00010000:1.0:1713279306.739394:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd7600, rc 0) 00010000:00010000:0.0:1713279306.739395:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7c90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.739395:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281195712 00010000:00010000:0.0:1713279306.739398:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7c90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.739401:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7c90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.739403:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8cb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.739404:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7c90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.739407:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7c90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.739409:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3772:11711:x1796503281196096:12345-192.168.203.4@tcp:101:touch.0 Request processed in 167us (188us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.739409:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222998 00000100:00100000:1.0:1713279306.739427:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785023 00000100:00100000:3.0:1713279306.739430:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:385c4b71-808c-40cf-91de-b076b668d13f+3676:11854:x1796503281195712:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:0.0:1713279306.739467:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3531 (ffff88012514d800) 00010000:00010000:0.0:1713279306.739469:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.739471:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7c90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.739474:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7c90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.739488:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008245cfc0/0xfc4b8e114eda7c7b lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755a3 expref: 3771 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.739488:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.739488:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:385c4b71-808c-40cf-91de-b076b668d13f+3677:11854:x1796503281195712:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 58us (122us total) trans 4295183623 rc 0/0 00010000:00010000:0.0:1713279306.739492:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008245cfc0/0xfc4b8e114eda7c7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755a3 expref: 3771 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.739494:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222998 00010000:00010000:0.0:1713279306.739497:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008245cfc0, rc 0) 00000100:00100000:1.0:1713279306.739498:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281195840 00000100:00100000:1.0:1713279306.739500:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281195840 00000100:00100000:1.0:1713279306.739508:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785024 00000100:00100000:0.0:1713279306.739510:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3770:11830:x1796503281195584:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 274us (305us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.739511:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3392:11374:x1796503281195840:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:0.0:1713279306.739514:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785022 00000100:00100000:2.0:1713279306.739518:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.739536:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.739546:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.739556:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281195968 00000100:00100000:3.0:1713279306.739559:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281195968 00000100:00100000:0.0:1713279306.739561:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.739569:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281196288 00000100:00100000:3.0:1713279306.739569:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281196160 00000100:00100000:3.0:1713279306.739570:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281196160 00000100:00100000:1.0:1713279306.739571:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281196288 00000100:00100000:2.0:1713279306.739571:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222999 00000100:00100000:2.0:1713279306.739576:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3758:11853:x1796503281195968:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:1.0:1713279306.739579:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110457 00000100:00100000:1.0:1713279306.739582:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+81:1957:x1796503281196288:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:3.0:1713279306.739587:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223000 00000100:00100000:3.0:1713279306.739591:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:385c4b71-808c-40cf-91de-b076b668d13f+3770:11867:x1796503281196160:12345-192.168.203.4@tcp:33:lfs.0 00000004:00200000:3.0:1713279306.739635:0:6932:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7f51:0x0]: returning size 4096 00000100:00100000:2.0:1713279306.739637:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3759:11853:x1796503281195968:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 60us (119us total) trans 4295202637 rc 0/0 00000004:00200000:3.0:1713279306.739638:0:6932:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1713279306.739640:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281196224 00000100:00100000:0.0:1713279306.739643:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281196224 00000100:00100000:2.0:1713279306.739643:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222999 00000100:00100000:0.0:1713279306.739653:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785025 00002000:00010000:1.0:1713279306.739655:0:15519:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb size from disk: 42048 -> 42048 00000100:00100000:0.0:1713279306.739656:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3393:11833:x1796503281196224:12345-192.168.203.4@tcp:34:lfs.0 00002000:00010000:1.0:1713279306.739657:0:15519:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00000100:00100000:3.0:1713279306.739658:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:385c4b71-808c-40cf-91de-b076b668d13f+3770:11867:x1796503281196160:12345-192.168.203.4@tcp:33:lfs.0 Request processed in 65us (119us total) trans 0 rc 0/0 00002000:00010000:1.0:1713279306.739659:0:15519:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:1.0:1713279306.739660:0:15519:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.739661:0:15519:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb blocks from disk: 24 -> 72 00000100:00100000:3.0:1713279306.739664:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223000 00010000:00010000:0.0:1713279306.739672:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7ca5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.739674:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+82:1957:x1796503281196288:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 91us (112us total) trans 4295010167 rc 0/0 00010000:00010000:0.0:1713279306.739677:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7ca5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.739678:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110457 00010000:00010000:0.0:1713279306.739681:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7ca5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739687:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7cac lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.739689:0:6916:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e524700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6916:1796503200026496:192.168.203.4@tcp:105: 00010000:00010000:0.0:1713279306.739690:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7cac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739693:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7cac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.739696:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.739708:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.739708:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+74:1957:x1796503281193664:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 2669us (3252us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.739713:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda7cba lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.739713:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196481 00010000:00010000:1.0:1713279306.739714:0:15485:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114eda6dd3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751f9 expref: 3393 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.739717:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda7cba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.739717:0:15485:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.739720:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda7cba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.739727:0:15485:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114eda6dd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751f9 expref: 3393 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.739732:0:15485:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114eda6dd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751f9 expref: 3393 pid: 15480 timeout: 509 lvb_type: 0 00000004:00010000:0.0:1713279306.739733:0:15752:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda7cba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739737:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7ca5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.739738:0:15485:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d304000 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001_UUID:15485:1796503200026816:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.739740:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7ca5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739743:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7ca5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739746:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7ca5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739749:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.739750:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7ca5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.739751:0:15485:0:(client.c:2539:ptlrpc_set_wait()) set ffff880130ade6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.739753:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7ca5 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739757:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:0.0:1713279306.739758:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.739760:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7ca5 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739763:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7ca5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739768:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7cac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739770:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7cac lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739773:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7cac lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739776:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe17a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.739777:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7cac lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739780:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7cac lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739783:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3631 (ffff88012514db00) 00010000:00010000:0.0:1713279306.739784:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.739785:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7cac lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739788:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7cac lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739793:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda7cba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739796:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda7cba lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739799:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda7cba lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739802:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe161c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.739803:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda7cba lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739805:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda7cba lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739808:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7bca:0x0].0x0 (ffff880093598800) 00010000:00010000:0.0:1713279306.739810:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.739811:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda7cba lrc: 2/0,0 mode: --/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.739813:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda7cba lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.739830:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3393:11833:x1796503281196224:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 173us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.739834:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785025 00000100:00100000:0.0:1713279306.739878:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.739908:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281196544 00000100:00100000:2.0:1713279306.739911:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281196544 00010000:00010000:3.0:1713279306.739924:0:15514:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff8800825a6680 x1796503200026688) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114eda77a4 lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x7644:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175461 expref: 3393 pid: 15482 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.739926:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785026 00000100:00100000:2.0:1713279306.739931:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3393:11666:x1796503281196544:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.739934:0:15514:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114eda77a4 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x7644:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175461 expref: 3393 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.739938:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.739944:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114eda7cc1 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391755b1 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.739945:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114eda77a4 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x7644:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175461 expref: 3393 pid: 15482 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.739954:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001_UUID:15514:1796503200026688:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.739962:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7644:0x0].0x0 (ffff88008e766f00) 00010000:00010000:3.0:1713279306.739965:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.739968:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7cc8 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.739970:0:15514:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.739974:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7cc8 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.739975:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.739981:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7cc8 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.739984:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.739989:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda7ccf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.739989:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.739994:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda7ccf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.739994:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.740000:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda7ccf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.740037:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200026880:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.740058:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:2.0:1713279306.740059:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x6e09:0x0]: returning size 4096 00000100:00100000:3.0:1713279306.740087:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d98f3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.740099:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7cc8 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.740104:0:15658:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000_UUID:15658:1796503200026752:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.740105:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7cc8 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.740110:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7cc8 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.740112:0:15658:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.740115:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7cc8 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.740119:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.740122:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7cc8 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.740126:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200026880 00010000:00010000:2.0:1713279306.740127:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7cc8 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.740130:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200026880 00010000:00010000:2.0:1713279306.740134:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff88007fcb8a00) 00010000:00010000:2.0:1713279306.740136:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.740139:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7cc8 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.740144:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda7cc8 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.740151:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda7ccf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.740153:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98690 00010000:00010000:2.0:1713279306.740156:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda7ccf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.740157:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+60:15514:x1796503200026880:12345-0@lo:1000:mdt_io00_007.0 00010000:00010000:2.0:1713279306.740160:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda7ccf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.740165:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.740167:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda7ccf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.740172:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda7ccf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.740178:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x3131 (ffff880095863700) 00010000:00010000:2.0:1713279306.740180:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.740182:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda7ccf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.740186:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda7ccf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.740207:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114eda7cc1 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755b1 expref: 3394 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.740210:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+60:15514:x1796503200026880:12345-0@lo:1000:mdt_io00_007.0 Request processed in 52us (151us total) trans 0 rc -2/-2 00000100:00100000:1.0:1713279306.740214:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98690 00010000:00010000:2.0:1713279306.740215:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114eda7cc1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755b1 expref: 3394 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.740222:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baa1c0, rc 0) 00000100:00100000:3.0:1713279306.740222:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200026880:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.740248:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200026944:0@lo:1000:mdt_io00_007.0 00000100:00100000:2.0:1713279306.740250:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3393:11666:x1796503281196544:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 318us (371us total) trans 4295183624 rc 301/301 00000100:00100000:2.0:1713279306.740256:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785026 00000100:00100000:3.0:1713279306.740265:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.740281:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98a80 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.740292:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200026944 00000100:00100000:1.0:1713279306.740295:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200026944 00000100:00100000:1.0:1713279306.740305:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98691 00000100:00100000:1.0:1713279306.740307:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+60:15514:x1796503200026944:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.740336:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+60:15514:x1796503200026944:12345-0@lo:1000:mdt_io00_007.0 Request processed in 28us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.740340:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98691 00000100:00100000:3.0:1713279306.740346:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200026944:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.740371:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200027008:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.740443:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.740457:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98000 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.740468:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200027008 00000100:00100000:1.0:1713279306.740471:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200027008 00000100:00100000:1.0:1713279306.740479:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98692 00000100:00100000:1.0:1713279306.740482:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+60:15514:x1796503200027008:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.740555:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+60:15514:x1796503200027008:12345-0@lo:1000:mdt_io00_007.0 Request processed in 71us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.740559:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98692 00000100:00100000:3.0:1713279306.740563:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200027008:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.740641:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200027072:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.740654:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.740667:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98a80 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.740678:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200027072 00000100:00100000:1.0:1713279306.740680:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200027072 00000100:00100000:1.0:1713279306.740689:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98693 00000100:00100000:1.0:1713279306.740691:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+60:15514:x1796503200027072:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.740716:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+60:15514:x1796503200027072:12345-0@lo:1000:mdt_io00_007.0 Request processed in 24us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.740719:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98693 00000100:00100000:3.0:1713279306.740723:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200027072:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.740764:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200027136:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.740776:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.740782:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ca459c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.740785:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200027136 00000100:00100000:1.0:1713279306.740787:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200027136 00000100:00100000:1.0:1713279306.740794:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98694 00000100:00100000:1.0:1713279306.740796:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+13:15514:x1796503200027136:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.740824:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+13:15514:x1796503200027136:12345-0@lo:1000:mdt_io00_007.0 Request processed in 27us (47us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.740828:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98694 00000100:00100000:3.0:1713279306.740831:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200027136:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.740851:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200027200:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.740862:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.740866:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d8240 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.740870:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200027200 00000100:00100000:1.0:1713279306.740872:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200027200 00000100:00100000:1.0:1713279306.740879:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98695 00000100:00100000:1.0:1713279306.740881:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+11:15514:x1796503200027200:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.740905:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+11:15514:x1796503200027200:12345-0@lo:1000:mdt_io00_007.0 Request processed in 23us (42us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.740908:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98695 00000100:00100000:3.0:1713279306.740911:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200027200:0@lo:1000:mdt_io00_007.0 00000040:00080000:3.0:1713279306.741057:0:15514:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x1c0:0x0].1541, 1488 off816936 00000040:00080000:3.0:1713279306.741095:0:15514:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xf8:0x0].2149, 1568 off1517360 00000100:00100000:3.0:1713279306.741108:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200027264:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.741122:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.741135:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a42d8240 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.741148:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200027264 00000100:00100000:1.0:1713279306.741150:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200027264 00000100:00100000:1.0:1713279306.741159:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98696 00000100:00100000:1.0:1713279306.741162:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+11:15514:x1796503200027264:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:0.0:1713279306.741190:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.741209:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+12:15514:x1796503200027264:12345-0@lo:1000:mdt_io00_007.0 Request processed in 46us (86us total) trans 4295010111 rc 0/0 00000100:00100000:1.0:1713279306.741212:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98696 00000100:00100000:3.0:1713279306.741224:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200027264:0@lo:1000:mdt_io00_007.0 00000100:00100000:2.0:1713279306.741229:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281197376 00000100:00100000:2.0:1713279306.741233:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281197376 00000100:00100000:3.0:1713279306.741241:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200027328:0@lo:1000:mdt_io00_007.0 00000100:00100000:2.0:1713279306.741249:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785027 00000100:00100000:2.0:1713279306.741253:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3394:11855:x1796503281197376:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.741260:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.741261:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.741268:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e7ab600 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.741269:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda7cdd lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391755bf expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.741272:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200027328 00000100:00100000:1.0:1713279306.741274:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200027328 00000100:00100000:1.0:1713279306.741281:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98697 00000100:00100000:1.0:1713279306.741283:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+13:15514:x1796503200027328:12345-0@lo:1000:mdt_io00_007.0 00010000:00010000:2.0:1713279306.741313:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda7ce4 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.741319:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+14:15514:x1796503200027328:12345-0@lo:1000:mdt_io00_007.0 Request processed in 34us (58us total) trans 4295010168 rc 0/0 00010000:00010000:2.0:1713279306.741321:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda7ce4 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.741322:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98697 00010000:00010000:2.0:1713279306.741327:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda7ce4 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.741335:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7ceb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.741335:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200027328:0@lo:1000:mdt_io00_007.0 00010000:00010000:2.0:1713279306.741341:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7ceb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000004:00080000:3.0:1713279306.741343:0:15514:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880094f8ef00 with version 31972 00000100:00100000:0.0:1713279306.741345:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.741347:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7ceb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713279306.741356:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.741360:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281196608 00000004:00080000:2.0:1713279306.741361:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31972 rpc_version 31972 00000100:00100000:3.0:1713279306.741363:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281196608 00000100:00100000:1.0:1713279306.741365:0:15525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281196736 00000100:00100000:0.0:1713279306.741366:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.741367:0:15525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281196736 00000100:00100000:0.0:1713279306.741374:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.741375:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114eda69ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750ef expref: 3771 pid: 15658 timeout: 509 lvb_type: 0 00000020:00100000:2.0:1713279306.741376:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1713279306.741380:0:15525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14331 00000100:00100000:2.0:1713279306.741381:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009089f800 x1796503200027456/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1713279306.741382:0:15525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:385c4b71-808c-40cf-91de-b076b668d13f+3771:11736:x1796503281196736:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:0.0:1713279306.741384:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.741393:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200027456:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.741394:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196485 00000100:00100000:3.0:1713279306.741399:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121984a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3771:1957:x1796503281196608:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.741400:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00000100:00100000:0.0:1713279306.741401:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281196864 00000100:00100000:0.0:1713279306.741404:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281196864 00010000:00010000:3.0:1713279306.741404:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.741407:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.741408:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114eda69ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750ef expref: 3771 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.741427:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00000100:00100000:0.0:1713279306.741430:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785028 00000100:00100000:2.0:1713279306.741430:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.741431:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114eda69ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750ef expref: 3771 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.741434:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3759:11204:x1796503281196864:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:1.0:1713279306.741434:0:15525:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.741438:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.741441:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760a80 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.741442:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114eda69ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391750ef expref: 3771 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.741450:0:15752:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.741450:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281196416 00010000:00010000:3.0:1713279306.741450:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7e71:0x0].0x0 (ffff8800939e3100) 00000100:00100000:1.0:1713279306.741451:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200027456 00000100:00100000:1.0:1713279306.741453:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200027456 00000100:00100000:2.0:1713279306.741453:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281196416 00010000:00010000:3.0:1713279306.741454:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.741458:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114eda7c51 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8541:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175595 expref: 3759 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.741459:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.741464:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98698 00000100:00100000:2.0:1713279306.741464:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281196992 00010000:00010000:3.0:1713279306.741465:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.741466:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8541:0x0].0x0 (ffff880090aa0900) 00000100:00100000:2.0:1713279306.741466:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281196992 00000100:00100000:1.0:1713279306.741467:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+60:8074:x1796503200027456:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713279306.741468:0:15752:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.741475:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.741485:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223001 00000100:00100000:0.0:1713279306.741489:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223002 00000100:00100000:2.0:1713279306.741490:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c56b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3771:11843:x1796503281196416:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1713279306.741492:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3677:11839:x1796503281196992:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:3.0:1713279306.741493:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121984a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3771:1957:x1796503281196608:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 93us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.741498:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196485 00010000:00010000:3.0:1713279306.741513:0:15658:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.741518:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000004:00200000:3.0:1713279306.741536:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e71:0x0]: returning size 35262 00000004:00200000:3.0:1713279306.741538:0:15658:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713279306.741545:0:15658:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000100:00100000:2.0:1713279306.741549:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c56b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3771:11843:x1796503281196416:12345-192.168.203.4@tcp:35:touch.0 Request processed in 58us (181us total) trans 4295202638 rc 0/0 00010000:00010000:3.0:1713279306.741552:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000100:00100000:2.0:1713279306.741555:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223001 00010000:00010000:3.0:1713279306.741558:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda7c66 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.741561:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3678:11839:x1796503281196992:12345-192.168.203.4@tcp:35:touch.0 Request processed in 67us (175us total) trans 4295183626 rc 0/0 00010000:00010000:3.0:1713279306.741562:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda7c66 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.741565:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223002 00010000:00010000:3.0:1713279306.741567:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda7c66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.741572:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda7c66 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.741576:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298eef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.741579:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda7c66 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.741583:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda7cf9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.741583:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda7c66 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.741588:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda7cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.741593:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda7cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.741594:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.741596:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.741598:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda7d00 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.741599:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda7c66 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.741603:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda7c66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.741605:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda7d00 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.741611:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda7d00 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.741611:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda7c6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.741615:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda7c6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00000004:00010000:0.0:1713279306.741617:0:15752:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880121987480 reply state ffff880095993000 transno 4295202639 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda7cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000004:00200000:2.0:1713279306.741617:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7831:0x0]: returning size 0 00010000:00010000:3.0:1713279306.741620:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda7c6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.741622:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda7cf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.741624:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.741625:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8541:0x0].0x0 (ffff880090aa0900) 00010000:00010000:0.0:1713279306.741627:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.741627:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda7c6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.741628:0:15752:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.741631:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda7c6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.741637:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x37 (ffff880090a56900) 00010000:00010000:3.0:1713279306.741639:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.741640:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda7ce4 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.741641:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda7c6d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.741646:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda7c6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.741647:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3760:11204:x1796503281196864:12345-192.168.203.4@tcp:36:touch.0 Request processed in 213us (271us total) trans 4295202639 rc 0/0 00010000:00010000:2.0:1713279306.741649:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda7ce4 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713279306.741651:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785028 00010000:00010000:2.0:1713279306.741653:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda7ce4 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.741658:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda7ce4 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.741662:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.741662:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda7c5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917559c expref: 3760 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.741665:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda7ce4 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713279306.741671:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.741671:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917559c expref: 3759 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.741672:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda7ce4 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.741674:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+61:8074:x1796503200027456:12345-0@lo:1000:osp_up0-1.0 Request processed in 206us (243us total) trans 4295202640 rc 0/0 00010000:00010000:3.0:1713279306.741676:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7e71:0x0].0x0 (ffff8800939e3100) 00010000:00010000:2.0:1713279306.741678:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88008d597100) 00000100:00100000:1.0:1713279306.741679:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98698 00010000:00010000:3.0:1713279306.741679:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.741680:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.741680:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298edd40, rc 0) 00010000:00010000:2.0:1713279306.741682:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda7ce4 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.741687:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda7ce4 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.741690:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281197056 00000100:00100000:1.0:1713279306.741692:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281197056 00000100:00100000:0.0:1713279306.741694:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.741694:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7ceb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.741697:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3759:11872:x1796503281195456:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2693us (2723us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.741699:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7ceb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.741701:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110458 00000100:00100000:3.0:1713279306.741703:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785021 00000100:00100000:1.0:1713279306.741704:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+76:1957:x1796503281197056:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:2.0:1713279306.741704:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7ceb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713279306.741707:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.741708:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.741710:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7ceb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.741712:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281197120 00010000:00010000:2.0:1713279306.741715:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7ceb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.741715:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281197120 00000100:00100000:0.0:1713279306.741718:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.741721:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x36 (ffff880091d49100) 00010000:00010000:2.0:1713279306.741723:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.741725:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7ceb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.741729:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281197248 00010000:00010000:2.0:1713279306.741730:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda7ceb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.741730:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281197248 00000100:00100000:3.0:1713279306.741740:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785029 00000100:00100000:3.0:1713279306.741744:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3759:11860:x1796503281197120:12345-192.168.203.4@tcp:101:lfs.0 00002000:00010000:1.0:1713279306.741746:0:15519:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb size from disk: 15538 -> 15538 00002000:00010000:1.0:1713279306.741748:0:15519:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb mtime from disk: 1713279304 -> 1713279304 00010000:00010000:2.0:1713279306.741749:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda7cdd lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755bf expref: 3398 pid: 9221 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713279306.741750:0:15519:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:1.0:1713279306.741751:0:15519:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.741753:0:15519:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb blocks from disk: 64 -> 64 00010000:00010000:3.0:1713279306.741753:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.741758:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda7d00 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755bf expref: 3397 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.741760:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda7d0e lrc: 2/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391755b8 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.741764:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7831:0x0].0x0 (ffff88008bde0600) 00010000:00010000:2.0:1713279306.741766:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.741768:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bd440, rc 0) 00000100:00100000:1.0:1713279306.741769:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+77:1957:x1796503281197056:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 64us (97us total) trans 4295010112 rc 0/0 00000100:00100000:0.0:1713279306.741771:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785030 00000100:00100000:1.0:1713279306.741773:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110458 00000100:00100000:0.0:1713279306.741774:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3397:11841:x1796503281197248:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1713279306.741781:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda7d15 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.741787:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda7d15 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.741789:0:6943:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281197504 00000100:00100000:1.0:1713279306.741791:0:6943:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281197504 00010000:00010000:3.0:1713279306.741793:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda7d15 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.741795:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200027456:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.741801:0:6943:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14332 00000100:00100000:1.0:1713279306.741804:0:6943:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:385c4b71-808c-40cf-91de-b076b668d13f+3678:11854:x1796503281197504:12345-192.168.203.4@tcp:36:lfs.0 00000004:00200000:3.0:1713279306.741810:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x235:0x0]: returning size 4096 00000004:00200000:3.0:1713279306.741813:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1713279306.741817:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3397:11841:x1796503281197248:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 42us (109us total) trans 0 rc -17/-17 00010000:00010000:1.0:1713279306.741817:0:6943:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:2.0:1713279306.741817:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3397:11855:x1796503281197376:12345-192.168.203.4@tcp:101:touch.0 Request processed in 563us (629us total) trans 4295183627 rc 0/0 00000100:00100000:0.0:1713279306.741821:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785030 00000100:00100000:2.0:1713279306.741824:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785027 00010000:00010000:3.0:1713279306.741825:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114eda7d0e lrc: 0/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755b8 expref: 3761 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.741826:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda78d1 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x7213:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917548b expref: 3678 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.741835:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942f600/0xfc4b8e114eda46ab lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7213:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391747f7 expref: 3677 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.741835:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda7d15 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755b8 expref: 3760 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.741840:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7213:0x0].0x0 (ffff880124f55f00) 00010000:00010000:3.0:1713279306.741840:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff880090a56500) 00010000:00010000:1.0:1713279306.741842:0:6943:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.741842:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713279306.741844:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ef180, rc 0) 00010000:00010000:1.0:1713279306.741853:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.741856:0:6943:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.741860:0:6943:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6943 initiator: MDT1 00000100:00100000:3.0:1713279306.741863:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3760:11860:x1796503281197120:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 117us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.741867:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200027520:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1713279306.741868:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785029 00000100:00100000:1.0:1713279306.741882:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1713279306.741886:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880135efd500 reply state ffff88009519b000 transno 4295183625 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:1.0:1713279306.741889:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.741893:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200027520 00010000:00010000:3.0:1713279306.741893:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713279306.741896:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200027520 00010000:00010000:3.0:1713279306.741898:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7644:0x0].0x0 (ffff88008e766f00) 00010000:00010000:3.0:1713279306.741900:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1713279306.741901:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.741905:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7c27 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:1.0:1713279306.741906:0:15485:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d304000 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001_UUID:15485:1796503200026816:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.741907:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98699 00010000:00010000:3.0:1713279306.741909:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7c27 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713279306.741910:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+61:6943:x1796503200027520:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1713279306.741913:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7c27 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.741914:0:15485:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.741916:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.741918:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7c27 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.741921:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda7d1c expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.741922:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68b840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.741924:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7c27 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.741929:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7c27 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.741930:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.741934:0:15516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda7d1c expref: 62 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.741934:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x0 (ffff88011f2c2200) 00010000:00010000:3.0:1713279306.741935:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.741937:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7c27 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.741940:0:15516:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.741941:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda7c27 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.741945:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda7d1c expref: 62 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.741949:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00000004:00010000:3.0:1713279306.741949:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880135efd500 reply state ffff88009519b000 transno 4295183625 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7c2e lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.741950:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.741951:0:15516:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.741954:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe146c0, rc 0) 00010000:00010000:3.0:1713279306.741954:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7c2e lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.741959:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x3731 (ffff8800934f8c00) 00010000:00010000:3.0:1713279306.741961:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.741962:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1713279306.741965:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00000100:00100000:0.0:1713279306.741970:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+62:6943:x1796503200027520:12345-0@lo:101:mdt_io00_002.0 Request processed in 60us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.741973:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98699 00000100:00100000:1.0:1713279306.741977:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200027520:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1713279306.741980:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda7c0b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7c12 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.741982:0:6943:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.741985:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda7c0b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda7c12 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.741987:0:6943:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.741988:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda7c0b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda7c12 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.741997:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1713279306.741999:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00010000:00010000:1.0:1713279306.742001:0:15544:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.742001:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008e68ba80/0xfc4b8e114eda7c19 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7c20 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.742004:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda7c0b lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114eda7c12 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.742005:0:15514:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008e68ba80/0xfc4b8e114eda7c19 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7c20 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.742008:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baaac0 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:1.0:1713279306.742010:0:15544:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda7c0b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda7c12 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713279306.742015:0:15544:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda7c0b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda7c12 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.742025:0:15544:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda7c0b lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7c12 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.742027:0:15544:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713279306.742036:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda7c0b lrc: 1/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7c12 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.742040:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaac0/0xfc4b8e114eda7c0b lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7c12 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.742042:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200027584:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.742047:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.742048:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1713279306.742048:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000403:0x863c:0x0] 00010000:00010000:1.0:1713279306.742049:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.742050:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.742054:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.742054:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.742058:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.742065:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1713279306.742084:0:6918:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713279306.742086:0:6918:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.742090:0:6918:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800923433c0 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:1.0:1713279306.742092:0:6918:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713279306.742096:0:6918:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.742100:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200027584 00000100:00100000:2.0:1713279306.742103:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200027584 00000100:00100000:3.0:1713279306.742103:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3396:10814:x1796503281187200:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 16555us (16592us total) trans 4295183625 rc 0/0 00010000:00010000:1.0:1713279306.742115:0:6918:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.742117:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14328 00010000:00010000:1.0:1713279306.742118:0:6918:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713279306.742133:0:6918:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.742137:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800923433c0/0xfc4b8e114eda786f lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda78b5 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.742137:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147219 00000100:00100000:2.0:1713279306.742141:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+62:3491:x1796503200027584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.742142:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.742142:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279306.742143:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1713279306.742144:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.742146:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.742149:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200027648:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.742154:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123732400/0xfc4b8e114eda7c12 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda7c0b expref: 62 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.742161:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.742162:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x0 (ffff880096b8ec00) 00010000:00010000:2.0:1713279306.742166:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.742171:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200027648 00000100:00100000:1.0:1713279306.742173:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200027648 00010000:00010000:1.0:1713279306.742180:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda78b5 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda786f expref: 62 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.742184:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+62:3491:x1796503200027584:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.742189:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147219 00000100:00100000:0.0:1713279306.742191:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200027584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.742192:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196486 00000100:00100000:1.0:1713279306.742194:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+61:3493:x1796503200027648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.742198:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.742201:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda78b5 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda786f expref: 61 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.742208:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda78b5 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda786f expref: 61 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.742214:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.742216:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.742220:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.742223:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.742226:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.742233:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.742244:0:15507:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00000100:00100000:1.0:1713279306.742247:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+60:3493:x1796503200027648:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (86us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.742249:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00000100:00100000:1.0:1713279306.742251:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196486 00000100:00100000:0.0:1713279306.742253:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200027648:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.742295:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.742301:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda7d15 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755b8 expref: 3759 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.742305:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 4/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.742315:0:15507:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda7d15 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755b8 expref: 3759 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.742320:0:15507:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda7d15 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755b8 expref: 3759 pid: 15483 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.742326:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200027712:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.742342:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549c00 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.744545:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.744570:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.744584:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281197824 00000100:00100000:3.0:1713279306.744588:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281197824 00000100:00100000:2.0:1713279306.744597:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.744613:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281198080 00000100:00100000:3.0:1713279306.744615:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281198080 00000100:00100000:2.0:1713279306.744622:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.744625:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785031 00000100:00100000:3.0:1713279306.744630:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3677:11711:x1796503281197824:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.744631:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281197696 00000100:00100000:2.0:1713279306.744633:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281197696 00000100:00100000:1.0:1713279306.744637:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281197568 00010000:00010000:3.0:1713279306.744640:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.744642:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281197568 00000100:00100000:2.0:1713279306.744648:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223003 00010000:00010000:3.0:1713279306.744649:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda7d31 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391755c6 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.744652:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3398:11666:x1796503281197696:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:1.0:1713279306.744654:0:15711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114eda6dd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751f9 expref: 3398 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.744668:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196487 00000100:00100000:0.0:1713279306.744672:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.744672:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3398:1956:x1796503281197568:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.744677:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.744679:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda7d38 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.744680:0:15711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114eda6dd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751f9 expref: 3398 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.744682:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281197952 00000100:00100000:0.0:1713279306.744685:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281197952 00010000:00010000:1.0:1713279306.744685:0:15711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114eda6dd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751f9 expref: 3398 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.744686:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda7d38 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.744693:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda7d38 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.744694:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114eda6dd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391751f9 expref: 3399 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.744697:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223004 00010000:00010000:1.0:1713279306.744699:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00000100:00100000:0.0:1713279306.744700:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3771:11832:x1796503281197952:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:3.0:1713279306.744701:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda7d3f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.744702:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.744706:0:15711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.744706:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda7d3f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.744709:0:15711:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.744712:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda7d3f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.744716:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.744720:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3398:11666:x1796503281197696:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 67us (97us total) trans 4295183628 rc 0/0 00000100:00100000:2.0:1713279306.744727:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223003 00010000:00010000:3.0:1713279306.744729:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda7d38 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.744730:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3398:1956:x1796503281197568:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 58us (160us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.744734:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda7d38 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.744737:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196487 00010000:00010000:3.0:1713279306.744739:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda7d38 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.744744:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda7d38 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.744748:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ef3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.744749:0:15485:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.744751:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda7d38 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.744753:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.744754:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.744756:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda7d38 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.744760:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x76da:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.744763:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880090a56800) 00000100:00100000:0.0:1713279306.744765:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3772:11832:x1796503281197952:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 63us (94us total) trans 4295202641 rc 0/0 00010000:00010000:1.0:1713279306.744765:0:15485:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7bc5 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175579 expref: 3396 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.744766:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281198144 00010000:00010000:3.0:1713279306.744766:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.744769:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281198144 00010000:00010000:3.0:1713279306.744769:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda7d38 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.744770:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223004 00010000:00010000:1.0:1713279306.744770:0:15485:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.744774:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda7d38 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.744781:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda7d3f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.744786:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda7d3f lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.744789:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110459 00000100:00100000:0.0:1713279306.744790:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.744791:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda7d3f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.744794:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+82:1955:x1796503281198144:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:3.0:1713279306.744795:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec480 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.744797:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281198208 00010000:00010000:3.0:1713279306.744798:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda7d3f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.744799:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281198208 00000100:00100000:0.0:1713279306.744800:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.744803:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda7d3f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.744807:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281198272 00000100:00100000:0.0:1713279306.744808:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.744808:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880090a56a00) 00000100:00100000:1.0:1713279306.744809:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281198272 00010000:00010000:3.0:1713279306.744810:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.744812:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda7d3f lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.744820:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114eda7d3f lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.744821:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281198464 00000100:00100000:1.0:1713279306.744822:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281198464 00000100:00100000:1.0:1713279306.744830:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147220 00000100:00100000:0.0:1713279306.744831:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.744833:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d304000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3680:1954:x1796503281198464:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.744838:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.744839:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda7d31 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755c6 expref: 3680 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.744843:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda7bf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6672:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175587 expref: 3680 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.744847:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda7d31 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755c6 expref: 3680 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.744849:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6672:0x0].0x0 (ffff88008e766600) 00010000:00010000:1.0:1713279306.744850:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.744855:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298edb00, rc 0) 00000100:00100000:1.0:1713279306.744862:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d304000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3678:1954:x1796503281198464:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 28us (52us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.744865:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147220 00000100:00100000:0.0:1713279306.744866:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.744868:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+83:1955:x1796503281198144:12345-192.168.203.4@tcp:2:touch.0 Request processed in 72us (112us total) trans 4295010169 rc 0/0 00000100:00100000:3.0:1713279306.744869:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3678:11711:x1796503281197824:12345-192.168.203.4@tcp:101:touch.0 Request processed in 239us (326us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.744874:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110459 00000100:00100000:1.0:1713279306.744875:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281198592 00000100:00100000:3.0:1713279306.744875:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785031 00000100:00100000:1.0:1713279306.744877:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281198592 00000100:00100000:2.0:1713279306.744883:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281198656 00000100:00100000:3.0:1713279306.744884:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785032 00000100:00100000:2.0:1713279306.744885:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281198656 00000100:00100000:1.0:1713279306.744886:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110460 00000100:00100000:3.0:1713279306.744888:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3772:11875:x1796503281198208:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.744889:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+85:1955:x1796503281198592:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:3.0:1713279306.744896:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.744898:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110461 00000100:00100000:2.0:1713279306.744901:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+74:1955:x1796503281198656:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:3.0:1713279306.744903:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda7d4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391755d4 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.744925:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7d54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.744932:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7d54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.744938:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7d54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.744940:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1955:x1796503281198592:12345-192.168.203.4@tcp:2:touch.0 Request processed in 50us (108us total) trans 4295010113 rc 0/0 00000100:00100000:1.0:1713279306.744944:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110460 00000100:00100000:1.0:1713279306.744959:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785033 00000100:00100000:1.0:1713279306.744962:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3676:11857:x1796503281198272:12345-192.168.203.4@tcp:101:mkdir.0 00000100:00100000:2.0:1713279306.744963:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1955:x1796503281198656:12345-192.168.203.4@tcp:2:touch.0 Request processed in 60us (95us total) trans 4295010170 rc 0/0 00010000:00010000:1.0:1713279306.744967:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:3.0:1713279306.744972:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7f51:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.744973:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda7d5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391755db expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.744973:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110461 00000004:00200000:3.0:1713279306.744975:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713279306.744983:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7d54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.744992:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda7d62 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.744995:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200027712:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.744995:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda7d4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755d4 expref: 3774 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.744997:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda7d62 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.745001:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda7d62 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.745005:0:15507:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.745005:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7d54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755d4 expref: 3773 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.745011:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f51:0x0].0x0 (ffff8800940a8800) 00010000:00010000:3.0:1713279306.745013:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713279306.745015:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ecfc0, rc 0) 00000100:00100000:3.0:1713279306.745027:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3773:11875:x1796503281198208:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 138us (236us total) trans 0 rc 0/0 00000004:00200000:1.0:1713279306.745030:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7693:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.745032:0:15753:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:3.0:1713279306.745033:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785032 00000004:00010000:1.0:1713279306.745037:0:15753:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda7d62 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.745050:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda7d5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755db expref: 3678 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.745058:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd58c0/0xfc4b8e114eda7d62 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755db expref: 3677 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.745062:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7693:0x0].0x0 (ffff880090aad600) 00010000:00010000:1.0:1713279306.745064:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1713279306.745065:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd58c0, rc 0) 00000100:00100000:3.0:1713279306.745093:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785034 00000100:00100000:1.0:1713279306.745096:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3677:11857:x1796503281198272:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 132us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.745098:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3396:11833:x1796503281198080:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.745100:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785033 00010000:00010000:3.0:1713279306.745106:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.745112:0:15485:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7bc5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175579 expref: 3396 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.745113:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda7d69 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7bca:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391755cd expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.745118:0:15485:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7bc5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175579 expref: 3396 pid: 15483 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.745124:0:15485:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001_UUID:15485:1796503200027776:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.745145:0:15485:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77f00 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.745149:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.745157:0:15483:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175231 expref: 3676 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.745162:0:15483:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 4/0,1 mode: --/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.745176:0:15483:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175231 expref: 3676 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.745184:0:15483:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175231 expref: 3676 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.745191:0:15483:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:15483:1796503200027840:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.745211:0:15483:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e7ab180 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.747719:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.747744:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.747792:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281198848 00000100:00100000:3.0:1713279306.747796:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281198848 00000100:00100000:1.0:1713279306.747808:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281199616 00000100:00100000:1.0:1713279306.747813:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281199616 00000100:00100000:3.0:1713279306.747821:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785035 00000100:00100000:3.0:1713279306.747827:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3773:11873:x1796503281198848:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:1.0:1713279306.747836:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785036 00010000:00010000:3.0:1713279306.747837:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.747840:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3398:11871:x1796503281199616:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.747846:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092342ac0/0xfc4b8e114eda7d77 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x6672:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391755e9 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.747851:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.747858:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114eda7d7e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391755e2 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.747895:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda7d85 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x78ee:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.747902:0:15753:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114eda63bc lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f52 expref: 3399 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.747906:0:15753:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda7d85 lrc: 4/0,1 mode: --/CW res: [0x240000402:0x78ee:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.747917:0:15753:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114eda63bc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f52 expref: 3399 pid: 15752 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713279306.747921:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x6672:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.747922:0:15753:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114eda63bc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f52 expref: 3399 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.747925:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.747928:0:15753:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_035:lustre-MDT0001_UUID:15753:1796503200027904:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.747934:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342ac0/0xfc4b8e114eda7d77 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x6672:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755e9 expref: 3774 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.747942:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342ac0/0xfc4b8e114eda7d77 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x6672:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755e9 expref: 3774 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.747945:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.747948:0:15753:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.747949:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092342ac0, rc 0) 00000100:00100000:2.0:1713279306.747959:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281199872 00000100:00100000:2.0:1713279306.747963:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281199872 00000100:00100000:3.0:1713279306.747968:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3773:11873:x1796503281198848:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 141us (250us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.747974:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785035 00000100:00100000:2.0:1713279306.747978:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281200064 00000100:00100000:2.0:1713279306.747980:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281200064 00000100:00100000:1.0:1713279306.747985:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785037 00000100:00100000:1.0:1713279306.747989:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3677:11879:x1796503281199872:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:3.0:1713279306.747996:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785038 00010000:00010000:1.0:1713279306.747998:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.748000:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3773:11711:x1796503281200064:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.748002:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda7d8c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391755f7 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.748007:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.748015:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda7d93 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391755fe expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713279306.748055:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76b7:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.748060:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340fc0/0xfc4b8e114eda7d9a lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748067:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092340fc0/0xfc4b8e114eda7d9a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748089:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092340fc0/0xfc4b8e114eda7d9a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748099:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda7da8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.748103:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda7d8c lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755f7 expref: 3679 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.748104:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda7da8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748107:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda7da8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.748111:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda7d8c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755f7 expref: 3679 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.748116:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd6640, rc 0) 00000004:00200000:3.0:1713279306.748118:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:3.0:1713279306.748123:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340fc0/0xfc4b8e114eda7d9a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748126:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340fc0/0xfc4b8e114eda7d9a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748129:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092340fc0/0xfc4b8e114eda7d9a lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748135:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092340fc0/0xfc4b8e114eda7d9a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748138:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092340fc0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.748139:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3678:11879:x1796503281199872:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 149us (215us total) trans 4295183629 rc 301/301 00010000:00010000:3.0:1713279306.748139:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092340fc0/0xfc4b8e114eda7d9a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748142:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092340fc0/0xfc4b8e114eda7d9a lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.748143:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785037 00010000:00010000:3.0:1713279306.748146:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880090a56700) 00010000:00010000:3.0:1713279306.748148:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.748149:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092340fc0/0xfc4b8e114eda7d9a lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748152:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092340fc0/0xfc4b8e114eda7d9a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748157:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda7da8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748160:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda7da8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748163:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda7da8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748165:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092343840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.748166:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda7da8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748169:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda7da8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748175:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880090a56d00) 00010000:00010000:3.0:1713279306.748176:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.748178:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda7da8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748180:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda7da8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748194:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda7d93 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755fe expref: 3774 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.748198:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda7d93 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755fe expref: 3774 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.748202:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092343a80, rc 0) 00000100:00100000:3.0:1713279306.748216:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3773:11711:x1796503281200064:12345-192.168.203.4@tcp:101:touch.0 Request processed in 216us (270us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.748220:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785038 00000100:00100000:0.0:1713279306.748261:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.748281:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.748283:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281198720 00000100:00100000:3.0:1713279306.748285:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281198720 00000100:00100000:3.0:1713279306.748296:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785039 00000100:00100000:3.0:1713279306.748298:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3760:10814:x1796503281198720:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1713279306.748315:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7daf lrc: 3/1,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748320:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7daf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748324:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7daf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748329:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda7db6 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x231:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748332:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda7db6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.748333:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281198784 00010000:00010000:3.0:1713279306.748335:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda7db6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.748336:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281198784 00000100:00100000:0.0:1713279306.748337:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.748345:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281198976 00000100:00100000:0.0:1713279306.748348:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281198976 00000100:00100000:1.0:1713279306.748351:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147221 00000100:00100000:1.0:1713279306.748354:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f44450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3401:1954:x1796503281198784:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.748358:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda7dbd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8584:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.748359:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.748362:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda7dbd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8584:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.748366:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114eda73bb lrc: 0/0,0 mode: --/CR res: [0x240000403:0x757a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175373 expref: 3401 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.748367:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda7dbd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8584:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.748368:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223005 00000100:00100000:0.0:1713279306.748372:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3400:11845:x1796503281198976:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:1.0:1713279306.748373:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x757a:0x0].0x0 (ffff88008c725f00) 00010000:00010000:1.0:1713279306.748375:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:3.0:1713279306.748386:0:15658:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda7dbd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8584:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.748388:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f44450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3400:1954:x1796503281198784:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.748392:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147221 00010000:00010000:3.0:1713279306.748394:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7daf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748399:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7daf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748404:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7daf lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748409:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7daf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748433:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092340d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.748436:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7daf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748442:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7daf lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.748449:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3400:11845:x1796503281198976:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 76us (111us total) trans 4295183630 rc 0/0 00010000:00010000:3.0:1713279306.748449:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x0 (ffff880090a56f00) 00010000:00010000:3.0:1713279306.748451:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.748453:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7daf lrc: 3/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.748456:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223005 00010000:00010000:3.0:1713279306.748457:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda7daf lrc: 0/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748466:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda7db6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748470:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda7db6 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748475:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda7db6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.748476:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.748479:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.748481:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda7db6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.748485:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281199104 00010000:00010000:3.0:1713279306.748486:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda7db6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.748488:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281199104 00010000:00010000:3.0:1713279306.748490:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x31 (ffff880096b90f00) 00010000:00010000:3.0:1713279306.748492:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.748493:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda7db6 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.748494:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.748499:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda7db6 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.748501:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281199232 00000100:00100000:1.0:1713279306.748502:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281199232 00010000:00010000:3.0:1713279306.748507:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda7dbd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8584:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.748512:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785040 00010000:00010000:3.0:1713279306.748512:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda7dbd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x8584:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.748515:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3678:11861:x1796503281199104:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1713279306.748517:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda7dbd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8584:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.748521:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092340b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.748523:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda7dbd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8584:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00000100:00100000:2.0:1713279306.748525:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785041 00010000:00010000:3.0:1713279306.748528:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda7dbd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8584:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.748530:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.748530:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3400:11855:x1796503281199232:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:3.0:1713279306.748534:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8584:0x0].0x0 (ffff8800908e1f00) 00010000:00010000:3.0:1713279306.748536:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.748537:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281199360 00010000:00010000:3.0:1713279306.748538:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda7dbd lrc: 2/0,0 mode: --/PR res: [0x200000403:0x8584:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.748539:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281199360 00010000:00010000:3.0:1713279306.748543:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda7dbd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8584:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.748549:0:15482:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.748553:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223006 00000100:00100000:0.0:1713279306.748556:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3679:11863:x1796503281199360:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:2.0:1713279306.748558:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda7d00 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755bf expref: 3400 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.748563:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3679:11861:x1796503281199104:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 47us (86us total) trans 0 rc -17/-17 00000100:00100000:1.0:1713279306.748567:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785040 00010000:00010000:2.0:1713279306.748567:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7831:0x0].0x0 (ffff88008bde0600) 00000100:00100000:3.0:1713279306.748567:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3760:10814:x1796503281198720:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 267us (306us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.748569:0:15482:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.748573:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785039 00000100:00100000:1.0:1713279306.748590:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.748598:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281199424 00000100:00100000:1.0:1713279306.748600:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281199424 00010000:00010000:2.0:1713279306.748603:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda7dc4 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7831:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.748606:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda7d15 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755b8 expref: 3760 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.748609:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda7dc4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.748614:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196488 00010000:00010000:2.0:1713279306.748615:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda7dc4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.748617:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3760:1956:x1796503281199424:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.748621:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.748623:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3679:11863:x1796503281199360:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 65us (92us total) trans 4295183631 rc 0/0 00010000:00010000:1.0:1713279306.748624:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda7d15 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755b8 expref: 3760 pid: 15483 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.748627:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223006 00010000:00010000:1.0:1713279306.748628:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda7d15 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755b8 expref: 3760 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.748636:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda7d15 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755b8 expref: 3760 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.748642:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff880090a56500) 00010000:00010000:1.0:1713279306.748644:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:0.0:1713279306.748646:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.748648:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15507 initiator: MDT0 00000004:00010000:2.0:1713279306.748649:0:15482:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091a2ce00 reply state ffff8801302e1000 transno 4295183632 ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda7dc4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.748651:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.748659:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.748661:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda7dc4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.748664:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.748666:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7831:0x0].0x0 (ffff88008bde0600) 00010000:00010000:2.0:1713279306.748668:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.748669:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281199680 00000100:00100000:1.0:1713279306.748669:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3759:1956:x1796503281199424:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 51us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.748670:0:15482:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713279306.748671:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281199680 00000100:00100000:1.0:1713279306.748673:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196488 00000100:00100000:3.0:1713279306.748679:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281199552 00000100:00100000:3.0:1713279306.748682:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281199552 00000100:00100000:0.0:1713279306.748684:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223007 00000100:00100000:0.0:1713279306.748687:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c568c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:11858:x1796503281199680:12345-192.168.203.4@tcp:33:lfs.0 00000100:00100000:1.0:1713279306.748696:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.748698:0:15507:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:3.0:1713279306.748699:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785042 00000100:00100000:1.0:1713279306.748703:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281199744 00010000:00010000:2.0:1713279306.748703:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:3.0:1713279306.748703:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3759:11860:x1796503281199552:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:1.0:1713279306.748704:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281199744 00010000:00010000:2.0:1713279306.748713:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7dcb lrc: 3/0,1 mode: --/PW res: [0x200000400:0x235:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00000100:00100000:1.0:1713279306.748714:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785043 00000100:00100000:1.0:1713279306.748716:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3679:11868:x1796503281199744:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:2.0:1713279306.748719:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7dcb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.748721:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.748725:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7dcb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.748727:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda7dd2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391755f0 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713279306.748729:0:15467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x79a0:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.748731:0:15467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:1.0:1713279306.748745:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda7de0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.748745:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.748750:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda7de0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.748751:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c568c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:11858:x1796503281199680:12345-192.168.203.4@tcp:33:lfs.0 Request processed in 63us (86us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.748752:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114ed81649 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a171 expref: 3759 pid: 15477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.748754:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda7de0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.748755:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3759:11860:x1796503281199552:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 52us (108us total) trans 0 rc -17/-17 00000100:00100000:0.0:1713279306.748757:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223007 00010000:00010000:2.0:1713279306.748759:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda0cac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173788 expref: 3772 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.748761:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785042 00010000:00010000:2.0:1713279306.748766:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923406c0/0xfc4b8e114eda7853 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7f29:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917547d expref: 3759 pid: 15473 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713279306.748776:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7693:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.748776:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 6/0,1 mode: --/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00000004:00200000:1.0:1713279306.748778:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1713279306.748783:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda7de0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.748797:0:15507:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800923406c0/0xfc4b8e114eda7853 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f29:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917547d expref: 3758 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.748802:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda7dd2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755f0 expref: 3681 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.748805:0:15507:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923406c0/0xfc4b8e114eda7853 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7f29:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917547d expref: 3758 pid: 15473 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.748813:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200027968:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.748814:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda7de0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755f0 expref: 3680 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.748818:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7693:0x0].0x0 (ffff880090aad600) 00000100:00100000:0.0:1713279306.748819:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.748819:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1713279306.748821:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd4fc0, rc 0) 00000100:00100000:3.0:1713279306.748834:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281199936 00000100:00100000:1.0:1713279306.748835:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3680:11868:x1796503281199744:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 118us (139us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.748837:0:15507:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda0cac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173788 expref: 3772 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.748837:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281199936 00000100:00100000:1.0:1713279306.748839:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785043 00010000:00010000:2.0:1713279306.748844:0:15507:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda0cac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173788 expref: 3772 pid: 15481 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.748847:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785044 00000100:00100000:0.0:1713279306.748848:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.748850:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:11666:x1796503281199936:12345-192.168.203.4@tcp:34:lfs.0 00000100:00100000:2.0:1713279306.748852:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200028032:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.748863:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda7de7 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.748867:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda7de7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748871:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda7de7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.748872:0:15507:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114ed81649 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a171 expref: 3758 pid: 15477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.748877:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda7dee lrc: 3/1,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.748880:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda7dee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.748880:0:15507:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114ed81649 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a171 expref: 3758 pid: 15477 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.748881:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.748881:0:15483:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:15483:1796503200027840:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.748883:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda7dee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.748888:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200028096:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.748891:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281200256 00010000:00010000:3.0:1713279306.748891:0:15483:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713279306.748894:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281200256 00000100:00100000:2.0:1713279306.748899:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012edd90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.748907:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223008 00010000:00010000:1.0:1713279306.748907:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda7df5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e09:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.748911:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3759:11204:x1796503281200256:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:1.0:1713279306.748911:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda7df5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e09:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.748912:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:11855:x1796503281199232:12345-192.168.203.4@tcp:36:touch.0 Request processed in 382us (416us total) trans 4295183632 rc 0/0 00010000:00010000:1.0:1713279306.748914:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda7df5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e09:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00200000:1.0:1713279306.748928:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x6e09:0x0]: returning size 4096 00000100:00100000:2.0:1713279306.748929:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785041 00000004:00010000:1.0:1713279306.748931:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda7df5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e09:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748935:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda7de7 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748938:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda7de7 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748941:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda7de7 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748944:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda7de7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748947:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.748948:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda7de7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748951:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda7de7 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748955:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff88007fcb8a00) 00010000:00010000:1.0:1713279306.748957:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.748959:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda7de7 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748962:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda7de7 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748966:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda7dee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748969:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda7dee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748972:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda7dee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748975:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd73c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.748976:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda7dee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748979:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda7dee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.748982:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3760:11204:x1796503281200256:12345-192.168.203.4@tcp:35:touch.0 Request processed in 69us (101us total) trans 4295202642 rc 0/0 00010000:00010000:1.0:1713279306.748982:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x3131 (ffff880135885a00) 00010000:00010000:1.0:1713279306.748983:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.748984:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda7dee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748987:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda7dee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748993:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda7df5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e09:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.748994:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223008 00010000:00010000:1.0:1713279306.748996:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda7df5 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6e09:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.748999:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda7df5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e09:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.749001:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd5680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.749003:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda7df5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e09:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.749005:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda7df5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e09:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.749008:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e09:0x0].0x0 (ffff880135885c00) 00010000:00010000:1.0:1713279306.749009:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.749011:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda7df5 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x6e09:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.749013:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda7df5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e09:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.749027:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3401:11666:x1796503281199936:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 176us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.749031:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785044 00000100:00100000:1.0:1713279306.749040:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281200128 00000100:00100000:1.0:1713279306.749042:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281200128 00010000:00010000:1.0:1713279306.749047:0:15711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7bc5 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175579 expref: 3401 pid: 15483 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.749053:0:15753:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_035:lustre-MDT0001_UUID:15753:1796503200027904:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.749056:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196489 00000100:00100000:1.0:1713279306.749059:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3401:1954:x1796503281200128:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.749060:0:15753:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda7d85 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x78ee:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.749062:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.749065:0:15711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7bc5 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175579 expref: 3401 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.749086:0:15711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7bc5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175579 expref: 3401 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.749093:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76da:0x0].0x0 (ffff88012514d600) 00010000:00010000:1.0:1713279306.749095:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749098:0:15711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749101:0:15711:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749107:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.749114:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3401:1954:x1796503281200128:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 55us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.749117:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196489 00010000:00010000:1.0:1713279306.749134:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009435e880/0xfc4b8e114eda7bc5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x76da:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175579 expref: 3400 pid: 15483 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.749140:0:15485:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001_UUID:15485:1796503200027776:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.749147:0:15485:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749150:0:15485:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749153:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749163:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114eda7dfc lrc: 3/0,1 mode: --/EX res: [0x240000400:0x262:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.749167:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114eda7dfc lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x262:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749170:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114eda7dfc lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x262:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749175:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114eda7e03 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x25c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.749178:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114eda7e03 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x25c:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749181:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114eda7e03 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x25c:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000004:00010000:1.0:1713279306.749355:0:15485:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009089e680 reply state ffff88009596fc00 transno 4295183633 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114eda7dfc lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x262:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749361:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114eda7dfc lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749364:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x262:0x0].0x0 (ffff8800937ce400) 00010000:00010000:1.0:1713279306.749366:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00000100:00100000:1.0:1713279306.749367:0:15485:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:1.0:1713279306.749369:0:15485:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009089e680 reply state ffff88009596fc00 transno 4295183633 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114eda7e03 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x25c:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749372:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114eda7e03 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749375:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25c:0x0].0x0 (ffff880096d67b00) 00010000:00010000:1.0:1713279306.749377:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00000100:00100000:1.0:1713279306.749378:0:15485:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00010000:1.0:1713279306.749380:0:15485:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009089e680 reply state ffff88009596fc00 transno 4295183633 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749384:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749386:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76da:0x0].0x0 (ffff88012514d600) 00010000:00010000:1.0:1713279306.749387:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00000100:00100000:1.0:1713279306.749388:0:15485:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000004:00010000:1.0:1713279306.749389:0:15485:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009089e680 reply state ffff88009596fc00 transno 4295183633 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749392:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.749395:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00010000:00010000:1.0:1713279306.749396:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.749397:0:15485:0:(service.c:188:ptlrpc_save_lock()) nlocks 3 00000100:00100000:1.0:1713279306.749428:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3401:11374:x1796503281195840:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 9899us (9925us total) trans 4295183633 rc 0/0 00000100:00100000:1.0:1713279306.749433:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785024 00000100:00100000:0.0:1713279306.750462:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.750478:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.750487:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.750494:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.750502:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281200384 00000100:00100000:0.0:1713279306.750505:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281200384 00010000:00010000:0.0:1713279306.750514:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114eda63bc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f52 expref: 3401 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.750515:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.750530:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281200320 00000100:00100000:0.0:1713279306.750532:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281200320 00000100:00100000:2.0:1713279306.750533:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.750537:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175231 expref: 3680 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.750539:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196490 00000100:00100000:1.0:1713279306.750545:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3401:1957:x1796503281200384:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.750549:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.750553:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.750557:0:15711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114eda63bc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f52 expref: 3401 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.750564:0:15711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114eda63bc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f52 expref: 3401 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.750570:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.750577:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114eda63bc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f52 expref: 3401 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.750584:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x78ee:0x0].0x0 (ffff880091b35f00) 00000100:00100000:0.0:1713279306.750585:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196491 00010000:00010000:1.0:1713279306.750586:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda7d85 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x78ee:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:3.0:1713279306.750586:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281200768 00000100:00100000:0.0:1713279306.750589:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3680:1957:x1796503281200320:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.750590:0:15711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda7d85 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x78ee:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15753 initiator: MDT1 00000100:00100000:3.0:1713279306.750591:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281200768 00010000:00010000:1.0:1713279306.750593:0:15711:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda7d85 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x78ee:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.750594:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.750597:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175231 expref: 3680 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.750603:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175231 expref: 3680 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.750603:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.750612:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda6e9e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175231 expref: 3680 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.750612:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110462 00000100:00100000:3.0:1713279306.750617:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1956:x1796503281200768:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.750618:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7bca:0x0].0x0 (ffff880093598800) 00000100:00100000:1.0:1713279306.750619:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3400:1957:x1796503281200384:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 74us (139us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.750621:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.750623:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196490 00010000:00010000:0.0:1713279306.750625:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.750625:0:15499:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.750628:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.750635:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281200704 00010000:00010000:3.0:1713279306.750635:0:15499:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda7e0a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175613 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.750636:0:15507:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff88009387df80 x1796503200027968) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8800923406c0/0xfc4b8e114eda7853 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7f29:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917547d expref: 3759 pid: 15473 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.750637:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.750638:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281200704 00000100:00100000:1.0:1713279306.750646:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281200896 00010000:00010000:2.0:1713279306.750646:0:15507:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800923406c0/0xfc4b8e114eda7853 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f29:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917547d expref: 3759 pid: 15473 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.750647:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281200896 00000100:00100000:0.0:1713279306.750650:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3679:1957:x1796503281200320:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 61us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.750652:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281201024 00000100:00100000:0.0:1713279306.750654:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196491 00000100:00100000:1.0:1713279306.750654:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281201024 00010000:00010000:2.0:1713279306.750657:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923406c0/0xfc4b8e114eda7853 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7f29:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917547d expref: 3759 pid: 15473 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.750660:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281200448 00000100:00100000:1.0:1713279306.750661:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281200448 00000100:00100000:3.0:1713279306.750661:0:15499:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:15499:1796503200028160:192.168.203.4@tcp:106: 00000100:00100000:1.0:1713279306.750666:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785045 00000100:00100000:2.0:1713279306.750667:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200027968:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.750668:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3774:11880:x1796503281200704:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.750675:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.750679:0:15753:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda7d85 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x78ee:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.750680:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda7e11 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917560c expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.750683:0:15499:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e7ab180 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.750685:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda7d85 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x78ee:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000004:00200000:2.0:1713279306.750693:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x78ee:0x0]: returning size 40670 00000100:00100000:3.0:1713279306.750696:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785046 00000100:00100000:3.0:1713279306.750700:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3775:11877:x1796503281200896:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.750708:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.750713:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281200576 00010000:00010000:1.0:1713279306.750714:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7e1f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x8430:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.750715:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092342880/0xfc4b8e114eda7e26 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917561a expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.750716:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281200576 00010000:00010000:1.0:1713279306.750720:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7e1f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x8430:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.750724:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7e1f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x8430:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.750726:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223009 00000100:00100000:0.0:1713279306.750728:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3777:11856:x1796503281200576:12345-192.168.203.4@tcp:35:touch.0 00000004:00200000:1.0:1713279306.750729:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8430:0x0]: returning size 3214 00010000:00010000:2.0:1713279306.750737:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114eda7d7e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755e2 expref: 3401 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.750751:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6ac0/0xfc4b8e114eda7d85 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x78ee:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755e2 expref: 3400 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.750758:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x78ee:0x0].0x0 (ffff880091b35f00) 00010000:00010000:1.0:1713279306.750760:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda7e11 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917560c expref: 3779 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.750760:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1713279306.750762:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd6ac0, rc 0) 00010000:00010000:3.0:1713279306.750766:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda7e34 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.750767:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7e1f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x8430:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917560c expref: 3778 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.750771:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8430:0x0].0x0 (ffff8800920e4400) 00010000:00010000:1.0:1713279306.750772:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1713279306.750774:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd4900, rc 0) 00010000:00010000:3.0:1713279306.750774:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda7e34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.750779:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3400:11871:x1796503281199616:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 2937us (3034us total) trans 4295183634 rc 0/0 00010000:00010000:3.0:1713279306.750780:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda7e34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.750784:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785036 00000100:00100000:1.0:1713279306.750788:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3778:11880:x1796503281200704:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 118us (327us total) trans 4295202643 rc 0/0 00010000:00010000:3.0:1713279306.750789:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343cc0/0xfc4b8e114eda7e3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.750791:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785045 00010000:00010000:3.0:1713279306.750794:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092343cc0/0xfc4b8e114eda7e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.750798:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785047 00010000:00010000:3.0:1713279306.750800:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092343cc0/0xfc4b8e114eda7e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.750801:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785048 00000100:00100000:2.0:1713279306.750803:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3680:11711:x1796503281201024:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.750804:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3680:11857:x1796503281200448:12345-192.168.203.4@tcp:101:mkdir.0 00000100:00100000:0.0:1713279306.750822:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3778:11856:x1796503281200576:12345-192.168.203.4@tcp:35:touch.0 Request processed in 91us (272us total) trans 4295202644 rc 0/0 00010000:00010000:2.0:1713279306.750824:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.750826:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223009 00010000:00010000:1.0:1713279306.750829:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.750833:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc480/0xfc4b8e114eda7e42 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175621 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.750835:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda7e49 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175605 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713279306.750841:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x8179:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.750848:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda7e34 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.750852:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7e50 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.750853:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda7e34 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.750857:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7e50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.750858:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda7e34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.750861:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7e50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.750863:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda7e34 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.750867:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.750867:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.750870:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda7e34 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.750872:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200028032:192.168.203.4@tcp:104: 00000004:00200000:1.0:1713279306.750873:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x260:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.750875:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1713279306.750875:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda7e34 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.750880:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0000_UUID:15507:1796503200028096:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.750883:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda7e49 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175605 expref: 3683 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.750883:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.750885:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.750886:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.750887:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda7e34 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.750890:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7e50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175605 expref: 3682 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.750892:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281201216 00010000:00010000:3.0:1713279306.750892:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda7e34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.750893:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f29:0x0].0x0 (ffff880089f68e00) 00000100:00100000:0.0:1713279306.750894:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281201216 00010000:00010000:1.0:1713279306.750894:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00010000:00010000:1.0:1713279306.750896:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713279306.750896:0:15507:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.750897:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094550fc0, rc 0) 00010000:00010000:3.0:1713279306.750899:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343cc0/0xfc4b8e114eda7e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.750901:0:15507:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.750902:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda0cac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173788 expref: 3778 pid: 15481 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.750904:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092343cc0/0xfc4b8e114eda7e3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.750906:0:15507:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00000100:00100000:1.0:1713279306.750908:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3682:11857:x1796503281200448:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 104us (375us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.750910:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092343cc0/0xfc4b8e114eda7e3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.750911:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196492 00000100:00100000:1.0:1713279306.750912:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785048 00010000:00010000:2.0:1713279306.750912:0:15507:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.750914:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092343cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.750916:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092343cc0/0xfc4b8e114eda7e3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.750919:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281201152 00010000:00010000:3.0:1713279306.750920:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092343cc0/0xfc4b8e114eda7e3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.750921:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281201152 00010000:00010000:3.0:1713279306.750925:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3031 (ffff880091b34600) 00010000:00010000:2.0:1713279306.750927:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda7e57 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.750927:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.750929:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092343cc0/0xfc4b8e114eda7e3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.750930:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785049 00000100:00100000:1.0:1713279306.750933:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3759:10814:x1796503281201152:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.750933:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda7e57 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.750934:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092343cc0/0xfc4b8e114eda7e3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.750938:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.750939:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda7e57 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.750942:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094550d80/0xfc4b8e114eda7e5e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x8584:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175628 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.750948:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7e65 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.750951:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342880/0xfc4b8e114eda7e26 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917561a expref: 3778 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.750954:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3778:1957:x1796503281201216:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.750954:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7e65 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.750958:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342880/0xfc4b8e114eda7e26 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917561a expref: 3778 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.750959:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.750959:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7e65 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.750962:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda0cac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173788 expref: 3778 pid: 15481 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.750964:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092342880, rc 0) 00010000:00010000:1.0:1713279306.750967:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7e6c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8584:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.750968:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda0cac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173788 expref: 3777 pid: 15481 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.750971:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7e6c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8584:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.750975:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda0cac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173788 expref: 3777 pid: 15481 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.750976:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7e6c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8584:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.750976:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda7e57 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000004:00200000:1.0:1713279306.750979:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8584:0x0]: returning size 0 00010000:00010000:0.0:1713279306.750981:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f29:0x0].0x0 (ffff880089f68e00) 00000100:00100000:3.0:1713279306.750981:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3776:11877:x1796503281200896:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 281us (492us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.750982:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda7e57 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.750984:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.750987:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.750987:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda7e57 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00000100:00100000:3.0:1713279306.750987:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785046 00010000:00010000:0.0:1713279306.750990:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.750992:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda7e57 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.750993:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.750996:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.750999:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda7e57 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.751001:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3775:1957:x1796503281201216:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 86us (115us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.751004:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094550d80/0xfc4b8e114eda7e5e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x8584:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175628 expref: 3762 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.751004:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda7e57 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.751005:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196492 00010000:00010000:1.0:1713279306.751010:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7e6c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x8584:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175628 expref: 3761 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.751011:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88008d597700) 00010000:00010000:2.0:1713279306.751013:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.751014:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8584:0x0].0x0 (ffff8800908e1f00) 00010000:00010000:3.0:1713279306.751014:0:15483:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.751015:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda7e57 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.751016:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1713279306.751017:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d4b3180, rc 0) 00010000:00010000:3.0:1713279306.751019:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.751020:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda7e57 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.751025:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.751026:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3761:10814:x1796503281201152:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 93us (159us total) trans 4295202645 rc 0/0 00010000:00010000:2.0:1713279306.751027:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7e65 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00000004:00200000:3.0:1713279306.751027:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7bca:0x0]: returning size 27670 00000100:00100000:1.0:1713279306.751030:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785049 00000100:00100000:0.0:1713279306.751031:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281201280 00010000:00010000:2.0:1713279306.751032:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7e65 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.751033:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281201280 00010000:00010000:2.0:1713279306.751036:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7e65 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.751038:0:15711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114ed81649 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a171 expref: 3761 pid: 15477 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.751040:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.751043:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7e65 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.751046:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196493 00010000:00010000:2.0:1713279306.751047:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7e65 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.751048:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3761:1955:x1796503281201280:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.751051:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.751053:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff8800909b0e00) 00010000:00010000:0.0:1713279306.751054:0:15711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114ed81649 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a171 expref: 3761 pid: 15477 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.751054:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.751055:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.751057:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7e65 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.751060:0:15711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114ed81649 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a171 expref: 3761 pid: 15477 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.751065:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda7e65 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.751065:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda7d69 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755cd expref: 3401 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.751066:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114ed81649 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f29:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916a171 expref: 3761 pid: 15477 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.751088:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f29:0x0].0x0 (ffff880089f68e00) 00010000:00010000:3.0:1713279306.751090:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755cd expref: 3400 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.751091:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.751094:0:15711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15507 initiator: MDT0 00010000:00010000:3.0:1713279306.751096:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7bca:0x0].0x0 (ffff880093598800) 00010000:00010000:0.0:1713279306.751097:0:15711:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.751098:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc480/0xfc4b8e114eda7e42 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175621 expref: 3681 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.751098:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1713279306.751100:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092341d40, rc 0) 00010000:00010000:2.0:1713279306.751104:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc480/0xfc4b8e114eda7e42 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175621 expref: 3681 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.751109:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.751113:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3400:11833:x1796503281198080:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 6015us (6516us total) trans 4295183635 rc 0/0 00010000:00010000:2.0:1713279306.751114:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bc480, rc 0) 00000100:00100000:1.0:1713279306.751115:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.751117:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3760:1955:x1796503281201280:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 68us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.751121:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196493 00000100:00100000:3.0:1713279306.751122:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785034 00010000:00010000:2.0:1713279306.751124:0:15507:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:1.0:1713279306.751125:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281201472 00000100:00100000:1.0:1713279306.751127:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281201472 00010000:00010000:2.0:1713279306.751129:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00000100:00100000:0.0:1713279306.751130:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281201408 00000100:00100000:0.0:1713279306.751131:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281201408 00000100:00100000:0.0:1713279306.751138:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223010 00000100:00100000:1.0:1713279306.751139:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785050 00000100:00100000:0.0:1713279306.751141:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3401:11666:x1796503281201408:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1713279306.751142:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3401:11374:x1796503281201472:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:1.0:1713279306.751174:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114eda7e81 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.751179:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114eda7e81 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751181:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751183:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114eda7e81 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751187:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751188:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7e88 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.751190:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:11666:x1796503281201408:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 47us (135us total) trans 4295183636 rc 0/0 00010000:00010000:1.0:1713279306.751192:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7e88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751192:0:15507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00000100:00100000:0.0:1713279306.751194:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223010 00010000:00010000:1.0:1713279306.751195:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7e88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751196:0:15507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bc6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.751199:0:15507:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.751204:0:15507:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.751213:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f29:0x0].0x0 (ffff880089f68e00) 00010000:00010000:2.0:1713279306.751214:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.751215:0:15507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751217:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda7e8f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x793a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.751218:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda7dd9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7f29:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751221:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda7e8f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x793a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.751224:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda7e8f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x793a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751224:0:15507:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.751227:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.751230:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.751233:0:15507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.751235:0:15507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bd8c0 already unused, calling callback (ffffffffa0f0d730) 00000004:00010000:1.0:1713279306.751236:0:15485:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda7e8f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x793a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751236:0:15507:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.751239:0:15507:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751241:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114eda7e81 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751242:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff880090a56500) 00010000:00010000:2.0:1713279306.751243:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.751244:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114eda7e81 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751244:0:15507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 3/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.751247:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda7d2a lrc: 0/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751250:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114eda7e81 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.751253:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114eda7e81 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751253:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7dcb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751256:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298efa80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.751256:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7dcb lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751257:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114eda7e81 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751259:0:15507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7dcb lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751260:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114eda7e81 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751261:0:15507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.751263:0:15507:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7dcb lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751264:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012514dc00) 00010000:00010000:2.0:1713279306.751265:0:15507:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7dcb lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751266:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.751267:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114eda7e81 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751268:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x3231 (ffff88009e797800) 00010000:00010000:2.0:1713279306.751269:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.751270:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114eda7e81 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751271:0:15507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7dcb lrc: 2/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.751273:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda7dcb lrc: 0/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751275:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7e88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.751277:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7e88 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.751280:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7e88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751280:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751283:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a4c86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.751283:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751285:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7e88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751286:0:15507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.751288:0:15507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ed8c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.751290:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7e88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751290:0:15507:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751293:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x65656ce3 (ffff88012d397c00) 00010000:00010000:2.0:1713279306.751293:0:15507:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.751295:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.751296:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7e88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751296:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.751298:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda7e88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751298:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.751299:0:15507:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.751302:0:15507:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.751304:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda7e8f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x793a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751305:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.751307:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda7e8f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x793a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751308:0:15507:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.751309:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda7e8f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x793a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.751312:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.751313:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda7e8f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x793a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.751316:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda7e8f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x793a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.751319:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x793a:0x0].0x0 (ffff88008c002700) 00010000:00010000:1.0:1713279306.751321:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.751323:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda7e8f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x793a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.751325:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda7e8f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x793a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.751325:0:15507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.751330:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda7ad7 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15507 initiator: MDT0 00000004:00020000:2.0:1713279306.751338:0:15507:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200000402:0x7f51:0x0]/12 failed: rc = -114 00000100:00100000:1.0:1713279306.751341:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3401:11374:x1796503281201472:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 197us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.751345:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785050 00010000:00010000:3.0:1713279306.751351:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.751357:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.751359:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3759:10123:x1796503281191680:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 17683us (17784us total) trans 0 rc -114/-114 00000100:00100000:2.0:1713279306.751364:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14329 00000100:00100000:2.0:1713279306.751385:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3680:11711:x1796503281201024:12345-192.168.203.4@tcp:101:touch.0 Request processed in 581us (871us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.751387:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028224:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1713279306.751390:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785047 00000100:00100000:3.0:1713279306.751410:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.751445:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800936db240 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.751457:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200028224 00000100:00100000:1.0:1713279306.751459:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200028224 00000100:00100000:1.0:1713279306.751472:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98700 00000100:00100000:1.0:1713279306.751475:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:6942:x1796503200028224:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1713279306.751509:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:6942:x1796503200028224:12345-0@lo:1000:mdt_io00_001.0 Request processed in 33us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.751512:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98700 00000100:00100000:3.0:1713279306.751525:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028224:0@lo:1000:mdt_io00_001.0 00000004:00080000:3.0:1713279306.751542:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000403:0x729c:0x0] 00000100:00100000:3.0:1713279306.751558:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028288:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1713279306.751577:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.751609:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800936db3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.751619:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200028288 00000100:00100000:1.0:1713279306.751621:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200028288 00000100:00100000:1.0:1713279306.751635:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98701 00000100:00100000:1.0:1713279306.751637:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:6942:x1796503200028288:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1713279306.751667:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:6942:x1796503200028288:12345-0@lo:1000:mdt_io00_001.0 Request processed in 29us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.751671:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98701 00000100:00100000:3.0:1713279306.751678:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028288:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1713279306.752041:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028352:0@lo:403:mdt_io00_001.0 00000100:00100000:3.0:1713279306.752058:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.752078:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e7ab600 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.752122:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200028352 00000100:00100000:1.0:1713279306.752127:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200028352 00000100:00100000:1.0:1713279306.752148:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98702 00000100:00100000:1.0:1713279306.752152:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:6942:x1796503200028352:12345-0@lo:403:mdt_io00_001.0 00000100:00100000:1.0:1713279306.753296:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:6942:x1796503200028352:12345-0@lo:403:mdt_io00_001.0 Request processed in 1142us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.753301:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98702 00000100:00100000:0.0:1713279306.753334:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.753346:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281201600 00000100:00100000:0.0:1713279306.753350:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.753352:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281201600 00000100:00100000:3.0:1713279306.753358:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028352:0@lo:403:mdt_io00_001.0 00000100:00100000:0.0:1713279306.753364:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.753378:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281201664 00000100:00100000:2.0:1713279306.753380:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281201664 00000100:00100000:2.0:1713279306.753391:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281201728 00000100:00100000:2.0:1713279306.753392:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281201728 00000100:00100000:1.0:1713279306.753395:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785051 00000100:00100000:1.0:1713279306.753399:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:11204:x1796503281201600:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.753407:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.753410:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785052 00010000:00010000:1.0:1713279306.753428:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda7e96 lrc: 2/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917562f expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.753432:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:11855:x1796503281201664:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.753441:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.753449:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc240/0xfc4b8e114eda7e9d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7831:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175636 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.753452:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda7ea4 lrc: 3/1,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.753457:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785053 00010000:00010000:1.0:1713279306.753457:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda7ea4 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.753461:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3775:11874:x1796503281201728:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.753462:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda7ea4 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.753468:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.753468:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7eab lrc: 3/1,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.753472:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7eab lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.753473:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc240/0xfc4b8e114eda7e9d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7831:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175636 expref: 3404 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.753475:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7eab lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.753476:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14900/0xfc4b8e114eda7eb2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917563d expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.753481:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc240/0xfc4b8e114eda7e9d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7831:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175636 expref: 3404 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.753489:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda7ea4 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.753492:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda7ea4 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.753492:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7831:0x0].0x0 (ffff88008bde0600) 00010000:00010000:2.0:1713279306.753494:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1713279306.753495:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda7ea4 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.753496:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bc240, rc 0) 00010000:00010000:1.0:1713279306.753499:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda7ea4 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.753503:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda7eb9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.753504:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023dd40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.753506:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda7ea4 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.753509:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda7ea4 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.753513:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda7eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.753513:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xff:0x0].0x0 (ffff880091de1a00) 00010000:00010000:1.0:1713279306.753515:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.753516:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3404:11855:x1796503281201664:12345-192.168.203.4@tcp:101:touch.0 Request processed in 84us (164us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.753517:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda7ea4 lrc: 3/0,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.753519:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda7eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.753520:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda7ea4 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xff:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.753522:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785052 00010000:00010000:1.0:1713279306.753524:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7eab lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.753528:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7eab lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.753529:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7ec0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.753531:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7eab lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.753533:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023cfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.753534:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7eab lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.753535:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.753537:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7eab lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xff:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.753540:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.753540:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xff:0x0].0x3831 (ffff880096da6900) 00010000:00010000:1.0:1713279306.753541:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.753543:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7eab lrc: 2/0,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.753546:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda7eab lrc: 0/0,0 mode: --/PR res: [0x240000401:0xff:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.753558:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda7e96 lrc: 1/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917562f expref: 3403 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.753562:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda7e96 lrc: 0/0,0 mode: --/CW res: [0x240000401:0xff:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917562f expref: 3403 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.753566:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023e880, rc 0) 00010000:00010000:0.0:1713279306.753575:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114eda7ec7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.753580:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114eda7ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.753580:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:11204:x1796503281201600:12345-192.168.203.4@tcp:101:touch.0 Request processed in 180us (248us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.753583:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114eda7ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.753584:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785051 00000100:00100000:2.0:1713279306.753600:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.753614:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281201792 00000100:00100000:1.0:1713279306.753616:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281201792 00000004:00200000:0.0:1713279306.753619:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.753621:0:15752:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1713279306.753627:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223011 00000004:00010000:0.0:1713279306.753628:0:15752:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114eda7ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.753630:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:11845:x1796503281201792:12345-192.168.203.4@tcp:33:lfs.0 00010000:00010000:0.0:1713279306.753633:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda7eb9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.753636:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda7eb9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.753639:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda7eb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.753642:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda7eb9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.753645:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe14fc0 already unused, calling callback (ffffffffa0f0d730) 00002000:00010000:2.0:1713279306.753646:0:15499:0:(ofd_lvb.c:290:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb atime: 1648351934 -> 1713279292 00010000:00010000:0.0:1713279306.753647:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda7eb9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.753650:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda7eb9 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00000004:00200000:1.0:1713279306.753651:0:15527:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x757a:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.753653:0:15527:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713279306.753655:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00000100:00100000:2.0:1713279306.753655:0:15499:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:15499:1796503200028160:192.168.203.4@tcp:106: 00010000:00010000:0.0:1713279306.753657:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.753659:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda7eb9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.753662:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda7eb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.753666:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.753668:0:15499:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda7e0a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175613 expref: 76 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713279306.753669:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7ec0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.753672:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.753672:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:11845:x1796503281201792:12345-192.168.203.4@tcp:33:lfs.0 Request processed in 41us (73us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.753675:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe15b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.753676:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.753676:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223011 00010000:00010000:2.0:1713279306.753677:0:15499:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda7e0a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175613 expref: 76 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713279306.753679:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7ec0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.753682:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff880092a4c400) 00010000:00010000:0.0:1713279306.753683:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.753684:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7ec0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.753685:0:15499:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923421c0, rc 0) 00010000:00010000:0.0:1713279306.753686:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda7ec0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.753699:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14900/0xfc4b8e114eda7eb2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917563d expref: 3777 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.753700:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1956:x1796503281200768:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 3083us (3129us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.753705:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114eda7ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917563d expref: 3776 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.753705:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110462 00010000:00010000:0.0:1713279306.753708:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:0.0:1713279306.753709:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713279306.753711:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe14480, rc 0) 00000100:00100000:0.0:1713279306.753726:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3776:11874:x1796503281201728:12345-192.168.203.4@tcp:101:touch.0 Request processed in 265us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.753730:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785053 00000100:00100000:0.0:1713279306.753860:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.753862:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028416:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1713279306.753903:0:15507:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281202048 00000100:00100000:2.0:1713279306.753907:0:15507:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281202048 00000100:00100000:2.0:1713279306.753925:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14333 00000100:00100000:3.0:1713279306.753925:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.753930:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:11666:x1796503281202048:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:3.0:1713279306.753944:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e7ab180 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.753947:0:15507:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.753953:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200028416 00000100:00100000:1.0:1713279306.753956:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200028416 00010000:00010000:2.0:1713279306.753957:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d86c0/0xfc4b8e114ecd2d3b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6e09:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391354d9 expref: 3402 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.753966:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e09:0x0].0x0 (ffff880135885c00) 00000100:00100000:1.0:1713279306.753967:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98703 00000100:00100000:1.0:1713279306.753969:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:6942:x1796503200028416:12345-0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1713279306.753969:0:15507:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.753984:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 15507 initiator: MDT0 00010000:00010000:2.0:1713279306.753990:0:15507:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.753998:0:15507:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 15507 initiator: MDT1 00000100:00100000:2.0:1713279306.754009:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0001-mdtlov_UUID:15507:1796503200028480:0@lo:101:mdt_io00_005.0 00000100:00100000:0.0:1713279306.754020:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.754029:0:15507:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.754037:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.754046:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012edd90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.754052:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.754054:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:6942:x1796503200028416:12345-0@lo:1000:mdt_io00_001.0 Request processed in 83us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.754059:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98703 00000100:00100000:2.0:1713279306.754064:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281201984 00000100:00100000:1.0:1713279306.754065:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200028480 00000100:00100000:3.0:1713279306.754066:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028416:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1713279306.754079:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200028480 00000100:00100000:0.0:1713279306.754080:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281202112 00000100:00100000:0.0:1713279306.754083:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281202112 00000100:00100000:2.0:1713279306.754083:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281201984 00000100:00100000:2.0:1713279306.754091:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281202368 00000100:00100000:1.0:1713279306.754092:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98704 00000100:00100000:2.0:1713279306.754093:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281202368 00000100:00100000:1.0:1713279306.754094:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+60:15507:x1796503200028480:12345-0@lo:101:mdt_io00_005.0 00000100:00100000:0.0:1713279306.754095:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785054 00000100:00100000:0.0:1713279306.754098:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3777:11875:x1796503281202112:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.754099:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.754104:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.754105:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda7ed5 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda7ece expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.754110:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda7edc lrc: 2/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917564b expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.754113:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785055 00010000:00010000:1.0:1713279306.754115:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda7d1c expref: 61 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.754117:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3778:11711:x1796503281202368:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.754121:0:15516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda7ed5 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda7ece expref: 61 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.754126:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda7ee3 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.754126:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.754131:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda7ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.754133:0:15516:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda7d1c expref: 61 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.754134:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7eea lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175652 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.754136:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda7ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.754139:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda7ed5 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda7ece expref: 61 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.754143:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.754144:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.754146:0:15516:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.754149:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023c000, rc 0) 00000004:00200000:0.0:1713279306.754154:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x235:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.754157:0:15752:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1713279306.754157:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028608:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1713279306.754164:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+61:15507:x1796503200028480:12345-0@lo:101:mdt_io00_005.0 Request processed in 68us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.754167:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98704 00010000:00010000:0.0:1713279306.754172:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda7edc lrc: 0/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917564b expref: 3780 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.754177:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.754183:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda7ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917564b expref: 3779 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.754184:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7ef1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.754186:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e7ab180 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.754189:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff880092a4c200) 00010000:00010000:0.0:1713279306.754191:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1713279306.754191:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200028608 00010000:00010000:2.0:1713279306.754191:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.754193:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe16d00, rc 0) 00000100:00100000:1.0:1713279306.754193:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200028608 00010000:00010000:2.0:1713279306.754197:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.754201:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98705 00000100:00100000:1.0:1713279306.754203:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+94:6942:x1796503200028608:12345-0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1713279306.754206:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda7ef8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.754207:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.754211:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3779:11875:x1796503281202112:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 111us (173us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.754211:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda7ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713279306.754215:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785054 00010000:00010000:2.0:1713279306.754217:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda7ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000004:00200000:2.0:1713279306.754233:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00000100:00100000:1.0:1713279306.754235:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+94:6942:x1796503200028608:12345-0@lo:1000:mdt_io00_001.0 Request processed in 31us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.754239:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98705 00010000:00010000:2.0:1713279306.754239:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7ef1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.754245:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7ef1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.754247:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281202240 00000100:00100000:1.0:1713279306.754249:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281202240 00010000:00010000:2.0:1713279306.754250:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.754255:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7ef1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.754256:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223012 00000100:00100000:0.0:1713279306.754259:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.754259:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3759:10123:x1796503281202240:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:2.0:1713279306.754260:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcd80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.754261:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028608:0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1713279306.754263:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7ef1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.754268:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7ef1 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.754274:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8800960e8000) 00010000:00010000:2.0:1713279306.754276:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.754279:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7ef1 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.754284:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3759:10123:x1796503281202240:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 24us (77us total) trans 0 rc -116/-116 00010000:00010000:2.0:1713279306.754284:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda7ef1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.754287:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028672:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1713279306.754288:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223012 00010000:00010000:2.0:1713279306.754291:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda7ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.754296:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda7ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.754301:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda7ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.754303:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.754305:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bf3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.754308:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda7ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.754312:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800936db3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.754313:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200028672 00010000:00010000:2.0:1713279306.754313:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda7ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.754315:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200028672 00010000:00010000:2.0:1713279306.754319:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff8800960e8f00) 00010000:00010000:2.0:1713279306.754321:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.754322:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98706 00010000:00010000:2.0:1713279306.754323:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda7ef8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.754324:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:6942:x1796503200028672:12345-0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1713279306.754327:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda7ef8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.754347:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7eea lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175652 expref: 3778 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.754354:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda7eea lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175652 expref: 3778 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.754355:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:6942:x1796503200028672:12345-0@lo:1000:mdt_io00_001.0 Request processed in 30us (52us total) trans 0 rc 1/1 00000100:00100000:1.0:1713279306.754359:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98706 00010000:00010000:2.0:1713279306.754362:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935beac0, rc 0) 00000100:00100000:3.0:1713279306.754368:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028672:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1713279306.754380:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3777:11711:x1796503281202368:12345-192.168.203.4@tcp:101:touch.0 Request processed in 263us (328us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.754386:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785055 00010000:00010000:3.0:1713279306.754392:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123732400/0xfc4b8e114eda7eff lrc: 3/0,1 mode: --/CW res: [0x240000400:0x254:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754398:0:6942:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123732400/0xfc4b8e114eda7eff lrc: 3/0,1 mode: --/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.754401:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281202432 00000100:00100000:2.0:1713279306.754403:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281202432 00010000:00010000:3.0:1713279306.754404:0:6942:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123732400/0xfc4b8e114eda7eff lrc: 3/0,1 mode: --/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.754430:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028736:0@lo:101:mdt_io00_001.0 00000100:00100000:0.0:1713279306.754435:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110463 00000100:00100000:0.0:1713279306.754439:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1954:x1796503281202432:12345-192.168.203.4@tcp:1:lfs.0 00000100:00100000:3.0:1713279306.754448:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.754452:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0001-mdtlov_UUID:15507:1796503200028480:0@lo:101:mdt_io00_005.0 00000100:00100000:3.0:1713279306.754457:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800936db240 going to sleep for 11 seconds 00002000:00010000:0.0:1713279306.754459:0:15538:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x1164:0x0] initial LVB size: 0, mtime: 0x661e9146, atime: 0x661e9146, ctime: 0x661e9146, blocks: 0x0 00010000:00010000:2.0:1713279306.754460:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.754463:0:15538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda7f06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1164:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.754466:0:15507:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.754469:0:15538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.754470:0:15538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.754473:0:15538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda7f06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.754479:0:15538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda7f06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.754482:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200028736 00000100:00100000:1.0:1713279306.754484:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200028736 00010000:00010000:0.0:1713279306.754485:0:15538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda7f06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.754488:0:15538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda7f06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.754489:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785056 00010000:00010000:0.0:1713279306.754492:0:15538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda7f06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.754492:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98707 00000100:00100000:2.0:1713279306.754494:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:11374:x1796503281201984:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.754495:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:6942:x1796503200028736:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:0.0:1713279306.754496:0:15538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe158c0 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:0.0:1713279306.754497:0:15538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda7f06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.754500:0:6934:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.754501:0:15538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda7f06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.754502:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.754506:0:6934:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114eda7f0d lrc: 2/0,0 mode: --/CW res: [0x240000400:0x254:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda7eff expref: -99 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.754507:0:15538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda7f06 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.754509:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda7f14 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x793a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175644 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.754511:0:15538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda7f06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.754515:0:6934:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114eda7f0d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda7eff expref: 95 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.754521:0:6934:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114eda7f0d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda7eff expref: 95 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.754525:0:6934:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x254:0x0].0x0 (ffff880089dc2800) 00010000:00010000:1.0:1713279306.754526:0:6934:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.754527:0:6934:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023c6c0, rc 0) 00000100:00100000:0.0:1713279306.754533:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+75:1954:x1796503281202432:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 93us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.754537:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110463 00000100:00100000:1.0:1713279306.754541:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+95:6942:x1796503200028736:12345-0@lo:101:mdt_io00_001.0 Request processed in 45us (92us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.754543:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda7f1b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x793a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.754544:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98707 00010000:00010000:2.0:1713279306.754550:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda7f1b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x793a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.754556:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda7f1b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x793a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.754556:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028736:0@lo:101:mdt_io00_001.0 00000004:00200000:2.0:1713279306.754563:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x793a:0x0]: returning size 33128 00010000:00010000:3.0:1713279306.754565:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123732400/0xfc4b8e114eda7eff lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7f0d expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.754572:0:6942:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123732400/0xfc4b8e114eda7eff lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7f0d expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713279306.754585:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x254:0x0] 00010000:00010000:2.0:1713279306.754603:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda7f14 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x793a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175644 expref: 3405 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.754613:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda7f1b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x793a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175644 expref: 3404 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.754615:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ea5f180/0xfc4b8e114eda7f29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x254:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.754619:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x793a:0x0].0x0 (ffff88008c002700) 00010000:00010000:3.0:1713279306.754620:0:6942:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ea5f180/0xfc4b8e114eda7f29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.754621:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1713279306.754623:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bc000, rc 0) 00010000:00010000:3.0:1713279306.754626:0:6942:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ea5f180/0xfc4b8e114eda7f29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.754634:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028800:0@lo:101:mdt_io00_001.0 00000100:00100000:3.0:1713279306.754650:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.754652:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3404:11374:x1796503281201984:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 157us (632us total) trans 4295183637 rc 0/0 00000100:00100000:2.0:1713279306.754658:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785056 00000100:00100000:3.0:1713279306.754658:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800936db240 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.754660:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200028800 00000100:00100000:1.0:1713279306.754662:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200028800 00000100:00100000:1.0:1713279306.754673:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98708 00000100:00100000:1.0:1713279306.754676:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+95:6942:x1796503200028800:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:1.0:1713279306.754680:0:6934:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.754685:0:6934:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114eda7f30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x254:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda7f29 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.754692:0:6934:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114eda7f30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda7f29 expref: 96 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.754696:0:6934:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114eda7f30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda7f29 expref: 96 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.754700:0:6934:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x254:0x0].0x39 (ffff880089dc2100) 00010000:00010000:1.0:1713279306.754702:0:6934:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.754703:0:6934:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023c900, rc 0) 00000100:00100000:1.0:1713279306.754715:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+96:6942:x1796503200028800:12345-0@lo:101:mdt_io00_001.0 Request processed in 38us (65us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.754717:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98708 00000100:00100000:3.0:1713279306.754727:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028800:0@lo:101:mdt_io00_001.0 00010000:00010000:3.0:1713279306.754735:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ea5f180/0xfc4b8e114eda7f29 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7f30 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.754742:0:6942:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ea5f180/0xfc4b8e114eda7f29 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7f30 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713279306.754751:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x254:0x0] 00010000:00010000:3.0:1713279306.754769:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009181c480/0xfc4b8e114eda7f37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754773:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009181c480/0xfc4b8e114eda7f37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754777:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009181c480/0xfc4b8e114eda7f37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754785:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda7f3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754789:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda7f3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754793:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda7f3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754796:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda7f3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754799:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda7f3e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754802:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda7f3e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754804:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.754806:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda7f3e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754808:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda7f3e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754813:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f28:0x0].0x0 (ffff88011eea4600) 00010000:00010000:3.0:1713279306.754814:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713279306.754816:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda7f3e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754818:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda7f3e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754830:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009181ed00/0xfc4b8e114eda7f45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754833:0:6942:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009181ed00/0xfc4b8e114eda7f45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754838:0:6942:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009181ed00/0xfc4b8e114eda7f45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.754844:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028864:0@lo:101:mdt_io00_001.0 00000100:00100000:3.0:1713279306.754856:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.754870:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800936db240 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.754883:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200028864 00000100:00100000:1.0:1713279306.754886:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200028864 00000100:00100000:1.0:1713279306.754900:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98709 00000100:00100000:1.0:1713279306.754902:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+96:6942:x1796503200028864:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:1.0:1713279306.754907:0:6934:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.754913:0:6934:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7f4c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda7f45 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.754921:0:6934:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7f4c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda7f45 expref: 97 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.754926:0:6934:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7f4c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda7f45 expref: 97 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.754929:0:6934:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f28:0x0].0x0 (ffff88012d397a00) 00010000:00010000:1.0:1713279306.754930:0:6934:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713279306.754932:0:6934:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023ed00, rc 0) 00000100:00100000:1.0:1713279306.754950:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+97:6942:x1796503200028864:12345-0@lo:101:mdt_io00_001.0 Request processed in 47us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.754953:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98709 00000100:00100000:3.0:1713279306.754970:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200028864:0@lo:101:mdt_io00_001.0 00010000:00010000:3.0:1713279306.754976:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009181ed00/0xfc4b8e114eda7f45 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7f4c expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.754980:0:6942:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009181ed00/0xfc4b8e114eda7f45 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7f4c expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.754989:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.754994:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d8 expref: 3758 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.754998:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x24/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.755007:0:6942:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d8 expref: 3758 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.755013:0:6942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d8 expref: 3758 pid: 15483 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.755018:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200028928:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.755038:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800936db240 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.755138:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.755150:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281202624 00000100:00100000:2.0:1713279306.755153:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281202624 00000100:00100000:2.0:1713279306.755173:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785057 00000100:00100000:2.0:1713279306.755177:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3759:11204:x1796503281202624:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.755184:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.755193:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda7f5a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175659 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.755231:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda7f61 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.755237:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda7f61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.755243:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda7f61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.755251:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda7f68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x124:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.755256:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda7f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x124:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.755261:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda7f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x124:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000004:00080000:2.0:1713279306.755463:0:15658:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x11a4:0x0], index 1: 0 00000004:00080000:2.0:1713279306.755468:0:15658:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x118f:0x0], index 0: 0 00000100:00100000:0.0:1713279306.755497:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.755513:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281203072 00000100:00100000:3.0:1713279306.755517:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281203072 00000100:00100000:3.0:1713279306.755535:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785058 00000100:00100000:3.0:1713279306.755540:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3680:11711:x1796503281203072:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.755541:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda7f6f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x872e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.755547:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda7f6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x872e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.755547:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.755554:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda7f6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x872e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.755554:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda7f76 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175667 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.755571:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda7f61 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.755576:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda7f61 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.755579:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7f84 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.755581:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda7f61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.755585:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7f84 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.755586:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda7f61 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.755590:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.755591:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7f84 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.755593:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda7f61 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.755598:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda7f61 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.755601:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7f8b lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.755604:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x0 (ffff8800960e8800) 00010000:00010000:3.0:1713279306.755606:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7f8b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.755607:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.755609:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda7f61 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.755612:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7f8b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.755614:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda7f61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000004:00010000:2.0:1713279306.755622:0:15658:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009661a680 reply state ffff8800931ce000 transno 4295202646 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda7f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x124:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.755627:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7f84 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.755632:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7f84 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.755633:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda7f68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.755638:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x3831 (ffff8800960e8300) 00010000:00010000:2.0:1713279306.755640:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.755640:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7f84 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713279306.755642:0:15658:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.755645:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7f84 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.755649:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8cb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.755651:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7f84 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.755655:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda7f5a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x124:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175659 expref: 3762 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.755656:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7f84 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.755662:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880091738a00) 00010000:00010000:3.0:1713279306.755664:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.755666:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda7f6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x872e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175659 expref: 3761 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.755666:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7f84 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.755671:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda7f84 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.755672:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x872e:0x0].0x0 (ffff8800960e8a00) 00010000:00010000:2.0:1713279306.755674:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.755675:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e35f80, rc 0) 00010000:00010000:3.0:1713279306.755678:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7f8b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.755682:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7f8b lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.755686:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7f8b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.755690:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131f3f3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.755693:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7f8b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713279306.755695:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3762:11204:x1796503281202624:12345-192.168.203.4@tcp:101:touch.0 Request processed in 518us (559us total) trans 4295202646 rc 0/0 00000100:00100000:2.0:1713279306.755701:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785057 00010000:00010000:3.0:1713279306.755701:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7f8b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.755707:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88007fc53100) 00010000:00010000:3.0:1713279306.755709:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.755711:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7f8b lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.755716:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda7f8b lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.755734:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda7f76 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175667 expref: 3681 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.755740:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda7f76 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175667 expref: 3681 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.755747:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bf8dd40, rc 0) 00000100:00100000:3.0:1713279306.755768:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3680:11711:x1796503281203072:12345-192.168.203.4@tcp:101:touch.0 Request processed in 227us (270us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.755772:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785058 00000100:00100000:3.0:1713279306.755784:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.755793:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281202560 00000100:00100000:0.0:1713279306.755797:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281202560 00000100:00100000:3.0:1713279306.755800:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.755816:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.755833:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.755853:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785059 00000100:00100000:2.0:1713279306.755853:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281202688 00000100:00100000:2.0:1713279306.755856:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281202688 00000100:00100000:0.0:1713279306.755857:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3680:11857:x1796503281202560:12345-192.168.203.4@tcp:101:mkdir.0 00000100:00100000:3.0:1713279306.755857:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.755866:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.755866:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281202752 00000100:00100000:1.0:1713279306.755871:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281202752 00000100:00100000:3.0:1713279306.755874:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.755876:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281202816 00000100:00100000:2.0:1713279306.755878:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281202816 00000100:00100000:0.0:1713279306.755882:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110464 00000100:00100000:1.0:1713279306.755889:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110465 00000100:00100000:3.0:1713279306.755890:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.755893:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+77:1957:x1796503281202752:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:2.0:1713279306.755894:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110466 00000100:00100000:2.0:1713279306.755898:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+77:1956:x1796503281202816:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:3.0:1713279306.755910:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.755954:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+79:1956:x1796503281202688:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:0.0:1713279306.755971:0:15783:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda7f92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.755977:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+79:1956:x1796503281202816:12345-192.168.203.4@tcp:2:touch.0 Request processed in 77us (142us total) trans 4295010172 rc 0/0 00010000:00010000:0.0:1713279306.755979:0:15783:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092540480/0xfc4b8e114eda71b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752fc expref: 82 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.755983:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1713279306.755983:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110466 00010000:00010000:0.0:1713279306.755984:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713279306.755985:0:15783:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda7f92 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.755997:0:15783:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092540480/0xfc4b8e114eda71b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->36863) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752fc expref: 82 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.755997:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281203328 00000100:00100000:2.0:1713279306.756000:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281203328 00000100:00100000:3.0:1713279306.756001:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.756002:0:15783:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092540480/0xfc4b8e114eda71b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->36863) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752fc expref: 82 pid: 11415 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.756010:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281203520 00000100:00100000:0.0:1713279306.756012:0:15783:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0000_UUID:15783:1796503200028992:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.756012:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281203520 00002000:00010000:1.0:1713279306.756022:0:15538:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb size from disk: 40670 -> 40670 00000100:00100000:2.0:1713279306.756022:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785060 00002000:00010000:1.0:1713279306.756025:0:15538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00000100:00100000:0.0:1713279306.756026:0:15783:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800958e3840 going to sleep for 11 seconds 00002000:00010000:1.0:1713279306.756026:0:15538:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb atime from disk: 1713279304 -> 1713279304 00000100:00100000:2.0:1713279306.756026:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3777:11874:x1796503281203328:12345-192.168.203.4@tcp:101:touch.0 00002000:00010000:1.0:1713279306.756027:0:15538:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.756029:0:15538:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb blocks from disk: 64 -> 24 00010000:00010000:2.0:1713279306.756032:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.756037:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281203264 00000100:00100000:0.0:1713279306.756039:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281203264 00010000:00010000:2.0:1713279306.756040:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7f99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917566e expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.756046:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+78:1957:x1796503281202752:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 152us (228us total) trans 4295010171 rc 0/0 00000100:00100000:1.0:1713279306.756050:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110465 00000100:00100000:0.0:1713279306.756052:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147222 00000100:00100000:0.0:1713279306.756055:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1479450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3779:1957:x1796503281203264:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.756056:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.756059:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.756062:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda7fa0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.756066:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114eda7ec7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917563d expref: 3779 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.756087:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281203392 00010000:00010000:2.0:1713279306.756088:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda7fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.756089:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00000100:00100000:1.0:1713279306.756090:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281203392 00010000:00010000:0.0:1713279306.756091:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.756095:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda7fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.756101:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110467 00000100:00100000:1.0:1713279306.756104:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1956:x1796503281203392:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:2.0:1713279306.756104:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7fa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.756110:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.756116:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00002000:00010000:1.0:1713279306.756120:0:15519:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000400:0x1029:0x0] initial LVB size: 33128, mtime: 0x5fb2fc3a, atime: 0x623fdabe, ctime: 0x661e9147, blocks: 0x48 00010000:00010000:1.0:1713279306.756124:0:15519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda7fae lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1029:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.756130:0:15519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.756131:0:15519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.756133:0:15519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda7fae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.756139:0:15519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda7fae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.756142:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7fb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.756145:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1479450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3778:1957:x1796503281203264:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 88us (254us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.756148:0:15519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda7fae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.756148:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.756150:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147222 00010000:00010000:1.0:1713279306.756153:0:15519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda7fae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.756156:0:15519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda7fae lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.756156:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.756160:0:15519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023fcc0 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:1.0:1713279306.756161:0:15519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda7fae lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.756165:0:15519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda7fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.756171:0:15519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda7fae lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.756175:0:15519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda7fae lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.756176:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785061 00000100:00100000:0.0:1713279306.756178:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3681:11876:x1796503281203520:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.756178:0:6942:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff88008be04a80 x1796503200028928) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d8 expref: 3761 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.756184:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.756188:0:6942:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d8 expref: 3761 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.756189:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda7fbc lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175675 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.756195:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1956:x1796503281203392:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 90us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.756199:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110467 00010000:00010000:3.0:1713279306.756201:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda7987 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7f28:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d8 expref: 3761 pid: 15483 timeout: 509 lvb_type: 0 00000004:00200000:2.0:1713279306.756202:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00000004:00200000:2.0:1713279306.756205:0:15658:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1713279306.756208:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281202944 00000100:00100000:3.0:1713279306.756209:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200028928:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.756211:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281202944 00000004:00010000:2.0:1713279306.756212:0:15658:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.756217:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f28:0x0].0x0 (ffff88011eea4600) 00010000:00010000:2.0:1713279306.756218:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda7fa0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.756219:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223013 00010000:00010000:3.0:1713279306.756221:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00000100:00100000:1.0:1713279306.756222:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c56a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3761:10123:x1796503281202944:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:2.0:1713279306.756223:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda7fa0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.756227:0:6942:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.756228:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda7fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.756232:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.756233:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda7fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.756234:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7fc3 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x721d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.756237:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a4d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.756239:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda7fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.756240:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7fc3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x721d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.756241:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.756244:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7fc3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x721d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.756244:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda7fa0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.756246:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00000004:00200000:0.0:1713279306.756249:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x721d:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.756250:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.756251:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:2.0:1713279306.756253:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.756255:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda7fa0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.756260:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda7fa0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.756266:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.756269:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c56a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3762:10123:x1796503281202944:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 46us (412us total) trans 4295202647 rc 0/0 00010000:00010000:2.0:1713279306.756271:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7fa7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.756273:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223013 00010000:00010000:2.0:1713279306.756275:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.756277:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda7fbc lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175675 expref: 3684 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.756279:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a4b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.756281:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.756283:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7fc3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x721d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175675 expref: 3683 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.756286:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.756287:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x721d:0x0].0x0 (ffff8800902cc000) 00010000:00010000:0.0:1713279306.756289:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1713279306.756290:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe17a80, rc 0) 00010000:00010000:2.0:1713279306.756291:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff88008a7a7700) 00010000:00010000:2.0:1713279306.756293:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.756295:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7fa7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.756299:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda7fa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.756303:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3683:11876:x1796503281203520:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 124us (303us total) trans 4295183638 rc 0/0 00000100:00100000:3.0:1713279306.756305:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f281f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200029056:0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1713279306.756307:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785061 00010000:00010000:2.0:1713279306.756315:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda7f99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917566e expref: 3778 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.756324:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281203200 00010000:00010000:2.0:1713279306.756324:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917566e expref: 3777 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.756326:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281203200 00000100:00100000:3.0:1713279306.756327:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.756330:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:2.0:1713279306.756332:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713279306.756334:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4a5b00, rc 0) 00000100:00100000:3.0:1713279306.756335:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800936db3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.756337:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14334 00000100:00100000:0.0:1713279306.756339:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3762:10814:x1796503281203200:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:1.0:1713279306.756343:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200029056 00000100:00100000:1.0:1713279306.756346:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200029056 00000100:00100000:2.0:1713279306.756351:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3777:11874:x1796503281203328:12345-192.168.203.4@tcp:101:touch.0 Request processed in 323us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.756356:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785060 00010000:00010000:0.0:1713279306.756357:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00000100:00100000:1.0:1713279306.756357:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98710 00000100:00100000:1.0:1713279306.756359:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+97:6942:x1796503200029056:12345-0@lo:1000:mdt_io00_001.0 00010000:00010000:0.0:1713279306.756362:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda7ed5 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda7ece expref: 60 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.756366:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.756381:0:15514:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda7ed5 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda7ece expref: 60 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.756386:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713279306.756391:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.756397:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda7fd8 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175660 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.756410:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda7fdf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.756426:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+97:6942:x1796503200029056:12345-0@lo:1000:mdt_io00_001.0 Request processed in 50us (84us total) trans 0 rc -2/-2 00000100:00100000:1.0:1713279306.756430:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98710 00010000:00010000:0.0:1713279306.756431:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda7fdf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.756436:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda7fdf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713279306.756440:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f281f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200029056:0@lo:1000:mdt_io00_001.0 00000004:00200000:0.0:1713279306.756452:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x25b:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.756455:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1713279306.756469:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda7fd8 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175660 expref: 3684 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.756473:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200029184:0@lo:1000:mdt_io00_001.0 00010000:00010000:0.0:1713279306.756479:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda7fdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175660 expref: 3683 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.756485:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012514dc00) 00010000:00010000:0.0:1713279306.756487:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713279306.756489:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c53ba80, rc 0) 00000100:00100000:2.0:1713279306.756493:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.756507:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3683:11857:x1796503281202560:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 649us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.756513:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785059 00000100:00100000:2.0:1713279306.756515:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c213000 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.756519:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200029184 00000100:00100000:1.0:1713279306.756521:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200029184 00000100:00100000:0.0:1713279306.756523:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281203648 00000100:00100000:0.0:1713279306.756526:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281203648 00000100:00100000:1.0:1713279306.756532:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98711 00000100:00100000:1.0:1713279306.756535:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+97:6942:x1796503200029184:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1713279306.756536:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785062 00000100:00100000:0.0:1713279306.756539:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3777:11711:x1796503281203648:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.756544:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.756550:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda7fe6 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917567c expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.756562:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+97:6942:x1796503200029184:12345-0@lo:1000:mdt_io00_001.0 Request processed in 26us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.756565:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98711 00000100:00100000:2.0:1713279306.756573:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200029184:0@lo:1000:mdt_io00_001.0 00010000:00010000:0.0:1713279306.756585:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538900/0xfc4b8e114eda7fed lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756590:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538900/0xfc4b8e114eda7fed lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756594:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538900/0xfc4b8e114eda7fed lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.756598:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200029248:0@lo:1000:mdt_io00_001.0 00010000:00010000:0.0:1713279306.756599:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda7ff4 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756603:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda7ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756606:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda7ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000004:00200000:0.0:1713279306.756613:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:0.0:1713279306.756617:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538900/0xfc4b8e114eda7fed lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756620:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538900/0xfc4b8e114eda7fed lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756624:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538900/0xfc4b8e114eda7fed lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756627:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538900/0xfc4b8e114eda7fed lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756629:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c538900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.756631:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538900/0xfc4b8e114eda7fed lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.756631:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.756634:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538900/0xfc4b8e114eda7fed lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756638:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012514da00) 00010000:00010000:0.0:1713279306.756639:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.756640:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538900/0xfc4b8e114eda7fed lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756643:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538900/0xfc4b8e114eda7fed lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756647:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda7ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.756647:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099728780 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.756650:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda7ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756653:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda7ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.756654:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200029248 00010000:00010000:0.0:1713279306.756656:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f1d73c0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.756656:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200029248 00010000:00010000:0.0:1713279306.756657:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda7ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.756665:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98712 00000100:00100000:1.0:1713279306.756667:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+97:6942:x1796503200029248:12345-0@lo:1000:mdt_io00_001.0 00010000:00010000:0.0:1713279306.756715:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda7ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756720:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff88012514df00) 00010000:00010000:0.0:1713279306.756721:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.756723:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda7ff4 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756726:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda7ff4 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.756739:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.756742:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda7fe6 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917567c expref: 3778 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.756746:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda7fe6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917567c expref: 3778 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.756749:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+97:6942:x1796503200029248:12345-0@lo:1000:mdt_io00_001.0 Request processed in 80us (117us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.756752:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c53ad00, rc 0) 00000100:00100000:1.0:1713279306.756755:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98712 00000100:00100000:0.0:1713279306.756767:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3777:11711:x1796503281203648:12345-192.168.203.4@tcp:101:touch.0 Request processed in 226us (376us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.756770:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785062 00000100:00100000:0.0:1713279306.756778:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281203776 00000100:00100000:2.0:1713279306.756779:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200029248:0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1713279306.756780:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281203776 00000100:00100000:0.0:1713279306.756788:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785063 00000100:00100000:0.0:1713279306.756791:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3763:11204:x1796503281203776:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1713279306.756802:0:9221:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.756807:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda7f6f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x872e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175659 expref: 3763 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.756816:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x872e:0x0].0x0 (ffff8800960e8a00) 00010000:00010000:0.0:1713279306.756819:0:9221:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.756833:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.756839:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.756844:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.756848:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda7ffb lrc: 3/0,1 mode: --/PW res: [0x200000403:0x872e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.756848:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.756850:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.756852:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda7ffb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x872e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.756855:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.756856:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda7ffb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x872e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.756864:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f28:0x0].0x0 (ffff88011eea4600) 00010000:00010000:2.0:1713279306.756866:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 24 00010000:00010000:2.0:1713279306.756869:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.756873:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda7f53 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.756879:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009181ed00/0xfc4b8e114eda7f45 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7f4c expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713279306.756882:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88011f280000 reply state ffff88008f7cc000 transno 4295202648 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda7ffb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x872e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.756884:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009181ed00/0xfc4b8e114eda7f45 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda7f4c expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.756886:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda7ffb lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x872e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.756889:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x872e:0x0].0x0 (ffff88012514d500) 00010000:00010000:2.0:1713279306.756890:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009181ed00/0xfc4b8e114eda7f45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda7f4c expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.756891:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.756892:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.756900:0:6942:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1713279306.756903:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009181c480/0xfc4b8e114eda7f37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.756907:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009181c480/0xfc4b8e114eda7f37 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.756909:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713279306.756912:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009181c480/0xfc4b8e114eda7f37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.756914:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009181ed00/0xfc4b8e114eda7f45 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114eda7f4c expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.756916:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.756918:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009181c480/0xfc4b8e114eda7f37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.756920:0:9214:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181ed00 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:2.0:1713279306.756923:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009181c480/0xfc4b8e114eda7f37 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.756923:0:9214:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009181ed00/0xfc4b8e114eda7f45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda7f4c expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.756929:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00000004:00010000:3.0:1713279306.756930:0:9214:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009181ed00/0xfc4b8e114eda7f45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda7f4c expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.756931:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.756933:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009181c480/0xfc4b8e114eda7f37 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.756937:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009181c480/0xfc4b8e114eda7f37 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00000004:00080000:2.0:1713279306.756944:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x254:0x0] 00010000:00010000:3.0:1713279306.756945:0:9214:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009181ed00/0xfc4b8e114eda7f45 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7f4c expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.756950:0:9214:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1713279306.756957:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3764:11204:x1796503281203776:12345-192.168.203.4@tcp:36:touch.0 Request processed in 121us (176us total) trans 4295202648 rc 0/0 00010000:00010000:2.0:1713279306.756959:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123732400/0xfc4b8e114eda7eff lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7f0d expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.756962:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785063 00010000:00010000:2.0:1713279306.756965:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123732400/0xfc4b8e114eda7eff lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda7f0d expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.756970:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009181ed00/0xfc4b8e114eda7f45 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7f4c expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.756971:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123732400/0xfc4b8e114eda7eff lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda7f0d expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.756976:0:9214:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009181ed00/0xfc4b8e114eda7f45 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7f4c expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.756980:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1713279306.756980:0:6942:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1713279306.756983:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x254:0x0] 00000100:00100000:0.0:1713279306.756985:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.756986:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1713279306.756987:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200029312:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.756988:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.756988:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123732400/0xfc4b8e114eda7eff lrc: 2/0,0 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114eda7f0d expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.756992:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ea5f180/0xfc4b8e114eda7f29 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7f30 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.756994:0:9214:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880123732400 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.756997:0:9214:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123732400/0xfc4b8e114eda7eff lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda7f0d expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.756998:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ea5f180/0xfc4b8e114eda7f29 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda7f30 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.757002:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1713279306.757003:0:9214:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123732400/0xfc4b8e114eda7eff lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda7f0d expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.757004:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ea5f180/0xfc4b8e114eda7f29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda7f30 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.757011:0:6942:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1713279306.757014:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200029312 00010000:00010000:3.0:1713279306.757015:0:9214:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123732400/0xfc4b8e114eda7eff lrc: 2/0,0 mode: --/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7f0d expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.757016:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200029312 00000004:00080000:2.0:1713279306.757016:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000403:0x729c:0x0] 00010000:00010000:3.0:1713279306.757019:0:9214:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713279306.757020:0:6919:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1713279306.757022:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.757023:0:6919:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ea5f180/0xfc4b8e114eda7f29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114eda7f30 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.757026:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147223 00000100:00100000:1.0:1713279306.757029:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+97:3492:x1796503200029312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.757029:0:6919:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ea5f180 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:2.0:1713279306.757031:0:6919:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ea5f180/0xfc4b8e114eda7f29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda7f30 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.757033:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.757035:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123732400/0xfc4b8e114eda7eff lrc: 1/0,0 mode: --/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7f0d expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.757038:0:6919:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ea5f180/0xfc4b8e114eda7f29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda7f30 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.757039:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200029376:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.757040:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda7f4c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7f28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda7f45 expref: 97 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.757041:0:9214:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123732400/0xfc4b8e114eda7eff lrc: 0/0,0 mode: --/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7f0d expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.757046:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f28:0x0].0x0 (ffff88012d397a00) 00010000:00010000:3.0:1713279306.757049:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.757050:0:6919:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ea5f180/0xfc4b8e114eda7f29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7f30 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.757051:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.757051:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279306.757052:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.757052:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.757055:0:6919:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713279306.757060:0:6919:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ea5f180/0xfc4b8e114eda7f29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7f30 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.757063:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+96:3492:x1796503200029312:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (60us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.757063:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200029440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.757066:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ea5f180/0xfc4b8e114eda7f29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7f30 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.757080:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281203904 00000100:00100000:1.0:1713279306.757081:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147223 00000100:00100000:0.0:1713279306.757082:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281203904 00000100:00100000:1.0:1713279306.757087:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200029376 00000100:00100000:1.0:1713279306.757089:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200029376 00010000:00010000:2.0:1713279306.757091:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.757092:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.757093:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279306.757096:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.757098:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147224 00000100:00100000:1.0:1713279306.757100:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+96:3490:x1796503200029376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.757102:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.757104:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.757107:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.757108:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114eda7f0d lrc: 0/0,0 mode: --/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda7eff expref: 96 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.757112:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.757114:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x254:0x0].0x0 (ffff880089dc2800) 00000100:00100000:3.0:1713279306.757115:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200029440 00010000:00010000:1.0:1713279306.757117:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.757117:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689d40 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.757118:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200029440 00010000:00010000:2.0:1713279306.757119:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.757124:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.757130:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:2.0:1713279306.757132:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.757134:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147225 00010000:00010000:2.0:1713279306.757135:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.757136:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+96:3490:x1796503200029376:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.757138:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+96:3491:x1796503200029440:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.757139:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147224 00010000:00010000:2.0:1713279306.757140:0:6942:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.757144:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.757145:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15525 initiator: MDT0 00000100:00100000:0.0:1713279306.757147:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200029376:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.757152:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda7d1c expref: 60 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.757152:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114eda7f30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x254:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda7f29 expref: 95 pid: 6934 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.757156:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281203968 00000100:00100000:1.0:1713279306.757156:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200029312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.757158:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281203968 00010000:00010000:3.0:1713279306.757161:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x254:0x0].0x39 (ffff880089dc2100) 00010000:00010000:2.0:1713279306.757165:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.757165:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.757168:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785064 00010000:00010000:2.0:1713279306.757169:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda7c04 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.757170:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3684:11875:x1796503281203904:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:1.0:1713279306.757174:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785065 00000004:00020000:2.0:1713279306.757176:0:6942:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x240000403:0x729c:0x0]/9 failed: rc = -114 00000100:00100000:1.0:1713279306.757177:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b3cf9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3684:11885:x1796503281203968:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.757183:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.757184:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+94:3491:x1796503200029440:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (87us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.757188:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda8002 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175683 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.757189:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147225 00000100:00100000:2.0:1713279306.757198:0:6942:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3763:9807:x1796503281194048:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 19939us (20724us total) trans 0 rc -114/-114 00000100:00100000:0.0:1713279306.757200:0:15752:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227c380 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-mdtlov_UUID:15752:1796503200029504:0@lo:1000:mdt00_034.0 00000100:00100000:2.0:1713279306.757204:0:6942:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14330 00010000:00010000:1.0:1713279306.757207:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda8009 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.757213:0:15483:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754a0 expref: 3685 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.757214:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200029440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.757217:0:15752:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.757217:0:15483:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda8009 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.757220:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00000100:00100000:0.0:1713279306.757223:0:15752:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb06c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.757225:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.757227:0:15483:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754a0 expref: 3685 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.757232:0:15483:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754a0 expref: 3685 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.757237:0:15483:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:15483:1796503200029568:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.757251:0:15483:0:(client.c:2539:ptlrpc_set_wait()) set ffff880130ade6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.757258:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200029504 00000100:00100000:1.0:1713279306.757260:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200029504 00000100:00100000:1.0:1713279306.757272:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98713 00000100:00100000:1.0:1713279306.757274:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+61:15752:x1796503200029504:12345-0@lo:1000:mdt00_034.0 00010000:00010000:2.0:1713279306.757289:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00000100:00100000:0.0:1713279306.757294:0:15783:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0000_UUID:15783:1796503200028992:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.757297:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda7ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917564b expref: 3776 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.757299:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.757302:0:15783:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda7f92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.757303:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00000100:00100000:3.0:1713279306.757309:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281204032 00000100:00100000:3.0:1713279306.757311:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281204032 00000100:00100000:1.0:1713279306.757315:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+61:15752:x1796503200029504:12345-0@lo:1000:mdt00_034.0 Request processed in 40us (98us total) trans 0 rc 1/1 00010000:00010000:2.0:1713279306.757317:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda7ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917564b expref: 3776 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.757319:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98713 00010000:00010000:3.0:1713279306.757322:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092540480/0xfc4b8e114eda71b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->36863) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752fc expref: 83 pid: 11415 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.757323:0:15752:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227c380 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-mdtlov_UUID:15752:1796503200029504:0@lo:1000:mdt00_034.0 00010000:00010000:2.0:1713279306.757325:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda7ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917564b expref: 3776 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.757333:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200029632:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.757335:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196494 00000100:00100000:3.0:1713279306.757339:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281204032:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.757345:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.757348:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3685:11875:x1796503281203904:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 177us (362us total) trans 0 rc -17/-17 00000100:00100000:0.0:1713279306.757352:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785064 00000100:00100000:2.0:1713279306.757352:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c213000 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.757354:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092540480/0xfc4b8e114eda71b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->36863) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752fc expref: 83 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.757362:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092540480/0xfc4b8e114eda71b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->36863) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752fc expref: 83 pid: 11415 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.757367:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.757375:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092540480/0xfc4b8e114eda71b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->36863) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391752fc expref: 83 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.757384:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.757386:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.757388:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda7f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.757389:0:6942:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281204160 00000100:00100000:2.0:1713279306.757392:0:6942:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281204160 00010000:00010000:3.0:1713279306.757395:0:6916:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda7f92 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.757406:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.757408:0:6942:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14335 00000100:00100000:2.0:1713279306.757427:0:6942:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3404:11374:x1796503281204160:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:3.0:1713279306.757440:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+82:1957:x1796503281204032:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 98us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.757445:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196494 00010000:00010000:0.0:1713279306.757452:0:15783:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda7f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.757457:0:15783:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda7f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.757457:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.757463:0:6942:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279306.757465:0:15783:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda7f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.757468:0:15783:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda7f92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.757469:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.757472:0:6942:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x1000000000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279306.757473:0:15783:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda7f92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.757477:0:15783:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe16f40 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:0.0:1713279306.757478:0:15783:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda7f92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.757482:0:15783:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda7f92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.757483:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd7480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200029696:0@lo:101:mdt_io00_001.0 00010000:00010000:0.0:1713279306.757488:0:15783:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda7f92 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.757492:0:15783:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe16f40/0xfc4b8e114eda7f92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.757499:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.757507:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124ce2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.757511:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200029696 00000100:00100000:1.0:1713279306.757513:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200029696 00000100:00100000:0.0:1713279306.757516:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+77:1956:x1796503281202688:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 1629us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.757516:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281204416 00000100:00100000:2.0:1713279306.757518:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281204416 00000100:00100000:0.0:1713279306.757519:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110464 00000100:00100000:1.0:1713279306.757525:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98714 00000100:00100000:1.0:1713279306.757527:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+61:6942:x1796503200029696:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:1.0:1713279306.757532:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.757532:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785066 00000100:00100000:2.0:1713279306.757536:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3685:11711:x1796503281204416:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.757538:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923433c0/0xfc4b8e114eda801e lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda8017 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.757543:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.757545:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.757549:0:15516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800923433c0/0xfc4b8e114eda801e lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda8017 expref: 62 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.757551:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8025 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917568a expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.757556:0:15516:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.757561:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923433c0/0xfc4b8e114eda801e lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8017 expref: 62 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.757565:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.757566:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.757569:0:15516:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda7d1c expref: 62 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.757573:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923433c0, rc 0) 00010000:00010000:2.0:1713279306.757573:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda802c lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.757579:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda802c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757585:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda802c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.757588:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+62:6942:x1796503200029696:12345-0@lo:101:mdt_io00_001.0 Request processed in 60us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.757591:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98714 00010000:00010000:2.0:1713279306.757593:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda8033 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.757598:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda8033 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757603:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda8033 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.757604:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd7480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200029696:0@lo:101:mdt_io00_001.0 00010000:00010000:3.0:1713279306.757612:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.757618:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.757622:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda802c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757626:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda802c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757631:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda802c lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757636:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda802c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757640:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ad686c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.757643:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda802c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757647:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda802c lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757653:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880091b34800) 00010000:00010000:2.0:1713279306.757655:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.757657:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda802c lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757661:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda802c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757667:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda8033 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757671:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda8033 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757676:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda8033 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757680:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.757682:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda8033 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757686:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda8033 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757691:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88008c725c00) 00010000:00010000:2.0:1713279306.757692:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.757694:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda8033 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757698:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda8033 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.757713:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8025 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917568a expref: 3686 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.757719:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8025 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917568a expref: 3686 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.757726:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d866d00, rc 0) 00000100:00100000:2.0:1713279306.757743:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3685:11711:x1796503281204416:12345-192.168.203.4@tcp:101:touch.0 Request processed in 206us (274us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.757748:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785066 00000100:00100000:0.0:1713279306.757915:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.757940:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.757943:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281204544 00000100:00100000:1.0:1713279306.757945:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281204544 00000100:00100000:1.0:1713279306.757957:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223014 00000100:00100000:1.0:1713279306.757960:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3763:9807:x1796503281204544:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1713279306.757962:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.757969:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281204608 00000100:00100000:2.0:1713279306.757972:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281204608 00000100:00100000:1.0:1713279306.757985:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3764:9807:x1796503281204544:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 24us (72us total) trans 0 rc -116/-116 00000100:00100000:2.0:1713279306.757987:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785067 00000100:00100000:1.0:1713279306.757988:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223014 00000100:00100000:2.0:1713279306.757991:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3764:11204:x1796503281204608:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.757994:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281204288 00000100:00100000:1.0:1713279306.757995:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281204288 00010000:00010000:2.0:1713279306.758001:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.758002:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223015 00000100:00100000:1.0:1713279306.758005:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3405:11855:x1796503281204288:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:2.0:1713279306.758008:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda803a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x872e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175691 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.758026:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda803a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x872e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175691 expref: 3764 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.758035:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541d40/0xfc4b8e114eda803a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x872e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175691 expref: 3764 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.758044:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x872e:0x0].0x0 (ffff88012514d500) 00010000:00010000:2.0:1713279306.758046:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1713279306.758047:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200029632:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.758048:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092541d40, rc 0) 00000100:00100000:1.0:1713279306.758052:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3406:11855:x1796503281204288:12345-192.168.203.4@tcp:35:touch.0 Request processed in 45us (90us total) trans 4295183639 rc 0/0 00000100:00100000:1.0:1713279306.758055:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223015 00010000:00010000:3.0:1713279306.758057:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000100:00100000:0.0:1713279306.758059:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.758063:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3764:11204:x1796503281204608:12345-192.168.203.4@tcp:101:touch.0 Request processed in 71us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.758083:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785067 00000100:00100000:3.0:1713279306.758085:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281204672 00000100:00100000:1.0:1713279306.758086:0:15483:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:15483:1796503200029568:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.758088:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281204672 00010000:00010000:1.0:1713279306.758093:0:15483:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda8009 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.758099:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754a0 expref: 3685 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.758113:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196495 00000100:00100000:3.0:1713279306.758117:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3685:1957:x1796503281204672:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.758124:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.758128:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754a0 expref: 3685 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.758135:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754a0 expref: 3685 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.758144:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda78f4 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754a0 expref: 3685 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.758153:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b9c:0x0].0x0 (ffff88009588c000) 00010000:00010000:3.0:1713279306.758156:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda8009 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.758161:0:15557:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda8009 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.758166:0:15557:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda8009 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.758175:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.758180:0:15483:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda8009 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.758186:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda8009 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:3.0:1713279306.758190:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3684:1957:x1796503281204672:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 72us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.758194:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196495 00000004:00200000:1.0:1713279306.758200:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7b9c:0x0]: returning size 15538 00000004:00200000:1.0:1713279306.758202:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1713279306.758207:0:15483:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda8009 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.758212:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda8009 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.758222:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda8002 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175683 expref: 3684 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.758228:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880094552ac0/0xfc4b8e114eda8009 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7b9c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175683 expref: 3683 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.758232:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b9c:0x0].0x0 (ffff88009588c000) 00010000:00010000:1.0:1713279306.758234:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.758235:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094552ac0, rc 0) 00000100:00100000:1.0:1713279306.758258:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b3cf9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3683:11885:x1796503281203968:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1080us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.758262:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785065 00000100:00100000:0.0:1713279306.758426:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.758448:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.758451:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281204736 00000100:00100000:3.0:1713279306.758454:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281204736 00010000:00010000:3.0:1713279306.758461:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda7ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917564b expref: 3777 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.758478:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196496 00000100:00100000:3.0:1713279306.758483:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3777:1955:x1796503281204736:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.758489:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.758493:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda7ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917564b expref: 3777 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.758501:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda7ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917564b expref: 3777 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.758511:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda7ee3 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917564b expref: 3777 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.758518:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff880092a4c200) 00010000:00010000:3.0:1713279306.758521:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.758526:0:15557:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.758530:0:15557:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.758539:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.758548:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.758555:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000100:00100000:3.0:1713279306.758557:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3776:1955:x1796503281204736:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 73us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.758560:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.758562:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196496 00010000:00010000:2.0:1713279306.758565:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda8041 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x235:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.758571:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda8041 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.758578:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda8041 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.758600:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.758608:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0d8480/0xfc4b8e114ed9e02f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a8b expref: 3763 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.758614:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114ed9e2cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b4f expref: 3775 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.758620:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7af3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7f37:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917552c expref: 3775 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.758625:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 6/0,1 mode: --/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.758638:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7af3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f37:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917552c expref: 3775 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.758645:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7af3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7f37:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917552c expref: 3775 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.758652:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd4a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200029760:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.758676:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114ed9e2cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b4f expref: 3775 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.758682:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114ed9e2cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b4f expref: 3775 pid: 15479 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.758693:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd7800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200029824:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.758709:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0d8480/0xfc4b8e114ed9e02f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a8b expref: 3763 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.758716:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0d8480/0xfc4b8e114ed9e02f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a8b expref: 3763 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.758722:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200029888:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.758734:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124ce2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.758743:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281204992 00000100:00100000:2.0:1713279306.758745:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281204992 00000100:00100000:2.0:1713279306.758758:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785068 00000100:00100000:2.0:1713279306.758762:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3776:11711:x1796503281204992:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.758769:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.758776:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114eda804f lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175698 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.758805:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281204864 00000100:00100000:1.0:1713279306.758808:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281204864 00010000:00010000:2.0:1713279306.758815:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda8056 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.758817:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223016 00000100:00100000:1.0:1713279306.758820:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3406:11871:x1796503281204864:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:2.0:1713279306.758821:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda8056 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758827:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda8056 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758834:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda805d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758840:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda805d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758844:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda805d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000004:00200000:2.0:1713279306.758854:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:2.0:1713279306.758859:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda8056 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758864:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda8056 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758868:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda8056 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.758869:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3407:11871:x1796503281204864:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 48us (420us total) trans 4295183640 rc 0/0 00010000:00010000:2.0:1713279306.758872:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda8056 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.758873:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223016 00010000:00010000:2.0:1713279306.758876:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092542880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.758878:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda8056 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758882:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda8056 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758888:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880096b8ec00) 00010000:00010000:2.0:1713279306.758889:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.758891:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda8056 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758895:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda8056 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758906:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda805d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758910:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda805d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758915:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda805d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758918:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e5f5200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.758920:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda805d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758924:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda805d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758929:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880096b8ef00) 00010000:00010000:2.0:1713279306.758930:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.758932:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda805d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758936:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda805d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.758951:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114eda804f lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175698 expref: 3777 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.758957:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114eda804f lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175698 expref: 3777 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.758964:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092541b00, rc 0) 00000100:00100000:2.0:1713279306.758982:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3776:11711:x1796503281204992:12345-192.168.203.4@tcp:101:touch.0 Request processed in 218us (421us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.758988:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785068 00000100:00100000:0.0:1713279306.759322:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.759341:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.759352:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281205056 00000100:00100000:3.0:1713279306.759356:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281205056 00000100:00100000:0.0:1713279306.759361:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.759377:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281205120 00000100:00100000:3.0:1713279306.759378:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147226 00000100:00100000:2.0:1713279306.759379:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281205120 00000100:00100000:3.0:1713279306.759382:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1479050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3776:1957:x1796503281205056:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.759383:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.759391:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.759394:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281205184 00000100:00100000:0.0:1713279306.759395:0:15502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281205312 00000100:00100000:2.0:1713279306.759396:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281205184 00000100:00100000:0.0:1713279306.759399:0:15502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281205312 00010000:00010000:3.0:1713279306.759400:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda7fb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917566e expref: 3777 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.759406:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785069 00010000:00010000:3.0:1713279306.759408:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00000100:00100000:2.0:1713279306.759410:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3408:11862:x1796503281205120:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1713279306.759428:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.759432:0:15502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14336 00000100:00100000:0.0:1713279306.759436:0:15502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3408:11833:x1796503281205312:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:3.0:1713279306.759447:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1479050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3776:1957:x1796503281205056:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 64us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.759453:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147226 00000100:00100000:1.0:1713279306.759454:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785070 00010000:00010000:0.0:1713279306.759459:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 15502 initiator: MDT0 00000100:00100000:1.0:1713279306.759459:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3775:11874:x1796503281205184:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.759463:0:15658:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-mdtlov_UUID:15658:1796503200030016:0@lo:1000:mdt00_029.0 00010000:00010000:0.0:1713279306.759464:0:15502:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.759466:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.759467:0:15502:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x1000000000000 pid: 15502 initiator: MDT1 00000100:00100000:0.0:1713279306.759474:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091a2ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200029952:0@lo:101:mdt_io00_004.0 00010000:00010000:1.0:1713279306.759474:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c04480/0xfc4b8e114eda806b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917569f expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.759484:0:15658:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.759493:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda8072 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759499:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda8072 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759503:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda8072 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.759504:0:15658:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124ce2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.759505:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.759509:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda8079 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759512:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda8079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713279306.759516:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb06c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.759516:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda8079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759538:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda8080 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713279306.759540:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.759542:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda8080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759545:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda8080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.759553:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281205376 00000100:00100000:2.0:1713279306.759556:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281205376 00000100:00100000:2.0:1713279306.759569:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785071 00000004:00200000:1.0:1713279306.759570:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.759573:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1713279306.759573:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3409:9807:x1796503281205376:12345-192.168.203.4@tcp:34:lfs.0 00000004:00010000:1.0:1713279306.759579:0:15483:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda8080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759583:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda8072 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759586:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda8072 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759589:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda8072 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759592:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda8072 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.759593:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda8087 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x254:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.759595:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ed200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.759596:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda8072 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759599:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda8072 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.759600:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda8087 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.759604:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.759605:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.759606:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda8087 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.759607:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda8072 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759610:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda8072 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.759612:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda808e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x254:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.759615:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda8079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.759617:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda808e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.759618:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda8079 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759621:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda8079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.759622:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda808e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.759623:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298edb00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.759625:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda8079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759627:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda8079 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759630:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff880090a56500) 00010000:00010000:1.0:1713279306.759632:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.759633:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda8079 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759635:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda8079 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.759646:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c04480/0xfc4b8e114eda806b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917569f expref: 3777 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.759650:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8095 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7256:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.759652:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda8080 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917569f expref: 3776 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.759655:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:1.0:1713279306.759656:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713279306.759656:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8095 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.759657:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ec480, rc 0) 00010000:00010000:2.0:1713279306.759661:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8095 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.759676:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3776:11874:x1796503281205184:12345-192.168.203.4@tcp:101:touch.0 Request processed in 217us (314us total) trans 0 rc 0/0 00000004:00010000:2.0:1713279306.759677:0:15752:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8095 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.759680:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785070 00010000:00010000:2.0:1713279306.759684:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda8087 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.759688:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda8087 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.759692:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda8087 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.759697:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda8087 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.759699:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200030016 00000100:00100000:1.0:1713279306.759701:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200030016 00010000:00010000:2.0:1713279306.759701:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090b25440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.759704:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda8087 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.759708:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda8087 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.759710:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200029952 00000100:00100000:1.0:1713279306.759711:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200029952 00010000:00010000:2.0:1713279306.759715:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x254:0x0].0x0 (ffff880096b8e500) 00010000:00010000:2.0:1713279306.759717:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.759720:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda8087 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.759725:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda8087 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.759726:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98715 00000100:00100000:1.0:1713279306.759729:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+63:15658:x1796503200030016:12345-0@lo:1000:mdt00_029.0 00000100:00100000:0.0:1713279306.759731:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98716 00010000:00010000:2.0:1713279306.759733:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda808e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.759734:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+63:15502:x1796503200029952:12345-0@lo:101:mdt_io00_004.0 00010000:00010000:2.0:1713279306.759738:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda808e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.759743:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.759743:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda808e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.759746:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091805440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.759748:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda808e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.759750:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981f80/0xfc4b8e114eda809c lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda8064 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.759752:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda808e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.759757:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x254:0x0].0x3931 (ffff880096b8e300) 00010000:00010000:2.0:1713279306.759758:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.759759:0:15542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923433c0/0xfc4b8e114eda801e lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8017 expref: 64 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.759760:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda808e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.759764:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda808e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.759766:0:15542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981f80/0xfc4b8e114eda809c lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda8064 expref: 64 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.759768:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+64:15658:x1796503200030016:12345-0@lo:1000:mdt00_029.0 Request processed in 38us (284us total) trans 0 rc 1/1 00010000:00010000:2.0:1713279306.759771:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8095 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.759772:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98715 00010000:00010000:2.0:1713279306.759776:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8095 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x7256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.759778:0:15542:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800923433c0/0xfc4b8e114eda801e lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8017 expref: 63 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.759782:0:15658:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-mdtlov_UUID:15658:1796503200030016:0@lo:1000:mdt00_029.0 00010000:00010000:0.0:1713279306.759783:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981f80/0xfc4b8e114eda809c lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8064 expref: 63 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.759784:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8095 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.759787:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:0.0:1713279306.759788:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.759788:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938fcfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.759790:0:15542:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda7d1c expref: 63 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.759790:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8095 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.759793:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d981f80, rc 0) 00010000:00010000:2.0:1713279306.759795:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8095 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x7256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.759800:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7256:0x0].0x0 (ffff88007fdcac00) 00010000:00010000:2.0:1713279306.759802:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.759804:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8095 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x7256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.759809:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8095 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.759810:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+63:15502:x1796503200029952:12345-0@lo:101:mdt_io00_004.0 Request processed in 76us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.759814:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98716 00000100:00100000:3.0:1713279306.759816:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3409:11862:x1796503281205120:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 405us (474us total) trans 0 rc -17/-17 00000100:00100000:1.0:1713279306.759821:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091a2ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200029952:0@lo:101:mdt_io00_004.0 00000100:00100000:3.0:1713279306.759822:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785069 00010000:00010000:1.0:1713279306.759828:0:15502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.759829:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3408:9807:x1796503281205376:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 255us (288us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.759833:0:15502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.759834:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785071 00000100:00100000:0.0:1713279306.765697:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.765702:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.765715:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.765726:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.765733:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.765736:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.765740:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281205632 00000100:00100000:2.0:1713279306.765746:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281205632 00000100:00100000:3.0:1713279306.765748:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.765762:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.765766:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281205824 00000100:00100000:2.0:1713279306.765768:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281205824 00000100:00100000:0.0:1713279306.765771:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.765773:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281206016 00000100:00100000:3.0:1713279306.765775:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281206016 00000100:00100000:1.0:1713279306.765782:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281205504 00000100:00100000:0.0:1713279306.765783:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.765784:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281205952 00000100:00100000:2.0:1713279306.765786:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281205952 00000100:00100000:1.0:1713279306.765787:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281205504 00000100:00100000:3.0:1713279306.765793:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147227 00000100:00100000:0.0:1713279306.765794:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.765795:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281206272 00000100:00100000:2.0:1713279306.765797:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281206272 00000100:00100000:3.0:1713279306.765799:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3776:1955:x1796503281206016:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.765804:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281205568 00000100:00100000:1.0:1713279306.765805:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281205568 00000100:00100000:2.0:1713279306.765806:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281206656 00010000:00010000:3.0:1713279306.765807:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.765808:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281206656 00000100:00100000:1.0:1713279306.765812:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281205696 00000100:00100000:1.0:1713279306.765814:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281205696 00000100:00100000:0.0:1713279306.765816:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.765820:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281206080 00000100:00100000:2.0:1713279306.765820:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785072 00010000:00010000:3.0:1713279306.765820:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda7e1f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x8430:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917560c expref: 3776 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.765821:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281206080 00000100:00100000:2.0:1713279306.765825:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3684:11890:x1796503281205632:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.765829:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.765831:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8430:0x0].0x0 (ffff8800920e4400) 00000100:00100000:1.0:1713279306.765832:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110468 00010000:00010000:2.0:1713279306.765835:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.765835:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.765836:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+87:1954:x1796503281205504:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.765836:0:15484:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1713279306.765842:0:15783:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.765843:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.765845:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda7ae5 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x125:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175525 expref: 3684 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.765852:0:15783:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda80a3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1118:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391756a6 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.765854:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x125:0x0].0x0 (ffff8800960e8700) 00000100:00100000:0.0:1713279306.765856:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281206528 00000100:00100000:3.0:1713279306.765857:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3775:1955:x1796503281206016:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 59us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.765859:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281206528 00010000:00010000:2.0:1713279306.765860:0:15484:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.765863:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147227 00010000:00010000:2.0:1713279306.765867:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda80aa lrc: 2/0,0 mode: --/CW res: [0x240000401:0x125:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391756ad expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.765873:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281206336 00000100:00100000:0.0:1713279306.765874:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785073 00000100:00100000:3.0:1713279306.765875:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281206336 00000100:00100000:1.0:1713279306.765877:0:15783:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0001_UUID:15783:1796503200030144:192.168.203.4@tcp:106: 00000100:00100000:0.0:1713279306.765878:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3409:11855:x1796503281205824:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.765882:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114ed9e2cf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b4f expref: 3775 pid: 15479 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.765886:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.765893:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983840/0xfc4b8e114eda80b1 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391756b4 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.765895:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281206400 00000100:00100000:3.0:1713279306.765896:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281206400 00000100:00100000:1.0:1713279306.765897:0:15783:0:(client.c:2539:ptlrpc_set_wait()) set ffff880130637840 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.765903:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda80b8 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x125:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.765903:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0d8480/0xfc4b8e114ed9e02f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a8b expref: 3766 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.765908:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110469 00000100:00100000:1.0:1713279306.765911:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+88:1955:x1796503281205568:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:2.0:1713279306.765911:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda80b8 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.765915:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196497 00010000:00010000:2.0:1713279306.765918:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda80b8 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.765919:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3775:1956:x1796503281206336:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.765924:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.765928:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda80bf lrc: 3/1,0 mode: --/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.765928:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114ed9e2cf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b4f expref: 3775 pid: 15479 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.765933:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda80bf lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.765935:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.765935:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114ed9e2cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b4f expref: 3775 pid: 15479 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.765938:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda80bf lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.765942:0:9221:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7941 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d1 expref: 3684 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.765945:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f37:0x0].0x0 (ffff88008c2e7500) 00010000:00010000:0.0:1713279306.765947:0:9221:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 4/0,1 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.765948:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.765953:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.765962:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.765964:0:9221:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7941 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d1 expref: 3684 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.765966:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.765973:0:9221:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7941 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d1 expref: 3684 pid: 6929 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.765981:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3775:1956:x1796503281206336:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 61us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.765982:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9221:1796503200030208:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.765987:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196497 00010000:00010000:2.0:1713279306.765991:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda80cd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7304:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.765996:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196498 00010000:00010000:2.0:1713279306.765997:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda80cd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7304:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.766000:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3766:1955:x1796503281206400:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.766004:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb0cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.766004:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda80cd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7304:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.766005:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.766008:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0d8480/0xfc4b8e114ed9e02f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a8b expref: 3766 pid: 15752 timeout: 509 lvb_type: 0 00000004:00200000:2.0:1713279306.766010:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7304:0x0]: returning size 0 00000100:00100000:1.0:1713279306.766011:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+89:1955:x1796503281205568:12345-192.168.203.4@tcp:2:touch.0 Request processed in 98us (278us total) trans 4295010114 rc 0/0 00000100:00100000:1.0:1713279306.766015:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110469 00010000:00010000:3.0:1713279306.766015:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0d8480/0xfc4b8e114ed9e02f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a8b expref: 3766 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.766022:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785074 00010000:00010000:3.0:1713279306.766023:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f37:0x0].0x0 (ffff88008c2e7500) 00000100:00100000:1.0:1713279306.766024:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110470 00010000:00010000:3.0:1713279306.766026:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00000100:00100000:0.0:1713279306.766027:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3684:11891:x1796503281205952:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:1.0:1713279306.766027:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+77:1954:x1796503281205696:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:3.0:1713279306.766031:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.766036:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.766036:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.766040:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.766044:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980900/0xfc4b8e114eda80db lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391756bb expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.766046:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda80b8 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.766051:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda80b8 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.766054:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3766:1955:x1796503281206400:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 53us (223us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.766057:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda80b8 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.766062:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda80b8 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.766062:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196498 00010000:00010000:2.0:1713279306.766066:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023cfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.766087:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda80b8 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.766092:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda80b8 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.766098:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785075 00010000:00010000:2.0:1713279306.766100:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x125:0x0].0x0 (ffff8800938abd00) 00010000:00010000:2.0:1713279306.766102:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.766103:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3765:11859:x1796503281206272:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.766105:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda80b8 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.766107:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+78:1954:x1796503281205696:12345-192.168.203.4@tcp:2:touch.0 Request processed in 78us (358us total) trans 4295010173 rc 0/0 00010000:00010000:2.0:1713279306.766109:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda80b8 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.766111:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda80e2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.766111:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110470 00010000:00010000:3.0:1713279306.766114:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.766117:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda80bf lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.766118:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110471 00000100:00100000:1.0:1713279306.766120:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+77:11880:x1796503281206080:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.766121:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda80e2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.766121:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c240/0xfc4b8e114eda80e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391756c9 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.766125:0:11415:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.766126:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda80e2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.766126:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda80bf lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.766131:0:11415:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda80f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391756c2 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.766131:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda80bf lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.766133:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114eda80f7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.766135:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023dd40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.766136:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114eda80f7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.766137:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda80bf lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.766140:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114eda80f7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.766141:0:11415:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda7a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175502 expref: 88 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.766141:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda80bf lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.766145:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.766147:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.766147:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x125:0x0].0x3731 (ffff880096da6900) 00010000:00010000:1.0:1713279306.766149:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda80f0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [16384->32767] (req 16384->32767) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756c2 expref: 78 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.766149:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.766149:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda80fe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.766151:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda80bf lrc: 2/0,0 mode: --/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.766156:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda80bf lrc: 0/0,0 mode: --/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.766156:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda80fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.766161:0:11415:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda7a21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175502 expref: 88 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.766162:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda80fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.766166:0:11415:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda7a21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175502 expref: 88 pid: 9197 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.766171:0:11415:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11415:1796503200030272:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.766172:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8105 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.766177:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.766178:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda80aa lrc: 0/0,0 mode: --/CW res: [0x240000401:0x125:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756ad expref: 3687 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.766182:0:11415:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012fb0e6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.766183:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.766188:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda80cd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7304:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756ad expref: 3686 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.766193:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7304:0x0].0x0 (ffff880091cffc00) 00000004:00200000:0.0:1713279306.766194:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7213:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.766195:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.766197:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023c480, rc 0) 00010000:00010000:0.0:1713279306.766199:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda80e2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.766202:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281206144 00010000:00010000:0.0:1713279306.766203:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda80e2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.766204:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281206144 00010000:00010000:0.0:1713279306.766205:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda80e2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.766209:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda80e2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.766211:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d9806c0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.766211:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3686:11890:x1796503281205632:12345-192.168.203.4@tcp:101:touch.0 Request processed in 385us (516us total) trans 4295183641 rc 0/0 00010000:00010000:0.0:1713279306.766214:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda80e2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.766216:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785072 00010000:00010000:0.0:1713279306.766219:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda80e2 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.766222:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223017 00010000:00010000:0.0:1713279306.766224:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:0.0:1713279306.766225:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.766225:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3767:11892:x1796503281206144:12345-192.168.203.4@tcp:33:lfs.0 00010000:00010000:0.0:1713279306.766227:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda80e2 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.766228:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785076 00010000:00010000:0.0:1713279306.766230:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9806c0/0xfc4b8e114eda80e2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.766232:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3410:9807:x1796503281206656:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.766235:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114eda80f7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.766237:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114eda80f7 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.766239:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.766240:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114eda80f7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000004:00200000:3.0:1713279306.766240:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x8179:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.766243:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d9821c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.766244:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114eda80f7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.766246:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda810c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x7256:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391756d0 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.766253:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114eda80f7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.766257:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3731 (ffff88012514d300) 00010000:00010000:0.0:1713279306.766258:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.766259:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114eda80f7 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.766265:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114eda80f7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000004:00200000:1.0:1713279306.766268:0:15527:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x84ee:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.766269:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda80fe lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000004:00200000:1.0:1713279306.766270:0:15527:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:3.0:1713279306.766274:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda80fe lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.766278:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980900/0xfc4b8e114eda80db lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756bb expref: 3685 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.766281:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114eda811a lrc: 3/0,1 mode: --/PW res: [0x240000403:0x7256:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.766282:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980900/0xfc4b8e114eda80db lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756bb expref: 3685 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.766282:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda80fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.766286:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d980900, rc 0) 00000100:00100000:1.0:1713279306.766286:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3768:11892:x1796503281206144:12345-192.168.203.4@tcp:33:lfs.0 Request processed in 60us (491us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.766287:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114eda811a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7256:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.766287:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda80fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.766290:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223017 00010000:00010000:3.0:1713279306.766292:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e5f5200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.766294:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114eda811a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7256:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.766294:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda80fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.766299:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda80fe lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00000004:00200000:2.0:1713279306.766300:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7256:0x0]: returning size 0 00000100:00100000:1.0:1713279306.766301:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785077 00000100:00100000:0.0:1713279306.766303:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3684:11891:x1796503281205952:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 276us (575us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.766304:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3767:11878:x1796503281206528:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1713279306.766306:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.766308:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.766309:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785074 00010000:00010000:3.0:1713279306.766310:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda80fe lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.766315:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda80fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.766322:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.766327:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8105 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.766330:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda810c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x7256:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756d0 expref: 3413 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.766332:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.766336:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d866d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.766339:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.766340:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114eda811a lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x7256:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756d0 expref: 3412 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.766343:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3767:11878:x1796503281206528:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 38us (499us total) trans 0 rc -17/-17 00010000:00010000:2.0:1713279306.766346:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7256:0x0].0x0 (ffff88007fdcac00) 00000100:00100000:1.0:1713279306.766347:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785077 00010000:00010000:3.0:1713279306.766347:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8105 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.766348:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1713279306.766350:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094550d80, rc 0) 00010000:00010000:3.0:1713279306.766353:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3031 (ffff88008c725c00) 00010000:00010000:3.0:1713279306.766355:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.766356:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8105 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.766361:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8105 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.766363:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3412:9807:x1796503281206656:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 130us (590us total) trans 4295183642 rc 0/0 00000100:00100000:2.0:1713279306.766371:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785076 00010000:00010000:3.0:1713279306.766378:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c240/0xfc4b8e114eda80e9 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756c9 expref: 3766 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.766385:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c240/0xfc4b8e114eda80e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756c9 expref: 3766 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.766388:0:15525:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880131cd4a80 x1796503200029760) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7af3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7f37:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917552c expref: 3774 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.766394:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f3c240, rc 0) 00010000:00010000:1.0:1713279306.766395:0:15525:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7af3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f37:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917552c expref: 3774 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.766403:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda7af3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7f37:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917552c expref: 3774 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.766409:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd4a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200029760:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.766410:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3765:11859:x1796503281206272:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 306us (672us total) trans 4295202649 rc 301/301 00010000:00010000:1.0:1713279306.766433:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114ed9e2cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b4f expref: 3773 pid: 15479 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.766434:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785075 00000100:00100000:1.0:1713279306.766439:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd7800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200029824:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.766444:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0d8480/0xfc4b8e114ed9e02f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a8b expref: 3764 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.766449:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200029888:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.766460:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f37:0x0].0x0 (ffff88008c2e7500) 00010000:00010000:1.0:1713279306.766463:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766467:0:15525:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766470:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766478:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766482:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766485:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766539:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766543:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766546:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766548:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925433c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.766550:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766553:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766557:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f37:0x0].0x0 (ffff88008c2e7500) 00010000:00010000:1.0:1713279306.766559:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1713279306.766560:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766563:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8048 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7f37:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766569:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766574:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766577:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766579:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766582:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a5f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.766583:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766586:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766589:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff880092a4c200) 00010000:00010000:1.0:1713279306.766590:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.766591:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766594:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda8010 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766600:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda8041 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766602:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda8041 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766605:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda8041 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766607:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.766609:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda8041 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766612:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda8041 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766615:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x3531 (ffff880096b8e700) 00010000:00010000:1.0:1713279306.766617:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.766618:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda8041 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766621:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda8041 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766629:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766632:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766635:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766637:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.766638:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766641:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766644:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.766646:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.766648:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda7d1c expref: 62 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.766656:0:15525:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda7d1c expref: 62 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.766659:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda7d1c expref: 62 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.766663:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda7ed5 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda7ece expref: 62 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.766673:0:15525:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda7d1c expref: 62 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.766679:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200030336:0@lo:105: 00000100:00100000:1.0:1713279306.766695:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.766713:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801360c7780 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.766729:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200030336 00000100:00100000:2.0:1713279306.766732:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200030336 00000100:00100000:2.0:1713279306.766752:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33427 00000100:00100000:2.0:1713279306.766755:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15525:x1796503200030336:12345-0@lo:105: 00010000:00010000:2.0:1713279306.766761:0:6913:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.766766:0:6913:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.766771:0:6913:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.766774:0:6913:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.766778:0:6913:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.766781:0:6913:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.766785:0:6913:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.766793:0:6913:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880091dd5440) 00010000:00010000:1.0:1713279306.766801:0:6943:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.766805:0:6943:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713279306.766815:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1713279306.766818:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15525:x1796503200030336:12345-0@lo:105: Request processed in 62us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.766822:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33427 00000100:00100000:0.0:1713279306.766846:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200030336:0@lo:105: 00010000:00010000:1.0:1713279306.766846:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114eda8128 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.766851:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114eda8128 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.766855:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.766855:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114eda8128 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.766858:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda7cf2 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 15525 initiator: MDT0 00000004:00020000:0.0:1713279306.766863:0:15525:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200000402:0x7f51:0x0]/15 failed: rc = -114 00010000:00010000:1.0:1713279306.766863:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda812f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.766867:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda812f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.766870:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda812f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.766875:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7213:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.766880:0:6943:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114ed8d7da lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x7213:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916ddd8 expref: 3411 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.766883:0:6943:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.766894:0:6943:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114ed8d7da lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x7213:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916ddd8 expref: 3411 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.766899:0:6943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114ed8d7da lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x7213:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916ddd8 expref: 3411 pid: 15749 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.766905:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001_UUID:6943:1796503200030400:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.766922:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801360c79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.766947:0:15525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:385c4b71-808c-40cf-91de-b076b668d13f+3772:11736:x1796503281196736:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 25562us (25588us total) trans 0 rc -114/-114 00000100:00100000:2.0:1713279306.766950:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.766952:0:15525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14331 00000100:00100000:3.0:1713279306.766985:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281206976 00000100:00100000:3.0:1713279306.766988:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281206976 00000100:00100000:3.0:1713279306.767005:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147228 00000100:00100000:3.0:1713279306.767008:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3684:1957:x1796503281206976:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.767014:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.767016:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.767024:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda7de0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755f0 expref: 3684 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.767036:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7693:0x0].0x0 (ffff880090aad600) 00010000:00010000:3.0:1713279306.767039:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.767043:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281206784 00000100:00100000:1.0:1713279306.767046:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281206784 00000100:00100000:0.0:1713279306.767048:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.767054:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3684:1957:x1796503281206976:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 44us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.767058:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281206912 00000100:00100000:1.0:1713279306.767059:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281206912 00000100:00100000:3.0:1713279306.767060:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147228 00000100:00100000:3.0:1713279306.767094:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785078 00000100:00100000:1.0:1713279306.767096:0:15783:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0001_UUID:15783:1796503200030144:192.168.203.4@tcp:106: 00000100:00100000:3.0:1713279306.767098:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3683:11711:x1796503281206784:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.767106:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.767107:0:15783:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda80a3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1118:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756a6 expref: 88 pid: 15783 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713279306.767113:0:15783:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda80a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1118:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756a6 expref: 88 pid: 15783 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713279306.767115:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda813d lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391756d7 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.767118:0:15783:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ef3c0, rc 0) 00000100:00100000:1.0:1713279306.767139:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+87:1954:x1796503281205504:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1303us (1439us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.767139:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8144 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.767143:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110468 00010000:00010000:3.0:1713279306.767145:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8144 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.767151:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8144 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.767158:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda814b lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.767159:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785079 00000100:00100000:1.0:1713279306.767162:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3412:11901:x1796503281206912:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.767164:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda814b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.767168:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.767169:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda814b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.767173:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114eda8152 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391756de expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.767184:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8144 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.767189:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8144 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.767194:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8144 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.767198:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8144 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.767201:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092542880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.767203:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda8159 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.767203:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8144 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.767208:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda8159 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.767208:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8144 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.767212:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda8159 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.767213:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880091d49100) 00010000:00010000:3.0:1713279306.767215:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.767217:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.767217:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8144 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.767220:0:15473:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda812f lrc: 2/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713279306.767221:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8144 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.767224:0:15473:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.767227:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda814b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.767229:0:15473:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda812f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713279306.767232:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda814b lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.767233:0:15473:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.767237:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda814b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.767241:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.767244:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda814b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.767247:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda814b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.767251:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88008a7a7700) 00010000:00010000:3.0:1713279306.767252:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.767253:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda814b lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.767256:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda814b lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.767269:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda813d lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756d7 expref: 3684 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.767274:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda813d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756d7 expref: 3684 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.767279:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092541b00, rc 0) 00000100:00100000:3.0:1713279306.767295:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3683:11711:x1796503281206784:12345-192.168.203.4@tcp:101:touch.0 Request processed in 197us (279us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.767296:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012cd19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9221:1796503200030208:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.767299:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785078 00010000:00010000:1.0:1713279306.767303:0:9221:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713279306.767310:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.767325:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281207040 00000100:00100000:3.0:1713279306.767327:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281207040 00010000:00010000:3.0:1713279306.767335:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7941 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d1 expref: 3683 pid: 6929 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.767344:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196499 00000100:00100000:3.0:1713279306.767347:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3683:1956:x1796503281207040:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.767351:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.767354:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7941 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d1 expref: 3683 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.767359:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7941 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d1 expref: 3683 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.767365:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3218c0/0xfc4b8e114eda7941 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754d1 expref: 3683 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.767370:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88008d597100) 00010000:00010000:3.0:1713279306.767372:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.767376:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.767379:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.767392:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.767404:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3682:1956:x1796503281207040:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 56us (95us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.767406:0:9221:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.767407:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196499 00010000:00010000:1.0:1713279306.767410:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.767431:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda8167 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x233:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.767435:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda8167 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.767439:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda8167 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.767487:0:11415:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11415:1796503200030272:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.767495:0:11415:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda80f0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [16384->32767] (req 16384->32767) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756c2 expref: 78 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.767505:0:11415:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ee880, rc 0) 00000100:00100000:1.0:1713279306.767519:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+78:11880:x1796503281206080:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 1398us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.767523:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110471 00000100:00100000:1.0:1713279306.767541:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796503200030464:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1713279306.767557:0:9221:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.767563:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012fb0e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.767568:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200030464 00000100:00100000:0.0:1713279306.767571:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200030464 00000100:00100000:0.0:1713279306.767585:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98717 00000100:00100000:0.0:1713279306.767588:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+63:9221:x1796503200030464:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1713279306.767620:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+63:9221:x1796503200030464:12345-0@lo:1000:mdt00_004.0 Request processed in 31us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.767623:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98717 00000100:00100000:1.0:1713279306.767624:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796503200030464:0@lo:1000:mdt00_004.0 00000004:00080000:1.0:1713279306.767777:0:9221:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x1084:0x0], index 1: 0 00000100:00100000:0.0:1713279306.767822:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.767835:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda816e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x76f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.767840:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda816e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.767844:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda816e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.767856:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.767857:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281207168 00000100:00100000:2.0:1713279306.767858:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.767859:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.767861:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281207168 00010000:00010000:1.0:1713279306.767862:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.767865:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.767870:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.767871:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.767875:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.767879:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88008d597100) 00000100:00100000:3.0:1713279306.767879:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785080 00010000:00010000:1.0:1713279306.767880:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.767881:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.767884:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda80c6 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.767884:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3764:11898:x1796503281207168:12345-192.168.203.4@tcp:101:fallocate.0 00000004:00010000:1.0:1713279306.767889:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091a2e680 reply state ffff880096a38000 transno 4295183643 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda8167 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.767892:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.767893:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda8167 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.767896:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x37 (ffff880090a56f00) 00010000:00010000:1.0:1713279306.767897:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.767899:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.767902:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda817c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391756e5 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.767909:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983840/0xfc4b8e114eda80b1 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756b4 expref: 3415 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.767917:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda816e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756b4 expref: 3414 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.767921:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76f3:0x0].0x0 (ffff880090a56900) 00010000:00010000:1.0:1713279306.767923:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.767924:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf6ac0, rc 0) 00000100:00100000:1.0:1713279306.767940:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:11855:x1796503281205824:12345-192.168.203.4@tcp:101:touch.0 Request processed in 2062us (2225us total) trans 4295183643 rc 0/0 00000100:00100000:1.0:1713279306.767944:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785073 00010000:00010000:3.0:1713279306.767946:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda8183 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.767953:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda8183 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.767958:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda8183 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000004:00200000:3.0:1713279306.767962:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7fe9:0x0]: returning size 46934 00010000:00010000:3.0:1713279306.767994:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda817c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756e5 expref: 3767 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.768001:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda8183 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756e5 expref: 3766 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.768005:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:3.0:1713279306.768007:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1713279306.768009:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea5f180, rc 0) 00000100:00100000:3.0:1713279306.768026:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3766:11898:x1796503281207168:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 143us (205us total) trans 4295202650 rc 0/0 00000100:00100000:3.0:1713279306.768030:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785080 00000100:00100000:3.0:1713279306.768042:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281207232 00000100:00100000:3.0:1713279306.768044:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281207232 00010000:00010000:3.0:1713279306.768051:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda7a21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175502 expref: 87 pid: 9197 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.768083:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196500 00000100:00100000:3.0:1713279306.768086:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+87:1957:x1796503281207232:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.768091:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.768098:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda7a21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175502 expref: 87 pid: 9197 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.768103:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda7a21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175502 expref: 87 pid: 9197 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.768112:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda7a21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175502 expref: 87 pid: 9197 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.768117:0:15655:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.768118:0:15655:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.768122:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda80f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756c2 expref: 77 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.768127:0:15655:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda80f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756c2 expref: 77 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.768138:0:15655:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda80f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756c2 expref: 77 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.768144:0:15655:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f281180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0001_UUID:15655:1796503200030528:192.168.203.4@tcp:105: 00000100:00100000:3.0:1713279306.768168:0:15655:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760780 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.768236:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.768255:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.768268:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281207360 00000100:00100000:1.0:1713279306.768268:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.768271:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281207360 00000100:00100000:3.0:1713279306.768271:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281207872 00000100:00100000:3.0:1713279306.768274:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281207872 00000100:00100000:0.0:1713279306.768284:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223018 00000100:00100000:1.0:1713279306.768286:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001_UUID:6943:1796503200030400:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.768288:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3766:11204:x1796503281207360:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:1.0:1713279306.768293:0:6943:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00000100:00100000:3.0:1713279306.768298:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785081 00000100:00100000:3.0:1713279306.768303:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3772:11711:x1796503281207872:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.768307:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.768314:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.768316:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.768322:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009181c480/0xfc4b8e114eda8191 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391756ec expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.768330:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281207616 00000100:00100000:1.0:1713279306.768332:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.768333:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281207616 00000100:00100000:1.0:1713279306.768339:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281207936 00000100:00100000:1.0:1713279306.768341:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281207936 00000100:00100000:2.0:1713279306.768348:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281207744 00000100:00100000:2.0:1713279306.768350:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281207744 00000100:00100000:1.0:1713279306.768353:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147229 00000100:00100000:1.0:1713279306.768356:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b25ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3682:1957:x1796503281207936:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.768361:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.768362:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223019 00010000:00010000:1.0:1713279306.768367:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda80cd lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7304:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756ad expref: 3682 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.768367:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012347c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:13161:x1796503281207616:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1713279306.768368:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3767:11204:x1796503281207360:12345-192.168.203.4@tcp:35:touch.0 Request processed in 79us (112us total) trans 4295202651 rc 0/0 00010000:00010000:3.0:1713279306.768370:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda8198 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.768373:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223018 00010000:00010000:1.0:1713279306.768373:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7304:0x0].0x0 (ffff880091cffc00) 00010000:00010000:1.0:1713279306.768375:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.768378:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda8198 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.768381:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223020 00000100:00100000:0.0:1713279306.768384:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3774:11736:x1796503281207744:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:3.0:1713279306.768384:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda8198 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.768385:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b25ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3681:1957:x1796503281207936:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 29us (53us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.768389:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147229 00010000:00010000:3.0:1713279306.768393:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda819f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.768398:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda819f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.768401:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3774:11736:x1796503281207744:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 16us (84us total) trans 0 rc -116/-116 00010000:00010000:3.0:1713279306.768404:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda819f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.768405:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223020 00000100:00100000:0.0:1713279306.768430:0:15525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281207488 00000100:00100000:0.0:1713279306.768433:0:15525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281207488 00000004:00200000:3.0:1713279306.768437:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00000100:00100000:0.0:1713279306.768444:0:15525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14337 00010000:00010000:3.0:1713279306.768444:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda8198 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.768447:0:15525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3417:9807:x1796503281207488:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1713279306.768449:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda8198 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.768451:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012347c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3417:13161:x1796503281207616:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 83us (142us total) trans 4295183644 rc 0/0 00010000:00010000:3.0:1713279306.768454:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda8198 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.768458:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223019 00010000:00010000:3.0:1713279306.768459:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda8198 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.768464:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.768466:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda8198 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.768470:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.768471:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda8198 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.768474:0:15525:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 15525 initiator: MDT1 00010000:00010000:3.0:1713279306.768478:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8800960e8000) 00010000:00010000:0.0:1713279306.768479:0:15525:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x1000000000000 pid: 15525 initiator: MDT1 00010000:00010000:3.0:1713279306.768480:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.768483:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda8198 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.768486:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200030592:0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713279306.768487:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda8198 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.768495:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda819f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.768500:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.768501:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda819f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.768505:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda819f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.768507:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb0540 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.768510:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a7180 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.768511:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200030592 00010000:00010000:3.0:1713279306.768512:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda819f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.768513:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200030592 00010000:00010000:3.0:1713279306.768516:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda819f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.768521:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff8800960e8800) 00000100:00100000:1.0:1713279306.768523:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98718 00010000:00010000:3.0:1713279306.768523:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.768525:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+63:15525:x1796503200030592:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713279306.768525:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda819f lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.768529:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda819f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.768531:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.768536:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda81ad lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda81a6 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.768545:0:15542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981f80/0xfc4b8e114eda809c lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8064 expref: 64 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.768548:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009181c480/0xfc4b8e114eda8191 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756ec expref: 3773 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.768550:0:15542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda81ad lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda81a6 expref: 64 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.768554:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009181c480/0xfc4b8e114eda8191 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756ec expref: 3773 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.768561:0:15542:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981f80/0xfc4b8e114eda809c lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8064 expref: 64 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.768563:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009181c480, rc 0) 00010000:00010000:1.0:1713279306.768566:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda81ad lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda81a6 expref: 64 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.768569:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.768571:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.768573:0:15542:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda7ed5 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda7ece expref: 64 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.768576:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf7cc0, rc 0) 00000100:00100000:3.0:1713279306.768582:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3772:11711:x1796503281207872:12345-192.168.203.4@tcp:101:touch.0 Request processed in 279us (347us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.768585:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785081 00000100:00100000:1.0:1713279306.768600:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+64:15525:x1796503200030592:12345-0@lo:101:mdt_io00_009.0 Request processed in 74us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.768603:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98718 00000100:00100000:0.0:1713279306.768607:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200030592:0@lo:101:mdt_io00_009.0 00010000:00010000:0.0:1713279306.768613:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.768618:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.769114:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.769143:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.769150:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281208256 00000100:00100000:3.0:1713279306.769155:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281208256 00000100:00100000:0.0:1713279306.769158:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281208064 00000100:00100000:0.0:1713279306.769161:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281208064 00000100:00100000:2.0:1713279306.769164:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.769171:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281208128 00000100:00100000:3.0:1713279306.769173:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281208128 00000100:00100000:0.0:1713279306.769174:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223021 00000100:00100000:0.0:1713279306.769177:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:385c4b71-808c-40cf-91de-b076b668d13f+3681:11890:x1796503281208064:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:3.0:1713279306.769184:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785082 00000100:00100000:3.0:1713279306.769189:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3772:11886:x1796503281208256:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:2.0:1713279306.769195:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785083 00010000:00010000:3.0:1713279306.769198:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.769199:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3767:11859:x1796503281208128:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.769206:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.769206:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda81b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391756fa expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.769212:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114eda81bb lrc: 2/0,0 mode: --/CR res: [0x200000400:0x23e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391756f3 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.769232:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009435e880/0xfc4b8e114eda81c2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x23e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.769240:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009435e880/0xfc4b8e114eda81c2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x23e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.769247:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009435e880/0xfc4b8e114eda81c2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x23e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.769251:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda81c9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769257:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda81c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769263:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda81c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000004:00200000:2.0:1713279306.769269:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x23e:0x0]: returning size 4096 00000004:00200000:2.0:1713279306.769272:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1713279306.769273:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda81d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.769275:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:385c4b71-808c-40cf-91de-b076b668d13f+3682:11890:x1796503281208064:12345-192.168.203.4@tcp:35:touch.0 Request processed in 96us (134us total) trans 4295183645 rc 0/0 00010000:00010000:3.0:1713279306.769278:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda81d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.769280:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223021 00010000:00010000:3.0:1713279306.769284:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda81d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.769287:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114eda81bb lrc: 0/0,0 mode: --/CR res: [0x200000400:0x23e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756f3 expref: 3769 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.769297:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009435e880/0xfc4b8e114eda81c2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x23e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756f3 expref: 3768 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.769303:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x23e:0x0].0x0 (ffff88012514d100) 00010000:00010000:2.0:1713279306.769305:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713279306.769307:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009435e880, rc 0) 00000100:00100000:1.0:1713279306.769317:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00200000:3.0:1713279306.769324:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7ccb:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.769330:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda81c9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769335:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda81c9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.769337:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281208384 00000100:00100000:2.0:1713279306.769338:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3768:11859:x1796503281208128:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 138us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.769340:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281208384 00010000:00010000:3.0:1713279306.769341:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda81c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.769344:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785083 00010000:00010000:3.0:1713279306.769346:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda81c9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.769350:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223022 00010000:00010000:3.0:1713279306.769350:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a4d80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.769353:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:385c4b71-808c-40cf-91de-b076b668d13f+3682:11876:x1796503281208384:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:3.0:1713279306.769353:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda81c9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769358:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda81c9 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769366:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.769368:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.769371:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda81c9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.769374:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.769375:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda81c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769382:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda81d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769387:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda81d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.769391:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.769392:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda81d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.769395:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281208640 00010000:00010000:3.0:1713279306.769396:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe16880 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.769397:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281208640 00010000:00010000:3.0:1713279306.769398:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda81d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769404:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda81d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.769409:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281208512 00010000:00010000:3.0:1713279306.769409:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x30 (ffff8800960e8f00) 00010000:00010000:3.0:1713279306.769428:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.769431:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281208512 00010000:00010000:3.0:1713279306.769431:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda81d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769437:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda81d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.769438:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:385c4b71-808c-40cf-91de-b076b668d13f+3683:11876:x1796503281208384:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 82us (122us total) trans 4295183646 rc 0/0 00000100:00100000:0.0:1713279306.769442:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223022 00000100:00100000:2.0:1713279306.769447:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785084 00000100:00100000:2.0:1713279306.769451:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3774:11736:x1796503281208640:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.769456:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda81b4 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756fa expref: 3774 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.769458:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.769463:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda81b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756fa expref: 3774 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.769465:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda81d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7efd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175708 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.769474:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4a4b40, rc 0) 00000100:00100000:3.0:1713279306.769491:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3774:11886:x1796503281208256:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 301us (377us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.769497:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785082 00010000:00010000:2.0:1713279306.769503:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda81de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7efd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:3.0:1713279306.769508:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785085 00010000:00010000:2.0:1713279306.769512:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda81de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7efd:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00000100:00100000:3.0:1713279306.769512:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3768:11204:x1796503281208512:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.769519:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda81de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7efd:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.769519:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.769525:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14900/0xfc4b8e114eda81e5 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175701 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713279306.769526:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7efd:0x0]: returning size 0 00010000:00010000:3.0:1713279306.769551:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda81f3 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769558:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda81f3 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.769563:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda81d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7efd:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175708 expref: 3775 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.769564:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda81f3 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.769573:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda81de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7efd:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175708 expref: 3774 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.769573:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda81fa lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769578:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda81fa lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.769579:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7efd:0x0].0x0 (ffff880122df6700) 00010000:00010000:2.0:1713279306.769581:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1713279306.769583:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd133c0, rc 0) 00010000:00010000:3.0:1713279306.769584:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda81fa lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769600:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda81f3 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769606:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda81f3 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769611:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda81f3 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.769612:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3774:11736:x1796503281208640:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 160us (236us total) trans 4295202652 rc 0/0 00010000:00010000:3.0:1713279306.769616:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda81f3 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.769617:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785084 00010000:00010000:3.0:1713279306.769620:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe15b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.769622:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda81f3 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769627:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda81f3 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769634:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:3.0:1713279306.769636:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.769638:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda81f3 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769643:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15b00/0xfc4b8e114eda81f3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769650:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda81fa lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769655:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda81fa lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769660:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda81fa lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769663:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe14fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.769666:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda81fa lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769670:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda81fa lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769675:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff8800960e8a00) 00010000:00010000:3.0:1713279306.769677:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.769679:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda81fa lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769683:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda81fa lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.769700:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14900/0xfc4b8e114eda81e5 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175701 expref: 3769 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.769705:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14900/0xfc4b8e114eda81e5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175701 expref: 3769 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.769709:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe14900, rc 0) 00000100:00100000:3.0:1713279306.769733:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3768:11204:x1796503281208512:12345-192.168.203.4@tcp:101:touch.0 Request processed in 220us (341us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.769736:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785085 00000100:00100000:3.0:1713279306.769761:0:15655:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f281180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0001_UUID:15655:1796503200030528:192.168.203.4@tcp:105: 00010000:00010000:3.0:1713279306.769769:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.769787:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1957:x1796503281207232:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1699us (1931us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.769793:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196500 00000100:00100000:0.0:1713279306.770353:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.770433:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281208832 00000100:00100000:3.0:1713279306.770437:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281208832 00000100:00100000:3.0:1713279306.770461:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785086 00000100:00100000:3.0:1713279306.770465:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3683:11711:x1796503281208832:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.770472:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.770479:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda8201 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917570f expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.770504:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda8208 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.770510:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda8208 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770514:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda8208 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770519:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda820f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.770523:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda820f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770526:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda820f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770539:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda8208 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770542:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda8208 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770545:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda8208 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770550:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda8208 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770553:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe16d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.770555:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda8208 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770558:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda8208 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770562:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88009e797800) 00010000:00010000:3.0:1713279306.770563:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.770565:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda8208 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770568:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda8208 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770573:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda820f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770576:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda820f lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770579:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda820f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770581:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe161c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.770583:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda820f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770585:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda820f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770591:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88008d597700) 00000100:00100000:1.0:1713279306.770592:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.770592:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.770594:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda820f lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770596:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda820f lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.770610:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda8201 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917570f expref: 3684 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.770613:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.770616:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda8201 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917570f expref: 3684 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.770623:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.770625:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe16f40, rc 0) 00000100:00100000:0.0:1713279306.770626:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281208896 00000100:00100000:0.0:1713279306.770629:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281208896 00000100:00100000:1.0:1713279306.770632:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.770640:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281208704 00000100:00100000:2.0:1713279306.770644:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281208704 00000100:00100000:0.0:1713279306.770649:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110472 00000100:00100000:3.0:1713279306.770650:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3683:11711:x1796503281208832:12345-192.168.203.4@tcp:101:touch.0 Request processed in 183us (297us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.770652:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+78:1954:x1796503281208896:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:2.0:1713279306.770656:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114ed8d7da lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x7213:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916ddd8 expref: 3417 pid: 15749 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.770656:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785086 00000100:00100000:1.0:1713279306.770658:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.770666:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281209024 00000100:00100000:3.0:1713279306.770668:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281209024 00000100:00100000:2.0:1713279306.770671:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196501 00000100:00100000:2.0:1713279306.770675:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3418:1955:x1796503281208704:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.770677:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281209152 00000100:00100000:3.0:1713279306.770679:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281209152 00010000:00010000:2.0:1713279306.770682:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.770686:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114ed8d7da lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x7213:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916ddd8 expref: 3418 pid: 15749 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.770686:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281209280 00000100:00100000:3.0:1713279306.770688:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281209280 00000100:00100000:3.0:1713279306.770698:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785087 00000100:00100000:1.0:1713279306.770699:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.770699:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114ed8d7da lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x7213:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916ddd8 expref: 3418 pid: 15749 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.770702:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3418:11855:x1796503281209024:12345-192.168.203.4@tcp:36:touch.0 00002000:00010000:0.0:1713279306.770704:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb size from disk: 3214 -> 3214 00002000:00010000:0.0:1713279306.770706:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb mtime from disk: 1713279304 -> 1713279304 00000100:00100000:1.0:1713279306.770706:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281209216 00002000:00010000:0.0:1713279306.770707:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb atime from disk: 1713279299 -> 1713279299 00002000:00010000:0.0:1713279306.770709:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb ctime from disk: 1713279304 -> 1713279304 00000100:00100000:1.0:1713279306.770709:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281209216 00002000:00010000:0.0:1713279306.770710:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1713279306.770710:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114ed8d7da lrc: 0/0,0 mode: --/CR res: [0x240000403:0x7213:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916ddd8 expref: 3418 pid: 15749 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.770718:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7213:0x0].0x0 (ffff880124f55f00) 00010000:00010000:3.0:1713279306.770718:0:15485:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.770721:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00000100:00100000:1.0:1713279306.770723:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147230 00000100:00100000:0.0:1713279306.770725:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+79:1954:x1796503281208896:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 73us (111us total) trans 4295010115 rc 0/0 00010000:00010000:3.0:1713279306.770725:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda816e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x76f3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756b4 expref: 3417 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.770726:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3775:1954:x1796503281209216:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.770727:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6943 initiator: MDT1 00000100:00100000:0.0:1713279306.770729:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110472 00010000:00010000:1.0:1713279306.770731:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.770732:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713279306.770732:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76f3:0x0].0x0 (ffff880090a56900) 00010000:00010000:3.0:1713279306.770736:0:15485:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.770740:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda8080 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917569f expref: 3775 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.770744:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.770746:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785088 00010000:00010000:1.0:1713279306.770748:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00000100:00100000:0.0:1713279306.770749:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3768:11872:x1796503281209152:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:1.0:1713279306.770750:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.770760:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3416:1955:x1796503281208704:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.770762:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3774:1954:x1796503281209216:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 36us (64us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.770766:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196501 00000100:00100000:1.0:1713279306.770774:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147230 00010000:00010000:3.0:1713279306.770775:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda8216 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x76f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.770782:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda8216 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.770783:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785089 00010000:00010000:1.0:1713279306.770787:0:6943:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00000100:00100000:2.0:1713279306.770787:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3773:11874:x1796503281209280:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.770788:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda8216 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.770791:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00000100:00100000:0.0:1713279306.770792:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3768:11872:x1796503281209152:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 42us (158us total) trans 0 rc -17/-17 00010000:00010000:2.0:1713279306.770794:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.770796:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785088 00010000:00010000:2.0:1713279306.770800:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd121c0/0xfc4b8e114eda821d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175716 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.770816:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.770823:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda8224 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.770825:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281209408 00000004:00010000:3.0:1713279306.770826:0:15485:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800997f9f80 reply state ffff88012c0b7000 transno 4295183647 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda8216 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.770827:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281209408 00010000:00010000:3.0:1713279306.770833:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda8216 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.770834:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda8224 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.770836:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110473 00000100:00100000:0.0:1713279306.770838:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+79:1957:x1796503281209408:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:2.0:1713279306.770839:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda8224 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.770839:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76f3:0x0].0x0 (ffff8800909b0e00) 00010000:00010000:3.0:1713279306.770841:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.770843:0:15485:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.770848:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda822b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.770850:0:11415:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda8232 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x111b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.770853:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda822b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.770857:0:11415:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092342640/0xfc4b8e114ed9dfe2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x111b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a45 expref: 79 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713279306.770858:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda822b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.770863:0:11415:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c539d40/0xfc4b8e114ed9e37e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x111b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b87 expref: 85 pid: 11415 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713279306.770866:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.770867:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.770869:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda8232 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x111b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.770872:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3417:11855:x1796503281209024:12345-192.168.203.4@tcp:36:touch.0 Request processed in 169us (248us total) trans 4295183647 rc 0/0 00000100:00100000:3.0:1713279306.770878:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785087 00010000:00010000:0.0:1713279306.770879:0:11415:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c539d40/0xfc4b8e114ed9e37e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x111b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b87 expref: 85 pid: 11415 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713279306.770885:0:11415:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c539d40/0xfc4b8e114ed9e37e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x111b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b87 expref: 85 pid: 11415 timeout: 509 lvb_type: 1 00010000:00010000:2.0:1713279306.770888:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda8239 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.770890:0:11415:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11415:1796503200030720:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.770895:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda8239 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.770901:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda8239 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.770907:0:11415:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092342640/0xfc4b8e114ed9dfe2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x111b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a45 expref: 79 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713279306.770916:0:11415:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092342640/0xfc4b8e114ed9dfe2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x111b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a45 expref: 79 pid: 15519 timeout: 509 lvb_type: 1 00000100:00100000:0.0:1713279306.770920:0:11415:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11415:1796503200030784:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.770922:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.770927:0:11415:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb06c0 going to sleep for 11 seconds 00000004:00200000:2.0:1713279306.770930:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00000004:00200000:2.0:1713279306.770933:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1713279306.770935:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281209344 00000100:00100000:3.0:1713279306.770938:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281209344 00000004:00010000:2.0:1713279306.770942:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda8239 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.770948:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda8224 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.770951:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785090 00010000:00010000:2.0:1713279306.770953:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda8224 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.770956:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3683:11890:x1796503281209344:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.770961:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda8224 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.770962:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.770966:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda8224 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.770970:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.770970:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda8240 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x125:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917571d expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.770973:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda8224 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.770978:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda8224 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.770985:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:2.0:1713279306.770987:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.770990:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda8224 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.770993:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda8247 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x125:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.770994:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda8224 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.770999:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda8247 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.771002:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda822b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.771005:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda8247 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.771007:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda822b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.771011:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda822b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.771013:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda824e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.771016:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.771018:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda822b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.771018:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda824e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771024:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda824e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.771026:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda822b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.771031:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff880135885a00) 00010000:00010000:2.0:1713279306.771033:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.771035:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda822b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.771039:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda822b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.771052:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda8255 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7304:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.771054:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd121c0/0xfc4b8e114eda821d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175716 expref: 3775 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.771058:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda8255 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7304:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.771063:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda8239 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175716 expref: 3774 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.771063:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda8255 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7304:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.771085:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:2.0:1713279306.771087:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713279306.771089:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd11d40, rc 0) 00000004:00200000:3.0:1713279306.771095:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7304:0x0]: returning size 0 00000004:00200000:3.0:1713279306.771098:0:15752:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713279306.771104:0:15752:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda8255 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7304:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.771111:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3774:11874:x1796503281209280:12345-192.168.203.4@tcp:101:touch.0 Request processed in 322us (451us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.771112:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda8255 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7304:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.771116:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785089 00010000:00010000:3.0:1713279306.771118:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda8247 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771122:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda8247 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771127:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda8247 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771132:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda8247 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771137:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.771139:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda8247 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771144:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda8247 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771151:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x125:0x0].0x0 (ffff88011f2c2200) 00010000:00010000:3.0:1713279306.771152:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.771154:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda8247 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771159:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda8247 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771166:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda824e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771170:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda824e lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771174:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda824e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771179:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.771182:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda824e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771186:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda824e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771191:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x125:0x0].0x3731 (ffff88011eea4e00) 00010000:00010000:3.0:1713279306.771192:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.771194:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda824e lrc: 2/0,0 mode: --/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771196:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda824e lrc: 0/0,0 mode: --/PR res: [0x240000401:0x125:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.771209:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda8240 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x125:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917571d expref: 3685 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.771216:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda8255 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7304:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917571d expref: 3684 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.771220:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7304:0x0].0x0 (ffff880091cffc00) 00010000:00010000:3.0:1713279306.771221:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713279306.771222:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd5680, rc 0) 00000100:00100000:3.0:1713279306.771245:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3684:11890:x1796503281209344:12345-192.168.203.4@tcp:101:touch.0 Request processed in 289us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.771249:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785090 00000100:00100000:0.0:1713279306.771724:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.771743:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.771757:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.771771:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281209536 00000100:00100000:3.0:1713279306.771772:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281209792 00000100:00100000:2.0:1713279306.771777:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281209536 00000100:00100000:3.0:1713279306.771777:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281209792 00000100:00100000:2.0:1713279306.771793:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281209664 00000100:00100000:2.0:1713279306.771795:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281209664 00000100:00100000:3.0:1713279306.771805:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785091 00000100:00100000:2.0:1713279306.771811:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785092 00000100:00100000:3.0:1713279306.771811:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3769:11859:x1796503281209536:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:2.0:1713279306.771816:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3684:11885:x1796503281209792:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1713279306.771820:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.771828:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd73c0/0xfc4b8e114eda825c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175724 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.771852:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.771854:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda8263 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.771862:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda8263 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.771868:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda8263 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.771877:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda826a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.771883:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3684:11885:x1796503281209792:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 66us (138us total) trans 0 rc -17/-17 00010000:00010000:3.0:1713279306.771883:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda826a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.771888:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda826a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.771889:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785092 00000100:00100000:2.0:1713279306.771900:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281209920 00000100:00100000:2.0:1713279306.771902:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281209920 00000100:00100000:2.0:1713279306.771925:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785093 00000100:00100000:2.0:1713279306.771930:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3770:11907:x1796503281209664:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:0.0:1713279306.771931:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785094 00000004:00200000:3.0:1713279306.771935:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x8179:0x0]: returning size 4096 00000100:00100000:0.0:1713279306.771936:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3417:11204:x1796503281209920:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.771936:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.771943:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.771944:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd118c0/0xfc4b8e114eda8271 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917572b expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.771950:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982d00/0xfc4b8e114eda827f lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175732 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.771964:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda8263 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.771972:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda8263 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.771977:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda8263 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.771981:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda8286 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.771986:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda8263 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.771988:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda8286 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.771989:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114eda828d lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.771990:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.771993:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda8263 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.771994:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda8286 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.771995:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114eda828d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.771998:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda8263 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.771999:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114eda828d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00000004:00200000:2.0:1713279306.772000:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7fe9:0x0]: returning size 46934 00010000:00010000:0.0:1713279306.772004:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981440/0xfc4b8e114eda8294 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.772005:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:0.0:1713279306.772008:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981440/0xfc4b8e114eda8294 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.772008:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.772011:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981440/0xfc4b8e114eda8294 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.772011:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda8263 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.772015:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda8263 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000004:00200000:0.0:1713279306.772021:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:3.0:1713279306.772024:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda826a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.772028:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114eda828d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.772028:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda826a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.772032:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114eda828d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.772033:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda826a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.772035:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114eda828d lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.772035:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd118c0/0xfc4b8e114eda8271 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917572b expref: 3774 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.772038:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114eda828d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.772038:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.772040:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.772040:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda826a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.772042:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114eda828d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.772044:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda8286 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917572b expref: 3773 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.772045:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114eda828d lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.772045:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda826a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.772049:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:0.0:1713279306.772050:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.772050:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:0.0:1713279306.772052:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114eda828d lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.772053:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1713279306.772055:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114eda828d lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.772055:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd106c0, rc 0) 00010000:00010000:3.0:1713279306.772055:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3031 (ffff88008e720f00) 00010000:00010000:3.0:1713279306.772057:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.772059:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda826a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.772060:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981440/0xfc4b8e114eda8294 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.772063:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda826a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.772065:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981440/0xfc4b8e114eda8294 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.772082:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981440/0xfc4b8e114eda8294 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.772085:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.772086:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981440/0xfc4b8e114eda8294 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00000040:00080000:1.0:1713279306.772086:0:6943:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x1c0:0x0].1543, 5872 off825072 00010000:00010000:0.0:1713279306.772089:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981440/0xfc4b8e114eda8294 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.772092:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88012514db00) 00000100:00100000:2.0:1713279306.772093:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3773:11907:x1796503281209664:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 162us (334us total) trans 4295202654 rc 0/0 00010000:00010000:0.0:1713279306.772094:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.772095:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981440/0xfc4b8e114eda8294 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.772098:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981440/0xfc4b8e114eda8294 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00000100:00100000:2.0:1713279306.772099:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785093 00010000:00010000:3.0:1713279306.772100:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd73c0/0xfc4b8e114eda825c lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175724 expref: 3773 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.772106:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd73c0/0xfc4b8e114eda825c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175724 expref: 3772 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.772112:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982d00/0xfc4b8e114eda827f lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175732 expref: 3418 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.772113:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd73c0, rc 0) 00010000:00010000:0.0:1713279306.772116:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982d00/0xfc4b8e114eda827f lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175732 expref: 3418 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.772121:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d982d00, rc 0) 00000100:00100000:3.0:1713279306.772130:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3771:11859:x1796503281209536:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 319us (405us total) trans 4295202653 rc 301/301 00000100:00100000:0.0:1713279306.772135:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3417:11204:x1796503281209920:12345-192.168.203.4@tcp:101:touch.0 Request processed in 198us (283us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.772136:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785091 00000100:00100000:0.0:1713279306.772139:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785094 00000040:00080000:1.0:1713279306.772200:0:6943:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xf8:0x0].2150, 5952 off1523312 00000004:00080000:1.0:1713279306.772203:0:6943:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8801360c7780 with version 31973 00000004:00080000:2.0:1713279306.772232:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31973 rpc_version 31973 00000020:00100000:2.0:1713279306.772257:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.772262:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880131cd7800 x1796503200030912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 272/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1713279306.772271:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200030912:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1713279306.772292:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.772306:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880095a94a80 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.772317:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200030912 00000100:00100000:1.0:1713279306.772320:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200030912 00000100:00100000:1.0:1713279306.772334:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98719 00000100:00100000:1.0:1713279306.772337:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+64:8074:x1796503200030912:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.772734:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+65:8074:x1796503200030912:12345-0@lo:1000:osp_up0-1.0 Request processed in 395us (440us total) trans 4295202655 rc 0/0 00000100:00100000:1.0:1713279306.772739:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98719 00000100:00100000:0.0:1713279306.772802:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.772817:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200030912:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.772823:0:11415:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11415:1796503200030720:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.772829:0:11415:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11415:1796503200030784:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.772838:0:11415:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda8232 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x111b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.772839:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114eda82a2 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7d86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00000100:00100000:3.0:1713279306.772841:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281210304 00010000:00010000:1.0:1713279306.772845:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114eda82a2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00000100:00100000:3.0:1713279306.772845:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281210304 00010000:00010000:1.0:1713279306.772850:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114eda82a2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.772858:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6400/0xfc4b8e114eda82a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x263:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.772862:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6400/0xfc4b8e114eda82a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00000100:00100000:3.0:1713279306.772863:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785095 00010000:00010000:1.0:1713279306.772865:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6400/0xfc4b8e114eda82a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00000100:00100000:3.0:1713279306.772869:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3774:11711:x1796503281210304:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.772877:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf4900/0xfc4b8e114eda82b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.772879:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.772880:0:6943:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf4900/0xfc4b8e114eda82b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.772887:0:6943:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf4900/0xfc4b8e114eda82b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713279306.772888:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6640/0xfc4b8e114eda82b7 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175739 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.772895:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df04380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200030976:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1713279306.772907:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.772914:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120671c00 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.772924:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200030976 00000100:00100000:0.0:1713279306.772928:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200030976 00000100:00100000:1.0:1713279306.772928:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.772938:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda82be lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.772944:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.772947:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98720 00010000:00010000:3.0:1713279306.772950:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda82be lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.772951:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+65:6943:x1796503200030976:12345-0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1713279306.772951:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281210112 00000100:00100000:1.0:1713279306.772954:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281210112 00010000:00010000:3.0:1713279306.772957:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda82be lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.772960:0:6934:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.772961:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281210048 00010000:00010000:1.0:1713279306.772963:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539d40/0xfc4b8e114ed9e37e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x111b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b87 expref: 86 pid: 11415 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.772964:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281210048 00010000:00010000:3.0:1713279306.772966:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda82c5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.772967:0:6934:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda82cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda82b0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.772971:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda82c5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.772973:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196502 00000100:00100000:1.0:1713279306.772976:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1956:x1796503281210112:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.772976:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda82c5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.772977:0:6934:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda82cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda82b0 expref: 66 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.772981:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.772983:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223023 00010000:00010000:0.0:1713279306.772984:0:6934:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda82cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda82b0 expref: 66 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.772988:0:6934:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x0 (ffff88012514d900) 00010000:00010000:1.0:1713279306.772988:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c539d40/0xfc4b8e114ed9e37e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x111b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b87 expref: 86 pid: 11415 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.772988:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3776:11880:x1796503281210048:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:0.0:1713279306.772989:0:6934:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.772991:0:6934:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d9818c0, rc 0) 00000004:00200000:3.0:1713279306.772992:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:1.0:1713279306.772994:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c539d40/0xfc4b8e114ed9e37e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x111b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b87 expref: 86 pid: 11415 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.772999:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda82be lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.773002:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c539d40/0xfc4b8e114ed9e37e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x111b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b87 expref: 86 pid: 11415 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.773004:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda82be lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.773008:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.773008:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda82be lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.773009:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+66:6943:x1796503200030976:12345-0@lo:101:mdt_io00_002.0 Request processed in 58us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.773012:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98720 00010000:00010000:3.0:1713279306.773014:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda82be lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.773018:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.773020:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda82be lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.773021:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+85:1956:x1796503281210112:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 43us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.773025:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196502 00010000:00010000:3.0:1713279306.773026:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda82be lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.773027:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df04380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200030976:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1713279306.773035:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf4900/0xfc4b8e114eda82b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda82cc expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.773036:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012d067b00) 00010000:00010000:3.0:1713279306.773039:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.773040:0:6943:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf4900/0xfc4b8e114eda82b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda82cc expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.773041:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda82be lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.773042:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.773046:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda82be lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.773050:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda82d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00000100:00100000:1.0:1713279306.773051:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281210368 00010000:00010000:0.0:1713279306.773053:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda82d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00000100:00100000:1.0:1713279306.773053:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281210368 00000100:00100000:2.0:1713279306.773054:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3777:11880:x1796503281210048:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 65us (125us total) trans 4295202656 rc 0/0 00010000:00010000:3.0:1713279306.773054:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda82c5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.773057:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda82d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713279306.773059:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda82c5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:2.0:1713279306.773060:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223023 00000100:00100000:1.0:1713279306.773061:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147231 00000100:00100000:1.0:1713279306.773063:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3685:1956:x1796503281210368:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.773063:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda82c5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.773066:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981200/0xfc4b8e114eda82da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x148:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.773081:0:6943:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981200/0xfc4b8e114eda82da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.773082:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.773085:0:6943:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981200/0xfc4b8e114eda82da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713279306.773086:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800923421c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.773088:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5680/0xfc4b8e114eda8255 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7304:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917571d expref: 3685 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.773088:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda82c5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.773092:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099c2c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200031040:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1713279306.773093:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda82c5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.773094:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7304:0x0].0x0 (ffff880091cffc00) 00010000:00010000:1.0:1713279306.773096:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.773100:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff88012d067c00) 00010000:00010000:3.0:1713279306.773102:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.773104:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda82c5 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.773107:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3684:1956:x1796503281210368:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 43us (65us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.773108:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.773109:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.773109:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda82c5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.773111:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147231 00000100:00100000:0.0:1713279306.773118:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.773123:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200031040 00000100:00100000:1.0:1713279306.773125:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200031040 00000100:00100000:2.0:1713279306.773127:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.773132:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6640/0xfc4b8e114eda82b7 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175739 expref: 3776 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.773135:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98721 00000100:00100000:1.0:1713279306.773137:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+66:6943:x1796503200031040:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1713279306.773140:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6640/0xfc4b8e114eda82b7 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175739 expref: 3776 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.773141:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281210240 00000100:00100000:2.0:1713279306.773141:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.773142:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.773143:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281210240 00010000:00010000:1.0:1713279306.773147:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda82e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x148:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda82da expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.773149:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd6640, rc 0) 00010000:00010000:0.0:1713279306.773152:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092342640/0xfc4b8e114ed9dfe2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x111b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a45 expref: 80 pid: 15519 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.773153:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.773155:0:15516:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda82e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda82da expref: 67 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.773164:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda82e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda82da expref: 67 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.773166:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281210496 00000100:00100000:0.0:1713279306.773167:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281210496 00010000:00010000:1.0:1713279306.773167:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x0 (ffff880091b34100) 00010000:00010000:1.0:1713279306.773169:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.773170:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf5d40, rc 0) 00000100:00100000:3.0:1713279306.773172:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281210432 00000100:00100000:2.0:1713279306.773175:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196503 00000100:00100000:3.0:1713279306.773175:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281210432 00000100:00100000:0.0:1713279306.773179:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147232 00000100:00100000:2.0:1713279306.773180:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:385c4b71-808c-40cf-91de-b076b668d13f+80:1954:x1796503281210240:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.773182:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3776:1957:x1796503281210496:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.773186:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.773186:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+67:6943:x1796503200031040:12345-0@lo:101:mdt_io00_002.0 Request processed in 47us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.773189:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98721 00000100:00100000:3.0:1713279306.773190:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281210560 00010000:00010000:2.0:1713279306.773191:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.773192:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281210560 00010000:00010000:0.0:1713279306.773193:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda8239 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175716 expref: 3776 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773199:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:2.0:1713279306.773200:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092342640/0xfc4b8e114ed9dfe2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x111b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a45 expref: 80 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:0.0:1713279306.773201:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.773202:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785096 00000100:00100000:3.0:1713279306.773206:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3417:11855:x1796503281210432:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.773210:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092342640/0xfc4b8e114ed9dfe2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x111b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a45 expref: 80 pid: 15519 timeout: 509 lvb_type: 1 00000100:00100000:0.0:1713279306.773213:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3776:1957:x1796503281210496:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 31us (72us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.773213:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.773217:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147232 00000100:00100000:1.0:1713279306.773217:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.773220:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092342880/0xfc4b8e114eda82e8 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x76f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175740 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.773222:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092342640/0xfc4b8e114ed9dfe2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x111b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a45 expref: 80 pid: 15519 timeout: 509 lvb_type: 1 00000100:00100000:1.0:1713279306.773223:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281210624 00000100:00100000:1.0:1713279306.773225:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281210624 00010000:00010000:2.0:1713279306.773230:0:15492:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.773232:0:15492:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713279306.773234:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099c2c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6943:1796503200031040:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1713279306.773235:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147233 00010000:00010000:2.0:1713279306.773235:0:15492:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda8232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x111b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.773238:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1478c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3684:1956:x1796503281210624:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:3.0:1713279306.773238:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092342880/0xfc4b8e114eda82e8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x76f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175740 expref: 3418 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773240:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981200/0xfc4b8e114eda82da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda82e1 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.773242:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1713279306.773242:0:15492:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda8232 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x111b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773244:0:6943:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981200/0xfc4b8e114eda82da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda82e1 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.773247:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342880/0xfc4b8e114eda82e8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x76f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175740 expref: 3418 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.773249:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda7fc3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x721d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175675 expref: 3684 pid: 15483 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713279306.773253:0:6943:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880096755880 reply state ffff880095776000 transno 4295183648 ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6400/0xfc4b8e114eda82a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.773255:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.773257:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6400/0xfc4b8e114eda82a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.773257:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecd80/0xfc4b8e114eda49bb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x721d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391748b4 expref: 3683 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.773257:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76f3:0x0].0x0 (ffff8800909b0e00) 00010000:00010000:3.0:1713279306.773259:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1713279306.773261:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x263:0x0].0x0 (ffff880090a56d00) 00010000:00010000:1.0:1713279306.773261:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x721d:0x0].0x0 (ffff8800902cc000) 00010000:00010000:3.0:1713279306.773261:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092342880, rc 0) 00010000:00010000:0.0:1713279306.773262:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.773263:0:6943:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713279306.773263:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.773266:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf4900/0xfc4b8e114eda82b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda82cc expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773270:0:6943:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf4900/0xfc4b8e114eda82b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda82cc expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.773271:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:385c4b71-808c-40cf-91de-b076b668d13f+79:1954:x1796503281210240:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 90us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.773272:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3418:11855:x1796503281210432:12345-192.168.203.4@tcp:101:touch.0 Request processed in 66us (164us total) trans 0 rc 0/0 00000004:00010000:0.0:1713279306.773273:0:6943:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880096755880 reply state ffff880095776000 transno 4295183648 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda82d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00000100:00100000:1.0:1713279306.773274:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1478c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3682:1956:x1796503281210624:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 35us (57us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.773276:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda82d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00000100:00100000:2.0:1713279306.773277:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196503 00000100:00100000:3.0:1713279306.773277:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785096 00010000:00010000:0.0:1713279306.773279:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x0 (ffff88012514da00) 00000100:00100000:1.0:1713279306.773279:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147233 00010000:00010000:0.0:1713279306.773280:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.773281:0:6943:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1713279306.773282:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981200/0xfc4b8e114eda82da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda82e1 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773286:0:6943:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981200/0xfc4b8e114eda82da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda82e1 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.773288:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785097 00000004:00080000:0.0:1713279306.773290:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x14f:0x0] 00000004:00080000:0.0:1713279306.773292:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x148:0x0] 00000100:00100000:3.0:1713279306.773293:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3775:11874:x1796503281210560:12345-192.168.203.4@tcp:101:touch.0 00000004:00010000:0.0:1713279306.773298:0:6943:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880096755880 reply state ffff880095776000 transno 4295183648 ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114eda82a2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713279306.773299:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.773302:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114eda82a2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7d86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.773304:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d86:0x0].0x0 (ffff880090a56500) 00010000:00010000:0.0:1713279306.773305:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.773305:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092343cc0/0xfc4b8e114eda82ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175747 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.773306:0:6943:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000004:00010000:0.0:1713279306.773309:0:6943:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880096755880 reply state ffff880095776000 transno 4295183648 ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.773316:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.773319:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7213:0x0].0x0 (ffff880124f55f00) 00010000:00010000:0.0:1713279306.773320:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1713279306.773321:0:6943:0:(service.c:188:ptlrpc_save_lock()) nlocks 3 00010000:00010000:0.0:1713279306.773323:0:6943:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114eda8128 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00000100:00100000:2.0:1713279306.773324:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.773326:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114eda8128 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713279306.773327:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda82f6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.773329:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114eda8128 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.773332:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114eda8128 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.773334:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ed680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.773334:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda82f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.773336:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114eda8128 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.773339:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114eda8128 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713279306.773339:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda82f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.773342:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:0.0:1713279306.773343:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.773345:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114eda8128 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.773347:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114eda8128 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713279306.773348:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda82fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000004:00010000:0.0:1713279306.773352:0:6943:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880096755880 reply state ffff880095776000 transno 4295183648 ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda812f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713279306.773354:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda82fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.773357:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda812f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713279306.773359:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda82fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.773360:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3731 (ffff880090a56a00) 00010000:00010000:0.0:1713279306.773361:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.773362:0:6943:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.773365:0:6943:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.773368:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.773374:0:6943:0:(service.c:188:ptlrpc_save_lock()) nlocks 4 00010000:00010000:1.0:1713279306.773383:0:15473:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.773383:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda8304 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.773387:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.773388:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda8304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.773393:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda8304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000004:00200000:3.0:1713279306.773446:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.773448:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7d86:0x0]: returning size 4096 00000004:00200000:3.0:1713279306.773449:0:15749:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713279306.773454:0:6943:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.773454:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda8159 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00010000:3.0:1713279306.773457:0:15749:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda8304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.773458:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.773458:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda8159 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.773462:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.773462:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda8159 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.773464:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda82f6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.773465:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda8159 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.773467:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ef180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.773468:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda82f6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.773469:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda8159 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.773473:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda82f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.773474:0:6943:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1713279306.773474:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda8159 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.773478:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:3.0:1713279306.773478:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda82f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.773480:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.773481:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda8159 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.773481:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.773484:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda8159 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.773484:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda82f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.773488:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda82f6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.773489:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.773493:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.773494:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00000100:00100000:0.0:1713279306.773496:0:6943:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:385c4b71-808c-40cf-91de-b076b668d13f+3682:11854:x1796503281197504:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 31690us (31776us total) trans 4295183648 rc 0/0 00010000:00010000:1.0:1713279306.773496:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.773496:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.773498:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ecb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.773499:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.773499:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda82f6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.773500:0:6943:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14332 00010000:00010000:1.0:1713279306.773502:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.773504:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342400/0xfc4b8e114eda82f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.773505:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3731 (ffff880090a56a00) 00010000:00010000:1.0:1713279306.773507:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.773508:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.773509:0:6943:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281210752 00010000:00010000:1.0:1713279306.773510:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda8160 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.773510:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda82fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.773511:0:6943:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281210752 00010000:00010000:3.0:1713279306.773513:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda82fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.773518:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda82fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.773521:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092340b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.773522:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114eda8152 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756de expref: 3417 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.773522:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda82fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.773526:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114eda8152 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756de expref: 3417 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.773527:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda82fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.773529:0:6943:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14338 00010000:00010000:1.0:1713279306.773530:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298efa80, rc 0) 00000100:00100000:0.0:1713279306.773531:0:6943:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:385c4b71-808c-40cf-91de-b076b668d13f+3777:11876:x1796503281210752:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1713279306.773532:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff88012d067700) 00010000:00010000:3.0:1713279306.773534:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.773536:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda82fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.773537:0:15544:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713279306.773540:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.773541:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092340b40/0xfc4b8e114eda82fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.773547:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd5440 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:0.0:1713279306.773549:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.773549:0:15544:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713279306.773553:0:15544:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773555:0:6943:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda81ad lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda81a6 expref: 66 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.773557:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092343cc0/0xfc4b8e114eda82ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175747 expref: 3778 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773558:0:6943:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.773563:0:15544:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.773566:0:15544:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.773566:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda8304 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175747 expref: 3777 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773569:0:6943:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda81ad lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda81a6 expref: 66 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.773571:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:3.0:1713279306.773573:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713279306.773574:0:6943:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.773575:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092342d00, rc 0) 00010000:00010000:1.0:1713279306.773577:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.773580:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd5440/0xfc4b8e114eda7d1c lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda7d23 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773584:0:11415:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda8232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x111b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.773584:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.773585:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.773586:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.773588:0:11415:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda8232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x111b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.773590:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3777:11874:x1796503281210560:12345-192.168.203.4@tcp:101:touch.0 Request processed in 296us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.773593:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200031104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.773595:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785097 00010000:00010000:0.0:1713279306.773596:0:11415:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda8232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x111b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773599:0:11415:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda8232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x111b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773603:0:11415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda8232 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x111b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.773607:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.773608:0:11415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982ac0 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:0.0:1713279306.773611:0:11415:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda8232 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x111b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773617:0:11415:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda8232 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x111b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.773622:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200031104 00000100:00100000:1.0:1713279306.773624:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200031104 00000100:00100000:3.0:1713279306.773625:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3776:11711:x1796503281210304:12345-192.168.203.4@tcp:101:touch.0 Request processed in 756us (823us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.773628:0:11415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda8232 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x111b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.773628:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785095 00010000:00010000:1.0:1713279306.773630:0:15711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda7d1c expref: 67 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773634:0:11415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda8232 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x111b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.773646:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196504 00000100:00100000:1.0:1713279306.773649:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+67:3492:x1796503200031104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.773653:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.773656:0:15711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda7d1c expref: 67 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.773663:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe146c0/0xfc4b8e114eda7d23 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda7d1c expref: 67 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.773668:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00000100:00100000:0.0:1713279306.773669:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+78:1957:x1796503281209408:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 2828us (2850us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.773671:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda7ed5 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda7ece expref: 66 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.773676:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110473 00010000:00010000:1.0:1713279306.773676:0:15711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda7ed5 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda7ece expref: 66 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.773680:0:15711:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda7ed5 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda7ece expref: 66 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.773683:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.773692:0:15711:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda7ed5 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda7ece expref: 66 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.773697:0:15711:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000_UUID:15711:1796503200031232:0@lo:105: 00000100:00100000:1.0:1713279306.773710:0:15711:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.773716:0:15711:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120671e40 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.773724:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200031232 00000100:00100000:2.0:1713279306.773728:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200031232 00000100:00100000:1.0:1713279306.773739:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3416:11901:x1796503281206912:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 6575us (6690us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.773743:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785079 00000100:00100000:2.0:1713279306.773746:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33428 00000100:00100000:2.0:1713279306.773751:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15711:x1796503200031232:12345-0@lo:105: 00010000:00010000:2.0:1713279306.773761:0:6913:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.773768:0:6913:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.773774:0:6913:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.773781:0:6913:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.773787:0:6913:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.773793:0:6913:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.773799:0:6913:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.773810:0:6913:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800935bfcc0) 00010000:00010000:0.0:1713279306.773821:0:15507:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773827:0:15507:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.773837:0:15507:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1713279306.773839:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15711:x1796503200031232:12345-0@lo:105: Request processed in 87us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.773844:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33428 00000100:00100000:1.0:1713279306.773857:0:15711:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000_UUID:15711:1796503200031232:0@lo:105: 00010000:00010000:1.0:1713279306.773864:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.773878:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+66:3492:x1796503200031104:12345-0@lo:103:ldlm_bl.0 Request processed in 229us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.773882:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196504 00000100:00100000:2.0:1713279306.773891:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200031104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.773895:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981680/0xfc4b8e114eda8312 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.773900:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981680/0xfc4b8e114eda8312 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.773904:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981680/0xfc4b8e114eda8312 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.773910:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda8319 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x261:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.773913:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda8319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.773916:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda8319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.773921:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.773925:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114eda5f63 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e48 expref: 3415 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773929:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 4/0,1 mode: --/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.773939:0:15507:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114eda5f63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e48 expref: 3415 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.773944:0:15507:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114eda5f63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e48 expref: 3415 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.773950:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099c2c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0001_UUID:15507:1796503200031296:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.773974:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.775391:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.775394:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.775435:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.775440:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281210880 00000100:00100000:2.0:1713279306.775443:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281210880 00000100:00100000:2.0:1713279306.775455:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281210944 00000100:00100000:1.0:1713279306.775456:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281211072 00000100:00100000:2.0:1713279306.775458:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281210944 00000100:00100000:1.0:1713279306.775461:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281211072 00000100:00100000:0.0:1713279306.775465:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223024 00000100:00100000:0.0:1713279306.775470:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3772:11859:x1796503281210880:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.775473:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.775477:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223025 00000100:00100000:1.0:1713279306.775480:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785098 00000100:00100000:2.0:1713279306.775481:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c568850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3416:11204:x1796503281210944:12345-192.168.203.4@tcp:33:touch.0 00000100:00100000:1.0:1713279306.775484:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3772:11904:x1796503281211072:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.775492:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.775493:0:15473:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:3.0:1713279306.775493:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281211200 00000100:00100000:3.0:1713279306.775496:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281211200 00000004:00200000:2.0:1713279306.775502:0:6932:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:1.0:1713279306.775503:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114ed9ea23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d94 expref: 3772 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.775511:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223026 00010000:00010000:1.0:1713279306.775512:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ede:0x0].0x0 (ffff88008e4c8000) 00010000:00010000:1.0:1713279306.775514:0:15473:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.775515:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3682:11879:x1796503281211200:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:1.0:1713279306.775519:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5b00/0xfc4b8e114eda8327 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x7ede:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917574e expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.775530:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c568850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3416:11204:x1796503281210944:12345-192.168.203.4@tcp:33:touch.0 Request processed in 48us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.775532:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3773:11859:x1796503281210880:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 61us (138us total) trans 4295202657 rc 0/0 00000100:00100000:2.0:1713279306.775536:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223025 00000100:00100000:0.0:1713279306.775539:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223024 00010000:00010000:1.0:1713279306.775552:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5680/0xfc4b8e114eda832e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.775558:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5680/0xfc4b8e114eda832e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.775562:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5680/0xfc4b8e114eda832e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00200000:1.0:1713279306.775566:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7ede:0x0]: returning size 0 00000100:00100000:3.0:1713279306.775579:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3683:11879:x1796503281211200:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 63us (106us total) trans 4295183649 rc 0/0 00000100:00100000:3.0:1713279306.775585:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223026 00010000:00010000:1.0:1713279306.775598:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5b00/0xfc4b8e114eda8327 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7ede:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917574e expref: 3774 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.775605:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5680/0xfc4b8e114eda832e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917574e expref: 3773 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.775609:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ede:0x0].0x0 (ffff88008e4c8000) 00010000:00010000:1.0:1713279306.775610:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.775612:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf5680, rc 0) 00000100:00100000:1.0:1713279306.775628:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3773:11904:x1796503281211072:12345-192.168.203.4@tcp:101:touch.0 Request processed in 144us (238us total) trans 4295202658 rc 0/0 00000100:00100000:1.0:1713279306.775632:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785098 00000100:00100000:0.0:1713279306.775665:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.775673:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.775675:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281211328 00000100:00100000:1.0:1713279306.775677:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281211328 00000100:00100000:0.0:1713279306.775686:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281211392 00000100:00100000:1.0:1713279306.775688:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785099 00000100:00100000:0.0:1713279306.775689:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281211392 00000100:00100000:1.0:1713279306.775691:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3683:11854:x1796503281211328:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.775699:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.775702:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110474 00010000:00010000:1.0:1713279306.775704:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda833c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175755 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.775705:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b42d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+85:1956:x1796503281211392:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:1.0:1713279306.775723:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda8343 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.775728:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda8343 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775732:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda8343 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775737:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda834a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.775744:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda834a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775747:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda834a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.775785:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b42d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1956:x1796503281211392:12345-192.168.203.4@tcp:2:touch.0 Request processed in 79us (113us total) trans 4295010116 rc 0/0 00000100:00100000:0.0:1713279306.775789:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110474 00000004:00200000:1.0:1713279306.775794:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7d86:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.775813:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda8343 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775816:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda8343 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775819:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda8343 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775822:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda8343 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775825:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131e35f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.775826:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda8343 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775829:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda8343 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775834:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:1.0:1713279306.775835:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.775837:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda8343 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775839:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114eda8343 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775846:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda834a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775849:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda834a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775852:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda834a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775854:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f1d73c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.775856:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda834a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775858:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda834a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775861:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3731 (ffff880090a56a00) 00010000:00010000:1.0:1713279306.775862:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.775864:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda834a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775866:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114eda834a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.775879:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda833c lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175755 expref: 3685 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.775883:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda833c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175755 expref: 3685 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.775887:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf5440, rc 0) 00000100:00100000:1.0:1713279306.775911:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3684:11854:x1796503281211328:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 219us (247us total) trans 4295183650 rc 301/301 00000100:00100000:1.0:1713279306.775915:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785099 00000100:00100000:0.0:1713279306.776191:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.776208:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.776217:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.776218:0:15534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281211584 00000100:00100000:0.0:1713279306.776221:0:15534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281211584 00000100:00100000:2.0:1713279306.776224:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.776240:0:15534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14339 00000100:00100000:2.0:1713279306.776240:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.776244:0:15534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_011:385c4b71-808c-40cf-91de-b076b668d13f+3776:11736:x1796503281211584:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:0.0:1713279306.776257:0:15534:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:1.0:1713279306.776263:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099c2c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0001_UUID:15507:1796503200031296:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.776267:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda2c8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174080 expref: 3776 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.776273:0:15507:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.776275:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7efd:0x0].0x0 (ffff880122df6700) 00010000:00010000:0.0:1713279306.776281:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda7d54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755d4 expref: 3775 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.776286:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281211456 00010000:00010000:0.0:1713279306.776287:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f51:0x0].0x0 (ffff8800940a8800) 00000100:00100000:1.0:1713279306.776288:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281211456 00010000:00010000:0.0:1713279306.776289:0:15534:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.776294:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.776297:0:15711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114eda5f63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e48 expref: 3416 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.776299:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.776303:0:15534:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.776308:0:15534:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.776313:0:15534:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.776315:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281211648 00000100:00100000:1.0:1713279306.776317:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281211648 00000100:00100000:0.0:1713279306.776322:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281211840 00000100:00100000:0.0:1713279306.776324:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281211840 00000100:00100000:1.0:1713279306.776326:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196505 00000100:00100000:1.0:1713279306.776329:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3416:1956:x1796503281211456:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.776331:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147234 00000100:00100000:0.0:1713279306.776334:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110475 00010000:00010000:1.0:1713279306.776334:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.776334:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3773:1956:x1796503281211648:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.776337:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1957:x1796503281211840:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:1.0:1713279306.776337:0:15711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114eda5f63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e48 expref: 3416 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.776340:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.776343:0:15711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114eda5f63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e48 expref: 3416 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.776347:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda8183 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756e5 expref: 3773 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.776351:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114eda5f63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e48 expref: 3416 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.776354:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:2.0:1713279306.776356:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.776358:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff88007fcb8a00) 00010000:00010000:1.0:1713279306.776360:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.776367:0:15711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.776370:0:15711:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.776377:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.776377:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3772:1956:x1796503281211648:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 41us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.776384:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147234 00000100:00100000:1.0:1713279306.776390:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:1956:x1796503281211456:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 60us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.776394:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196505 00010000:00010000:1.0:1713279306.776404:0:15507:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.776407:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.776430:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ad00/0xfc4b8e114eda835f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x237:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.776434:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ad00/0xfc4b8e114eda835f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.776438:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ad00/0xfc4b8e114eda835f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.776444:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e09:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00002000:00010000:0.0:1713279306.776446:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb size from disk: 46934 -> 46934 00002000:00010000:0.0:1713279306.776448:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00010000:00010000:1.0:1713279306.776449:0:15507:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f4900/0xfc4b8e114ecd9665 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x6e09:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39137563 expref: 3683 pid: 15475 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713279306.776450:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:0.0:1713279306.776451:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279306.776452:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb blocks from disk: 48 -> 48 00010000:00010000:1.0:1713279306.776453:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.776463:0:15507:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f4900/0xfc4b8e114ecd9665 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6e09:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39137563 expref: 3683 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.776469:0:15507:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f4900/0xfc4b8e114ecd9665 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6e09:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39137563 expref: 3683 pid: 15475 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.776470:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+87:1957:x1796503281211840:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 132us (230us total) trans 4295010117 rc 0/0 00000100:00100000:0.0:1713279306.776474:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110475 00000100:00100000:1.0:1713279306.776475:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0001_UUID:15507:1796503200031360:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.776489:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549c00 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.776495:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281211776 00000100:00100000:1.0:1713279306.776497:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281211776 00000100:00100000:1.0:1713279306.776513:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785100 00000100:00100000:1.0:1713279306.776516:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3684:11711:x1796503281211776:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.776522:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.776529:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda836d lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917575c expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.776551:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda8374 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776555:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda8374 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776558:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda8374 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776564:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda837b lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776567:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda837b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776570:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda837b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776584:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda8374 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776587:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda8374 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776590:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda8374 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776593:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda8374 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776596:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c04480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.776597:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda8374 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776600:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda8374 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776604:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff8800958c9500) 00010000:00010000:1.0:1713279306.776606:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.776607:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda8374 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776610:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114eda8374 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776615:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda837b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776617:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda837b lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776621:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda837b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776623:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298edb00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.776625:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda837b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776627:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda837b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776630:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff8800954bed00) 00010000:00010000:1.0:1713279306.776632:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.776633:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda837b lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776635:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298edb00/0xfc4b8e114eda837b lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.776646:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda836d lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917575c expref: 3685 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.776650:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda836d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917575c expref: 3685 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.776654:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c53b3c0, rc 0) 00000100:00100000:1.0:1713279306.776677:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3684:11711:x1796503281211776:12345-192.168.203.4@tcp:101:touch.0 Request processed in 159us (486us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.776681:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785100 00000100:00100000:2.0:1713279306.776717:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.776737:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.776752:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281212032 00000100:00100000:1.0:1713279306.776755:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281212032 00000100:00100000:1.0:1713279306.776765:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281212288 00000100:00100000:1.0:1713279306.776766:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281212288 00000100:00100000:3.0:1713279306.776775:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785101 00000100:00100000:1.0:1713279306.776779:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785102 00000100:00100000:3.0:1713279306.776780:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3773:11204:x1796503281212032:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.776782:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3773:11882:x1796503281212288:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.776789:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.776792:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.776793:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda8382 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917576a expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.776799:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda8389 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175763 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.776814:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.776826:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda8390 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.776827:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda8397 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.776829:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281211968 00000100:00100000:0.0:1713279306.776830:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.776832:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281211968 00010000:00010000:1.0:1713279306.776833:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda8397 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.776833:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda8390 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.776837:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda8397 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.776841:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda8390 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.776843:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda839e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776846:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda839e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776849:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda839e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.776850:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281212160 00000100:00100000:2.0:1713279306.776853:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281212160 00000100:00100000:0.0:1713279306.776855:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223027 00000100:00100000:0.0:1713279306.776858:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3776:11859:x1796503281211968:12345-192.168.203.4@tcp:33:lfs.0 00010000:00010000:1.0:1713279306.776866:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114eda83a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.776866:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223028 00000100:00100000:3.0:1713279306.776870:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:11855:x1796503281212160:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:1.0:1713279306.776871:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114eda83a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776874:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114eda83a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00200000:1.0:1713279306.776881:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8439:0x0]: returning size 45312 00000004:00200000:0.0:1713279306.776899:0:15467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x8179:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.776901:0:15467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1713279306.776904:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda8397 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776907:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda8397 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776910:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda8397 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776913:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda8397 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776915:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.776917:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda8397 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.776919:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3777:11859:x1796503281211968:12345-192.168.203.4@tcp:33:lfs.0 Request processed in 60us (105us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.776920:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda8397 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.776923:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223027 00010000:00010000:1.0:1713279306.776924:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:1.0:1713279306.776925:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.776927:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda8397 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776929:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda8397 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776934:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda839e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776937:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda839e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776942:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda839e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776945:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.776946:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda839e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.776949:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda839e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.776949:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3416:11855:x1796503281212160:12345-192.168.203.4@tcp:35:touch.0 Request processed in 77us (117us total) trans 4295183651 rc 0/0 00010000:00010000:1.0:1713279306.776952:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3531 (ffff880094e7b100) 00010000:00010000:1.0:1713279306.776953:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.776954:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda839e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.776954:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223028 00010000:00010000:1.0:1713279306.776956:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda839e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.776969:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda83b3 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.776971:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda8382 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917576a expref: 3777 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.776976:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114eda83a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917576a expref: 3776 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.776976:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda83b3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.776979:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8439:0x0].0x0 (ffff8800938abb00) 00010000:00010000:1.0:1713279306.776980:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.776981:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023ed00, rc 0) 00010000:00010000:3.0:1713279306.776982:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda83b3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.776999:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda8390 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.777004:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda8390 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.777005:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3776:11882:x1796503281212288:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 222us (268us total) trans 4295202659 rc 0/0 00000100:00100000:1.0:1713279306.777009:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785102 00010000:00010000:3.0:1713279306.777009:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda8390 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.777014:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda8390 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.777018:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092343a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.777021:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda8390 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.777025:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda8390 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.777033:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:3.0:1713279306.777035:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.777038:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda8390 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.777043:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092343a80/0xfc4b8e114eda8390 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.777050:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda83b3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.777055:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda83b3 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.777059:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda83b3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.777063:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092343840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.777065:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda83b3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.777082:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda83b3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.777087:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff88012d067200) 00010000:00010000:3.0:1713279306.777089:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.777090:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda83b3 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.777094:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda83b3 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.777112:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda8389 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175763 expref: 3775 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.777119:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092340d80/0xfc4b8e114eda8389 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175763 expref: 3775 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.777124:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092340d80, rc 0) 00000100:00100000:3.0:1713279306.777142:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3774:11204:x1796503281212032:12345-192.168.203.4@tcp:101:touch.0 Request processed in 361us (425us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.777146:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785101 00000100:00100000:0.0:1713279306.777245:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.777255:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.777255:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281212352 00000100:00100000:3.0:1713279306.777258:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281212352 00000100:00100000:0.0:1713279306.777269:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.777269:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785103 00000100:00100000:3.0:1713279306.777271:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3684:11854:x1796503281212352:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.777278:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.777282:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281212416 00000100:00100000:1.0:1713279306.777284:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281212416 00010000:00010000:3.0:1713279306.777285:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114eda83ba lrc: 2/0,0 mode: --/CR res: [0x240000400:0x263:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175771 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.777287:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.777297:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147235 00000100:00100000:1.0:1713279306.777300:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3775:1956:x1796503281212416:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.777302:0:15526:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281212608 00010000:00010000:1.0:1713279306.777305:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.777305:0:15526:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281212608 00000100:00100000:2.0:1713279306.777306:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281212480 00000100:00100000:2.0:1713279306.777309:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281212480 00010000:00010000:1.0:1713279306.777311:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda8304 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175747 expref: 3776 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.777317:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:1.0:1713279306.777319:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.777322:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785104 00000100:00100000:3.0:1713279306.777322:0:15526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14340 00000100:00100000:2.0:1713279306.777326:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3775:11874:x1796503281212480:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.777326:0:15526:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_010:385c4b71-808c-40cf-91de-b076b668d13f+3686:11879:x1796503281212608:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:1.0:1713279306.777332:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3775:1956:x1796503281212416:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 31us (77us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.777335:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.777336:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147235 00010000:00010000:2.0:1713279306.777341:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114eda83c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175778 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.777343:0:15526:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.777353:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda5d87 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174dc3 expref: 3686 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.777362:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda83c8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.777362:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76b7:0x0].0x0 (ffff88012d067100) 00010000:00010000:3.0:1713279306.777365:0:15526:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.777369:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda83c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.777375:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda83c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.777378:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.777382:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda83d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.777383:0:15526:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.777388:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda83d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.777390:0:15526:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x1000000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.777393:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda83d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.777399:0:15526:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f282680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001-mdtlov_UUID:15526:1796503200031424:0@lo:101:mdt_io00_010.0 00000100:00100000:3.0:1713279306.777437:0:15526:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.777440:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda83dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.777447:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda83dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.777447:0:15526:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.777449:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200031424 00000100:00100000:0.0:1713279306.777451:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200031424 00010000:00010000:2.0:1713279306.777453:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda83dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.777466:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98722 00010000:00010000:3.0:1713279306.777466:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923406c0/0xfc4b8e114eda83e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x263:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.777469:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+66:15526:x1796503200031424:12345-0@lo:101:mdt_io00_010.0 00010000:00010000:3.0:1713279306.777472:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800923406c0/0xfc4b8e114eda83e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x263:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.777475:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.777478:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800923406c0/0xfc4b8e114eda83e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x263:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.777481:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda83eb lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda83cf expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713279306.777483:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00000004:00200000:2.0:1713279306.777486:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713279306.777490:0:15542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.777494:0:15542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda83eb lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda83cf expref: 67 pid: 15542 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.777494:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda83dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000004:00200000:3.0:1713279306.777495:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x263:0x0]: returning size 4096 00000004:00200000:3.0:1713279306.777497:0:15485:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 4 MDT count 2 00010000:00010000:0.0:1713279306.777500:0:15542:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.777501:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda83c8 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.777505:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda83eb lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda83cf expref: 67 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.777505:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda83c8 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.777509:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:2.0:1713279306.777510:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda83c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.777511:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.777512:0:15542:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.777512:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114eda83ba lrc: 0/0,0 mode: --/CR res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175771 expref: 3686 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.777515:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d983cc0, rc 0) 00010000:00010000:2.0:1713279306.777515:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda83c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.777519:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd13600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.777521:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923406c0/0xfc4b8e114eda83e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x263:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175771 expref: 3685 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.777522:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda83c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.777527:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda83c8 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.777527:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x263:0x0].0x0 (ffff880090a56d00) 00010000:00010000:3.0:1713279306.777529:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713279306.777533:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.777533:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923406c0, rc 0) 00010000:00010000:2.0:1713279306.777535:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.777537:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda83c8 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.777538:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+67:15526:x1796503200031424:12345-0@lo:101:mdt_io00_010.0 Request processed in 68us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.777541:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98722 00010000:00010000:2.0:1713279306.777541:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda83c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.777549:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda83d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.777551:0:15526:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f282680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001-mdtlov_UUID:15526:1796503200031424:0@lo:101:mdt_io00_010.0 00010000:00010000:2.0:1713279306.777554:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda83d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.777559:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda83d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.777559:0:15526:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.777564:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.777565:0:15526:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.777566:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda83d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.777571:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda83d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.777576:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff880091738a00) 00010000:00010000:2.0:1713279306.777578:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.777580:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda83d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.777584:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda83d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.777585:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3685:11854:x1796503281212352:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 312us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.777591:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785103 00010000:00010000:2.0:1713279306.777600:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114eda83c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175778 expref: 3776 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.777609:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda83dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175778 expref: 3775 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.777615:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:2.0:1713279306.777617:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713279306.777618:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd11680, rc 0) 00000100:00100000:2.0:1713279306.777632:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3775:11874:x1796503281212480:12345-192.168.203.4@tcp:101:touch.0 Request processed in 305us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.777637:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785104 00000100:00100000:2.0:1713279306.778540:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.778552:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281212928 00000100:00100000:0.0:1713279306.778556:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281212928 00000100:00100000:0.0:1713279306.778569:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785105 00000100:00100000:0.0:1713279306.778572:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3775:11711:x1796503281212928:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.778577:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.778584:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980000/0xfc4b8e114eda83f2 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917577f expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.778625:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda83f9 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778631:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda83f9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778635:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda83f9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778641:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda8400 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778645:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda8400 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778648:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda8400 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000004:00200000:0.0:1713279306.778657:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:0.0:1713279306.778662:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda83f9 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778665:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda83f9 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778668:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda83f9 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778671:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda83f9 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778673:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.778675:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda83f9 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778678:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda83f9 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778682:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88007fc53100) 00010000:00010000:0.0:1713279306.778683:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.778685:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda83f9 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778687:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda83f9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778693:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda8400 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778699:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda8400 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778702:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda8400 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778704:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.778705:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda8400 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778708:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda8400 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778711:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff8800960e8f00) 00010000:00010000:0.0:1713279306.778712:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.778713:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda8400 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778716:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda8400 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.778729:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980000/0xfc4b8e114eda83f2 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917577f expref: 3776 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.778733:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980000/0xfc4b8e114eda83f2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917577f expref: 3776 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.778738:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d980000, rc 0) 00000100:00100000:0.0:1713279306.778762:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3775:11711:x1796503281212928:12345-192.168.203.4@tcp:101:touch.0 Request processed in 189us (222us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.778766:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785105 00000100:00100000:0.0:1713279306.783282:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.783309:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.783318:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.783336:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.783337:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0001_UUID:15507:1796503200031360:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.783350:0:15507:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00000100:00100000:3.0:1713279306.783352:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281212736 00000100:00100000:3.0:1713279306.783357:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281212736 00000100:00100000:0.0:1713279306.783362:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281212800 00000100:00100000:1.0:1713279306.783363:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281213056 00000100:00100000:0.0:1713279306.783365:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281212800 00000100:00100000:1.0:1713279306.783366:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281213056 00000100:00100000:2.0:1713279306.783367:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.783379:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223029 00000100:00100000:1.0:1713279306.783380:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281213440 00000100:00100000:1.0:1713279306.783381:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281213440 00000100:00100000:3.0:1713279306.783384:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3686:10962:x1796503281212736:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1713279306.783386:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223030 00000100:00100000:0.0:1713279306.783390:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c56a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:385c4b71-808c-40cf-91de-b076b668d13f+3775:11910:x1796503281212800:12345-192.168.203.4@tcp:33:lfs.0 00000100:00100000:1.0:1713279306.783393:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281213120 00000100:00100000:1.0:1713279306.783394:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281213120 00000100:00100000:1.0:1713279306.783410:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785106 00000100:00100000:1.0:1713279306.783429:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3416:11855:x1796503281213056:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.783437:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.783437:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.783445:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda8407 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175786 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.783457:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00200000:0.0:1713279306.783463:0:15497:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x820c:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.783466:0:15497:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1713279306.783475:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.783483:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281213312 00000100:00100000:2.0:1713279306.783486:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281213312 00000100:00100000:0.0:1713279306.783491:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c56a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:385c4b71-808c-40cf-91de-b076b668d13f+3775:11910:x1796503281212800:12345-192.168.203.4@tcp:33:lfs.0 Request processed in 100us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.783496:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223030 00000100:00100000:2.0:1713279306.783501:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223031 00000100:00100000:3.0:1713279306.783501:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3687:10962:x1796503281212736:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 115us (184us total) trans 4295183652 rc 0/0 00010000:00010000:1.0:1713279306.783502:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023db00/0xfc4b8e114eda840e lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.783505:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3775:11859:x1796503281213312:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:1.0:1713279306.783507:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023db00/0xfc4b8e114eda840e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.783507:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223029 00010000:00010000:1.0:1713279306.783512:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023db00/0xfc4b8e114eda840e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00000100:00100000:0.0:1713279306.783519:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281213184 00010000:00010000:1.0:1713279306.783519:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda8415 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.783521:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281213184 00010000:00010000:1.0:1713279306.783523:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda8415 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.783526:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda8415 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00000100:00100000:0.0:1713279306.783533:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110476 00000100:00100000:0.0:1713279306.783536:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097badc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+78:11882:x1796503281213184:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:3.0:1713279306.783536:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281213632 00000100:00100000:3.0:1713279306.783539:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281213632 00010000:00010000:0.0:1713279306.783541:0:15783:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.783546:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda841c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x708d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.783551:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda841c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x708d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.783552:0:15783:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d980900/0xfc4b8e114eda8423 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175794 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.783554:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda841c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x708d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.783554:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785107 00000004:00200000:1.0:1713279306.783558:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x708d:0x0]: returning size 4259840 00000100:00100000:3.0:1713279306.783558:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3686:11912:x1796503281213440:12345-192.168.203.4@tcp:101:touch.0 00002000:00010000:0.0:1713279306.783563:0:15783:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x113c:0x0] initial LVB size: 45312, mtime: 0x661e914a, atime: 0x0, ctime: 0x661e914a, blocks: 0x28 00010000:00010000:3.0:1713279306.783566:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.783568:0:15484:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1713279306.783571:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.783572:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713279306.783575:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3776:11859:x1796503281213312:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 69us (99us total) trans 4295202660 rc 0/0 00010000:00010000:0.0:1713279306.783578:0:15783:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d980900/0xfc4b8e114eda8423 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 24576->49151) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175794 expref: 79 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.783579:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda7fdf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175660 expref: 3686 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.783581:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223031 00010000:00010000:1.0:1713279306.783583:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023db00/0xfc4b8e114eda840e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.783585:0:15783:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d980900/0xfc4b8e114eda8423 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x113c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 24576->49151) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175794 expref: 79 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.783586:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023db00/0xfc4b8e114eda840e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.783590:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012514dc00) 00010000:00010000:1.0:1713279306.783592:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023db00/0xfc4b8e114eda840e lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.783594:0:15484:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.783595:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023db00/0xfc4b8e114eda840e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.783598:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023db00 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.783599:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785108 00010000:00010000:1.0:1713279306.783600:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023db00/0xfc4b8e114eda840e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.783601:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114eda8431 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917579b expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.783603:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023db00/0xfc4b8e114eda840e lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00000100:00100000:2.0:1713279306.783603:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3775:10123:x1796503281213120:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.783608:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88007fcb8400) 00010000:00010000:1.0:1713279306.783609:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.783610:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.783611:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023db00/0xfc4b8e114eda840e lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.783614:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023db00/0xfc4b8e114eda840e lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.783616:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda8438 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917578d expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.783619:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda8415 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.783621:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda8415 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.783624:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda8415 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.783627:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.783628:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda8415 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.783631:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda843f lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.783633:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda8415 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.783636:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda8446 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.783637:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x38 (ffff88007fcb8700) 00010000:00010000:1.0:1713279306.783638:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.783638:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda843f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.783639:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda8415 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.783640:0:15783:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d980900, rc 0) 00010000:00010000:1.0:1713279306.783642:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114eda8415 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.783643:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda8446 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.783645:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda843f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.783653:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda8446 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.783654:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097badc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+79:11882:x1796503281213184:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 116us (196us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.783654:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda844d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.783657:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda8407 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175786 expref: 3420 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.783658:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110476 00010000:00010000:3.0:1713279306.783659:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda844d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.783661:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda8454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.783664:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda841c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x708d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175786 expref: 3419 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.783665:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda844d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.783666:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda8454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.783667:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x708d:0x0].0x0 (ffff88008c1d2f00) 00010000:00010000:1.0:1713279306.783669:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.783670:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023e880, rc 0) 00010000:00010000:2.0:1713279306.783671:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda8454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.783679:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.783680:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda843f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.783685:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda843f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.783686:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3419:11855:x1796503281213056:12345-192.168.203.4@tcp:101:touch.0 Request processed in 256us (407us total) trans 4295183653 rc 0/0 00010000:00010000:3.0:1713279306.783689:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda843f lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.783691:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785106 00010000:00010000:3.0:1713279306.783694:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda843f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.783698:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd118c0/0xfc4b8e114eda845b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x81cf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.783699:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281213504 00010000:00010000:3.0:1713279306.783699:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092345440 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.783701:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281213504 00010000:00010000:3.0:1713279306.783702:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda843f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.783703:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd118c0/0xfc4b8e114eda845b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x81cf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.783707:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda843f lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.783709:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.783709:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd118c0/0xfc4b8e114eda845b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x81cf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.783712:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785109 00010000:00010000:3.0:1713279306.783713:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012514dc00) 00000100:00100000:1.0:1713279306.783714:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3418:11204:x1796503281213632:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.783716:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:2.0:1713279306.783717:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x81cf:0x0]: returning size 2 00010000:00010000:3.0:1713279306.783718:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda843f lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.783720:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.783723:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda843f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.783725:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda8462 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391757a9 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.783726:0:15752:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd118c0/0xfc4b8e114eda845b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x81cf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.783730:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda844d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.783732:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda8446 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.783735:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda844d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.783737:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda8446 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.783740:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda844d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.783742:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda8446 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.783744:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd88240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.783746:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda8446 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.783746:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda844d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.783748:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.783750:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda844d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.783751:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd12400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.783755:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88012d067300) 00010000:00010000:2.0:1713279306.783756:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda8446 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.783757:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.783759:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda8469 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.783759:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda844d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.783761:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda8446 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.783764:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda8469 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.783767:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.783767:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda844d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.783768:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda8469 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.783769:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.783771:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda8446 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.783774:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda8470 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.783775:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda8446 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.783777:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda8470 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.783780:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda8470 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.783781:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda8454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.783785:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114eda8431 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917579b expref: 3686 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.783786:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda8454 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.783788:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281213888 00000004:00200000:1.0:1713279306.783788:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00000100:00100000:0.0:1713279306.783791:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281213888 00010000:00010000:2.0:1713279306.783791:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda8454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.783792:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114eda8431 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917579b expref: 3686 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.783793:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda8469 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.783795:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda8469 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.783795:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd11f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.783797:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda8454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.783798:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda8469 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.783798:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092342640, rc 0) 00010000:00010000:1.0:1713279306.783801:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda8469 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.783801:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda8454 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.783804:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785110 00010000:00010000:1.0:1713279306.783804:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023cfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.783806:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda8469 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.783806:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3231 (ffff88012514df00) 00000100:00100000:0.0:1713279306.783807:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3775:11854:x1796503281213504:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.783808:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.783809:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda8469 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.783810:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda8454 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.783812:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.783813:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:1.0:1713279306.783814:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.783815:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda8454 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.783816:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda8469 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.783818:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda8477 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391757a2 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.783818:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda8469 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.783819:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3686:11912:x1796503281213440:12345-192.168.203.4@tcp:101:touch.0 Request processed in 260us (508us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.783823:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda8470 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.783825:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785107 00010000:00010000:1.0:1713279306.783826:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda8470 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.783829:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda8470 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.783830:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda8438 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917578d expref: 3777 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.783832:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ef3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.783833:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda8470 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.783836:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda8470 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.783836:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785111 00010000:00010000:0.0:1713279306.783837:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda847e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.783839:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88008d597100) 00010000:00010000:2.0:1713279306.783839:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd118c0/0xfc4b8e114eda845b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x81cf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917578d expref: 3776 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.783840:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.783841:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda8470 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.783841:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3685:11711:x1796503281213888:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.783843:0:15479:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda82cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda82b0 expref: 66 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.783845:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x81cf:0x0].0x0 (ffff88011f2c2500) 00010000:00010000:1.0:1713279306.783846:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda8470 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.783847:0:15479:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda847e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x14f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.783847:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713279306.783847:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.783849:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd118c0, rc 0) 00010000:00010000:3.0:1713279306.783855:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda8485 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391757b0 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.783858:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281213760 00010000:00010000:1.0:1713279306.783859:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda8462 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757a9 expref: 3419 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.783860:0:15479:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda82cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda82b0 expref: 66 pid: 6934 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.783861:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281213760 00010000:00010000:1.0:1713279306.783863:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda8462 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757a9 expref: 3419 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.783867:0:15479:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130292a00 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:15479:1796503200031488:0@lo:104: 00010000:00010000:1.0:1713279306.783867:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023dd40, rc 0) 00000100:00100000:2.0:1713279306.783875:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223032 00000100:00100000:2.0:1713279306.783879:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3777:11898:x1796503281213760:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:3.0:1713279306.783880:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda848c lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.783881:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3418:11204:x1796503281213632:12345-192.168.203.4@tcp:101:touch.0 Request processed in 165us (445us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.783885:0:15479:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.783885:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785109 00010000:00010000:3.0:1713279306.783887:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda848c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.783893:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda848c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.783894:0:15479:0:(client.c:2539:ptlrpc_set_wait()) set ffff880129a98f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.783902:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200031488 00010000:00010000:3.0:1713279306.783902:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8493 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.783904:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200031488 00010000:00010000:3.0:1713279306.783908:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8493 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.783913:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8493 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.783916:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33429 00000100:00100000:0.0:1713279306.783919:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15479:x1796503200031488:12345-0@lo:104: 00010000:00010000:0.0:1713279306.783924:0:6913:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf4900/0xfc4b8e114eda82b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda82cc expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.783929:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda848c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.783934:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda848c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.783937:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3778:11898:x1796503281213760:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 57us (188us total) trans 4295202661 rc 0/0 00010000:00010000:3.0:1713279306.783939:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda848c lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.783943:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223032 00010000:00010000:3.0:1713279306.783944:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda848c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.783949:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801312c58c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.783950:0:6913:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1713279306.783951:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda848c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.783953:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15479:x1796503200031488:12345-0@lo:104: Request processed in 34us (68us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.783956:0:6918:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.783956:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda848c lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.783957:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33429 00010000:00010000:1.0:1713279306.783960:0:6918:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf4900/0xfc4b8e114eda82b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda82cc expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.783963:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3777:10123:x1796503281213120:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 359us (595us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.783963:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88012d067400) 00010000:00010000:1.0:1713279306.783965:0:6918:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf4900 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.783965:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.783967:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda848c lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.783968:0:6918:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf4900/0xfc4b8e114eda82b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda82cc expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.783968:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785108 00000100:00100000:0.0:1713279306.783972:0:15479:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130292a00 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:15479:1796503200031488:0@lo:104: 00000004:00010000:1.0:1713279306.783972:0:6918:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf4900/0xfc4b8e114eda82b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda82cc expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.783972:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda848c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.783980:0:15479:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda847e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x14f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.783980:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8493 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.783985:0:6918:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf4900/0xfc4b8e114eda82b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda82cc expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.783985:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8493 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.783989:0:6918:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.783990:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8493 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.783994:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938fcfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.783996:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8493 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.784001:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8493 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.784003:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200031552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.784005:0:6918:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf4900/0xfc4b8e114eda82b0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda82cc expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.784006:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88012d067600) 00010000:00010000:3.0:1713279306.784008:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.784009:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf4900/0xfc4b8e114eda82b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda82cc expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.784010:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8493 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.784015:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda8493 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.784016:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.784017:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.784018:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.784018:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279306.784031:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200031552 00000100:00100000:0.0:1713279306.784033:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200031552 00010000:00010000:3.0:1713279306.784034:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda8485 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757b0 expref: 3686 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.784041:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda82cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfc4b8e114eda82b0 expref: 67 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.784041:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda8485 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757b0 expref: 3686 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.784050:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a4c86c0, rc 0) 00000100:00100000:0.0:1713279306.784051:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196506 00000100:00100000:0.0:1713279306.784053:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130292a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+67:3493:x1796503200031552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.784058:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.784086:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3685:11711:x1796503281213888:12345-192.168.203.4@tcp:101:touch.0 Request processed in 227us (358us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.784092:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785111 00000100:00100000:0.0:1713279306.784441:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.784468:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281213952 00000100:00100000:3.0:1713279306.784471:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281213952 00000100:00100000:3.0:1713279306.784487:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785112 00000100:00100000:3.0:1713279306.784491:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3777:11874:x1796503281213952:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.784498:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.784506:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda849a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391757b7 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.784527:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda84a1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.784534:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda84a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.784540:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda84a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.784548:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda84a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.784554:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda84a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.784559:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda84a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.784573:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.784585:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281214016 00010000:00010000:3.0:1713279306.784587:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda84af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.784588:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281214016 00000100:00100000:2.0:1713279306.784591:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.784593:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda84af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.784599:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda84af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.784610:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281214080 00000100:00100000:0.0:1713279306.784612:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281214080 00010000:00010000:0.0:1713279306.784619:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f4900/0xfc4b8e114ecd9665 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6e09:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39137563 expref: 3685 pid: 15475 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.784619:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147236 00000100:00100000:2.0:1713279306.784624:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:385c4b71-808c-40cf-91de-b076b668d13f+3779:1957:x1796503281214016:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.784628:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196507 00000100:00100000:0.0:1713279306.784631:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b25ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3685:1955:x1796503281214080:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.784632:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00200000:3.0:1713279306.784634:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.784636:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00200000:3.0:1713279306.784637:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713279306.784639:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f4900/0xfc4b8e114ecd9665 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6e09:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39137563 expref: 3685 pid: 15475 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.784642:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda83dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175778 expref: 3779 pid: 15484 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.784644:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda84af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.784645:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f4900/0xfc4b8e114ecd9665 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6e09:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39137563 expref: 3685 pid: 15475 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.784650:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:3.0:1713279306.784650:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda84a1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.784652:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f4900/0xfc4b8e114ecd9665 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6e09:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39137563 expref: 3685 pid: 15475 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.784653:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.784655:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda84a1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.784659:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e09:0x0].0x0 (ffff880135885c00) 00010000:00010000:3.0:1713279306.784659:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda84a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.784662:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.784664:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda84a1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.784666:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15507 initiator: MDT1 00000100:00100000:2.0:1713279306.784669:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:385c4b71-808c-40cf-91de-b076b668d13f+3778:1957:x1796503281214016:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 45us (96us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.784669:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090b25440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.784670:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.784671:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda84a1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.784675:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147236 00010000:00010000:3.0:1713279306.784676:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda84a1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.784682:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.784683:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.784685:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.784687:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda84a1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.784689:0:15507:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.784692:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda84a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.784695:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b25ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3684:1955:x1796503281214080:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 62us (103us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.784696:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00000100:00100000:0.0:1713279306.784699:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196507 00010000:00010000:3.0:1713279306.784699:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda84a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.784704:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda84a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.784709:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda84a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.784713:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bfa80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.784715:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda84a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.784720:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda84a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.784726:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff88012d067e00) 00010000:00010000:3.0:1713279306.784728:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.784730:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda84a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.784733:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.784734:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda84a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.784743:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281214144 00000100:00100000:0.0:1713279306.784745:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281214144 00010000:00010000:3.0:1713279306.784752:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda849a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757b7 expref: 3778 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.784754:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110477 00000100:00100000:0.0:1713279306.784757:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+79:1957:x1796503281214144:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:3.0:1713279306.784761:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda84af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757b7 expref: 3777 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.784766:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:3.0:1713279306.784768:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713279306.784769:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935be400, rc 0) 00000100:00100000:3.0:1713279306.784784:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3777:11874:x1796503281213952:12345-192.168.203.4@tcp:101:touch.0 Request processed in 292us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.784789:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785112 00002000:00010000:0.0:1713279306.784981:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x113c:0x0] updating lvb size from disk: 45312 -> 45312 00002000:00010000:0.0:1713279306.784984:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x113c:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279306.784985:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x113c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1713279306.784986:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x113c:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279306.784988:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x113c:0x0] updating lvb blocks from disk: 40 -> 64 00000100:00100000:0.0:1713279306.785002:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+80:1957:x1796503281214144:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 243us (269us total) trans 4295010174 rc 0/0 00000100:00100000:0.0:1713279306.785006:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110477 00000100:00100000:2.0:1713279306.785318:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.785332:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281214272 00000100:00100000:2.0:1713279306.785335:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.785336:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281214272 00000100:00100000:0.0:1713279306.785345:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281214400 00000100:00100000:0.0:1713279306.785348:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281214400 00000100:00100000:3.0:1713279306.785352:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785113 00000100:00100000:2.0:1713279306.785353:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.785357:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3778:10123:x1796503281214272:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:2.0:1713279306.785372:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.785378:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281214656 00000100:00100000:0.0:1713279306.785379:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281214656 00000100:00100000:0.0:1713279306.785388:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281214528 00000100:00100000:0.0:1713279306.785389:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281214528 00010000:00010000:3.0:1713279306.785390:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda84b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.785397:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785114 00010000:00010000:3.0:1713279306.785398:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda84b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.785400:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3779:11204:x1796503281214400:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.785403:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda84b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.785406:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.785425:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda84c4 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391757be expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.785429:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.785437:0:15484:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114ed9ba65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39171fd3 expref: 3776 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.785443:0:15484:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869200/0xfc4b8e114ed9ddc0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391729b9 expref: 3780 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.785449:0:15484:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda77c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175468 expref: 3780 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785451:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda84cb lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.785455:0:15484:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114ed9c66d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7f51:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172368 expref: 3776 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785456:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda84cb lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.785460:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda84cb lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.785460:0:15484:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 7/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.785476:0:15484:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114ed9c66d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7f51:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172368 expref: 3776 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785477:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3600/0xfc4b8e114eda66a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x84ee:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.785480:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3600/0xfc4b8e114eda66a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x84ee:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.785483:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3600/0xfc4b8e114eda66a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x84ee:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.785484:0:15484:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114ed9c66d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x7f51:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172368 expref: 3776 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.785486:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b3600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.785486:0:6911:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008942e400/0xfc4b8e114eda7408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x261:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda740f expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785488:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3600/0xfc4b8e114eda66a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x84ee:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.785491:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3600/0xfc4b8e114eda66a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x84ee:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00000040:00080000:1.0:1713279306.785493:0:15507:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x1c0:0x0].1544, 3736 off828808 00000100:00100000:3.0:1713279306.785493:0:15484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f280000 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000_UUID:15484:1796503200031616:192.168.203.4@tcp:104: 00000004:00010000:2.0:1713279306.785494:0:6911:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008942e400/0xfc4b8e114eda7408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x261:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda740f expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785495:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84ee:0x0].0x0 (ffff88012b01f000) 00010000:00010000:0.0:1713279306.785497:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.785498:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3600/0xfc4b8e114eda66a2 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x84ee:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.785501:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3600/0xfc4b8e114eda66a2 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x84ee:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.785508:0:6911:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008942e400/0xfc4b8e114eda7408 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x261:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda740f expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785509:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda6db0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.785512:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda6db0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.785513:0:6911:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713279306.785516:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda6db0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.785518:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baa640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.785518:0:15484:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda77c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175468 expref: 3779 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785520:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda6db0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.785522:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda6db0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.785525:0:6911:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008942e400/0xfc4b8e114eda7408 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x261:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda740f expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.785525:0:15484:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda77c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175468 expref: 3779 pid: 15473 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.785526:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x3331 (ffff88012514d400) 00010000:00010000:0.0:1713279306.785527:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.785529:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda6db0 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x124:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.785531:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda6db0 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x124:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00000100:00100000:3.0:1713279306.785533:0:15484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f283b80 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000_UUID:15484:1796503200031744:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.785536:0:6911:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091dd4480/0xfc4b8e114eda6f85 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x245:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda6f93 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785543:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b180/0xfc4b8e114eda6f54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x871b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.785546:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b180/0xfc4b8e114eda6f54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x871b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00000004:00010000:2.0:1713279306.785547:0:6911:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091dd4480/0xfc4b8e114eda6f85 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x245:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda6f93 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785549:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b180/0xfc4b8e114eda6f54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x871b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.785549:0:15484:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869200/0xfc4b8e114ed9ddc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391729b9 expref: 3778 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785551:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68b180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.785552:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b180/0xfc4b8e114eda6f54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x871b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.785555:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b180/0xfc4b8e114eda6f54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x871b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.785556:0:15484:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869200/0xfc4b8e114ed9ddc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391729b9 expref: 3778 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.785558:0:6911:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091dd4480/0xfc4b8e114eda6f85 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x245:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6f93 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785559:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x871b:0x0].0x0 (ffff880092a4cc00) 00010000:00010000:0.0:1713279306.785561:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.785562:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b180/0xfc4b8e114eda6f54 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x871b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.785562:0:6911:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1713279306.785564:0:15484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f281f80 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000_UUID:15484:1796503200031808:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.785565:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b180/0xfc4b8e114eda6f54 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x871b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.785567:0:6911:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091dd4480/0xfc4b8e114eda6f85 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x245:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6f93 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785570:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda6dbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.785573:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda6dbe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.785576:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda6dbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.785577:0:6911:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ba9200/0xfc4b8e114eda6e5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x261:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda6e66 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785578:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68bcc0 already unused, calling callback (ffffffffa0f0d730) 00000040:00080000:1.0:1713279306.785578:0:15507:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xf8:0x0].2151, 3816 off1527128 00010000:00010000:0.0:1713279306.785579:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda6dbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.785579:0:15484:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114ed9ba65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39171fd3 expref: 3776 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785582:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda6dbe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00000004:00080000:1.0:1713279306.785582:0:15507:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88008f549c00 with version 31974 00000004:00010000:2.0:1713279306.785583:0:6911:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ba9200/0xfc4b8e114eda6e5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x261:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda6e66 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785586:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.785586:0:15484:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114ed9ba65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39171fd3 expref: 3776 pid: 15481 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.785587:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.785588:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda6dbe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.785591:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda6dbe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.785593:0:6911:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ba9200/0xfc4b8e114eda6e5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x261:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6e66 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785595:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.785597:0:6911:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713279306.785598:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.785598:0:15484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f281180 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000_UUID:15484:1796503200031936:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.785599:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785115 00010000:00010000:0.0:1713279306.785601:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.785603:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134a41f80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.785603:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3419:11855:x1796503281214656:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1713279306.785605:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.785605:0:6911:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ba9200/0xfc4b8e114eda6e5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x261:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6e66 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785607:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.785609:0:15484:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb06c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.785611:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8179:0x0].0x0 (ffff88007f389300) 00010000:00010000:0.0:1713279306.785612:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:0.0:1713279306.785613:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.785616:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda6dc5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x8179:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000001:00080000:2.0:1713279306.785616:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202661 is committed 00010000:00010000:1.0:1713279306.785619:0:9221:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.785620:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda6e74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x139:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.785623:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5f80/0xfc4b8e114eda6f7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x23e:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.785625:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda6e74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x139:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.785626:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5f80/0xfc4b8e114eda6f7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x23e:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.785627:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda841c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x708d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175786 expref: 3419 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.785628:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5f80/0xfc4b8e114eda6f7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x23e:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00000001:00080000:2.0:1713279306.785628:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202656 is committed 00010000:00010000:0.0:1713279306.785630:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd5f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.785630:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda6e74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x139:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00000001:00080000:2.0:1713279306.785631:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202655 is committed 00010000:00010000:0.0:1713279306.785632:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5f80/0xfc4b8e114eda6f7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x23e:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.785634:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096a2d680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.785635:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5f80/0xfc4b8e114eda6f7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x23e:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.785635:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x708d:0x0].0x0 (ffff88008c1d2f00) 00010000:00010000:1.0:1713279306.785637:0:9221:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.785637:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda6e74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x139:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.785639:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x23e:0x0].0x0 (ffff88012514d100) 00010000:00010000:0.0:1713279306.785640:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:0.0:1713279306.785641:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5f80/0xfc4b8e114eda6f7e lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x23e:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.785641:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda6e74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x139:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.785644:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5f80/0xfc4b8e114eda6f7e lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x23e:0x0].0x0 bits 0x7f/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.785648:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x38 (ffff88009228ef00) 00010000:00010000:0.0:1713279306.785650:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda7210 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.785650:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.785652:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda7210 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.785652:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda6e74 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x139:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.785655:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda7210 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.785656:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda6e74 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x139:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.785657:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.785659:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda7210 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.785662:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda7210 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.785665:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x3431 (ffff880136671500) 00010000:00010000:0.0:1713279306.785666:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.785666:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda84d9 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x708d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.785666:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114eda6e7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x7de3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.785668:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda7210 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x124:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.785670:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda7210 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x124:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.785671:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda84d9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x708d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.785671:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114eda6e7b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x7de3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.785675:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda84d9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x708d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.785679:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114eda7280 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x871e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.785679:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114eda6e7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7de3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.785682:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114eda7280 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x871e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.785683:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf99680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.785685:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114eda7280 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x871e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.785685:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114eda6e7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7de3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.785687:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fef8b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.785689:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114eda7280 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x871e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.785690:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114eda6e7b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x7de3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.785691:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114eda7280 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x871e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.785695:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x871e:0x0].0x0 (ffff880091b35600) 00010000:00010000:3.0:1713279306.785695:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7de3:0x0].0x0 (ffff88012d397900) 00010000:00010000:0.0:1713279306.785696:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.785697:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114eda7280 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x871e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.785697:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1713279306.785699:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114eda6e7b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x7de3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.785700:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114eda7280 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x871e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000004:00010000:1.0:1713279306.785701:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880097bae300 reply state ffff880095198000 transno 4295183655 ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda84d9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x708d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.785704:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114eda6e7b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x7de3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.785706:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda75d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x242:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.785706:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda84d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x708d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.785708:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda75d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x242:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.785710:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x708d:0x0].0x0 (ffff88008c1d2f00) 00010000:00010000:0.0:1713279306.785711:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda75d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x242:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.785711:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.785712:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.785716:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.785716:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda741d lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.785717:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda75d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x242:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.785720:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda75d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x242:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.785720:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda741d lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.785723:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x242:0x0].0x3931 (ffff880136671800) 00010000:00010000:0.0:1713279306.785724:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.785724:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda741d lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.785725:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda75d6 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x242:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.785728:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda75d6 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x242:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.785728:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.785731:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda741d lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.785735:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda7757 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8725:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.785735:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3420:11855:x1796503281214656:12345-192.168.203.4@tcp:36:touch.0 Request processed in 132us (382us total) trans 4295183655 rc 0/0 00010000:00010000:3.0:1713279306.785735:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda741d lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.785738:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda7757 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8725:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.785739:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785115 00010000:00010000:0.0:1713279306.785741:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda7757 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8725:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.785741:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x34 (ffff880131204400) 00010000:00010000:0.0:1713279306.785743:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf4000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.785743:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.785744:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda7757 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8725:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00000020:00080000:2.0:1713279306.785745:0:6911:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 16403 batchid updated 00010000:00010000:3.0:1713279306.785745:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda741d lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.785747:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda7757 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8725:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00000020:00080000:2.0:1713279306.785748:0:6911:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 16378 batchid updated 00000100:00100000:1.0:1713279306.785749:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785116 00010000:00010000:3.0:1713279306.785749:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda741d lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x139:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00000020:00080000:2.0:1713279306.785750:0:6911:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 16377 batchid updated 00010000:00010000:0.0:1713279306.785751:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8725:0x0].0x0 (ffff88007fe41800) 00010000:00010000:0.0:1713279306.785752:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.785752:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3731:11888:x1796503281214528:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.785754:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda7757 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8725:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.785757:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda7757 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8725:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.785759:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.785763:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda7837 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.785764:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.785766:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda7837 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000020:00080000:1.0:1713279306.785767:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16403 00010000:00010000:0.0:1713279306.785769:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda7837 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.785769:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.785771:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.785773:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda7837 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.785773:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942d8c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.785775:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda7837 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.785775:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.785779:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x3631 (ffff88008e59ca00) 00010000:00010000:3.0:1713279306.785779:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT0 00010000:00010000:0.0:1713279306.785780:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.785781:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda7837 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x124:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000020:00080000:2.0:1713279306.785783:0:6911:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008c213b40 refcount 2 committed 0 result 0 batchid 16406 00010000:00010000:0.0:1713279306.785784:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda7837 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x124:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.785785:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c03:0x0].0x0 (ffff880131200900) 00000020:00080000:2.0:1713279306.785786:0:6911:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096b8e100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008c213000 00010000:00010000:3.0:1713279306.785786:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000004:00080000:1.0:1713279306.785789:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b3c75e40 with version 29400 00000020:00080000:2.0:1713279306.785789:0:6911:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].673 00010000:00010000:3.0:1713279306.785789:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00000020:00080000:2.0:1713279306.785792:0:6911:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096b8ed00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009271ee00 00000020:00080000:1.0:1713279306.785794:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16374 cancel update log [0x240000401:0xf2:0x0].641: rc = 0 00000020:00080000:2.0:1713279306.785794:0:6911:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].188 00010000:00010000:3.0:1713279306.785794:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda742b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7c03:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT0 00000020:00080000:2.0:1713279306.785801:0:6911:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008a65dc00 refcount 2 committed 0 result 0 batchid 16405 00000020:00080000:2.0:1713279306.785803:0:6911:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011f2c2800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800925450c0 00000020:00080000:2.0:1713279306.785805:0:6911:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].672 00010000:00010000:3.0:1713279306.785805:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda67d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x863c:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00000020:00080000:2.0:1713279306.785807:0:6911:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009254e400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008e955000 00000020:00080000:2.0:1713279306.785809:0:6911:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].187 00010000:00010000:3.0:1713279306.785811:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda67d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x863c:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00000020:00080000:2.0:1713279306.785814:0:6911:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008fd91000 refcount 2 committed 0 result 0 batchid 16404 00010000:00010000:3.0:1713279306.785815:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda67d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x863c:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00000020:00080000:2.0:1713279306.785816:0:6911:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88013484ff00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8801206710c0 00000020:00080000:2.0:1713279306.785819:0:6911:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].671 00010000:00010000:3.0:1713279306.785819:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd11440 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:2.0:1713279306.785820:0:6911:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012510d700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880096e70c00 00010000:00010000:3.0:1713279306.785821:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda67d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x863c:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00000020:00080000:2.0:1713279306.785823:0:6911:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].186 00010000:00010000:3.0:1713279306.785826:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda67d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x863c:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.785831:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x863c:0x0].0x0 (ffff88008b918d00) 00010000:00010000:3.0:1713279306.785833:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1713279306.785835:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda67d6 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x863c:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.785837:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200031680:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1713279306.785839:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda7892 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8727:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00000004:00080000:1.0:1713279306.785839:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29400 rpc_version 29400 00010000:00010000:3.0:1713279306.785840:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda67d6 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x863c:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.785843:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda7892 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8727:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.785847:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda7892 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8727:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.785849:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.785850:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda68ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8378:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.785851:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda7892 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8727:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00000020:00100000:1.0:1713279306.785852:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1713279306.785854:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda7892 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8727:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.785855:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda68ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8378:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.785856:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880131cdca80 x1796503200032128/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1713279306.785858:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8727:0x0].0x0 (ffff880135caad00) 00000100:00100000:2.0:1713279306.785858:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.785859:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.785860:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda68ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8378:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.785861:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda7892 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8727:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.785863:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda7892 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8727:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.785864:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10240 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.785867:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200032128:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713279306.785867:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda68ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8378:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.785870:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda7cf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.785870:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1713279306.785872:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda68ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8378:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.785873:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda7cf9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.785875:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200031872:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1713279306.785876:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda7cf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.785878:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe15f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.785878:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8378:0x0].0x0 (ffff88008e5b8b00) 00010000:00010000:0.0:1713279306.785879:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda7cf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.785880:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1713279306.785882:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda7cf9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.785882:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda68ee lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8378:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.785887:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8541:0x0].0x0 (ffff880090aa0900) 00010000:00010000:3.0:1713279306.785887:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda68ee lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8378:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.785888:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.785888:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.785888:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.785889:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda7cf9 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.785892:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda7cf9 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.785897:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098f8b480 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.785897:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda6d5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.785898:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda7f68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.785900:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda7f68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00000004:00080000:2.0:1713279306.785901:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31974 rpc_version 31974 00010000:00010000:3.0:1713279306.785902:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda6d5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.785903:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda7f68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.785905:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bdb00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.785905:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.785907:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda7f68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.785907:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda6d5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.785910:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda7f68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x124:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.785911:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda84e0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391757c5 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.785911:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ee880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.785913:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda6d5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00000020:00100000:2.0:1713279306.785917:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1713279306.785918:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda6d5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00000100:00100000:2.0:1713279306.785922:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880131cb5f80 x1796503200032256/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1713279306.785925:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x3032 (ffff880129b60f00) 00010000:00010000:3.0:1713279306.785927:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.785929:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda6d5c lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:2.0:1713279306.785933:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb5f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200032256:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.785934:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda6d5c lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.785941:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x124:0x0].0x3831 (ffff8800960e8300) 00010000:00010000:0.0:1713279306.785942:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.785944:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda7f68 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x124:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.785946:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda7f68 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x124:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.785948:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda6d7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x86b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.785953:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda6d7f lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x86b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.785955:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda7ffb lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x872e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.785958:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.785958:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda6d7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x86b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.785959:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda7ffb lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x872e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.785961:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.785962:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda7ffb lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x872e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.785964:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134a40240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.785964:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda6d7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x86b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.785966:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda7ffb lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x872e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.785967:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a06b0600 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.785968:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda7ffb lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x872e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.785969:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda6d7f lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x86b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.785973:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x872e:0x0].0x0 (ffff88012514d500) 00010000:00010000:0.0:1713279306.785974:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.785975:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda7ffb lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x872e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.785975:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200032000:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1713279306.785975:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86b1:0x0].0x0 (ffff880092a4c000) 00010000:00010000:0.0:1713279306.785977:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda7ffb lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x872e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.785977:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.785980:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda6d7f lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x86b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.785983:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda84e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.785985:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda6d7f lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x86b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.785988:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.785991:0:9221:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009181cb40/0xfc4b8e114eda573d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c11 expref: 3728 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.785995:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda6e12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.785997:0:9221:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda5fda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c3b expref: 3716 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.786000:0:9221:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda84e7 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.786000:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda6e12 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.786004:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda6e12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.786005:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda82cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfc4b8e114eda82b0 expref: 61 pid: 6934 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.786008:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200031680 00010000:00010000:0.0:1713279306.786010:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x0 (ffff88012514d900) 00010000:00010000:0.0:1713279306.786011:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda847e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x14f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713279306.786011:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200031680 00000100:00100000:2.0:1713279306.786011:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200031872 00010000:00010000:3.0:1713279306.786012:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9b00 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.786014:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200031872 00010000:00010000:0.0:1713279306.786015:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda847e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x14f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.786015:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda6e12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.786018:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda847e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x14f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.786019:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda6e12 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00000100:00100000:1.0:1713279306.786023:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200032000 00000100:00100000:1.0:1713279306.786025:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200032000 00010000:00010000:3.0:1713279306.786025:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x847f:0x0].0x0 (ffff88008d729200) 00010000:00010000:0.0:1713279306.786026:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.786027:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.786030:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147237 00010000:00010000:3.0:1713279306.786030:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda6e12 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00000100:00100000:2.0:1713279306.786034:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+96:3490:x1796503200031680:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1713279306.786035:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114eda6e12 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00000100:00100000:1.0:1713279306.786037:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147238 00000100:00100000:1.0:1713279306.786040:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+96:3490:x1796503200031872:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1713279306.786043:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.786044:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda7057 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x86bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.786045:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.786048:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda7057 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x86bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.786052:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130292a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+60:3493:x1796503200031552:12345-0@lo:103:ldlm_bl.0 Request processed in 1997us (2035us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.786052:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda740f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x261:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda7408 expref: 96 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.786053:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda7057 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x86bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.786056:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196506 00010000:00010000:3.0:1713279306.786058:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.786060:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda7057 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x86bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.786061:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x34 (ffff88008e766400) 00010000:00010000:3.0:1713279306.786064:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda7057 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x86bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.786065:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.786085:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86bb:0x0].0x0 (ffff880092a4c900) 00010000:00010000:3.0:1713279306.786087:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.786088:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147239 00010000:00010000:1.0:1713279306.786088:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda6f93 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x245:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda6f85 expref: 95 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.786089:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda7057 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x86bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.786091:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+95:3492:x1796503200032000:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1713279306.786094:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x245:0x0].0x0 (ffff88008d729f00) 00010000:00010000:3.0:1713279306.786094:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda7057 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x86bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.786095:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.786098:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.786100:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+94:3490:x1796503200031680:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 65us (242us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.786102:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114eda6e66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x261:0x0].0x38 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda6e5f expref: 94 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.786104:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0daac0/0xfc4b8e114eda715a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7f40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.786105:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147237 00010000:00010000:0.0:1713279306.786108:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x38 (ffff8800937ce800) 00010000:00010000:3.0:1713279306.786109:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0daac0/0xfc4b8e114eda715a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7f40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.786112:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.786113:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0daac0/0xfc4b8e114eda715a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7f40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.786114:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+92:3490:x1796503200031872:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 73us (226us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.786118:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a0daac0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.786119:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147238 00010000:00010000:3.0:1713279306.786120:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0daac0/0xfc4b8e114eda715a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7f40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.786124:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0daac0/0xfc4b8e114eda715a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7f40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.786125:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+91:3492:x1796503200032000:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 34us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.786129:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147239 00000100:00100000:2.0:1713279306.786129:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200031872:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1713279306.786130:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f40:0x0].0x0 (ffff88013484f000) 00010000:00010000:3.0:1713279306.786132:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.786135:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0daac0/0xfc4b8e114eda715a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7f40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.786136:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200031680:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1713279306.786139:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0daac0/0xfc4b8e114eda715a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7f40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.786145:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200031552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.786150:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda7693 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:2.0:1713279306.786152:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200032000:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1713279306.786154:0:15479:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda847e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x14f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.786155:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda7693 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.786158:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda847e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x14f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.786160:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda7693 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.786164:0:9221:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda5fda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c3b expref: 3716 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.786164:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baaf40 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.786165:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200032128 00010000:00010000:3.0:1713279306.786166:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda7693 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00000100:00100000:2.0:1713279306.786167:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200032128 00010000:00010000:1.0:1713279306.786170:0:9221:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda5fda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c3b expref: 3716 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.786171:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda7693 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00000004:00200000:0.0:1713279306.786174:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x14f:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.786176:0:15479:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 4 MDT count 2 00000100:00100000:1.0:1713279306.786176:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdc000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9221:1796503200032320:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.786177:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86db:0x0].0x0 (ffff88008eba0d00) 00010000:00010000:3.0:1713279306.786178:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.786181:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200032256 00010000:00010000:3.0:1713279306.786181:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda7693 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:2.0:1713279306.786182:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200032256 00010000:00010000:3.0:1713279306.786185:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda7693 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x86db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.786190:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda8477 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757a2 expref: 3725 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.786190:0:9221:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009181cb40/0xfc4b8e114eda573d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c11 expref: 3725 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.786192:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98723 00010000:00010000:1.0:1713279306.786195:0:9221:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009181cb40/0xfc4b8e114eda573d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c11 expref: 3723 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.786196:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+91:8634:x1796503200032128:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713279306.786196:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.786197:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda847e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x14f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757a2 expref: 3723 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.786199:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9221:1796503200032384:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.786200:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.786201:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x0 (ffff88012514d900) 00010000:00010000:0.0:1713279306.786203:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713279306.786204:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d9806c0, rc 0) 00000100:00100000:1.0:1713279306.786204:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800917f2f00 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.786205:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.786209:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf4fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.786211:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.786215:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3723:11854:x1796503281213504:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2407us (2535us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.786215:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98724 00010000:00010000:3.0:1713279306.786215:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.786219:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785110 00000100:00100000:1.0:1713279306.786219:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac44b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+60:8074:x1796503200032256:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.786222:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c58:0x0].0x0 (ffff880092139d00) 00010000:00010000:3.0:1713279306.786224:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.786226:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.786231:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda78ae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7c58:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.786232:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda84d2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.786236:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda84d2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.786241:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda84d2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.786241:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114eda7b5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x824e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.786245:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114eda7b5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x824e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.786250:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114eda7b5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x824e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.786254:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925421c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.786256:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114eda7b5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x824e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.786261:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114eda7b5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x824e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.786267:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x824e:0x0].0x0 (ffff88009588ce00) 00010000:00010000:3.0:1713279306.786270:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.786271:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+92:8634:x1796503200032128:12345-0@lo:1000:osp_up1-0.0 Request processed in 74us (382us total) trans 4295183656 rc 0/0 00010000:00010000:3.0:1713279306.786272:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114eda7b5c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x824e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.786276:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114eda7b5c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x824e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.786277:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98723 00010000:00010000:0.0:1713279306.786286:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda84cb lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.786290:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda84cb lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.786293:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda84cb lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.786296:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda84cb lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.786298:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200032128:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713279306.786299:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880089fe1680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.786301:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda84cb lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.786306:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda84cb lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.786309:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.786310:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:0.0:1713279306.786311:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.786313:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda84cb lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.786316:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda84cb lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.786318:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281214976 00010000:00010000:0.0:1713279306.786321:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda84d2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.786321:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281214976 00010000:00010000:0.0:1713279306.786324:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda84d2 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.786327:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda84d2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.786329:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ad686c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.786330:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda84d2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.786333:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda84d2 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.786335:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147240 00000100:00100000:2.0:1713279306.786338:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:1956:x1796503281214976:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.786344:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.786349:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880096e84f00) 00010000:00010000:0.0:1713279306.786350:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.786351:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda84d2 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.786353:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda8286 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917572b expref: 3717 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.786354:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114eda84d2 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.786361:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:2.0:1713279306.786364:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:1.0:1713279306.786366:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16374 cancel update log [0x200000400:0x1b7:0x0].155: rc = 0 00010000:00010000:0.0:1713279306.786368:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda84c4 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757be expref: 3716 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.786372:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda84c4 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757be expref: 3716 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.786374:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:1956:x1796503281214976:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 35us (66us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.786376:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe16880, rc 0) 00000100:00100000:3.0:1713279306.786378:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.786380:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147240 00000004:00080000:1.0:1713279306.786385:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800917f2d80 with version 29401 00000020:00080000:1.0:1713279306.786390:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16375 cancel update log [0x240000401:0xf2:0x0].642: rc = 0 00000100:00100000:2.0:1713279306.786392:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281214784 00000100:00100000:2.0:1713279306.786394:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281214784 00000100:00100000:2.0:1713279306.786405:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785117 00000020:00080000:1.0:1713279306.786408:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16375 cancel update log [0x200000400:0x1b7:0x0].156: rc = 0 00000100:00100000:2.0:1713279306.786409:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281214784:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.786431:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.786432:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.786440:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd121c0/0xfc4b8e114eda84ee lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391757cc expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713279306.786441:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800917f2900 with version 29402 00000020:00080000:1.0:1713279306.786444:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16376 cancel update log [0x240000401:0xf2:0x0].643: rc = 0 00000100:00100000:0.0:1713279306.786447:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281215040 00000100:00100000:0.0:1713279306.786450:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281215040 00000020:00080000:1.0:1713279306.786458:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16376 cancel update log [0x200000400:0x1b7:0x0].158: rc = 0 00000100:00100000:0.0:1713279306.786467:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110478 00000100:00100000:0.0:1713279306.786470:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+87:1956:x1796503281215040:12345-192.168.203.4@tcp:22:fallocate.0 00000004:00080000:1.0:1713279306.786471:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88008f549f00 with version 29403 00000100:00100000:3.0:1713279306.786471:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000020:00080000:1.0:1713279306.786473:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16377 cancel update log [0x240000401:0xf2:0x0].644: rc = 0 00000020:00080000:1.0:1713279306.786484:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16377 cancel update log [0x200000400:0x1b7:0x0].159: rc = 0 00010000:00010000:2.0:1713279306.786491:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda84f5 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.786494:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281214912 00000004:00080000:1.0:1713279306.786495:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88008f5493c0 with version 29404 00000100:00100000:3.0:1713279306.786496:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281214912 00000020:00080000:1.0:1713279306.786497:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16378 cancel update log [0x240000401:0xf2:0x0].645: rc = 0 00010000:00010000:2.0:1713279306.786498:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda84f5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.786504:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda84f5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000020:00080000:1.0:1713279306.786509:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16378 cancel update log [0x200000400:0x1b7:0x0].160: rc = 0 00010000:00010000:2.0:1713279306.786513:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda84fc lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.786513:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785118 00000100:00100000:3.0:1713279306.786517:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3723:11893:x1796503281214912:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.786519:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda84fc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00000004:00080000:1.0:1713279306.786520:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880097df83c0 with version 29405 00000020:00080000:1.0:1713279306.786523:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16379 cancel update log [0x240000401:0xf2:0x0].646: rc = 0 00010000:00010000:2.0:1713279306.786524:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda84fc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.786524:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.786530:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda8503 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391757d3 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000020:00080000:1.0:1713279306.786533:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16379 cancel update log [0x200000400:0x1b7:0x0].161: rc = 0 00000004:00200000:2.0:1713279306.786539:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00002000:00010000:0.0:1713279306.786544:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb size from disk: 46934 -> 46934 00002000:00010000:0.0:1713279306.786546:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00010000:00010000:2.0:1713279306.786546:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda84f5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00002000:00010000:0.0:1713279306.786547:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00000004:00080000:1.0:1713279306.786547:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f0033c0 with version 29406 00002000:00010000:0.0:1713279306.786549:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00000020:00080000:1.0:1713279306.786549:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16380 cancel update log [0x240000401:0xf2:0x0].647: rc = 0 00002000:00010000:0.0:1713279306.786550:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb blocks from disk: 48 -> 72 00010000:00010000:2.0:1713279306.786551:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda84f5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.786553:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda850a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.786556:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda84f5 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00000020:00080000:1.0:1713279306.786559:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16380 cancel update log [0x200000400:0x1b7:0x0].162: rc = 0 00010000:00010000:3.0:1713279306.786559:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda850a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.786561:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+88:1956:x1796503281215040:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 90us (129us total) trans 4295010118 rc 0/0 00010000:00010000:2.0:1713279306.786561:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda84f5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.786564:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110478 00010000:00010000:3.0:1713279306.786565:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda850a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.786566:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.786568:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda84f5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000004:00080000:1.0:1713279306.786571:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8801237270c0 with version 29407 00000020:00080000:1.0:1713279306.786573:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16381 cancel update log [0x240000401:0xf2:0x0].648: rc = 0 00010000:00010000:2.0:1713279306.786573:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda84f5 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.786573:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda8511 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.786576:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:11204:x1796503281214400:12345-192.168.203.4@tcp:101:touch.0 Request processed in 1176us (1242us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.786578:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda8511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.786579:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785114 00010000:00010000:2.0:1713279306.786580:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88008e4c3c00) 00010000:00010000:2.0:1713279306.786582:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1713279306.786583:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16381 cancel update log [0x200000400:0x1b7:0x0].163: rc = 0 00010000:00010000:3.0:1713279306.786583:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda8511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.786585:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda84f5 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.786589:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda84f5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000004:00080000:1.0:1713279306.786595:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800959c23c0 with version 29408 00000020:00080000:1.0:1713279306.786597:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16382 cancel update log [0x240000401:0xf2:0x0].649: rc = 0 00010000:00010000:2.0:1713279306.786597:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda84fc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.786602:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda84fc lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.786606:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda84fc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000020:00080000:1.0:1713279306.786607:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16382 cancel update log [0x200000400:0x1b7:0x0].164: rc = 0 00010000:00010000:3.0:1713279306.786607:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda850a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.786611:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.786612:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda850a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.786614:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda84fc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000004:00080000:1.0:1713279306.786618:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88008fdf7540 with version 29409 00010000:00010000:2.0:1713279306.786618:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda84fc lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00000020:00080000:1.0:1713279306.786620:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16383 cancel update log [0x240000401:0xf2:0x0].650: rc = 0 00010000:00010000:3.0:1713279306.786620:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda850a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.786624:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff88008e4c3d00) 00010000:00010000:2.0:1713279306.786625:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.786625:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda850a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.786627:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda84fc lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000020:00080000:1.0:1713279306.786630:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16383 cancel update log [0x200000400:0x1b7:0x0].165: rc = 0 00010000:00010000:3.0:1713279306.786630:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.786632:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda84fc lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.786632:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda850a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.786636:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda850a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00000004:00080000:1.0:1713279306.786641:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880096e07840 with version 29410 00010000:00010000:3.0:1713279306.786642:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00000020:00080000:1.0:1713279306.786643:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16384 cancel update log [0x240000401:0xf2:0x0].651: rc = 0 00010000:00010000:3.0:1713279306.786643:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.786645:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda850a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.786650:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd121c0/0xfc4b8e114eda84ee lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757cc expref: 3724 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.786650:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda850a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000020:00080000:1.0:1713279306.786654:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16384 cancel update log [0x200000400:0x1b7:0x0].166: rc = 0 00010000:00010000:3.0:1713279306.786656:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda8511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.786661:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd121c0/0xfc4b8e114eda84ee lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757cc expref: 3724 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.786661:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda8511 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00000004:00080000:1.0:1713279306.786666:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880096e07780 with version 29411 00010000:00010000:3.0:1713279306.786666:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda8511 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00000020:00080000:1.0:1713279306.786667:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16385 cancel update log [0x240000401:0xf2:0x0].652: rc = 0 00010000:00010000:2.0:1713279306.786669:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd121c0, rc 0) 00010000:00010000:3.0:1713279306.786670:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bd680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.786672:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda8511 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00000020:00080000:1.0:1713279306.786677:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16385 cancel update log [0x200000400:0x1b7:0x0].167: rc = 0 00010000:00010000:3.0:1713279306.786679:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda8511 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713279306.786681:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3723:11711:x1796503281214784:12345-192.168.203.4@tcp:101:touch.0 Request processed in 271us (303us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.786685:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3531 (ffff8800954bed00) 00000100:00100000:2.0:1713279306.786687:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785117 00010000:00010000:3.0:1713279306.786687:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.786689:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda8511 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000004:00080000:1.0:1713279306.786691:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880092abf240 with version 29412 00000020:00080000:1.0:1713279306.786693:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16386 cancel update log [0x240000401:0xf2:0x0].653: rc = 0 00010000:00010000:3.0:1713279306.786694:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd680/0xfc4b8e114eda8511 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000020:00080000:1.0:1713279306.786706:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16386 cancel update log [0x200000400:0x1b7:0x0].168: rc = 0 00010000:00010000:3.0:1713279306.786709:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda8503 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757d3 expref: 3722 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.786715:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda8503 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757d3 expref: 3722 pid: 15479 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713279306.786720:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800963fcf00 with version 29413 00010000:00010000:3.0:1713279306.786721:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bf3c0, rc 0) 00000020:00080000:1.0:1713279306.786723:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16387 cancel update log [0x240000401:0xf2:0x0].654: rc = 0 00000100:00100000:3.0:1713279306.786732:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3721:11893:x1796503281214912:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 214us (261us total) trans 0 rc 301/301 00000020:00080000:1.0:1713279306.786735:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16387 cancel update log [0x200000400:0x1b7:0x0].169: rc = 0 00000100:00100000:3.0:1713279306.786737:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785118 00000004:00080000:1.0:1713279306.786748:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800963fc6c0 with version 29414 00000020:00080000:1.0:1713279306.786750:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16388 cancel update log [0x240000401:0xf2:0x0].655: rc = 0 00000020:00080000:1.0:1713279306.786761:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16388 cancel update log [0x200000400:0x1b7:0x0].170: rc = 0 00000004:00080000:1.0:1713279306.786770:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800963fc540 with version 29415 00000020:00080000:1.0:1713279306.786772:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16389 cancel update log [0x240000401:0xf2:0x0].656: rc = 0 00000020:00080000:1.0:1713279306.786778:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16389 cancel update log [0x200000400:0x1b7:0x0].171: rc = 0 00000004:00080000:1.0:1713279306.786786:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800963fc240 with version 29416 00000020:00080000:1.0:1713279306.786787:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16390 cancel update log [0x240000401:0xf2:0x0].657: rc = 0 00000020:00080000:1.0:1713279306.786793:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16390 cancel update log [0x200000400:0x1b7:0x0].172: rc = 0 00000004:00080000:1.0:1713279306.786801:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880123727cc0 with version 29417 00000020:00080000:1.0:1713279306.786802:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16391 cancel update log [0x240000401:0xf2:0x0].658: rc = 0 00000020:00080000:1.0:1713279306.786808:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16391 cancel update log [0x200000400:0x1b7:0x0].173: rc = 0 00000004:00080000:1.0:1713279306.786816:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f003b40 with version 29418 00000020:00080000:1.0:1713279306.786818:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16392 cancel update log [0x240000401:0xf2:0x0].659: rc = 0 00000020:00080000:1.0:1713279306.786824:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16392 cancel update log [0x200000400:0x1b7:0x0].174: rc = 0 00000004:00080000:1.0:1713279306.786832:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012984a480 with version 29419 00000020:00080000:1.0:1713279306.786833:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16393 cancel update log [0x240000401:0xf2:0x0].660: rc = 0 00000100:00100000:3.0:1713279306.786834:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000020:00080000:1.0:1713279306.786842:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16393 cancel update log [0x200000400:0x1b7:0x0].175: rc = 0 00000100:00100000:3.0:1713279306.786846:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281215168 00000100:00100000:3.0:1713279306.786849:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281215168 00000100:00100000:0.0:1713279306.786854:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00080000:1.0:1713279306.786865:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88008ca450c0 with version 29420 00000020:00080000:1.0:1713279306.786868:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16394 cancel update log [0x240000401:0xf2:0x0].661: rc = 0 00000100:00100000:3.0:1713279306.786870:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281215296 00000100:00100000:3.0:1713279306.786873:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281215296 00000020:00080000:1.0:1713279306.786884:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16394 cancel update log [0x200000400:0x1b7:0x0].176: rc = 0 00000100:00100000:3.0:1713279306.786884:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785119 00000100:00100000:3.0:1713279306.786888:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:11904:x1796503281215168:12345-192.168.203.4@tcp:36:touch.0 00000004:00080000:1.0:1713279306.786900:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800965400c0 with version 29421 00000020:00080000:1.0:1713279306.786903:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16395 cancel update log [0x240000401:0xf2:0x0].662: rc = 0 00010000:00010000:3.0:1713279306.786904:0:15479:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.786914:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785120 00010000:00010000:3.0:1713279306.786914:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5680/0xfc4b8e114eda832e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917574e expref: 3714 pid: 15473 timeout: 0 lvb_type: 0 00000020:00080000:1.0:1713279306.786916:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16395 cancel update log [0x200000400:0x1b7:0x0].177: rc = 0 00000100:00100000:2.0:1713279306.786919:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3420:11931:x1796503281215296:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.786922:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ede:0x0].0x0 (ffff88008e4c8000) 00010000:00010000:3.0:1713279306.786925:0:15479:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.786926:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:1.0:1713279306.786929:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880096540240 with version 29422 00000020:00080000:1.0:1713279306.786931:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16396 cancel update log [0x240000401:0xf2:0x0].663: rc = 0 00010000:00010000:2.0:1713279306.786933:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11d40/0xfc4b8e114eda8518 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391757da expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000020:00080000:1.0:1713279306.786943:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16396 cancel update log [0x200000400:0x1b7:0x0].178: rc = 0 00000004:00080000:1.0:1713279306.786955:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800965403c0 with version 29423 00000020:00080000:1.0:1713279306.786957:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16397 cancel update log [0x240000401:0xf2:0x0].664: rc = 0 00010000:00010000:3.0:1713279306.786962:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.786967:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d86c0/0xfc4b8e114eda8526 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x78ee:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.786969:0:15479:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114ed9dd11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172981 expref: 3720 pid: 6934 timeout: 0 lvb_type: 0 00000020:00080000:1.0:1713279306.786972:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16397 cancel update log [0x200000400:0x1b7:0x0].179: rc = 0 00010000:00010000:2.0:1713279306.786974:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d86c0/0xfc4b8e114eda8526 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x78ee:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.786975:0:15479:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.786981:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d86c0/0xfc4b8e114eda8526 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x78ee:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000004:00080000:1.0:1713279306.786983:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880096540540 with version 29424 00000020:00080000:1.0:1713279306.786985:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16398 cancel update log [0x240000401:0xf2:0x0].665: rc = 0 00000004:00200000:2.0:1713279306.786987:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x78ee:0x0]: returning size 40670 00010000:00010000:3.0:1713279306.786988:0:15479:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114ed9dd11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172981 expref: 3720 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.786995:0:15479:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114ed9dd11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172981 expref: 3720 pid: 6934 timeout: 509 lvb_type: 0 00000020:00080000:1.0:1713279306.786996:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16398 cancel update log [0x200000400:0x1b7:0x0].180: rc = 0 00000100:00100000:3.0:1713279306.787004:0:15479:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c03100 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:15479:1796503200032448:192.168.203.4@tcp:104: 00000004:00080000:1.0:1713279306.787008:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800965406c0 with version 29425 00000020:00080000:1.0:1713279306.787010:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16399 cancel update log [0x240000401:0xf2:0x0].666: rc = 0 00000020:00080000:1.0:1713279306.787021:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16399 cancel update log [0x200000400:0x1b7:0x0].181: rc = 0 00010000:00010000:2.0:1713279306.787025:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11d40/0xfc4b8e114eda8518 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757da expref: 3423 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.787025:0:15479:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb0f00 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.787034:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d86c0/0xfc4b8e114eda8526 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x78ee:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757da expref: 3422 pid: 15752 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713279306.787039:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880096540840 with version 29426 00000020:00080000:1.0:1713279306.787042:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16400 cancel update log [0x240000401:0xf2:0x0].667: rc = 0 00010000:00010000:2.0:1713279306.787045:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x78ee:0x0].0x0 (ffff880091b35f00) 00010000:00010000:2.0:1713279306.787047:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1713279306.787049:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801237d86c0, rc 0) 00000020:00080000:1.0:1713279306.787055:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16400 cancel update log [0x200000400:0x1b7:0x0].182: rc = 0 00000100:00100000:2.0:1713279306.787065:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3422:11931:x1796503281215296:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 145us (210us total) trans 4295183657 rc 0/0 00000004:00080000:1.0:1713279306.787082:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800965409c0 with version 29427 00000100:00100000:2.0:1713279306.787084:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785120 00000020:00080000:1.0:1713279306.787085:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16401 cancel update log [0x240000401:0xf2:0x0].668: rc = 0 00000020:00080000:1.0:1713279306.787101:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16401 cancel update log [0x200000400:0x1b7:0x0].183: rc = 0 00000004:00080000:1.0:1713279306.787116:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880096540b40 with version 29428 00000020:00080000:1.0:1713279306.787119:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16402 cancel update log [0x240000401:0xf2:0x0].669: rc = 0 00000020:00080000:1.0:1713279306.787133:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16402 cancel update log [0x200000400:0x1b7:0x0].184: rc = 0 00000004:00080000:1.0:1713279306.787145:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880096540cc0 with version 29429 00000020:00080000:1.0:1713279306.787147:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16403 cancel update log [0x240000401:0xf2:0x0].670: rc = 0 00000020:00080000:1.0:1713279306.787157:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16403 cancel update log [0x200000400:0x1b7:0x0].185: rc = 0 00000020:00080000:1.0:1713279306.787162:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 16406 committed batchid 16403 00000020:00080000:1.0:1713279306.787171:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16403 00000004:00080000:1.0:1713279306.787176:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29401 rpc_version 29401 00000020:00100000:1.0:1713279306.787187:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1713279306.787191:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880131cdc380 x1796503200032576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1713279306.787201:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdc380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200032576:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.787268:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.787279:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540e40 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.787283:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200032576 00000100:00100000:2.0:1713279306.787285:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200032576 00000100:00100000:2.0:1713279306.787304:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98725 00000100:00100000:2.0:1713279306.787308:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+92:8634:x1796503200032576:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1713279306.787373:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+93:8634:x1796503200032576:12345-0@lo:1000:osp_up1-0.0 Request processed in 63us (104us total) trans 4295183658 rc 0/0 00000100:00100000:2.0:1713279306.787378:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98725 00000100:00100000:0.0:1713279306.787451:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdc380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200032576:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1713279306.787457:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29402 rpc_version 29402 00000100:00100000:1.0:1713279306.787463:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac44b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+61:8074:x1796503200032256:12345-0@lo:1000:osp_up0-1.0 Request processed in 1242us (1503us total) trans 4295202662 rc 0/0 00000020:00100000:0.0:1713279306.787466:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.787469:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880130293480 x1796503200032704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1713279306.787471:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98724 00000100:00100000:2.0:1713279306.787473:0:8074:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4295202655 gen 2 00000004:00080000:2.0:1713279306.787476:0:8074:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202573 committed transno 4295202655 00000100:00100000:0.0:1713279306.787478:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130293480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200032704:0@lo:1000:osp_up1-0.0 00000020:00080000:2.0:1713279306.787479:0:8074:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88008c2fbcc0 refcount 2 committed 0 result 0 batchid 17677 00000020:00080000:2.0:1713279306.787481:0:8074:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880097910c00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008c213180 00000020:00080000:2.0:1713279306.787483:0:8074:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012514de00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880094f8ee40 00000020:00080000:2.0:1713279306.787485:0:8074:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012514d200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8800924b49c0 00000020:00080000:2.0:1713279306.787487:0:8074:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2145 00000020:00080000:2.0:1713279306.787488:0:8074:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012514d000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880094347e00 00000020:00080000:2.0:1713279306.787489:0:8074:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1537 00000100:00100000:0.0:1713279306.787494:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.787503:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000004:00080000:2.0:1713279306.787511:0:8074:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202593 committed transno 4295202655 00000020:00080000:3.0:1713279306.787522:0:8082:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 17677 committed batchid 17642 00000004:00080000:2.0:1713279306.787524:0:8074:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202598 committed transno 4295202655 00000004:00080000:2.0:1713279306.787538:0:8074:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202619 committed transno 4295202655 00000020:00080000:3.0:1713279306.787540:0:8082:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17642 00000004:00080000:2.0:1713279306.787550:0:8074:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202640 committed transno 4295202655 00000004:00080000:2.0:1713279306.787561:0:8074:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202655 committed transno 4295202655 00000100:00100000:2.0:1713279306.787580:0:8074:0:(client.c:2997:ptlrpc_free_committed()) @@@ stopping search req@ffff880131cb5f80 x1796503200032256/t4295202662(4295202662) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1713279322 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 00000100:00100000:0.0:1713279306.787600:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.787600:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb5f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200032256:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.787610:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281215424 00000100:00100000:2.0:1713279306.787611:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200032704 00000100:00100000:2.0:1713279306.787613:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200032704 00000100:00100000:3.0:1713279306.787613:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281215424 00000100:00100000:2.0:1713279306.787630:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98726 00000100:00100000:2.0:1713279306.787634:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+93:8634:x1796503200032704:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.787638:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785121 00000100:00100000:3.0:1713279306.787642:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3422:11903:x1796503281215424:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.787649:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.787657:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda8534 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391757e1 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.787697:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:8634:x1796503200032704:12345-0@lo:1000:osp_up1-0.0 Request processed in 61us (201us total) trans 4295183659 rc 0/0 00010000:00010000:3.0:1713279306.787697:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda853b lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.787703:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98726 00010000:00010000:3.0:1713279306.787705:0:15752:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda4936 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391748bb expref: 3423 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.787712:0:15752:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda5bab lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174d4c expref: 3683 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.787716:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130293480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200032704:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713279306.787718:0:15752:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda853b lrc: 5/0,1 mode: --/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000004:00080000:0.0:1713279306.787721:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29403 rpc_version 29403 00000020:00100000:0.0:1713279306.787728:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.787731:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880130291500 x1796503200032896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1713279306.787732:0:15752:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda5bab lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174d4c expref: 3683 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.787739:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130291500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200032896:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713279306.787740:0:15752:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda5bab lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174d4c expref: 3683 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.787748:0:15752:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd19500 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001_UUID:15752:1796503200032832:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.787754:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.787767:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.787768:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114eda8542 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x76ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00000100:00100000:2.0:1713279306.787768:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200032896 00000100:00100000:2.0:1713279306.787771:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200032896 00010000:00010000:1.0:1713279306.787775:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114eda8542 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.787775:0:15752:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda4936 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391748bb expref: 3423 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.787780:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114eda8542 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.787784:0:15752:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda4936 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391748bb expref: 3423 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.787788:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda8549 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x264:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00000100:00100000:2.0:1713279306.787789:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98727 00010000:00010000:1.0:1713279306.787791:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda8549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00000100:00100000:3.0:1713279306.787792:0:15752:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001_UUID:15752:1796503200032960:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.787793:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+94:8634:x1796503200032896:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1713279306.787794:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda8549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.787800:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda8550 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x242:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.787803:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda8550 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.787805:0:15507:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda8550 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00000100:00100000:3.0:1713279306.787811:0:15752:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb0d80 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.787816:0:15507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd7180/0xfc4b8e114eda8557 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x140:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15507 initiator: MDT0 00010000:00010000:1.0:1713279306.787821:0:15507:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd7180/0xfc4b8e114eda8557 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.787827:0:15507:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd7180/0xfc4b8e114eda8557 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15507 initiator: MDT1 00000100:00100000:1.0:1713279306.787837:0:15507:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdf100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0001-mdtlov_UUID:15507:1796503200033024:0@lo:101:mdt_io00_005.0 00000100:00100000:2.0:1713279306.787855:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+95:8634:x1796503200032896:12345-0@lo:1000:osp_up1-0.0 Request processed in 60us (98us total) trans 4295183660 rc 0/0 00000100:00100000:1.0:1713279306.787857:0:15507:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.787861:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98727 00000100:00100000:0.0:1713279306.787869:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130291500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200032896:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1713279306.787872:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29404 rpc_version 29404 00000100:00100000:2.0:1713279306.787874:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200033024 00000100:00100000:1.0:1713279306.787876:0:15507:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800917f2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.787877:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200033024 00000020:00100000:0.0:1713279306.787878:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.787881:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880130290380 x1796503200033152/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.787887:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130290380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200033152:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1713279306.787892:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98728 00000100:00100000:2.0:1713279306.787896:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+61:15507:x1796503200033024:12345-0@lo:101:mdt_io00_005.0 00000100:00100000:0.0:1713279306.787899:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.787904:0:6934:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.787911:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.787911:0:6934:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801237da400/0xfc4b8e114eda855e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x140:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda8557 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.787922:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200033152 00000100:00100000:1.0:1713279306.787925:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200033152 00010000:00010000:2.0:1713279306.787927:0:6934:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801237da400/0xfc4b8e114eda855e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda8557 expref: 62 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.787935:0:6934:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801237da400/0xfc4b8e114eda855e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8557 expref: 62 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.787940:0:6934:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x140:0x0].0x0 (ffff88008e4c3e00) 00000100:00100000:1.0:1713279306.787941:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98729 00010000:00010000:2.0:1713279306.787943:0:6934:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.787945:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+95:8634:x1796503200033152:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1713279306.787945:0:6934:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801237da400, rc 0) 00000100:00100000:2.0:1713279306.787964:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+62:15507:x1796503200033024:12345-0@lo:101:mdt_io00_005.0 Request processed in 68us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.787969:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98728 00000100:00100000:0.0:1713279306.787970:0:15507:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdf100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_005:lustre-MDT0001-mdtlov_UUID:15507:1796503200033024:0@lo:101:mdt_io00_005.0 00010000:00010000:0.0:1713279306.787978:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd7180/0xfc4b8e114eda8557 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda855e expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.787985:0:15507:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd7180/0xfc4b8e114eda8557 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda855e expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713279306.787994:0:15507:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009661ad80 reply state ffff8801302e2000 transno 4295183654 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda8549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.787999:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda8549 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788003:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x264:0x0].0x0 (ffff880130675400) 00000100:00100000:1.0:1713279306.788004:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+96:8634:x1796503200033152:12345-0@lo:1000:osp_up1-0.0 Request processed in 58us (103us total) trans 4295183661 rc 0/0 00010000:00010000:0.0:1713279306.788005:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.788006:0:15507:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:0.0:1713279306.788008:0:15507:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009661ad80 reply state ffff8801302e2000 transno 4295183654 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda8550 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00000100:00100000:1.0:1713279306.788010:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98729 00010000:00010000:0.0:1713279306.788012:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda8550 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788014:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x242:0x0].0x0 (ffff880130675b00) 00010000:00010000:0.0:1713279306.788016:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.788016:0:15507:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1713279306.788019:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd7180/0xfc4b8e114eda8557 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda855e expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.788019:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130290380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200033152:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713279306.788023:0:15507:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd7180/0xfc4b8e114eda8557 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda855e expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.788024:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29405 rpc_version 29405 00000004:00080000:0.0:1713279306.788028:0:15507:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x140:0x0] 00000004:00010000:0.0:1713279306.788032:0:15507:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009661ad80 reply state ffff8801302e2000 transno 4295183654 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114eda8542 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00000020:00100000:2.0:1713279306.788032:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.788036:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880131cb6a00 x1796503200033280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1713279306.788039:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114eda8542 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788042:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76ef:0x0].0x0 (ffff880130675200) 00010000:00010000:0.0:1713279306.788043:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.788044:0:15507:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000004:00010000:0.0:1713279306.788047:0:15507:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009661ad80 reply state ffff8801302e2000 transno 4295183654 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00000100:00100000:2.0:1713279306.788047:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200033280:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713279306.788051:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788053:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e09:0x0].0x0 (ffff880135885c00) 00010000:00010000:0.0:1713279306.788055:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1713279306.788056:0:15507:0:(service.c:188:ptlrpc_save_lock()) nlocks 3 00010000:00010000:0.0:1713279306.788058:0:15507:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788061:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788064:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00000100:00100000:2.0:1713279306.788065:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.788077:0:15507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788080:0:15507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.788082:0:15507:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788085:0:15507:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00000100:00100000:2.0:1713279306.788090:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fe40 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.788092:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff88007fcb8a00) 00010000:00010000:0.0:1713279306.788094:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.788095:0:15507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788098:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda8320 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00000004:00010000:0.0:1713279306.788106:0:15507:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009661ad80 reply state ffff8801302e2000 transno 4295183654 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ad00/0xfc4b8e114eda835f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788110:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ad00/0xfc4b8e114eda835f lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788113:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x3131 (ffff880089dc2800) 00010000:00010000:0.0:1713279306.788114:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.788114:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200033280 00000100:00100000:0.0:1713279306.788115:0:15507:0:(service.c:188:ptlrpc_save_lock()) nlocks 4 00010000:00010000:0.0:1713279306.788117:0:15507:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981680/0xfc4b8e114eda8312 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00000100:00100000:1.0:1713279306.788118:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200033280 00010000:00010000:0.0:1713279306.788120:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981680/0xfc4b8e114eda8312 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788123:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981680/0xfc4b8e114eda8312 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788125:0:15507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981680/0xfc4b8e114eda8312 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788128:0:15507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.788129:0:15507:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981680/0xfc4b8e114eda8312 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788134:0:15507:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981680/0xfc4b8e114eda8312 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00000100:00100000:1.0:1713279306.788134:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98730 00010000:00010000:0.0:1713279306.788138:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x0 (ffff88008bde0b00) 00000100:00100000:1.0:1713279306.788138:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+96:8634:x1796503200033280:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713279306.788139:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.788140:0:15507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981680/0xfc4b8e114eda8312 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788142:0:15507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981680/0xfc4b8e114eda8312 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00000004:00010000:0.0:1713279306.788148:0:15507:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009661ad80 reply state ffff8801302e2000 transno 4295183654 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda8319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788152:0:15507:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda8319 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.788154:0:15507:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x3131 (ffff880091714100) 00010000:00010000:0.0:1713279306.788155:0:15507:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.788156:0:15507:0:(service.c:188:ptlrpc_save_lock()) nlocks 5 00000100:00100000:1.0:1713279306.788189:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+97:8634:x1796503200033280:12345-0@lo:1000:osp_up1-0.0 Request processed in 50us (122us total) trans 4295183662 rc 0/0 00000100:00100000:1.0:1713279306.788194:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98730 00000100:00100000:2.0:1713279306.788197:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200033280:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1713279306.788201:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29406 rpc_version 29406 00000020:00100000:2.0:1713279306.788207:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.788210:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880131cb7480 x1796503200033408/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1713279306.788214:0:15507:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.788218:0:15507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.788220:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200033408:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713279306.788221:0:15507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.788232:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.788236:0:15507:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1713279306.788240:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801206710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.788244:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200033408 00000100:00100000:1.0:1713279306.788246:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200033408 00000100:00100000:1.0:1713279306.788256:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98731 00010000:00010000:3.0:1713279306.788258:0:8071:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1713279306.788260:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3424:11666:x1796503281202048:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 34330us (34400us total) trans 4295183654 rc 0/0 00000100:00100000:1.0:1713279306.788260:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+97:8634:x1796503200033408:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713279306.788263:0:8071:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.788266:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14333 00010000:00010000:3.0:1713279306.788269:0:8071:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bfcc0 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.788273:0:8071:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.788278:0:8071:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.788292:0:8071:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.788297:0:8071:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1713279306.788303:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+98:8634:x1796503200033408:12345-0@lo:1000:osp_up1-0.0 Request processed in 42us (69us total) trans 4295183663 rc 0/0 00010000:00010000:3.0:1713279306.788307:0:8071:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.788308:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98731 00000100:00100000:0.0:1713279306.788311:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200033472:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.788313:0:8071:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bfcc0/0xfc4b8e114eda7ece lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda7ed5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.788317:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200033408:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713279306.788321:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.788322:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1713279306.788323:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29407 rpc_version 29407 00000100:00100000:0.0:1713279306.788324:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.788324:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00100000:2.0:1713279306.788330:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.788334:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880131cb4380 x1796503200033600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1713279306.788336:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200033472 00000100:00100000:1.0:1713279306.788338:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200033472 00000100:00100000:2.0:1713279306.788344:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb4380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200033600:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1713279306.788346:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda7ed5 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda7ece expref: 62 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.788364:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.788366:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196508 00000100:00100000:1.0:1713279306.788368:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+62:3493:x1796503200033472:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.788372:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fe40 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.788373:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.788377:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda7ed5 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda7ece expref: 62 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.788385:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda7ed5 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda7ece expref: 62 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.788390:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.788393:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.788398:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.788401:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.788404:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800923433c0/0xfc4b8e114eda801e lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8017 expref: 61 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.788428:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.788429:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.788432:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00000100:00100000:1.0:1713279306.788445:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+61:3493:x1796503200033472:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.788448:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196508 00000100:00100000:1.0:1713279306.788457:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200033600 00000100:00100000:1.0:1713279306.788459:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200033600 00000100:00100000:1.0:1713279306.788466:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98732 00000100:00100000:1.0:1713279306.788469:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+98:8634:x1796503200033600:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713279306.788497:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8565 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.788502:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8565 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.788505:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8565 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:1.0:1713279306.788505:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+99:8634:x1796503200033600:12345-0@lo:1000:osp_up1-0.0 Request processed in 35us (141us total) trans 4295183664 rc 0/0 00000100:00100000:1.0:1713279306.788509:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98732 00010000:00010000:0.0:1713279306.788510:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda856c lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.788514:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda856c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.788517:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda856c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713279306.788520:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb4380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200033600:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713279306.788522:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda8573 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x231:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00000004:00080000:2.0:1713279306.788524:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29408 rpc_version 29408 00010000:00010000:0.0:1713279306.788525:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda8573 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.788530:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda8573 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000020:00100000:2.0:1713279306.788531:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.788534:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880131cb5500 x1796503200033728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1713279306.788535:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda857a lrc: 3/0,1 mode: --/PW res: [0x200000400:0x231:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.788538:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda857a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713279306.788540:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200033728:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713279306.788541:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda857a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.788553:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8584:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713279306.788555:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.788559:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7e6c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x8584:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175628 expref: 3713 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.788561:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801206710c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.788562:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00000100:00100000:1.0:1713279306.788564:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200033728 00000100:00100000:1.0:1713279306.788566:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200033728 00010000:00010000:0.0:1713279306.788573:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7e6c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x8584:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175628 expref: 3713 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.788578:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98733 00010000:00010000:0.0:1713279306.788579:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7e6c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x8584:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175628 expref: 3713 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.788580:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+99:8634:x1796503200033728:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.788585:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130290000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200033792:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.788601:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.788616:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012cd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200033472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.788623:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+100:8634:x1796503200033728:12345-0@lo:1000:osp_up1-0.0 Request processed in 42us (67us total) trans 4295183665 rc 0/0 00000100:00100000:1.0:1713279306.788627:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98733 00000100:00100000:3.0:1713279306.788657:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200033728:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1713279306.788663:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29409 rpc_version 29409 00000020:00100000:3.0:1713279306.788670:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.788673:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012cd19c00 x1796503200033920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.788682:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd19c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200033920:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.788700:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.788715:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb0300 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.788727:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200033920 00000100:00100000:1.0:1713279306.788729:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200033920 00000100:00100000:1.0:1713279306.788738:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98734 00000100:00100000:1.0:1713279306.788741:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+100:8634:x1796503200033920:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.788778:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+101:8634:x1796503200033920:12345-0@lo:1000:osp_up1-0.0 Request processed in 37us (78us total) trans 4295183666 rc 0/0 00000100:00100000:1.0:1713279306.788782:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98734 00000100:00100000:3.0:1713279306.788790:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012cd19c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200033920:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1713279306.788795:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29410 rpc_version 29410 00000020:00100000:3.0:1713279306.788801:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.788805:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012227c380 x1796503200034048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.788813:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034048:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.788827:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.788833:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801206710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.788836:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200034048 00000100:00100000:1.0:1713279306.788838:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200034048 00000100:00100000:1.0:1713279306.788845:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98735 00000100:00100000:1.0:1713279306.788848:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+101:8634:x1796503200034048:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.788882:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+102:8634:x1796503200034048:12345-0@lo:1000:osp_up1-0.0 Request processed in 34us (54us total) trans 4295183667 rc 0/0 00000100:00100000:1.0:1713279306.788886:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98735 00000100:00100000:3.0:1713279306.788893:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034048:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1713279306.788898:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29411 rpc_version 29411 00000020:00100000:3.0:1713279306.788904:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.788907:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012227fb80 x1796503200034176/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.788915:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034176:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.788930:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.788935:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb0300 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.788942:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200034176 00000100:00100000:1.0:1713279306.788945:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200034176 00000100:00100000:1.0:1713279306.788959:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98736 00000100:00100000:1.0:1713279306.788962:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+102:8634:x1796503200034176:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.789017:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+103:8634:x1796503200034176:12345-0@lo:1000:osp_up1-0.0 Request processed in 52us (85us total) trans 4295183668 rc 0/0 00000100:00100000:1.0:1713279306.789023:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98736 00000100:00100000:3.0:1713279306.789024:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034176:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1713279306.789028:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29412 rpc_version 29412 00000020:00100000:3.0:1713279306.789035:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.789038:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012227c700 x1796503200034304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.789046:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034304:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.789060:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.789066:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801206710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.789085:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200034304 00000100:00100000:1.0:1713279306.789088:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200034304 00000100:00100000:1.0:1713279306.789099:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98737 00000100:00100000:1.0:1713279306.789103:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+103:8634:x1796503200034304:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.789151:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+104:8634:x1796503200034304:12345-0@lo:1000:osp_up1-0.0 Request processed in 47us (89us total) trans 4295183669 rc 0/0 00000100:00100000:1.0:1713279306.789157:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98737 00000100:00100000:3.0:1713279306.789163:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034304:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1713279306.789168:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29413 rpc_version 29413 00000020:00100000:3.0:1713279306.789175:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.789178:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009387c380 x1796503200034432/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.789186:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034432:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.789201:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.789207:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb0300 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.789216:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200034432 00000100:00100000:1.0:1713279306.789220:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200034432 00000100:00100000:1.0:1713279306.789234:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98738 00000100:00100000:1.0:1713279306.789238:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+104:8634:x1796503200034432:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.789288:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+105:8634:x1796503200034432:12345-0@lo:1000:osp_up1-0.0 Request processed in 49us (85us total) trans 4295183670 rc 0/0 00000100:00100000:1.0:1713279306.789294:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98738 00000100:00100000:3.0:1713279306.789298:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034432:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1713279306.789303:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29414 rpc_version 29414 00000020:00100000:3.0:1713279306.789309:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.789312:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009387c000 x1796503200034560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.789320:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034560:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.789334:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.789340:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801206710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.789345:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200034560 00000100:00100000:1.0:1713279306.789347:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200034560 00000100:00100000:1.0:1713279306.789357:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98739 00000100:00100000:1.0:1713279306.789360:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+105:8634:x1796503200034560:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.789406:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+106:8634:x1796503200034560:12345-0@lo:1000:osp_up1-0.0 Request processed in 45us (71us total) trans 4295183671 rc 0/0 00000100:00100000:1.0:1713279306.789428:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98739 00000100:00100000:3.0:1713279306.789430:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034560:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1713279306.789435:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29415 rpc_version 29415 00000020:00100000:3.0:1713279306.789441:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.789444:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009387ce00 x1796503200034688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.789452:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034688:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.789467:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.789473:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb0300 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.789478:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200034688 00000100:00100000:1.0:1713279306.789480:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200034688 00000100:00100000:1.0:1713279306.789492:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98740 00000100:00100000:1.0:1713279306.789495:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+106:8634:x1796503200034688:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.789535:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+107:8634:x1796503200034688:12345-0@lo:1000:osp_up1-0.0 Request processed in 39us (67us total) trans 4295183672 rc 0/0 00000100:00100000:1.0:1713279306.789538:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98740 00000100:00100000:3.0:1713279306.789545:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034688:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1713279306.789550:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29416 rpc_version 29416 00000020:00100000:3.0:1713279306.789556:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.789559:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009387ca80 x1796503200034816/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.789567:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034816:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.789580:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.789586:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801206710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.789590:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200034816 00000100:00100000:1.0:1713279306.789592:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200034816 00000100:00100000:1.0:1713279306.789599:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98741 00000100:00100000:1.0:1713279306.789601:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+107:8634:x1796503200034816:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.789634:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+108:8634:x1796503200034816:12345-0@lo:1000:osp_up1-0.0 Request processed in 32us (53us total) trans 4295183673 rc 0/0 00000100:00100000:1.0:1713279306.789638:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98741 00000100:00100000:3.0:1713279306.789645:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034816:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1713279306.789649:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29417 rpc_version 29417 00000020:00100000:3.0:1713279306.789655:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.789659:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009387e300 x1796503200034944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.789666:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034944:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.789681:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.789687:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb0300 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.789690:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200034944 00000100:00100000:1.0:1713279306.789691:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200034944 00000100:00100000:1.0:1713279306.789698:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98742 00000100:00100000:1.0:1713279306.789701:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+108:8634:x1796503200034944:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.789732:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+109:8634:x1796503200034944:12345-0@lo:1000:osp_up1-0.0 Request processed in 30us (51us total) trans 4295183674 rc 0/0 00000100:00100000:1.0:1713279306.789735:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98742 00000100:00100000:3.0:1713279306.789743:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200034944:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1713279306.789747:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29418 rpc_version 29418 00000020:00100000:3.0:1713279306.789753:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.789756:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008be06300 x1796503200035072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.789764:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be06300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200035072:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.789779:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.789785:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801206710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.789788:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200035072 00000100:00100000:1.0:1713279306.789790:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200035072 00000100:00100000:1.0:1713279306.789797:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98743 00000100:00100000:1.0:1713279306.789799:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+109:8634:x1796503200035072:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.789831:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+110:8634:x1796503200035072:12345-0@lo:1000:osp_up1-0.0 Request processed in 31us (52us total) trans 4295183675 rc 0/0 00000100:00100000:1.0:1713279306.789837:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98743 00000100:00100000:3.0:1713279306.789842:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be06300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200035072:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1713279306.789846:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29419 rpc_version 29419 00000020:00100000:3.0:1713279306.789853:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.789856:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008be05c00 x1796503200035200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.789864:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be05c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200035200:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.789881:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.789881:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.789887:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.789889:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb0300 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.789890:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200035200 00000100:00100000:1.0:1713279306.789892:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200035200 00000100:00100000:0.0:1713279306.789895:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.789902:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281215488 00000100:00100000:1.0:1713279306.789903:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281215488 00000100:00100000:3.0:1713279306.789904:0:15484:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f280000 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000_UUID:15484:1796503200031616:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.789906:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.789910:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114ed9c66d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x7f51:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172368 expref: 3721 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.789912:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.789915:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281216320 00000100:00100000:3.0:1713279306.789917:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281216320 00000100:00100000:2.0:1713279306.789922:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281215616 00000100:00100000:2.0:1713279306.789924:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281215616 00000100:00100000:1.0:1713279306.789926:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196509 00000100:00100000:0.0:1713279306.789927:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.789929:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3721:1957:x1796503281215488:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.789930:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281216512 00000100:00100000:3.0:1713279306.789932:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281216512 00010000:00010000:1.0:1713279306.789934:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.789937:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114ed9c66d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x7f51:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172368 expref: 3721 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.789937:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223033 00000100:00100000:3.0:1713279306.789940:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281216768 00000100:00100000:2.0:1713279306.789942:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:11882:x1796503281215616:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:3.0:1713279306.789942:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281216768 00010000:00010000:1.0:1713279306.789943:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114ed9c66d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7f51:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172368 expref: 3721 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.789950:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114ed9c66d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7f51:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172368 expref: 3722 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.789953:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785122 00010000:00010000:1.0:1713279306.789957:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f51:0x0].0x0 (ffff8800940a8800) 00000100:00100000:3.0:1713279306.789957:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3425:11204:x1796503281216320:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.789961:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.789964:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.789966:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.789972:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.789972:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc480/0xfc4b8e114eda8588 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391757f6 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.789978:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281216896 00010000:00010000:1.0:1713279306.789980:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.789981:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281216896 00010000:00010000:1.0:1713279306.789985:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.789990:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.789994:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.789996:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785123 00010000:00010000:1.0:1713279306.789999:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.790000:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3426:11666:x1796503281216512:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.790007:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.790011:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:11882:x1796503281215616:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 68us (97us total) trans 4295202663 rc 0/0 00010000:00010000:0.0:1713279306.790015:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda858f lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391757fd expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.790018:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3721:1957:x1796503281215488:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 85us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.790018:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223033 00010000:00010000:3.0:1713279306.790020:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda8596 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.790024:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196509 00010000:00010000:3.0:1713279306.790027:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda8596 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.790034:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda8596 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.790039:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda859d lrc: 3/1,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.790043:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785124 00010000:00010000:3.0:1713279306.790043:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda85a4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.790044:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda859d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00000100:00100000:2.0:1713279306.790045:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.790047:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3720:11893:x1796503281216768:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.790049:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda859d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.790053:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda85ab lrc: 3/1,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.790053:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda85a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.790057:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda85ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.790058:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda85a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.790061:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda85ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.790062:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281215680 00000100:00100000:1.0:1713279306.790065:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281215680 00000004:00200000:3.0:1713279306.790087:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:0.0:1713279306.790093:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda859d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.790094:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda8596 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.790095:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147241 00010000:00010000:0.0:1713279306.790097:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda859d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.790100:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda859d lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.790100:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b25eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3721:1956:x1796503281215680:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.790100:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda8596 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.790103:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda859d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.790104:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda8596 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.790106:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a5b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.790106:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.790107:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda859d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.790109:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda8596 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.790110:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda859d lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.790114:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda84af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757b7 expref: 3721 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.790114:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.790115:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff880096e84000) 00010000:00010000:0.0:1713279306.790116:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.790117:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda8596 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.790118:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda859d lrc: 3/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.790121:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114eda859d lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00000100:00100000:2.0:1713279306.790121:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.790122:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:3.0:1713279306.790122:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda8596 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.790125:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.790126:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda85ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.790128:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda85ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.790129:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:0.0:1713279306.790131:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda85ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.790131:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.790134:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092541440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.790134:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda8596 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.790136:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda85ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.790139:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda85ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279306.790139:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b25eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3720:1956:x1796503281215680:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 39us (94us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.790139:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcb40/0xfc4b8e114eda8596 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.790143:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x3131 (ffff880089dc2800) 00010000:00010000:0.0:1713279306.790144:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.790144:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147241 00010000:00010000:0.0:1713279306.790145:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda85ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.790148:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda85ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.790150:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda85a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.790156:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda85a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.790158:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda858f lrc: 1/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757fd expref: 3427 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.790161:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda85a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.790162:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda858f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757fd expref: 3427 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.790166:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.790167:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4a5f80, rc 0) 00010000:00010000:3.0:1713279306.790169:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda85a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.790170:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281215744 00000100:00100000:1.0:1713279306.790172:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281215744 00010000:00010000:3.0:1713279306.790173:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda85a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.790176:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.790179:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880092ae7100) 00000100:00100000:0.0:1713279306.790182:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3426:11666:x1796503281216512:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 182us (286us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.790182:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.790186:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785123 00010000:00010000:3.0:1713279306.790186:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda85a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.790191:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be1c0/0xfc4b8e114eda85a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.790195:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785125 00000100:00100000:1.0:1713279306.790199:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3684:11711:x1796503281216896:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.790203:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785126 00000100:00100000:0.0:1713279306.790206:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3720:11874:x1796503281215744:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.790207:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.790211:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.790212:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc480/0xfc4b8e114eda8588 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757f6 expref: 3425 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.790216:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114eda85b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391757e8 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.790216:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda85b2 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917580b expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.790217:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.790220:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc480/0xfc4b8e114eda8588 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757f6 expref: 3425 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.790227:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bc480, rc 0) 00000100:00100000:2.0:1713279306.790229:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.790236:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda85c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.790241:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda85c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.790241:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281215872 00000100:00100000:3.0:1713279306.790244:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281215872 00010000:00010000:0.0:1713279306.790245:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda85c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.790247:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda85c7 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.790250:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda85ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.790253:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda85ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.790254:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869200/0xfc4b8e114ed9ddc0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391729b9 expref: 3715 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.790255:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda85c7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.790256:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.790257:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda85ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.790261:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda85c7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.790266:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281215808 00000100:00100000:3.0:1713279306.790268:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281215808 00010000:00010000:1.0:1713279306.790269:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda85d5 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.790270:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.790274:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda85d5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.790274:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda77c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175468 expref: 3716 pid: 15473 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.790279:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda85dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.790280:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda85d5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.790281:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.790282:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda85dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.790286:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda85dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.790292:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281215936 00000100:00100000:3.0:1713279306.790294:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281215936 00010000:00010000:1.0:1713279306.790295:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda85c7 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.790298:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281216064 00010000:00010000:1.0:1713279306.790300:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda85c7 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.790300:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281216064 00010000:00010000:3.0:1713279306.790302:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114ed9ba65 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39171fd3 expref: 3722 pid: 15481 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.790305:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda85c7 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.790308:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda5fda lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c3b expref: 3717 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.790310:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda85c7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00000004:00200000:0.0:1713279306.790311:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.790313:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1713279306.790313:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196510 00010000:00010000:1.0:1713279306.790315:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.790317:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda85c7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.790317:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:1956:x1796503281215872:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000004:00010000:0.0:1713279306.790318:0:15483:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda85dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.790321:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda85c7 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.790321:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196511 00010000:00010000:0.0:1713279306.790323:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda85c0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.790324:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.790325:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880130675a00) 00000100:00100000:2.0:1713279306.790325:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:1956:x1796503281215808:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.790326:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda85c0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.790326:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.790328:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda85c7 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.790328:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869200/0xfc4b8e114ed9ddc0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391729b9 expref: 3717 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.790329:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda85c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.790330:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.790331:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7a80/0xfc4b8e114eda85c7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.790332:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda85c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.790334:0:15496:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda77c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175468 expref: 3717 pid: 15473 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.790335:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.790335:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869200/0xfc4b8e114ed9ddc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391729b9 expref: 3717 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.790336:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda85c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.790337:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda85d5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.790339:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda85c0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.790340:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda85d5 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.790342:0:15496:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda77c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175468 expref: 3717 pid: 15473 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.790343:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.790343:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda85d5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.790344:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.790345:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.790346:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda85c0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.790347:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda85d5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.790348:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114eda85c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.790352:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda85d5 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.790352:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f51:0x0].0x0 (ffff8800940a8800) 00010000:00010000:0.0:1713279306.790353:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda85ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.790355:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda85ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.790355:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880130675700) 00010000:00010000:3.0:1713279306.790355:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.790357:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.790358:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda85ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.790358:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda85d5 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.790360:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda85d5 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.790361:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092542880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.790361:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.790363:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda85ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.790366:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda85ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.790368:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.790369:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff880096e84900) 00010000:00010000:0.0:1713279306.790370:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.790372:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda85ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.790373:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda85b2 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917580b expref: 3685 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.790373:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.790374:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114eda85ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.790377:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda85b2 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917580b expref: 3685 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.790377:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.790381:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.790382:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd73c0, rc 0) 00010000:00010000:0.0:1713279306.790385:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114eda85b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757e8 expref: 3723 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.790385:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.790388:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.790389:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f51:0x0].0x0 (ffff8800940a8800) 00010000:00010000:0.0:1713279306.790390:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda85dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757e8 expref: 3722 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.790391:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.790393:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:0.0:1713279306.790394:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713279306.790395:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092540240, rc 0) 00000100:00100000:1.0:1713279306.790396:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3684:11711:x1796503281216896:12345-192.168.203.4@tcp:101:touch.0 Request processed in 197us (469us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.790396:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.790400:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785125 00010000:00010000:2.0:1713279306.790400:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.790403:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:1956:x1796503281215872:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 85us (227us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.790406:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.790407:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281216128 00000100:00100000:3.0:1713279306.790408:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196510 00000100:00100000:0.0:1713279306.790409:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3722:11874:x1796503281215744:12345-192.168.203.4@tcp:101:touch.0 Request processed in 202us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.790409:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281216128 00010000:00010000:2.0:1713279306.790428:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.790430:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785126 00010000:00010000:2.0:1713279306.790433:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.790436:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196512 00010000:00010000:2.0:1713279306.790438:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.790439:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785127 00000100:00100000:3.0:1713279306.790440:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3721:1956:x1796503281215936:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.790442:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3684:11854:x1796503281216128:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.790443:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.790446:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.790447:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.790450:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114ed9ba65 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39171fd3 expref: 3721 pid: 15481 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.790453:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda85e3 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391757ef expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.790454:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196513 00000100:00100000:0.0:1713279306.790457:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:1954:x1796503281216064:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.790457:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114ed9ba65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39171fd3 expref: 3721 pid: 15481 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.790458:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:1956:x1796503281215808:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 132us (240us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.790463:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.790464:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196511 00010000:00010000:0.0:1713279306.790466:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda5fda lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c3b expref: 3716 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.790466:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f51:0x0].0x0 (ffff8800940a8800) 00010000:00010000:3.0:1713279306.790469:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.790470:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda85ea lrc: 3/1,0 mode: --/PR res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.790472:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda5fda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c3b expref: 3715 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.790475:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda85ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.790475:0:15557:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.790478:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ff8:0x0].0x0 (ffff880089dc3f00) 00010000:00010000:1.0:1713279306.790478:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda85ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.790479:0:15557:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.790480:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda84e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.790485:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda84e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.790487:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.790487:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:1.0:1713279306.790492:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x252:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.790494:0:6929:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 4 MDT count 2 00000100:00100000:2.0:1713279306.790496:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.790497:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:1954:x1796503281216064:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 40us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.790501:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196513 00000100:00100000:3.0:1713279306.790502:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3721:1956:x1796503281215936:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 61us (271us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.790504:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda85e3 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757ef expref: 3686 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.790506:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281216192 00000100:00100000:3.0:1713279306.790507:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196512 00000100:00100000:0.0:1713279306.790508:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281216192 00010000:00010000:1.0:1713279306.790511:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda85ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757ef expref: 3685 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.790514:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009181cb40/0xfc4b8e114eda573d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c11 expref: 3721 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.790514:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x0 (ffff88012514da00) 00010000:00010000:1.0:1713279306.790516:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1713279306.790517:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd6d00, rc 0) 00000100:00100000:0.0:1713279306.790522:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196514 00000100:00100000:0.0:1713279306.790524:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3721:1954:x1796503281216192:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.790527:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.790530:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009181cb40/0xfc4b8e114eda573d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c11 expref: 3721 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.790531:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3685:11854:x1796503281216128:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 87us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.790534:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785127 00010000:00010000:0.0:1713279306.790535:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009181cb40/0xfc4b8e114eda573d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c11 expref: 3721 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.790542:0:15479:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c03100 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:15479:1796503200032448:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.790543:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ff8:0x0].0x0 (ffff880089dc3f00) 00010000:00010000:0.0:1713279306.790545:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda84e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.790548:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda84e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.790548:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.790550:0:15479:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.790551:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda84e7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.790553:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114eda85f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175804 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.790556:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.790564:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3722:1954:x1796503281216192:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 39us (69us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.790566:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda77c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175468 expref: 3714 pid: 15473 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.790568:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196514 00010000:00010000:1.0:1713279306.790570:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda85f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.790574:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.790574:0:15484:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f283b80 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000_UUID:15484:1796503200031744:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.790576:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281216000 00000100:00100000:0.0:1713279306.790578:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281216000 00010000:00010000:1.0:1713279306.790578:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda85f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.790582:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda85f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.790582:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869200/0xfc4b8e114ed9ddc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391729b9 expref: 3713 pid: 15474 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.790586:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110479 00010000:00010000:1.0:1713279306.790587:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114eda85ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:0.0:1713279306.790588:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+80:1956:x1796503281216000:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:3.0:1713279306.790590:0:15484:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f281f80 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000_UUID:15484:1796503200031808:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.790591:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114eda85ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.790594:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114eda85ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.790595:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.790598:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114ed9ba65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39171fd3 expref: 3721 pid: 15481 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.790604:0:15484:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f281180 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000_UUID:15484:1796503200031936:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.790611:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281216384 00000100:00100000:1.0:1713279306.790613:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281216384 00010000:00010000:1.0:1713279306.790619:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114ed9dd11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172981 expref: 3721 pid: 6934 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.790622:0:15484:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.790624:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.790627:0:15484:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.790629:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281216640 00000100:00100000:1.0:1713279306.790630:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281216640 00010000:00010000:3.0:1713279306.790632:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.790635:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda4936 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391748bb expref: 3425 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.790641:0:15655:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281216576 00000100:00100000:1.0:1713279306.790642:0:15655:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281216576 00002000:00010000:0.0:1713279306.790646:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0xfb2:0x0] updating lvb size from disk: 786432 -> 4259840 00010000:00010000:1.0:1713279306.790646:0:15655:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda5bab lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174d4c expref: 3685 pid: 15753 timeout: 509 lvb_type: 0 00002000:00010000:0.0:1713279306.790648:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xfb2:0x0] updating lvb mtime from disk: 1713279300 -> 1713279305 00002000:00010000:0.0:1713279306.790649:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0xfb2:0x0] updating lvb atime from disk: 1713279291 -> 1713279305 00002000:00010000:0.0:1713279306.790651:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0xfb2:0x0] updating lvb ctime from disk: 1713279300 -> 1713279305 00002000:00010000:0.0:1713279306.790652:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0xfb2:0x0] updating lvb blocks from disk: 0 -> 6784 00000100:00100000:1.0:1713279306.790661:0:15655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196515 00000100:00100000:0.0:1713279306.790663:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+81:1956:x1796503281216000:12345-192.168.203.4@tcp:2:touch.0 Request processed in 74us (407us total) trans 4295010175 rc 0/0 00000100:00100000:1.0:1713279306.790664:0:15655:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3721:1957:x1796503281216384:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.790667:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110479 00010000:00010000:1.0:1713279306.790668:0:15655:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.790668:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.790671:0:15655:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114ed9dd11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172981 expref: 3721 pid: 6934 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.790674:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.790676:0:15655:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114ed9dd11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172981 expref: 3721 pid: 6934 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.790677:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196516 00010000:00010000:3.0:1713279306.790679:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.790681:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b25ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3425:1957:x1796503281216640:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.790682:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196517 00010000:00010000:1.0:1713279306.790683:0:15655:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114ed9dd11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172981 expref: 3721 pid: 6934 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.790683:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935beac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.790685:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.790685:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.790688:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda4936 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391748bb expref: 3425 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.790688:0:15655:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ede:0x0].0x0 (ffff88008e4c8000) 00000100:00100000:2.0:1713279306.790688:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:385c4b71-808c-40cf-91de-b076b668d13f+3685:1957:x1796503281216576:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.790690:0:15655:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.790691:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.790693:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda4936 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391748bb expref: 3425 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.790694:0:15655:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.790695:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.790697:0:15655:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.790698:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f51:0x0].0x0 (ffff8800940a8800) 00010000:00010000:0.0:1713279306.790699:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b15:0x0].0x0 (ffff880090884a00) 00010000:00010000:2.0:1713279306.790700:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda5bab lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174d4c expref: 3685 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.790700:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:0.0:1713279306.790701:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda853b lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.790702:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.790704:0:15655:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.790705:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda853b lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.790707:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935beac0/0xfc4b8e114eda84bd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7f51:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.790708:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.790710:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda5bab lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174d4c expref: 3685 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.790715:0:15655:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:385c4b71-808c-40cf-91de-b076b668d13f+3720:1957:x1796503281216384:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 51us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.790716:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b25ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3425:1957:x1796503281216640:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 34us (120us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.790716:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda84b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.790719:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196516 00010000:00010000:2.0:1713279306.790719:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b15:0x0].0x0 (ffff880090884a00) 00000100:00100000:1.0:1713279306.790721:0:15655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196515 00010000:00010000:3.0:1713279306.790721:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda84b6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.790722:0:9215:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda853b lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.790726:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda84b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.790728:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda853b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.790730:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bf180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.790733:0:9215:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda853b lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.790733:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda84b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.790734:0:15514:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880130290000 x1796503200033792) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7e6c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x8584:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175628 expref: 3712 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.790737:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda84b6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.790739:0:15479:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.790740:0:15514:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7e6c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x8584:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175628 expref: 3712 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.790740:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.790743:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.790743:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.790745:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.790746:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda7e6c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x8584:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175628 expref: 3712 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.790747:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda84b6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.790751:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda84b6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.790752:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130290000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200033792:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.790754:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:385c4b71-808c-40cf-91de-b076b668d13f+3685:1957:x1796503281216576:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 66us (130us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.790759:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8584:0x0].0x0 (ffff8800908e1f00) 00000100:00100000:2.0:1713279306.790759:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196517 00010000:00010000:0.0:1713279306.790761:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.790764:0:15514:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.790767:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.790772:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713279306.790772:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:10123:x1796503281214272:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 5415us (5456us total) trans 0 rc -114/-114 00000004:00010000:1.0:1713279306.790774:0:15479:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880122c00000 reply state ffff88012c0b3000 transno 4295202664 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.790776:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.790778:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713279306.790778:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785113 00010000:00010000:1.0:1713279306.790781:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.790784:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ede:0x0].0x0 (ffff88008e4c8000) 00010000:00010000:1.0:1713279306.790786:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.790787:0:15479:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713279306.790802:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.790808:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3424:11204:x1796503281216320:12345-192.168.203.4@tcp:101:touch.0 Request processed in 851us (930us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.790813:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785122 00000100:00100000:2.0:1713279306.790815:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281217024 00000100:00100000:1.0:1713279306.790816:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11904:x1796503281215168:12345-192.168.203.4@tcp:36:touch.0 Request processed in 3926us (3982us total) trans 4295202664 rc 0/0 00000100:00100000:2.0:1713279306.790818:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281217024 00000100:00100000:1.0:1713279306.790822:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785119 00000100:00100000:2.0:1713279306.790832:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223034 00010000:00010000:3.0:1713279306.790833:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda5bab lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174d4c expref: 3684 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.790836:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11907:x1796503281217024:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:3.0:1713279306.790843:0:15752:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012cd19500 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001_UUID:15752:1796503200032832:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.790851:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda4936 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7b15:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391748bb expref: 3423 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.790858:0:15752:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012cd18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001_UUID:15752:1796503200032960:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.790868:0:15752:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda853b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.790870:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114eda8606 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000004:00010000:0.0:1713279306.790872:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800900e3480 reply state ffff88008f7c9000 transno 4295202665 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.790874:0:15752:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda853b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.790878:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.790878:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114eda8606 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.790879:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda853b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.790882:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8584:0x0].0x0 (ffff8800908e1f00) 00010000:00010000:0.0:1713279306.790883:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1713279306.790884:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713279306.790884:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114eda8606 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000004:00200000:3.0:1713279306.790886:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7b15:0x0]: returning size 23529 00010000:00010000:0.0:1713279306.790887:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda8573 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.790889:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda8573 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00000004:00200000:1.0:1713279306.790889:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8439:0x0]: returning size 45312 00010000:00010000:0.0:1713279306.790895:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda8573 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713279306.790896:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:11907:x1796503281217024:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 59us (94us total) trans 4295202666 rc 0/0 00010000:00010000:0.0:1713279306.790898:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda8573 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.790900:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a4b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.790902:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda8573 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713279306.790903:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223034 00010000:00010000:0.0:1713279306.790905:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda8573 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.790908:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x0 (ffff880096e84500) 00010000:00010000:0.0:1713279306.790909:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.790910:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda8573 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.790913:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda8573 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.790915:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda85f8 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000004:00010000:0.0:1713279306.790919:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800900e3480 reply state ffff88008f7c9000 transno 4295202665 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda857a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.790919:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda85f8 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.790922:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda857a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.790922:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda85f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.790922:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda8534 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757e1 expref: 3424 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.790925:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x31 (ffff880096e84200) 00010000:00010000:1.0:1713279306.790925:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda85f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.790926:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.790927:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1713279306.790928:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd5680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.790929:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8565 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.790930:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda85f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.790932:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc6c0/0xfc4b8e114eda853b lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757e1 expref: 3423 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.790933:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda85f8 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.790934:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8565 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.790937:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8565 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.790938:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b15:0x0].0x0 (ffff880090884a00) 00010000:00010000:1.0:1713279306.790939:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:0.0:1713279306.790940:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8565 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.790940:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1713279306.790941:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.790942:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d866d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.790942:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bc6c0, rc 0) 00010000:00010000:1.0:1713279306.790943:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda85f8 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.790944:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8565 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.790946:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8565 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.790948:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda85f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.790949:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x0 (ffff880096e84700) 00010000:00010000:0.0:1713279306.790951:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.790952:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8565 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.790954:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d866d00/0xfc4b8e114eda8565 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.790955:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114eda85ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00000100:00100000:3.0:1713279306.790957:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3423:11903:x1796503281215424:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 3314us (3357us total) trans 4295183676 rc 0/0 00000004:00010000:0.0:1713279306.790959:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800900e3480 reply state ffff88008f7c9000 transno 4295202665 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda856c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.790960:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114eda85ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.790962:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda856c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713279306.790962:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785121 00010000:00010000:0.0:1713279306.790965:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x31 (ffff880096e84400) 00010000:00010000:1.0:1713279306.790965:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114eda85ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.790966:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.790967:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:1.0:1713279306.790969:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.790970:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.790972:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114eda85ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.790973:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.790976:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.790976:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114eda85ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.790978:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe17cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.790980:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.790982:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.790982:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3531 (ffff880130675000) 00010000:00010000:1.0:1713279306.790983:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.790985:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.790985:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114eda85ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.790987:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.790989:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800923433c0/0xfc4b8e114eda801e lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8017 expref: 60 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.790993:0:15514:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923433c0/0xfc4b8e114eda801e lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda8017 expref: 60 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.790994:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114eda85ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.790997:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800923433c0/0xfc4b8e114eda801e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda8017 expref: 60 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.791001:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981f80/0xfc4b8e114eda809c lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8064 expref: 60 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.791011:0:15514:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800923433c0/0xfc4b8e114eda801e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8017 expref: 60 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.791016:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114eda85f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175804 expref: 3721 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.791020:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200035264:0@lo:105: 00010000:00010000:1.0:1713279306.791025:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114eda8606 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175804 expref: 3720 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.791030:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8439:0x0].0x0 (ffff8800938abb00) 00010000:00010000:1.0:1713279306.791032:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.791034:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d982d00, rc 0) 00000100:00100000:0.0:1713279306.791036:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.791048:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.791051:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200035264 00000100:00100000:1.0:1713279306.791054:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3720:11893:x1796503281216768:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1006us (1146us total) trans 4295202667 rc 0/0 00000100:00100000:2.0:1713279306.791055:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200035264 00000100:00100000:1.0:1713279306.791059:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785124 00000100:00100000:2.0:1713279306.791086:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33430 00000100:00100000:2.0:1713279306.791090:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15514:x1796503200035264:12345-0@lo:105: 00010000:00010000:2.0:1713279306.791097:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.791100:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda5fda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c3b expref: 3713 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.791103:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.791106:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdc000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9221:1796503200032320:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.791109:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.791112:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009181cb40/0xfc4b8e114eda573d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174c11 expref: 3719 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.791115:0:9213:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.791116:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9221:1796503200032384:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.791120:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.791125:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.791126:0:9221:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda84e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.791130:0:9221:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda84e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.791131:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.791134:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda84e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000004:00200000:1.0:1713279306.791140:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7ff8:0x0]: returning size 13836 00010000:00010000:2.0:1713279306.791142:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880094e34b40) 00010000:00010000:3.0:1713279306.791147:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.791158:0:6942:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.791169:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda84e0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757c5 expref: 3714 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.791170:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15514:x1796503200035264:12345-0@lo:105: Request processed in 79us (133us total) trans 0 rc 0/0 00000004:00080000:3.0:1713279306.791171:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1713279306.791175:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33430 00010000:00010000:1.0:1713279306.791176:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4fc0/0xfc4b8e114eda84e7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757c5 expref: 3713 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.791180:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ff8:0x0].0x0 (ffff880089dc3f00) 00010000:00010000:1.0:1713279306.791181:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1713279306.791182:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd4fc0, rc 0) 00000100:00100000:0.0:1713279306.791188:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200035264:0@lo:105: 00010000:00010000:0.0:1713279306.791196:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 15514 initiator: MDT0 00000100:00100000:1.0:1713279306.791197:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11888:x1796503281214528:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 5444us (5826us total) trans 4295202668 rc 0/0 00010000:00010000:0.0:1713279306.791199:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda7fd1 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 15514 initiator: MDT0 00000100:00100000:1.0:1713279306.791200:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785116 00000100:00100000:0.0:1713279306.791224:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:10814:x1796503281203200:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 34883us (35349us total) trans 4295202665 rc 0/0 00000100:00100000:1.0:1713279306.791224:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98744 00000100:00100000:1.0:1713279306.791227:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+110:8634:x1796503200035200:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.791228:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14334 00010000:00010000:3.0:1713279306.791235:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.791244:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7e50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175605 expref: 3683 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.791250:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 4/0,1 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.791263:0:6942:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7e50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175605 expref: 3683 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.791270:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+111:8634:x1796503200035200:12345-0@lo:1000:osp_up1-0.0 Request processed in 42us (1389us total) trans 4295183677 rc 0/0 00010000:00010000:3.0:1713279306.791270:0:6942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7e50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175605 expref: 3683 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.791274:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98744 00000100:00100000:3.0:1713279306.791279:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be06a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001_UUID:6942:1796503200035328:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.791281:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be05c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200035200:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1713279306.791286:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29420 rpc_version 29420 00000020:00100000:0.0:1713279306.791293:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.791296:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008df04a80 x1796503200035456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.791297:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880095a94780 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.791304:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df04a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200035456:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.791321:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.791327:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.791330:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200035456 00000100:00100000:1.0:1713279306.791333:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200035456 00000100:00100000:1.0:1713279306.791340:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98745 00000100:00100000:1.0:1713279306.791342:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+111:8634:x1796503200035456:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.791377:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+112:8634:x1796503200035456:12345-0@lo:1000:osp_up1-0.0 Request processed in 34us (56us total) trans 4295183678 rc 0/0 00000100:00100000:1.0:1713279306.791381:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98745 00000100:00100000:0.0:1713279306.791386:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df04a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200035456:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1713279306.791389:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29421 rpc_version 29421 00000020:00100000:0.0:1713279306.791395:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.791397:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880097bafb80 x1796503200035584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.791404:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097bafb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200035584:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.791430:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.791437:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.791496:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200035584 00000100:00100000:1.0:1713279306.791499:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200035584 00000100:00100000:1.0:1713279306.791512:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98746 00000100:00100000:1.0:1713279306.791516:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+112:8634:x1796503200035584:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.791570:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+113:8634:x1796503200035584:12345-0@lo:1000:osp_up1-0.0 Request processed in 53us (138us total) trans 4295183679 rc 0/0 00000100:00100000:1.0:1713279306.791574:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98746 00000100:00100000:0.0:1713279306.791589:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097bafb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200035584:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1713279306.791593:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29422 rpc_version 29422 00000020:00100000:0.0:1713279306.791599:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.791601:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880097badf80 x1796503200035712/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.791673:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097badf80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200035712:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.791688:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.791700:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.791721:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200035712 00000100:00100000:1.0:1713279306.791724:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200035712 00000100:00100000:1.0:1713279306.791740:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98747 00000100:00100000:1.0:1713279306.791742:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+113:8634:x1796503200035712:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.791783:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+114:8634:x1796503200035712:12345-0@lo:1000:osp_up1-0.0 Request processed in 39us (94us total) trans 4295183680 rc 0/0 00000100:00100000:1.0:1713279306.791786:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98747 00000100:00100000:0.0:1713279306.791795:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097badf80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200035712:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1713279306.791798:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29423 rpc_version 29423 00000020:00100000:0.0:1713279306.791804:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.791807:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880097bad880 x1796503200035840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.791813:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097bad880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200035840:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.791825:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.791829:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.791833:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200035840 00000100:00100000:1.0:1713279306.791835:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200035840 00000100:00100000:1.0:1713279306.791843:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98748 00000100:00100000:1.0:1713279306.791845:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+114:8634:x1796503200035840:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.791880:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+115:8634:x1796503200035840:12345-0@lo:1000:osp_up1-0.0 Request processed in 34us (54us total) trans 4295183681 rc 0/0 00000100:00100000:1.0:1713279306.791883:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98748 00000100:00100000:0.0:1713279306.791889:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097bad880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200035840:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1713279306.791893:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29424 rpc_version 29424 00000020:00100000:0.0:1713279306.791898:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.791900:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880097a1b800 x1796503200035968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.791905:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200035968:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.791917:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.791922:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.791926:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200035968 00000100:00100000:1.0:1713279306.791928:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200035968 00000100:00100000:1.0:1713279306.791935:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98749 00000100:00100000:1.0:1713279306.791937:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+115:8634:x1796503200035968:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.791989:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+116:8634:x1796503200035968:12345-0@lo:1000:osp_up1-0.0 Request processed in 49us (69us total) trans 4295183682 rc 0/0 00000100:00100000:0.0:1713279306.791993:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200035968:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.791995:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98749 00000004:00080000:0.0:1713279306.791997:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29425 rpc_version 29425 00000020:00100000:0.0:1713279306.792001:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.792003:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880097a1b100 x1796503200036096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.792009:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200036096:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.792021:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.792025:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.792031:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200036096 00000100:00100000:1.0:1713279306.792034:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200036096 00000100:00100000:1.0:1713279306.792047:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98750 00000100:00100000:1.0:1713279306.792050:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+116:8634:x1796503200036096:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.792105:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+117:8634:x1796503200036096:12345-0@lo:1000:osp_up1-0.0 Request processed in 54us (83us total) trans 4295183683 rc 0/0 00000100:00100000:1.0:1713279306.792109:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98750 00000100:00100000:0.0:1713279306.792114:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200036096:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1713279306.792118:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29426 rpc_version 29426 00000020:00100000:0.0:1713279306.792123:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.792125:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880097a18e00 x1796503200036224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.792131:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a18e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200036224:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.792142:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.792147:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.792151:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200036224 00000100:00100000:1.0:1713279306.792153:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200036224 00000100:00100000:1.0:1713279306.792161:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98751 00000100:00100000:1.0:1713279306.792163:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+117:8634:x1796503200036224:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.792197:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+118:8634:x1796503200036224:12345-0@lo:1000:osp_up1-0.0 Request processed in 33us (54us total) trans 4295183684 rc 0/0 00000100:00100000:1.0:1713279306.792201:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98751 00000100:00100000:0.0:1713279306.792204:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a18e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200036224:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1713279306.792208:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29427 rpc_version 29427 00000020:00100000:0.0:1713279306.792212:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.792214:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880097a18380 x1796503200036352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.792220:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a18380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200036352:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.792230:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.792235:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.792239:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200036352 00000100:00100000:1.0:1713279306.792241:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200036352 00000100:00100000:1.0:1713279306.792248:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98752 00000100:00100000:1.0:1713279306.792250:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+118:8634:x1796503200036352:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.792282:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+119:8634:x1796503200036352:12345-0@lo:1000:osp_up1-0.0 Request processed in 31us (51us total) trans 4295183685 rc 0/0 00000100:00100000:1.0:1713279306.792285:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98752 00000100:00100000:0.0:1713279306.792290:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a18380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200036352:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1713279306.792293:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29428 rpc_version 29428 00000020:00100000:0.0:1713279306.792297:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.792299:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880097a19500 x1796503200036480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.792305:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200036480:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.792315:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.792320:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.792323:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200036480 00000100:00100000:1.0:1713279306.792325:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200036480 00000100:00100000:1.0:1713279306.792333:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98753 00000100:00100000:1.0:1713279306.792335:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+119:8634:x1796503200036480:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.792385:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+120:8634:x1796503200036480:12345-0@lo:1000:osp_up1-0.0 Request processed in 47us (67us total) trans 4295183686 rc 0/0 00000100:00100000:1.0:1713279306.792391:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98753 00000100:00100000:0.0:1713279306.792394:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.792400:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200036480:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.792406:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281217152 00000004:00080000:2.0:1713279306.792406:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29429 rpc_version 29429 00000100:00100000:1.0:1713279306.792408:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281217152 00000020:00100000:2.0:1713279306.792433:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.792438:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880095212d80 x1796503200036608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1713279306.792440:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785128 00000100:00100000:1.0:1713279306.792443:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11935:x1796503281217152:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.792449:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.792450:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095212d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200036608:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1713279306.792454:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda8629 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175812 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.792469:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.792477:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606c180 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.792479:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200036608 00010000:00010000:1.0:1713279306.792490:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda8630 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792495:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda8630 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792500:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda8630 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792507:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda8637 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792510:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda8637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792513:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda8637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792529:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda863e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.792530:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200036608 00010000:00010000:1.0:1713279306.792533:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda863e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792536:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda863e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000004:00200000:1.0:1713279306.792540:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x8235:0x0]: returning size 12827 00000100:00100000:2.0:1713279306.792555:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.792558:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda8630 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792562:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda8630 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792564:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda8630 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792567:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda8630 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792570:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.792571:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda8630 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.792571:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98754 00010000:00010000:1.0:1713279306.792574:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda8630 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.792576:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+120:8634:x1796503200036608:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1713279306.792578:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.792580:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.792581:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda8630 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792584:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda8630 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.792588:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281217280 00000100:00100000:0.0:1713279306.792590:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281217280 00010000:00010000:1.0:1713279306.792591:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda8637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792595:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda8637 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792598:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda8637 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792600:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d9821c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.792601:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda8637 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.792602:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785129 00010000:00010000:1.0:1713279306.792604:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda8637 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.792605:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3423:11666:x1796503281217280:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.792607:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x37 (ffff880130675e00) 00010000:00010000:1.0:1713279306.792608:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.792608:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.792609:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda8637 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792611:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.792612:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda8637 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792617:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda864c lrc: 2/0,0 mode: --/CR res: [0x240000400:0x261:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175819 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.792626:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda8629 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175812 expref: 3716 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.792631:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda863e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175812 expref: 3715 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.792634:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8235:0x0].0x0 (ffff880096da6c00) 00010000:00010000:1.0:1713279306.792635:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.792637:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d9818c0, rc 0) 00000100:00100000:3.0:1713279306.792637:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+121:8634:x1796503200036608:12345-0@lo:1000:osp_up1-0.0 Request processed in 60us (166us total) trans 4295183687 rc 0/0 00010000:00010000:0.0:1713279306.792639:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8653 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x261:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.792642:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98754 00010000:00010000:0.0:1713279306.792644:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8653 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.792648:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8653 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.792653:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda865a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.792653:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:11935:x1796503281217152:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 209us (260us total) trans 4295202669 rc 0/0 00000100:00100000:2.0:1713279306.792653:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095212d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200036608:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713279306.792657:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda865a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.792657:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785128 00010000:00010000:0.0:1713279306.792660:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda865a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.792664:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281217408 00000100:00100000:1.0:1713279306.792666:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281217408 00000100:00100000:1.0:1713279306.792674:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785130 00000100:00100000:1.0:1713279306.792677:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3719:11711:x1796503281217408:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.792681:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.792686:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980000/0xfc4b8e114eda8661 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175820 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713279306.792711:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76ef:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.792720:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda866f lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792724:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda866f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792728:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda866f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792732:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8653 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.792733:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda8676 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792735:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8653 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.792737:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda8676 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792738:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8653 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.792740:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda8676 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792741:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8653 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.792743:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.792745:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8653 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000004:00200000:1.0:1713279306.792747:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:0.0:1713279306.792748:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8653 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.792751:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda866f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792753:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x0 (ffff880096e84600) 00010000:00010000:0.0:1713279306.792754:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.792756:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8653 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.792756:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda866f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792758:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8653 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.792761:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda866f lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792766:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda865a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.792766:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda866f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792769:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda865a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.792770:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.792772:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda865a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.792772:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda866f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792774:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925421c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.792775:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda865a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.792777:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda866f lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792778:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda865a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.792781:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x3131 (ffff880091714100) 00010000:00010000:0.0:1713279306.792782:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.792784:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda865a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.792784:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880130675800) 00010000:00010000:0.0:1713279306.792786:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda865a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.792786:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.792788:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda866f lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792792:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114eda866f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792799:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda864c lrc: 1/0,0 mode: --/CR res: [0x240000400:0x261:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175819 expref: 3425 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.792800:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda8676 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792803:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda864c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x261:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175819 expref: 3425 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.792805:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda8676 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.792809:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925433c0, rc 0) 00010000:00010000:1.0:1713279306.792810:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda8676 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792815:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.792818:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda8676 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.792822:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3424:11666:x1796503281217280:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 217us (268us total) trans 4295183688 rc 301/301 00010000:00010000:1.0:1713279306.792823:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda8676 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792829:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880130675100) 00010000:00010000:1.0:1713279306.792831:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.792833:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda8676 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792838:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114eda8676 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.792855:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980000/0xfc4b8e114eda8661 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175820 expref: 3720 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.792860:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980000/0xfc4b8e114eda8661 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175820 expref: 3720 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.792866:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d980000, rc 0) 00000100:00100000:0.0:1713279306.792876:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785129 00000100:00100000:1.0:1713279306.792884:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3719:11711:x1796503281217408:12345-192.168.203.4@tcp:101:touch.0 Request processed in 205us (276us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.792887:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.792890:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785130 00000100:00100000:3.0:1713279306.792918:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281217472 00000100:00100000:3.0:1713279306.792922:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281217472 00000100:00100000:3.0:1713279306.792938:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147242 00000100:00100000:3.0:1713279306.792943:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3719:1957:x1796503281217472:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.792949:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.792950:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.792958:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114eda85dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757e8 expref: 3719 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.792961:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281217536 00000100:00100000:0.0:1713279306.792963:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281217536 00010000:00010000:3.0:1713279306.792966:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:3.0:1713279306.792969:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.792973:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785131 00000100:00100000:0.0:1713279306.792975:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3719:11854:x1796503281217536:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.792981:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.792985:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3719:1957:x1796503281217472:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 40us (96us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.792987:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123732400/0xfc4b8e114eda867d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x148:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175827 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.792990:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147242 00010000:00010000:0.0:1713279306.793003:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c240/0xfc4b8e114eda8684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x148:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.793008:0:15753:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda82e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda82da expref: 60 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.793012:0:15753:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c240/0xfc4b8e114eda8684 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x148:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.793022:0:15753:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda82e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda82da expref: 60 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.793027:0:15753:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764d880 pname:cluuid:pid:xid:nid:opc:job mdt00_035:lustre-MDT0000_UUID:15753:1796503200036672:0@lo:104: 00000100:00100000:0.0:1713279306.793042:0:15753:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.793049:0:15753:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77540 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.793059:0:9213:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1713279306.793065:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200036672 00000100:00100000:2.0:1713279306.793078:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200036672 00000100:00100000:2.0:1713279306.793090:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33431 00000100:00100000:2.0:1713279306.793094:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15753:x1796503200036672:12345-0@lo:104: 00010000:00010000:2.0:1713279306.793100:0:9213:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981200/0xfc4b8e114eda82da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda82e1 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.793125:0:9213:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1713279306.793129:0:15753:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764d880 pname:cluuid:pid:xid:nid:opc:job mdt00_035:lustre-MDT0000_UUID:15753:1796503200036672:0@lo:104: 00000100:00100000:2.0:1713279306.793130:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15753:x1796503200036672:12345-0@lo:104: Request processed in 35us (86us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.793135:0:15753:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c240/0xfc4b8e114eda8684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x148:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.793135:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33431 00010000:00010000:3.0:1713279306.793189:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.793195:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981200/0xfc4b8e114eda82da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda82e1 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.793201:0:9214:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981200 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.793204:0:9214:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981200/0xfc4b8e114eda82da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda82e1 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.793209:0:9214:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981200/0xfc4b8e114eda82da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda82e1 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.793222:0:9214:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981200/0xfc4b8e114eda82da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda82e1 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.793225:0:9214:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.793236:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981200/0xfc4b8e114eda82da lrc: 1/0,0 mode: --/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda82e1 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.793242:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200036736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.793243:0:9214:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d981200/0xfc4b8e114eda82da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda82e1 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.793251:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.793252:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.793253:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279306.793255:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.793269:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200036736 00000100:00100000:3.0:1713279306.793271:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200036736 00010000:00010000:3.0:1713279306.793280:0:15711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda82e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfc4b8e114eda82da expref: 61 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.793290:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196518 00000100:00100000:3.0:1713279306.793293:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095212300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+61:3490:x1796503200036736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.793298:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.793493:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.793504:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281217728 00000100:00100000:0.0:1713279306.793506:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.793507:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281217728 00000100:00100000:2.0:1713279306.793519:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785132 00000100:00100000:2.0:1713279306.793522:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:11204:x1796503281217728:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.793524:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.793528:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.793534:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda868b lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917582e expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.793536:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281217600 00000100:00100000:1.0:1713279306.793541:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281217600 00000100:00100000:3.0:1713279306.793544:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281217792 00000100:00100000:3.0:1713279306.793548:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281217792 00010000:00010000:2.0:1713279306.793554:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda8692 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.793558:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110480 00010000:00010000:2.0:1713279306.793559:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda8692 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.793562:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+81:1955:x1796503281217600:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:2.0:1713279306.793563:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda8692 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.793569:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda8699 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.793571:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110481 00010000:00010000:2.0:1713279306.793572:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda8699 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.793575:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda8699 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.793575:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+88:1957:x1796503281217792:12345-192.168.203.4@tcp:22:fallocate.0 00002000:00010000:1.0:1713279306.793616:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x1101:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1713279306.793618:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1101:0x0] updating lvb mtime from disk: 1713279303 -> 1713279305 00002000:00010000:1.0:1713279306.793619:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x1101:0x0] updating lvb atime from disk: 1713279303 -> 1713279305 00002000:00010000:1.0:1713279306.793621:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x1101:0x0] updating lvb ctime from disk: 1713279303 -> 1713279305 00002000:00010000:1.0:1713279306.793622:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x1101:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1713279306.793641:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+82:1955:x1796503281217600:12345-192.168.203.4@tcp:2:touch.0 Request processed in 79us (134us total) trans 4295010176 rc 0/0 00010000:00010000:2.0:1713279306.793645:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda8692 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00002000:00010000:3.0:1713279306.793645:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb size from disk: 13836 -> 13836 00000100:00100000:1.0:1713279306.793646:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110480 00002000:00010000:3.0:1713279306.793647:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb mtime from disk: 1713279304 -> 1713279304 00002000:00010000:3.0:1713279306.793648:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb atime from disk: 1713279298 -> 1713279298 00010000:00010000:2.0:1713279306.793649:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda8692 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00002000:00010000:3.0:1713279306.793650:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb ctime from disk: 1713279305 -> 1713279304 00002000:00010000:3.0:1713279306.793651:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:2.0:1713279306.793652:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda8692 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.793655:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda8692 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.793658:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.793660:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda8692 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.793663:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda8692 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.793667:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+89:1957:x1796503281217792:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 91us (142us total) trans 4295010119 rc 0/0 00010000:00010000:2.0:1713279306.793668:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00000100:00100000:0.0:1713279306.793669:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.793669:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.793671:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda8692 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.793671:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110481 00010000:00010000:2.0:1713279306.793674:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10240/0xfc4b8e114eda8692 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.793679:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281217856 00010000:00010000:2.0:1713279306.793679:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda8699 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.793681:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281217856 00010000:00010000:2.0:1713279306.793683:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda8699 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.793685:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda8699 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.793688:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd11440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.793689:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda8699 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.793692:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda8699 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.793695:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880090beea00) 00010000:00010000:2.0:1713279306.793696:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.793698:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda8699 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.793700:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda8699 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.793714:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda868b lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917582e expref: 3716 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.793718:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda868b lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917582e expref: 3716 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.793722:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801237d9b00, rc 0) 00000100:00100000:0.0:1713279306.793727:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785133 00000100:00100000:0.0:1713279306.793730:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3424:11666:x1796503281217856:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.793736:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.793738:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:11204:x1796503281217728:12345-192.168.203.4@tcp:101:touch.0 Request processed in 215us (246us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.793741:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda86a0 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x264:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175835 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.793742:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785132 00010000:00010000:0.0:1713279306.793758:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda86a7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x264:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.793763:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda86a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x264:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.793767:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda86a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x264:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00200000:0.0:1713279306.793779:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x264:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.793781:0:15473:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:0.0:1713279306.793792:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda86a0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175835 expref: 3426 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.793799:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda86a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x264:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175835 expref: 3425 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.793806:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x264:0x0].0x0 (ffff880130675400) 00010000:00010000:0.0:1713279306.793807:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713279306.793809:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bf8fcc0, rc 0) 00000100:00100000:0.0:1713279306.793831:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3425:11666:x1796503281217856:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 100us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.793835:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785133 00010000:00010000:3.0:1713279306.793979:0:6942:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff88008be06a00 x1796503200035328) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7e50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175605 expref: 3683 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.793985:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.793986:0:6942:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7e50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175605 expref: 3683 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.793995:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda7e50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175605 expref: 3683 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.794001:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be06a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001_UUID:6942:1796503200035328:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.794009:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00010000:00010000:3.0:1713279306.794012:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.794016:0:6942:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.794019:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 6942 initiator: MDT1 00000001:00080000:0.0:1713279306.794024:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202669 is committed 00010000:00010000:3.0:1713279306.794026:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.794029:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00000001:00080000:0.0:1713279306.794030:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202667 is committed 00010000:00010000:2.0:1713279306.794031:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda856c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.794032:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00000001:00080000:0.0:1713279306.794034:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202662 is committed 00000020:00080000:0.0:1713279306.794035:0:6911:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 16406 batchid updated 00010000:00010000:2.0:1713279306.794035:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda856c lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.794037:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.794038:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda856c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.794039:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda86ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x260:0x0].0x65656ce3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.794041:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e5f5200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.794042:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda856c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.794043:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.794045:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda856c lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.794045:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda86ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.794046:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.794048:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda86ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.794049:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.794051:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.794052:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x31 (ffff880096e84400) 00010000:00010000:1.0:1713279306.794054:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.794054:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.794054:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.794055:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda856c lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x24a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713279306.794058:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281217984 00010000:00010000:2.0:1713279306.794058:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda856c lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x24a:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.794058:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda6f4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175254 expref: 3424 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.794059:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ede:0x0].0x0 (ffff88008e4c8000) 00000100:00100000:0.0:1713279306.794060:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281217984 00010000:00010000:1.0:1713279306.794061:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.794062:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 4/0,1 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.794063:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.794065:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda857a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.794066:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be880/0xfc4b8e114eda851f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.794077:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda857a lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.794080:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda857a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.794083:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a4d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.794084:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda857a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713279306.794085:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785134 00010000:00010000:3.0:1713279306.794085:0:6942:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda6f4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175254 expref: 3424 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.794087:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda857a lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713279306.794089:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3683:11912:x1796503281217984:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.794090:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x31 (ffff880096e84200) 00000020:00080000:1.0:1713279306.794091:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16406 00010000:00010000:3.0:1713279306.794091:0:6942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda6f4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175254 expref: 3424 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.794092:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.794093:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda857a lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.794095:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.794095:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda857a lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x231:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.794096:0:15473:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:3.0:1713279306.794096:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be06a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001_UUID:6942:1796503200036800:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.794097:0:15473:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 18179780525799669328) 00010000:00010000:0.0:1713279306.794098:0:15473:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.794101:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.794103:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda86bc lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917583c expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.794104:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.794107:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.794109:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a7180 already unused, calling callback (ffffffffa0f0d730) 00000004:00080000:1.0:1713279306.794111:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88008c199780 with version 29430 00010000:00010000:2.0:1713279306.794111:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.794113:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713279306.794114:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011f137180 going to sleep for 11 seconds 00000020:00080000:1.0:1713279306.794116:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16404 cancel update log [0x240000401:0xf2:0x0].671: rc = 0 00010000:00010000:2.0:1713279306.794116:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8584:0x0].0x0 (ffff8800908e1f00) 00010000:00010000:2.0:1713279306.794117:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.794119:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.794121:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114eda8581 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8584:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000004:00080000:2.0:1713279306.794128:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29430 rpc_version 29430 00010000:00010000:3.0:1713279306.794135:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda82e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfc4b8e114eda82da expref: 60 pid: 15516 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1713279306.794136:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:1.0:1713279306.794138:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16404 cancel update log [0x200000400:0x1b7:0x0].186: rc = 0 00010000:00010000:0.0:1713279306.794140:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda86c3 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.794140:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880095213800 x1796503200036928/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1713279306.794141:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x0 (ffff880091b34100) 00010000:00010000:3.0:1713279306.794144:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c240/0xfc4b8e114eda8684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x148:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.794145:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda86c3 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.794148:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095213800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200036928:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713279306.794149:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda86c3 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.794149:0:15711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c240/0xfc4b8e114eda8684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.794153:0:15711:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c240/0xfc4b8e114eda8684 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.794155:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda86ca lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000004:00080000:1.0:1713279306.794156:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88008fd91000 with version 29431 00000020:00080000:1.0:1713279306.794158:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16405 cancel update log [0x240000401:0xf2:0x0].672: rc = 0 00010000:00010000:0.0:1713279306.794159:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda86ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.794159:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.794162:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda86ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.794163:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1713279306.794166:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16405 cancel update log [0x200000400:0x1b7:0x0].187: rc = 0 00000004:00200000:0.0:1713279306.794169:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00000100:00100000:2.0:1713279306.794170:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606c180 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.794175:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda86c3 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00080000:1.0:1713279306.794175:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800969d00c0 with version 29432 00000100:00100000:3.0:1713279306.794176:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095212300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+59:3490:x1796503200036736:12345-0@lo:103:ldlm_bl.0 Request processed in 882us (919us total) trans 0 rc 0/0 00000020:00080000:1.0:1713279306.794177:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16406 cancel update log [0x240000401:0xf2:0x0].673: rc = 0 00010000:00010000:0.0:1713279306.794178:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda86c3 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.794180:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196518 00010000:00010000:0.0:1713279306.794181:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda86c3 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.794182:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200036736:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1713279306.794183:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16406 cancel update log [0x200000400:0x1b7:0x0].188: rc = 0 00010000:00010000:0.0:1713279306.794184:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda86c3 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.794186:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8cb40 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:1.0:1713279306.794186:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16406 00010000:00010000:0.0:1713279306.794188:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda86c3 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.794191:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda86c3 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.794191:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200036928 00010000:00010000:3.0:1713279306.794191:0:15753:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c240/0xfc4b8e114eda8684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.794193:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200036928 00010000:00010000:3.0:1713279306.794194:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c240/0xfc4b8e114eda8684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.794195:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00010000:00010000:0.0:1713279306.794196:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.794197:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda86c3 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.794202:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98755 00010000:00010000:0.0:1713279306.794203:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda86c3 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.794204:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+121:8634:x1796503200036928:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713279306.794208:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda86ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000004:00200000:3.0:1713279306.794210:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x148:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.794211:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda86ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000004:00200000:3.0:1713279306.794212:0:15753:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 4 MDT count 2 00010000:00010000:0.0:1713279306.794214:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda86ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.794216:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.794218:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda86ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.794220:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda86ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.794223:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880096e84100) 00010000:00010000:0.0:1713279306.794225:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.794225:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123732400/0xfc4b8e114eda867d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175827 expref: 3719 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.794226:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda86ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.794228:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda86ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.794231:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c240/0xfc4b8e114eda8684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175827 expref: 3718 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.794235:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x0 (ffff880091b34100) 00010000:00010000:3.0:1713279306.794236:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713279306.794238:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f3c240, rc 0) 00010000:00010000:0.0:1713279306.794241:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda86bc lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917583c expref: 3684 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.794246:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda86bc lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917583c expref: 3684 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.794250:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+122:8634:x1796503200036928:12345-0@lo:1000:osp_up1-0.0 Request processed in 45us (86us total) trans 4295183689 rc 0/0 00010000:00010000:0.0:1713279306.794253:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bf8dd40, rc 0) 00000100:00100000:3.0:1713279306.794253:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3718:11854:x1796503281217536:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1277us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.794254:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98755 00000100:00100000:3.0:1713279306.794256:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785131 00000100:00100000:0.0:1713279306.794267:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3683:11912:x1796503281217984:12345-192.168.203.4@tcp:101:touch.0 Request processed in 177us (281us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.794268:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095213800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200036928:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.794271:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785134 00000004:00080000:2.0:1713279306.794272:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29431 rpc_version 29431 00000020:00100000:2.0:1713279306.794278:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.794281:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009234ed80 x1796503200037056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1713279306.794288:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200037056:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1713279306.794300:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.794305:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff880136a3f240 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.794306:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200037056 00000100:00100000:3.0:1713279306.794309:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200037056 00000100:00100000:3.0:1713279306.794317:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98756 00000100:00100000:3.0:1713279306.794320:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+122:8634:x1796503200037056:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.794365:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+123:8634:x1796503200037056:12345-0@lo:1000:osp_up1-0.0 Request processed in 44us (63us total) trans 4295183690 rc 0/0 00000100:00100000:2.0:1713279306.794370:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200037056:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.794371:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98756 00000100:00100000:0.0:1713279306.794372:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00080000:2.0:1713279306.794374:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29432 rpc_version 29432 00000020:00100000:2.0:1713279306.794379:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.794381:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009234dc00 x1796503200037184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1713279306.794387:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200037184:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1713279306.794399:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.794404:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606c180 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.794407:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200037184 00000100:00100000:3.0:1713279306.794410:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200037184 00000100:00100000:1.0:1713279306.794442:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281218304 00000100:00100000:1.0:1713279306.794445:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281218304 00000100:00100000:3.0:1713279306.794445:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98757 00000100:00100000:3.0:1713279306.794449:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+123:8634:x1796503200037184:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.794459:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785135 00000100:00100000:1.0:1713279306.794464:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3683:11711:x1796503281218304:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.794473:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.794482:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114eda86d1 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175843 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.794498:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+124:8634:x1796503200037184:12345-0@lo:1000:osp_up1-0.0 Request processed in 48us (97us total) trans 4295183691 rc 0/0 00000100:00100000:3.0:1713279306.794502:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98757 00000100:00100000:2.0:1713279306.794504:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200037184:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1713279306.794514:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114eda86d8 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794522:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114eda86d8 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794529:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114eda86d8 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794537:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda86df lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794543:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda86df lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794548:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda86df lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794568:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114eda86d8 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794573:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114eda86d8 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794578:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114eda86d8 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794583:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114eda86d8 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794587:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf99680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.794590:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114eda86d8 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794594:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114eda86d8 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794601:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880130675600) 00010000:00010000:1.0:1713279306.794603:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.794605:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114eda86d8 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794610:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114eda86d8 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794618:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda86df lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794623:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda86df lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794627:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda86df lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794630:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091805440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.794631:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda86df lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794634:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda86df lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794637:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880130675300) 00010000:00010000:1.0:1713279306.794639:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.794640:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda86df lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794643:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114eda86df lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.794657:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114eda86d1 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175843 expref: 3684 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.794662:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114eda86d1 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175843 expref: 3684 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.794667:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a0daac0, rc 0) 00000100:00100000:1.0:1713279306.794685:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3683:11711:x1796503281218304:12345-192.168.203.4@tcp:101:touch.0 Request processed in 221us (314us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.794689:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785135 00000100:00100000:2.0:1713279306.794729:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.794737:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281218048 00000100:00100000:1.0:1713279306.794740:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281218048 00000100:00100000:2.0:1713279306.794744:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.794755:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785136 00000100:00100000:1.0:1713279306.794758:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3707:10814:x1796503281218048:12345-192.168.203.4@tcp:34:lfs.0 00000100:00100000:3.0:1713279306.794771:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281218240 00000100:00100000:3.0:1713279306.794773:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281218240 00010000:00010000:1.0:1713279306.794779:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda86e6 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794783:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda86e6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.794785:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223035 00010000:00010000:1.0:1713279306.794787:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda86e6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.794787:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3718:11893:x1796503281218240:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:1.0:1713279306.794792:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda86ed lrc: 3/1,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794795:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda86ed lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794799:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda86ed lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794823:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda86f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x862e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794827:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda86f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x862e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794830:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda86f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x862e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.794840:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3719:11893:x1796503281218240:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 51us (95us total) trans 4295202670 rc 0/0 00000004:00010000:1.0:1713279306.794844:0:15485:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda86f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x862e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.794844:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223035 00010000:00010000:1.0:1713279306.794849:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda86e6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794853:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda86e6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794856:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda86e6 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794859:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda86e6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794861:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090b25440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.794863:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda86e6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794866:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda86e6 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794869:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x0 (ffff88009254e400) 00010000:00010000:1.0:1713279306.794871:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.794872:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda86e6 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794875:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b25440/0xfc4b8e114eda86e6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794880:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda86ed lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794883:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda86ed lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794886:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda86ed lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794888:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a4c86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.794890:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda86ed lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794893:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda86ed lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794896:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x3931 (ffff88012510d700) 00010000:00010000:1.0:1713279306.794897:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.794899:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda86ed lrc: 2/0,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794901:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda86ed lrc: 0/0,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794907:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda86f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x862e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794909:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda86f4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x862e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794912:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda86f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x862e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794914:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938fcfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.794915:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda86f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x862e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794918:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda86f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x862e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794921:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x862e:0x0].0x0 (ffff88009213a500) 00010000:00010000:1.0:1713279306.794923:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.794924:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda86f4 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x862e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.794930:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda86f4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x862e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.794951:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3707:10814:x1796503281218048:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 191us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.794955:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785136 00000100:00100000:2.0:1713279306.795004:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.795013:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281219008 00000100:00100000:1.0:1713279306.795016:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281219008 00000100:00100000:1.0:1713279306.795027:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785137 00000100:00100000:1.0:1713279306.795029:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3425:11204:x1796503281219008:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.795033:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.795035:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.795040:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda86fb lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175858 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.795042:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281219264 00000100:00100000:3.0:1713279306.795044:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281219264 00000100:00100000:0.0:1713279306.795047:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.795054:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785138 00000100:00100000:3.0:1713279306.795057:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3683:11905:x1796503281219264:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:2.0:1713279306.795058:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281218368 00000100:00100000:0.0:1713279306.795059:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.795060:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281218368 00010000:00010000:3.0:1713279306.795062:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.795081:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281218496 00000100:00100000:3.0:1713279306.795083:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281218496 00000100:00100000:0.0:1713279306.795085:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.795087:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110482 00000100:00100000:2.0:1713279306.795090:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+82:1956:x1796503281218368:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:3.0:1713279306.795092:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223036 00000100:00100000:0.0:1713279306.795095:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.795096:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130146050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3427:11855:x1796503281218496:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:1.0:1713279306.795102:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda8702 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.795104:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.795107:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda8702 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.795111:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda8702 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.795112:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281218688 00000100:00100000:0.0:1713279306.795115:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281218688 00010000:00010000:1.0:1713279306.795117:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda8709 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.795120:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda8709 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.795123:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda8709 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.795124:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281218816 00000100:00100000:0.0:1713279306.795125:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281218816 00000100:00100000:0.0:1713279306.795133:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223037 00000004:00200000:1.0:1713279306.795135:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00000100:00100000:0.0:1713279306.795136:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3708:11888:x1796503281218688:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:1.0:1713279306.795139:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda8702 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.795142:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda8702 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.795143:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130146050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3428:11855:x1796503281218496:12345-192.168.203.4@tcp:35:touch.0 Request processed in 47us (83us total) trans 4295183692 rc 0/0 00010000:00010000:1.0:1713279306.795145:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda8702 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.795148:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda8702 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.795148:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223036 00010000:00010000:1.0:1713279306.795150:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd88240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.795152:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda8702 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.795155:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda8702 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.795158:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:1.0:1713279306.795159:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.795161:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda8702 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.795163:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114eda8702 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00002000:00010000:2.0:1713279306.795166:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb size from disk: 40670 -> 40670 00000100:00100000:3.0:1713279306.795166:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223038 00010000:00010000:1.0:1713279306.795168:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda8709 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00002000:00010000:2.0:1713279306.795168:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00000100:00100000:3.0:1713279306.795168:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3709:11904:x1796503281218816:12345-192.168.203.4@tcp:35:touch.0 00002000:00010000:2.0:1713279306.795169:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb atime from disk: 1713279304 -> 1713279304 00010000:00010000:1.0:1713279306.795170:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda8709 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00002000:00010000:2.0:1713279306.795170:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.795172:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb blocks from disk: 24 -> 40 00010000:00010000:1.0:1713279306.795176:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda8709 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.795179:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092345440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.795180:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda8709 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.795183:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda8709 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.795185:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+83:1956:x1796503281218368:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 93us (136us total) trans 4295010177 rc 0/0 00010000:00010000:1.0:1713279306.795186:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88013484ff00) 00000100:00100000:0.0:1713279306.795187:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3709:11888:x1796503281218688:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 50us (91us total) trans 4295202671 rc 0/0 00010000:00010000:1.0:1713279306.795187:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.795188:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda8709 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.795188:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110482 00010000:00010000:1.0:1713279306.795190:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114eda8709 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.795192:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223037 00000100:00100000:2.0:1713279306.795200:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281218560 00000100:00100000:2.0:1713279306.795202:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281218560 00010000:00010000:1.0:1713279306.795204:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda86fb lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175858 expref: 3427 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.795207:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3709:11904:x1796503281218816:12345-192.168.203.4@tcp:35:touch.0 Request processed in 37us (102us total) trans 4295202672 rc 0/0 00010000:00010000:1.0:1713279306.795208:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda86fb lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175858 expref: 3427 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.795211:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223038 00010000:00010000:1.0:1713279306.795212:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312c58c0, rc 0) 00000100:00100000:2.0:1713279306.795212:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785139 00000100:00100000:2.0:1713279306.795215:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3719:11874:x1796503281218560:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.795216:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.795220:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.795226:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3426:11204:x1796503281219008:12345-192.168.203.4@tcp:101:touch.0 Request processed in 196us (222us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.795226:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114eda8717 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917584a expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.795226:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda8710 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175866 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.795230:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785137 00000100:00100000:1.0:1713279306.795236:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281218880 00000100:00100000:1.0:1713279306.795238:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281218880 00010000:00010000:2.0:1713279306.795243:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda871e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.795247:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.795248:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda871e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.795251:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281219072 00000100:00100000:1.0:1713279306.795253:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281219072 00010000:00010000:2.0:1713279306.795253:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda871e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.795258:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda8725 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.795260:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785140 00010000:00010000:2.0:1713279306.795261:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda8725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.795262:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda872c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:1.0:1713279306.795263:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3426:11666:x1796503281218880:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.795264:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda8725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.795266:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.795267:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda872c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.795268:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.795273:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114eda8733 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x242:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175851 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.795273:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda872c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:3.0:1713279306.795283:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281219136 00010000:00010000:2.0:1713279306.795284:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda873a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:3.0:1713279306.795286:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281219136 00010000:00010000:1.0:1713279306.795288:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013585cd80/0xfc4b8e114eda8741 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x242:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.795288:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda873a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.795291:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda873a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.795293:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013585cd80/0xfc4b8e114eda8741 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.795296:0:15711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda6f4d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175254 expref: 3428 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.795297:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013585cd80/0xfc4b8e114eda8741 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000004:00200000:1.0:1713279306.795309:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x242:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.795311:0:15479:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00200000:2.0:1713279306.795314:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00000100:00100000:3.0:1713279306.795315:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196519 00000004:00200000:2.0:1713279306.795316:0:15749:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1713279306.795319:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3429:1956:x1796503281219136:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.795320:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114eda8733 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175851 expref: 3429 pid: 15479 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.795321:0:15749:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda873a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.795325:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda871e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.795326:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013585cd80/0xfc4b8e114eda8741 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175851 expref: 3428 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.795326:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.795328:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda871e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.795329:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x242:0x0].0x0 (ffff880130675b00) 00010000:00010000:3.0:1713279306.795330:0:15711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda6f4d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175254 expref: 3428 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.795331:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713279306.795331:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda871e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.795332:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013585cd80, rc 0) 00010000:00010000:2.0:1713279306.795334:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda871e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.795338:0:15711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda6f4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175254 expref: 3428 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.795340:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.795341:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda871e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.795344:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda871e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.795348:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.795348:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012514dc00) 00000100:00100000:1.0:1713279306.795350:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3428:11666:x1796503281218880:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 85us (133us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.795350:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.795351:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda871e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.795351:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.795354:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda871e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.795355:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785140 00010000:00010000:3.0:1713279306.795357:0:15711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.795359:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda8725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.795362:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda8725 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.795362:0:15711:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.795365:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda8725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.795366:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785141 00010000:00010000:2.0:1713279306.795367:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd13600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.795368:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda8725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.795370:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3685:11854:x1796503281219072:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.795370:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.795371:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda8725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.795374:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff880092a4c400) 00010000:00010000:2.0:1713279306.795375:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.795376:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda8725 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.795377:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.795379:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda8725 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.795384:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda8748 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917585f expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.795389:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114eda8717 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917584a expref: 3721 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.795390:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3427:1956:x1796503281219136:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 69us (122us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.795395:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda873a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917584a expref: 3720 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.795396:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196519 00010000:00010000:2.0:1713279306.795399:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:2.0:1713279306.795400:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713279306.795401:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea5f180, rc 0) 00010000:00010000:1.0:1713279306.795410:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda874f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7d86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713279306.795431:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3720:11874:x1796503281218560:12345-192.168.203.4@tcp:101:touch.0 Request processed in 215us (345us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.795434:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda874f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7d86:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713279306.795435:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785139 00010000:00010000:3.0:1713279306.795438:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda6f4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175254 expref: 3426 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.795441:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda874f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7d86:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.795448:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be06a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001_UUID:6942:1796503200036800:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.795462:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.795467:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.795472:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00000004:00200000:1.0:1713279306.795477:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7d86:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.795479:0:15479:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 4 MDT count 2 00010000:00010000:3.0:1713279306.795483:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda8756 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00000004:00010000:1.0:1713279306.795485:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda874f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7d86:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.795489:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda8756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.795494:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda8748 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917585f expref: 3687 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.795495:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda8756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.795500:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda874f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7d86:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917585f expref: 3686 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.795504:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d86:0x0].0x0 (ffff880090a56500) 00010000:00010000:1.0:1713279306.795505:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713279306.795507:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f084d80, rc 0) 00010000:00010000:3.0:1713279306.795517:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x793a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00000100:00100000:1.0:1713279306.795523:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3686:11854:x1796503281219072:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 153us (275us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.795525:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda7f1b lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x793a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175644 expref: 3425 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.795529:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785141 00010000:00010000:3.0:1713279306.795531:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 4/0,1 mode: --/EX res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.795544:0:6942:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda7f1b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x793a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175644 expref: 3425 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.795551:0:6942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda7f1b lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x793a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175644 expref: 3425 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.795560:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be06a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001_UUID:6942:1796503200037248:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.795577:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135eb0f00 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.795589:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda8764 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.795593:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda8764 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.795597:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda8764 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000004:00200000:3.0:1713279306.795640:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x752c:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.795645:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda872c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.795648:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda872c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.795651:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda872c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.795654:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda872c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.795657:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fef8b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.795659:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda872c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.795661:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda872c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.795665:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.795666:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:3.0:1713279306.795668:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.795670:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda872c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00000100:00100000:1.0:1713279306.795672:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.795673:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda872c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.795677:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda8764 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.795680:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda8764 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.795682:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda8764 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.795685:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134a40240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.795687:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda8764 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.795690:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda8764 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.795691:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281219456 00010000:00010000:3.0:1713279306.795693:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3331 (ffff8800960e8b00) 00000100:00100000:2.0:1713279306.795694:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281219456 00010000:00010000:3.0:1713279306.795694:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.795695:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda8764 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.795698:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda8764 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.795704:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110483 00000100:00100000:2.0:1713279306.795707:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+83:1955:x1796503281219456:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:3.0:1713279306.795709:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda8710 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175866 expref: 3685 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.795716:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda8710 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175866 expref: 3685 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.795721:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880089fe1680, rc 0) 00000100:00100000:3.0:1713279306.795735:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3684:11905:x1796503281219264:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 677us (703us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.795739:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785138 00000100:00100000:3.0:1713279306.795746:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281219392 00000100:00100000:3.0:1713279306.795748:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281219392 00000100:00100000:3.0:1713279306.795757:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785142 00000100:00100000:3.0:1713279306.795760:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3720:11711:x1796503281219392:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.795764:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.795770:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda876b lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917586d expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.795805:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda8772 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.795810:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda8772 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.795814:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda8772 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.795819:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342640/0xfc4b8e114eda8779 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.795822:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092342640/0xfc4b8e114eda8779 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.795825:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092342640/0xfc4b8e114eda8779 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00002000:00010000:2.0:1713279306.795832:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb size from disk: 23529 -> 23529 00000004:00200000:3.0:1713279306.795833:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00002000:00010000:2.0:1713279306.795834:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb mtime from disk: 1713279304 -> 1713279306 00002000:00010000:2.0:1713279306.795835:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb atime from disk: 1713279302 -> 1648351934 00002000:00010000:2.0:1713279306.795836:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00010000:00010000:3.0:1713279306.795837:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda8772 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00002000:00010000:2.0:1713279306.795838:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb blocks from disk: 64 -> 48 00010000:00010000:3.0:1713279306.795840:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda8772 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.795843:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda8772 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.795846:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda8772 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.795848:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.795850:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda8772 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.795852:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+84:1955:x1796503281219456:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 143us (187us total) trans 4295010178 rc 0/0 00010000:00010000:3.0:1713279306.795852:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda8772 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.795856:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8800960e8900) 00010000:00010000:3.0:1713279306.795857:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.795858:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110483 00010000:00010000:3.0:1713279306.795859:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda8772 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000100:00100000:1.0:1713279306.795860:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.795861:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342f40/0xfc4b8e114eda8772 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000100:00100000:0.0:1713279306.795865:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.795865:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342640/0xfc4b8e114eda8779 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.795871:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092342640/0xfc4b8e114eda8779 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.795873:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281219712 00010000:00010000:3.0:1713279306.795874:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092342640/0xfc4b8e114eda8779 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.795875:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281219712 00010000:00010000:3.0:1713279306.795876:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342640 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.795877:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281219584 00010000:00010000:3.0:1713279306.795877:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342640/0xfc4b8e114eda8779 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00000100:00100000:0.0:1713279306.795880:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281219584 00010000:00010000:3.0:1713279306.795880:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342640/0xfc4b8e114eda8779 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.795883:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff8800960e8600) 00010000:00010000:3.0:1713279306.795884:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.795885:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092342640/0xfc4b8e114eda8779 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.795887:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342640/0xfc4b8e114eda8779 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.795890:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110484 00000100:00100000:2.0:1713279306.795893:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+89:1956:x1796503281219712:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:3.0:1713279306.795899:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda876b lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917586d expref: 3721 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.795903:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda876b lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917586d expref: 3721 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.795908:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134a41f80, rc 0) 00000100:00100000:3.0:1713279306.795922:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3720:11711:x1796503281219392:12345-192.168.203.4@tcp:101:touch.0 Request processed in 162us (251us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.795926:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785142 00002000:00010000:2.0:1713279306.795929:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb size from disk: 12827 -> 12827 00002000:00010000:2.0:1713279306.795931:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.795932:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:2.0:1713279306.795933:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.795935:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:2.0:1713279306.795948:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+90:1956:x1796503281219712:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 54us (83us total) trans 4295010120 rc 0/0 00000100:00100000:2.0:1713279306.795951:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110484 00000100:00100000:0.0:1713279306.796009:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785143 00000100:00100000:0.0:1713279306.796012:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3709:10814:x1796503281219584:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.796014:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.796019:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.796021:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281219776 00010000:00010000:0.0:1713279306.796024:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ed00/0xfc4b8e114eda8780 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x862e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175874 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.796024:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281219776 00000100:00100000:3.0:1713279306.796034:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785144 00000100:00100000:3.0:1713279306.796036:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3426:11855:x1796503281219776:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.796042:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.796048:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114eda8787 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917587b expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.796092:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda878e lrc: 3/0,1 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.796097:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda878e lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.796101:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda878e lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.796106:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda8795 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x233:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.796109:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda8795 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.796111:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda879c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x862e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.796113:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda8795 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.796117:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda879c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x862e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.796122:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda879c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x862e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000004:00200000:0.0:1713279306.796126:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x862e:0x0]: returning size 0 00000100:00100000:3.0:1713279306.796150:0:15752:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-mdtlov_UUID:15752:1796503200037312:0@lo:1000:mdt00_034.0 00010000:00010000:0.0:1713279306.796152:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ed00/0xfc4b8e114eda8780 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x862e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175874 expref: 3712 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.796159:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda879c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x862e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175874 expref: 3711 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.796163:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x862e:0x0].0x0 (ffff88009213a500) 00010000:00010000:0.0:1713279306.796165:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1713279306.796166:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009181ef40, rc 0) 00000100:00100000:3.0:1713279306.796167:0:15752:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.796177:0:15752:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800902fd900 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.796178:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200037312 00000100:00100000:2.0:1713279306.796180:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200037312 00000100:00100000:0.0:1713279306.796183:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:10814:x1796503281219584:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 171us (323us total) trans 4295202673 rc 0/0 00000100:00100000:0.0:1713279306.796187:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785143 00000100:00100000:2.0:1713279306.796190:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98758 00000100:00100000:2.0:1713279306.796192:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+59:15752:x1796503200037312:12345-0@lo:1000:mdt00_034.0 00000100:00100000:2.0:1713279306.796224:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+59:15752:x1796503200037312:12345-0@lo:1000:mdt00_034.0 Request processed in 31us (56us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.796228:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98758 00010000:00010000:3.0:1713279306.796228:0:6942:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff88008be06a00 x1796503200037248) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda7f1b lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x793a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175644 expref: 3427 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.796234:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.796239:0:6942:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda7f1b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x793a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175644 expref: 3427 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.796246:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda7f1b lrc: 0/0,0 mode: --/PW res: [0x240000402:0x793a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175644 expref: 3427 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.796252:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be06a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001_UUID:6942:1796503200037248:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.796259:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x793a:0x0].0x0 (ffff88008c002700) 00010000:00010000:3.0:1713279306.796261:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00000100:00100000:1.0:1713279306.796262:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281219840 00010000:00010000:3.0:1713279306.796265:0:6942:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6942 initiator: MDT1 00000100:00100000:1.0:1713279306.796266:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281219840 00010000:00010000:3.0:1713279306.796268:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.796274:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.796277:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.796280:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00000100:00100000:1.0:1713279306.796283:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785145 00000100:00100000:1.0:1713279306.796288:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11666:x1796503281219840:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.796297:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.796306:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0846c0/0xfc4b8e114eda87aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x140:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175882 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.796328:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x140:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.796336:0:15485:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801237da400/0xfc4b8e114eda855e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8557 expref: 58 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.796342:0:15485:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.796356:0:15485:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801237da400/0xfc4b8e114eda855e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda8557 expref: 58 pid: 6934 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.796363:0:15485:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdd500 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000_UUID:15485:1796503200037376:0@lo:104: 00000004:00010000:3.0:1713279306.796368:0:6942:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800997fb480 reply state ffff8800a56b7000 transno 4295183693 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.796374:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.796378:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x793a:0x0].0x0 (ffff88008c002700) 00000100:00100000:1.0:1713279306.796379:0:15485:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.796380:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1713279306.796381:0:6942:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.796384:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00000100:00100000:1.0:1713279306.796386:0:15485:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0240 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.796386:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00000100:00100000:2.0:1713279306.796388:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200037376 00010000:00010000:3.0:1713279306.796389:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00000100:00100000:2.0:1713279306.796390:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200037376 00010000:00010000:3.0:1713279306.796393:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.796395:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bfa80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.796397:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33432 00010000:00010000:3.0:1713279306.796397:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00000100:00100000:2.0:1713279306.796400:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15485:x1796503200037376:12345-0@lo:104: 00010000:00010000:3.0:1713279306.796400:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.796403:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012514dc00) 00010000:00010000:2.0:1713279306.796404:0:9213:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd7180/0xfc4b8e114eda8557 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda855e expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.796404:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.796405:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.796408:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda86b5 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00000004:00010000:3.0:1713279306.796434:0:6942:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800997fb480 reply state ffff8800a56b7000 transno 4295183693 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda8756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.796437:0:9213:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1713279306.796440:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15485:x1796503200037376:12345-0@lo:104: Request processed in 39us (61us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.796441:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda8756 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00000100:00100000:2.0:1713279306.796443:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33432 00010000:00010000:3.0:1713279306.796444:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x65656ce3 (ffff8800960e8a00) 00010000:00010000:3.0:1713279306.796445:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.796446:0:6942:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:3.0:1713279306.796447:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.796450:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.796451:0:6919:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1713279306.796453:0:15485:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdd500 pname:cluuid:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000_UUID:15485:1796503200037376:0@lo:104: 00010000:00010000:2.0:1713279306.796453:0:6919:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd7180/0xfc4b8e114eda8557 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda855e expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.796453:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.796456:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.796457:0:6919:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7180 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:2.0:1713279306.796459:0:6919:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd7180/0xfc4b8e114eda8557 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda855e expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.796459:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bd440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.796460:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.796463:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT1 00000004:00010000:2.0:1713279306.796464:0:6919:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd7180/0xfc4b8e114eda8557 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda855e expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.796465:0:15485:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.796466:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00010000:00010000:3.0:1713279306.796467:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.796468:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.796471:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda8622 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.796474:0:6919:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd7180/0xfc4b8e114eda8557 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda855e expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.796477:0:6919:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000004:00010000:3.0:1713279306.796477:0:6942:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800997fb480 reply state ffff8800a56b7000 transno 4295183693 ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda86ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.796481:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda86ae lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.796483:0:6919:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd7180/0xfc4b8e114eda8557 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda855e expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.796483:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x65656ce3 (ffff8800960e8800) 00010000:00010000:3.0:1713279306.796484:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.796485:0:6942:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:2.0:1713279306.796487:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd7180/0xfc4b8e114eda8557 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda855e expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.796489:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.796490:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200037440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.796492:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.796494:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.796495:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.796496:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.796496:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.796503:0:6942:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1713279306.796504:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.796510:0:15544:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1713279306.796511:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200037440 00000100:00100000:2.0:1713279306.796513:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200037440 00010000:00010000:1.0:1713279306.796514:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.796519:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801237da400/0xfc4b8e114eda855e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfc4b8e114eda8557 expref: 59 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.796520:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094e34b40 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:1.0:1713279306.796524:0:15544:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.796525:0:6942:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3428:11374:x1796503281204160:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 39112us (39157us total) trans 4295183693 rc 0/0 00000100:00100000:2.0:1713279306.796528:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196520 00000100:00100000:3.0:1713279306.796529:0:6942:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14335 00000004:00010000:1.0:1713279306.796530:0:15544:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.796530:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+59:3491:x1796503200037440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.796535:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.796543:0:15544:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.796546:0:15544:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1713279306.796548:0:15752:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4295202662 gen 2 00000004:00080000:3.0:1713279306.796550:0:15752:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202662 committed transno 4295202662 00010000:00010000:1.0:1713279306.796559:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.796563:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880094e34b40/0xfc4b8e114eda8017 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda801e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.796564:0:15752:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-mdtlov_UUID:15752:1796503200037312:0@lo:1000:mdt00_034.0 00010000:00010000:1.0:1713279306.796569:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.796570:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.796571:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279306.796577:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200037504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.796591:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.796598:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200037504 00000100:00100000:2.0:1713279306.796599:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200037504 00010000:00010000:2.0:1713279306.796605:0:15711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800923433c0/0xfc4b8e114eda801e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8017 expref: 60 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.796613:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196521 00000100:00100000:2.0:1713279306.796615:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+60:3492:x1796503200037504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.796618:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.796621:0:15711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff8800923433c0/0xfc4b8e114eda801e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda8017 expref: 60 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.796627:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923433c0/0xfc4b8e114eda801e lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda8017 expref: 60 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.796633:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:2.0:1713279306.796636:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981f80/0xfc4b8e114eda809c lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8064 expref: 59 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.796641:0:15711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981f80/0xfc4b8e114eda809c lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda8064 expref: 59 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.796644:0:15711:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981f80/0xfc4b8e114eda809c lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda8064 expref: 59 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.796649:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda81ad lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda81a6 expref: 59 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.796658:0:15711:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981f80/0xfc4b8e114eda809c lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8064 expref: 59 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.796663:0:15711:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000_UUID:15711:1796503200037568:0@lo:105: 00000100:00100000:2.0:1713279306.796675:0:15711:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.796682:0:15711:0:(client.c:2539:ptlrpc_set_wait()) set ffff880136a3f240 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.796687:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200037568 00000100:00100000:0.0:1713279306.796690:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200037568 00000004:00080000:3.0:1713279306.796692:0:15752:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x1078:0x0], index 0: 0 00000100:00100000:0.0:1713279306.796701:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33433 00000100:00100000:0.0:1713279306.796704:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15711:x1796503200037568:12345-0@lo:105: 00010000:00010000:0.0:1713279306.796719:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.796724:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.796728:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.796732:0:9213:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.796735:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.796739:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.796740:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092343a80/0xfc4b8e114eda87b8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x76fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.796743:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.796747:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092343a80/0xfc4b8e114eda87b8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.796751:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880134a40b40) 00010000:00010000:3.0:1713279306.796751:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092343a80/0xfc4b8e114eda87b8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.796762:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda878e lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.796765:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda878e lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.796768:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda878e lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.796771:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda878e lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.796772:0:15711:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000_UUID:15711:1796503200037568:0@lo:105: 00010000:00010000:3.0:1713279306.796774:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092340d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.796775:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda878e lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.796777:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.796778:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda878e lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.796782:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff8800960e8e00) 00010000:00010000:3.0:1713279306.796783:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.796784:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda878e lrc: 3/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.796787:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda878e lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.796788:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+59:3492:x1796503200037504:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.796791:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196521 00000004:00010000:3.0:1713279306.796792:0:15752:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880131cdf100 reply state ffff8800967fc000 transno 4295183694 ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda8795 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.796796:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda8795 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.796799:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200037504:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.796799:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x39 (ffff8800960e8d00) 00010000:00010000:3.0:1713279306.796800:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.796801:0:15752:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.796810:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114eda8787 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917587b expref: 3429 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.796817:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092343a80/0xfc4b8e114eda87b8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917587b expref: 3428 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.796821:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15711:x1796503200037568:12345-0@lo:105: Request processed in 64us (92us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.796821:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76fb:0x0].0x0 (ffff8800960e8000) 00010000:00010000:3.0:1713279306.796822:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713279306.796823:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092343a80, rc 0) 00000100:00100000:0.0:1713279306.796836:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33433 00000100:00100000:1.0:1713279306.796838:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.796840:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3429:11855:x1796503281219776:12345-192.168.203.4@tcp:101:touch.0 Request processed in 803us (827us total) trans 4295183694 rc 0/0 00000100:00100000:3.0:1713279306.796845:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785144 00010000:00010000:0.0:1713279306.796848:0:15502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.796851:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281220096 00010000:00010000:0.0:1713279306.796853:0:15502:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.796853:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281220096 00000004:00080000:0.0:1713279306.796862:0:15502:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1713279306.796862:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785146 00000100:00100000:2.0:1713279306.796865:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3720:11874:x1796503281220096:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.796870:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.796875:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f4900/0xfc4b8e114eda87c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175890 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.796891:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda87cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.796896:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114eda87d4 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15502 initiator: MDT0 00010000:00010000:2.0:1713279306.796896:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda87cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.796901:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114eda87d4 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.796902:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda87cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.796905:0:15502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114eda87d4 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.796908:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f5440/0xfc4b8e114eda87db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.796911:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114eda87e2 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15502 initiator: MDT0 00010000:00010000:2.0:1713279306.796911:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f5440/0xfc4b8e114eda87db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.796914:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114eda87e2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.796914:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f5440/0xfc4b8e114eda87db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.796917:0:15502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114eda87e2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.796928:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15502 initiator: MDT0 00010000:00010000:2.0:1713279306.796932:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda87f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.796934:0:15502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9680/0xfc4b8e114eda3abf lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x7bca:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391744ee expref: 3683 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.796936:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda87f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.796938:0:15502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755cd expref: 3428 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.796939:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda87f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.796942:0:15502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 5/0,1 mode: --/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.796952:0:15502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755cd expref: 3428 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.796958:0:15502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755cd expref: 3428 pid: 15483 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.796963:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b8700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200037632:192.168.203.4@tcp:104: 00000004:00200000:2.0:1713279306.796965:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00000004:00200000:2.0:1713279306.796967:0:15482:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1713279306.796972:0:15482:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda87f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.796976:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda87cd lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.796979:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda87cd lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.796981:0:15502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9680/0xfc4b8e114eda3abf lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7bca:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391744ee expref: 3683 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.796982:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda87cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.796986:0:15502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9680/0xfc4b8e114eda3abf lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x7bca:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391744ee expref: 3683 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.796987:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda87cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.796990:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219bb480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200037696:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.796990:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801250f7a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.796991:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda87cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.796994:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda87cd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.796996:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77540 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.796998:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:2.0:1713279306.797000:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.797001:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda87cd lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797004:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda87cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797008:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f5440/0xfc4b8e114eda87db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797011:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f5440/0xfc4b8e114eda87db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797014:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f5440/0xfc4b8e114eda87db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797016:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801250f5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.797018:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f5440/0xfc4b8e114eda87db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797020:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f5440/0xfc4b8e114eda87db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797026:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff880092a4cf00) 00010000:00010000:2.0:1713279306.797027:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.797028:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f5440/0xfc4b8e114eda87db lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797031:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f5440/0xfc4b8e114eda87db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797041:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f4900/0xfc4b8e114eda87c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175890 expref: 3722 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.797048:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda87f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175890 expref: 3721 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.797051:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:2.0:1713279306.797052:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713279306.797053:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801250f6ac0, rc 0) 00000100:00100000:2.0:1713279306.797066:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3721:11874:x1796503281220096:12345-192.168.203.4@tcp:101:touch.0 Request processed in 200us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.797081:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785146 00000001:00080000:1.0:1713279306.797305:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202673 is committed 00000001:00080000:1.0:1713279306.797310:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202670 is committed 00000100:00100000:2.0:1713279306.797321:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.797328:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281220032 00000100:00100000:2.0:1713279306.797330:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281220032 00000100:00100000:0.0:1713279306.797331:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.797342:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281219968 00000100:00100000:2.0:1713279306.797344:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281219968 00000100:00100000:0.0:1713279306.797348:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.797352:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147243 00000100:00100000:2.0:1713279306.797354:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b25edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3720:1957:x1796503281219968:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.797357:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.797358:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.797364:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda873a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917584a expref: 3720 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.797369:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00000100:00100000:0.0:1713279306.797370:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.797371:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.797375:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281220480 00000100:00100000:1.0:1713279306.797379:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281220224 00000100:00100000:3.0:1713279306.797380:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281220480 00000100:00100000:1.0:1713279306.797382:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281220224 00000100:00100000:2.0:1713279306.797383:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b25edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3719:1957:x1796503281219968:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 27us (52us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.797386:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147243 00000100:00100000:1.0:1713279306.797392:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281220352 00000100:00100000:1.0:1713279306.797393:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281220352 00000100:00100000:2.0:1713279306.797394:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785147 00000100:00100000:2.0:1713279306.797396:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3710:11204:x1796503281220032:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.797397:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223039 00010000:00010000:2.0:1713279306.797401:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.797401:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3429:11903:x1796503281220480:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:1.0:1713279306.797402:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785148 00000100:00100000:1.0:1713279306.797405:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3685:11902:x1796503281220224:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.797406:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7840/0xfc4b8e114eda87f7 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175889 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.797410:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.797428:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda87fe lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175897 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.797451:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.797462:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281220544 00010000:00010000:1.0:1713279306.797462:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8805 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.797465:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281220544 00010000:00010000:2.0:1713279306.797466:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda880c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.797468:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8805 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.797471:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda880c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.797472:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8805 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.797475:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda880c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.797477:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223040 00010000:00010000:1.0:1713279306.797478:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda8813 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:3.0:1713279306.797478:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3430:11903:x1796503281220480:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 75us (118us total) trans 4295183695 rc 0/0 00000100:00100000:0.0:1713279306.797480:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:385c4b71-808c-40cf-91de-b076b668d13f+3687:11854:x1796503281220544:12345-192.168.203.4@tcp:37:lfs.0 00010000:00010000:2.0:1713279306.797480:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda881a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.797481:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda8813 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.797482:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223039 00010000:00010000:2.0:1713279306.797483:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda881a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.797485:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda8813 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.797487:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda881a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797501:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda880c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797504:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda880c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797507:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda880c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797510:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda880c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.797511:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801237da400/0xfc4b8e114eda855e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfc4b8e114eda8557 expref: 58 pid: 6934 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.797512:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4480 already unused, calling callback (ffffffffa0f0d730) 00000004:00200000:1.0:1713279306.797513:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76b7:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.797514:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda880c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797517:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda880c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.797518:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8805 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.797520:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:2.0:1713279306.797521:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.797521:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x140:0x0].0x0 (ffff88008e4c3e00) 00010000:00010000:1.0:1713279306.797522:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8805 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.797523:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda880c lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.797524:0:9215:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.797525:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8805 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.797525:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda880c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.797528:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8805 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.797528:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.797530:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda881a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.797531:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68b180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.797532:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8805 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.797532:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda881a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.797532:0:9215:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.797535:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8805 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.797535:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda881a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.797539:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd11d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.797540:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:2.0:1713279306.797540:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda881a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.797541:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.797541:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.797543:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8805 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.797543:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda881a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.797545:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8805 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.797546:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880092a4c800) 00010000:00010000:2.0:1713279306.797547:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.797548:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda881a lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.797550:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda8813 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.797551:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda881a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.797552:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda8813 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.797555:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda8813 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.797557:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+57:3491:x1796503200037440:12345-0@lo:103:ldlm_bl.0 Request processed in 1026us (1053us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.797560:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.797561:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7840/0xfc4b8e114eda87f7 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175889 expref: 3711 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.797561:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196520 00010000:00010000:1.0:1713279306.797562:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda8813 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.797565:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda8813 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.797565:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7840/0xfc4b8e114eda87f7 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175889 expref: 3711 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.797568:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff880094169700) 00010000:00010000:1.0:1713279306.797569:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.797569:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801250f7840, rc 0) 00010000:00010000:1.0:1713279306.797570:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda8813 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.797573:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114eda8813 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713279306.797581:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3710:11204:x1796503281220032:12345-192.168.203.4@tcp:101:touch.0 Request processed in 184us (260us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.797584:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda87fe lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175897 expref: 3687 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.797585:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785147 00010000:00010000:1.0:1713279306.797588:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda87fe lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175897 expref: 3687 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.797593:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68bcc0, rc 0) 00000100:00100000:3.0:1713279306.797593:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785149 00000100:00100000:3.0:1713279306.797596:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3686:11711:x1796503281220352:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.797602:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.797607:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3686:11902:x1796503281220224:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 201us (258us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.797609:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114eda8821 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917589e expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.797611:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785148 00000100:00100000:2.0:1713279306.797611:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.797617:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281220608 00000100:00100000:2.0:1713279306.797619:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281220608 00000100:00100000:2.0:1713279306.797627:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110485 00010000:00010000:3.0:1713279306.797629:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda8828 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.797630:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+90:1955:x1796503281220608:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:3.0:1713279306.797633:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda8828 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.797637:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda8828 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:1.0:1713279306.797640:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.797642:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda8836 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00002000:00010000:2.0:1713279306.797645:0:15783:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x1193:0x0] initial LVB size: 0, mtime: 0x661e9148, atime: 0x661e9148, ctime: 0x661e9148, blocks: 0x0 00010000:00010000:3.0:1713279306.797646:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda8836 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00000100:00100000:1.0:1713279306.797647:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281220672 00000100:00100000:1.0:1713279306.797649:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281220672 00010000:00010000:2.0:1713279306.797649:0:15783:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda882f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1193:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.797649:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda8836 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.797655:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.797656:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713279306.797657:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785150 00010000:00010000:2.0:1713279306.797659:0:15783:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda882f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.797660:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3430:11374:x1796503281220672:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1713279306.797662:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda8828 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.797664:0:15783:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda882f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.797665:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda8828 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.797668:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda8828 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.797669:0:15783:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda882f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.797671:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda8828 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.797673:0:15783:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda882f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.797674:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092340b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.797676:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda8828 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.797677:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda883d lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.797677:0:15783:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda882f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.797679:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda8828 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.797680:0:15783:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd121c0 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:1.0:1713279306.797682:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda883d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.797682:0:15783:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda882f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.797683:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff8800960e8f00) 00010000:00010000:3.0:1713279306.797684:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.797685:0:15783:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda882f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.797686:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda883d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.797686:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda8828 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.797688:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda8828 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.797691:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda8844 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.797693:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda8836 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.797695:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda8844 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.797695:0:15783:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda882f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.797696:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda8836 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.797698:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda8844 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.797699:0:15783:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda882f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.797699:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda8836 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.797702:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.797703:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda8836 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.797706:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda8836 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.797709:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff8800960e8300) 00010000:00010000:3.0:1713279306.797710:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.797711:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda8836 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.797714:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda8836 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.797717:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda884b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7ad7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.797717:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+90:1955:x1796503281220608:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 85us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.797720:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110485 00010000:00010000:1.0:1713279306.797721:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda884b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7ad7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.797724:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda884b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7ad7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.797725:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114eda8821 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917589e expref: 3686 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.797730:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114eda8821 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917589e expref: 3686 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.797734:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092343cc0, rc 0) 00000004:00010000:1.0:1713279306.797738:0:15473:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda884b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7ad7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.797742:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda883d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.797745:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda883d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.797747:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3685:11711:x1796503281220352:12345-192.168.203.4@tcp:101:touch.0 Request processed in 150us (376us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.797751:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda883d lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.797751:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785149 00010000:00010000:1.0:1713279306.797754:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda883d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.797756:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689200 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.797757:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.797758:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda883d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.797761:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda883d lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.797764:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880092139200) 00010000:00010000:1.0:1713279306.797766:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.797767:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda883d lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.797769:0:15527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281220800 00010000:00010000:1.0:1713279306.797770:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda883d lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.797772:0:15527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281220800 00010000:00010000:1.0:1713279306.797775:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda8844 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.797778:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda8844 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.797781:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda8844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.797781:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.797781:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223041 00000100:00100000:3.0:1713279306.797783:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3431:11931:x1796503281220800:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:1.0:1713279306.797784:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68b840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.797785:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda8844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.797790:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda8844 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.797793:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3431 (ffff88007fdcae00) 00010000:00010000:1.0:1713279306.797795:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.797796:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda8844 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.797798:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda8844 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.797803:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda884b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7ad7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.797803:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.797805:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda884b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7ad7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.797808:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda884b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7ad7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.797809:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281220928 00010000:00010000:1.0:1713279306.797810:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.797811:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda884b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7ad7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.797811:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281220928 00010000:00010000:1.0:1713279306.797814:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda884b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7ad7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.797817:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ad7:0x0].0x0 (ffff880094168d00) 00010000:00010000:1.0:1713279306.797818:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.797819:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda884b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x7ad7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.797820:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281221056 00010000:00010000:1.0:1713279306.797822:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114eda884b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7ad7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.797822:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281221056 00000100:00100000:3.0:1713279306.797828:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3432:11931:x1796503281220800:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 43us (70us total) trans 4295183696 rc 0/0 00000100:00100000:2.0:1713279306.797829:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223042 00000100:00100000:2.0:1713279306.797831:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130145450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3710:11935:x1796503281220928:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:3.0:1713279306.797832:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223041 00000100:00100000:3.0:1713279306.797839:0:15527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223043 00000100:00100000:1.0:1713279306.797842:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3431:11374:x1796503281220672:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 181us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.797842:0:15527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3685:5824:x1796503281221056:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1713279306.797846:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785150 00000100:00100000:3.0:1713279306.797874:0:15527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:385c4b71-808c-40cf-91de-b076b668d13f+3686:5824:x1796503281221056:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 31us (70us total) trans 4295183697 rc 0/0 00000100:00100000:3.0:1713279306.797877:0:15527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223043 00010000:00010000:3.0:1713279306.797890:0:15485:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.797894:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000100:00100000:2.0:1713279306.797900:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130145450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11935:x1796503281220928:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 67us (117us total) trans 4295202674 rc 0/0 00000100:00100000:2.0:1713279306.797904:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223042 00000004:00200000:3.0:1713279306.797906:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x140:0x0]: returning size 4096 00000004:00200000:3.0:1713279306.797908:0:15485:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:3.0:1713279306.797918:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0846c0/0xfc4b8e114eda87aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x140:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175882 expref: 3711 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.797924:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175882 expref: 3710 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.797928:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x140:0x0].0x0 (ffff88008e4c3e00) 00010000:00010000:3.0:1713279306.797930:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713279306.797931:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f086f40, rc 0) 00000100:00100000:3.0:1713279306.797939:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3710:11666:x1796503281219840:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1652us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.797943:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785145 00000100:00100000:0.0:1713279306.797980:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200037440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.798001:0:15502:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff8801219b8700 x1796503200037632) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755cd expref: 3430 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.798008:0:15502:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755cd expref: 3430 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.798015:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114eda7d70 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x7bca:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391755cd expref: 3430 pid: 15483 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.798020:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b8700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200037632:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.798025:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219bb480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200037696:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.798031:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7bca:0x0].0x0 (ffff880093598800) 00010000:00010000:0.0:1713279306.798033:0:15502:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.798037:0:15502:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.798040:0:15502:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.798043:0:15502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00000100:00100000:0.0:1713279306.798214:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.798230:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.798244:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281221184 00000100:00100000:3.0:1713279306.798247:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281221184 00000100:00100000:0.0:1713279306.798249:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.798256:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281221248 00000100:00100000:3.0:1713279306.798257:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281221312 00000100:00100000:3.0:1713279306.798258:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281221312 00000100:00100000:2.0:1713279306.798259:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281221248 00000100:00100000:3.0:1713279306.798265:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785151 00000100:00100000:3.0:1713279306.798268:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3430:11855:x1796503281221184:12345-192.168.203.4@tcp:36:touch.0 00000100:00100000:1.0:1713279306.798271:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785152 00000100:00100000:2.0:1713279306.798272:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147244 00000100:00100000:2.0:1713279306.798274:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:385c4b71-808c-40cf-91de-b076b668d13f+3720:1955:x1796503281221248:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.798276:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3720:11874:x1796503281221312:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.798280:0:15485:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.798281:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.798284:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.798286:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092343a80/0xfc4b8e114eda87b8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x76fb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917587b expref: 3430 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.798287:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda87f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175890 expref: 3720 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.798292:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda8852 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391758a5 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.798292:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76fb:0x0].0x0 (ffff8800960e8000) 00010000:00010000:2.0:1713279306.798293:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:2.0:1713279306.798295:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.798296:0:15485:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.798308:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:385c4b71-808c-40cf-91de-b076b668d13f+3720:1955:x1796503281221248:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 33us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.798311:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147244 00010000:00010000:1.0:1713279306.798316:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda8859 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798323:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda8859 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.798323:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda8860 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x76fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.798327:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda8860 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.798329:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda8859 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.798331:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda8860 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.798339:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8867 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798344:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8867 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798349:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8867 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000004:00010000:3.0:1713279306.798355:0:15485:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008c970a80 reply state ffff8800928d8000 transno 4295183698 ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda8860 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x76fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.798360:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda8860 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.798363:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76fb:0x0].0x0 (ffff8800937ce800) 00010000:00010000:3.0:1713279306.798365:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.798366:0:15485:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713279306.798381:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda886e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798388:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda886e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.798391:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3431:11855:x1796503281221184:12345-192.168.203.4@tcp:36:touch.0 Request processed in 122us (177us total) trans 4295183698 rc 0/0 00010000:00010000:1.0:1713279306.798394:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda886e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.798395:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785151 00000004:00200000:1.0:1713279306.798452:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.798455:0:15480:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1713279306.798465:0:15480:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda886e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798472:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda8859 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798477:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda8859 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798482:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda8859 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798487:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda8859 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798491:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68a640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.798493:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda8859 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798497:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda8859 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798504:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.798506:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.798508:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda8859 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798512:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114eda8859 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798519:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8867 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798521:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8867 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798524:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8867 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798527:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.798528:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8867 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798531:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8867 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798534:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff88008bf03500) 00010000:00010000:1.0:1713279306.798535:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.798537:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8867 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798539:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8867 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.798552:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda8852 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758a5 expref: 3720 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.798557:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda886e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758a5 expref: 3719 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.798561:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:1.0:1713279306.798562:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713279306.798563:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68aac0, rc 0) 00000100:00100000:1.0:1713279306.798587:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3719:11874:x1796503281221312:12345-192.168.203.4@tcp:101:touch.0 Request processed in 311us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.798591:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785152 00000100:00100000:2.0:1713279306.798667:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.798677:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281221376 00000100:00100000:0.0:1713279306.798680:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281221376 00000100:00100000:0.0:1713279306.798692:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223044 00000100:00100000:0.0:1713279306.798695:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3686:11912:x1796503281221376:12345-192.168.203.4@tcp:33:touch.0 00000004:00200000:0.0:1713279306.798710:0:15467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00000100:00100000:0.0:1713279306.798731:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3686:11912:x1796503281221376:12345-192.168.203.4@tcp:33:touch.0 Request processed in 35us (64us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.798735:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223044 00000100:00100000:1.0:1713279306.799142:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:385c4b71-808c-40cf-91de-b076b668d13f+3685:11854:x1796503281220544:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1660us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.799147:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223040 00000100:00100000:0.0:1713279306.799594:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.799614:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.799624:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281221504 00000100:00100000:1.0:1713279306.799627:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281221504 00000100:00100000:1.0:1713279306.799641:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281221632 00000100:00100000:1.0:1713279306.799642:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281221632 00000100:00100000:1.0:1713279306.799650:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785153 00000100:00100000:1.0:1713279306.799653:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3685:11932:x1796503281221504:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.799659:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.799665:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688240/0xfc4b8e114eda8875 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391758ac expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.799678:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785154 00000100:00100000:2.0:1713279306.799683:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3719:11941:x1796503281221632:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.799685:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda887c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.799689:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda887c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.799691:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.799693:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda887c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.799698:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda8883 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391758b3 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.799699:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda888a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.799703:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda888a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.799709:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda888a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.799737:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda8891 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.799739:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8898 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7ae9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.799743:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda8891 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.799745:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8898 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7ae9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.799747:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda8891 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.799750:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8898 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7ae9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.799754:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda889f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000004:00200000:1.0:1713279306.799756:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7ae9:0x0]: returning size 0 00010000:00010000:2.0:1713279306.799757:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda889f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.799761:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda889f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.799779:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda88ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x8272:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.799783:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda88ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8272:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.799786:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda887c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.799786:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda88ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8272:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000004:00200000:2.0:1713279306.799790:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x8272:0x0]: returning size 32236 00010000:00010000:1.0:1713279306.799791:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda887c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.799796:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda887c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.799801:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda887c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.799805:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.799805:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68ad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.799807:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda887c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.799812:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda887c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.799812:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda8891 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.799815:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda8891 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.799818:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda8891 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.799819:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012bacd500) 00000100:00100000:3.0:1713279306.799820:0:6942:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281222016 00010000:00010000:1.0:1713279306.799821:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.799821:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda8891 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.799824:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda887c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.799824:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10000 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.799824:0:6942:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281222016 00010000:00010000:2.0:1713279306.799826:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda8891 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.799828:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda887c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.799829:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda8891 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.799833:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:2.0:1713279306.799834:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.799835:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda888a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.799836:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda8891 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.799839:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114eda8891 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.799840:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda888a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.799843:0:6942:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14341 00010000:00010000:1.0:1713279306.799844:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda888a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.799844:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda889f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.799847:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda889f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.799847:0:6942:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3710:10814:x1796503281222016:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:1.0:1713279306.799848:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68a1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.799850:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda888a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.799850:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda889f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.799852:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd106c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.799854:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda889f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.799855:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda888a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.799857:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda889f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.799859:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3931 (ffff88012bacd400) 00010000:00010000:2.0:1713279306.799860:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3131 (ffff880096b90f00) 00010000:00010000:1.0:1713279306.799861:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.799861:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.799862:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda889f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.799863:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda888a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.799865:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda889f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.799867:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda888a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.799868:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.799876:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda83eb lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda83cf expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.799880:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10480/0xfc4b8e114eda8883 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758b3 expref: 3722 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.799880:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.799885:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda88ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8272:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758b3 expref: 3721 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.799888:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688240/0xfc4b8e114eda8875 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758ac expref: 3688 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.799893:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8272:0x0].0x0 (ffff88009228ee00) 00010000:00010000:2.0:1713279306.799894:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713279306.799894:0:6942:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda83eb lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda83cf expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.799895:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd11680, rc 0) 00010000:00010000:3.0:1713279306.799899:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.799906:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8898 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7ae9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758ac expref: 3687 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.799912:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ae9:0x0].0x0 (ffff88008da65800) 00010000:00010000:1.0:1713279306.799914:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:2.0:1713279306.799914:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3721:11941:x1796503281221632:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 231us (299us total) trans 4295202675 rc 0/0 00010000:00010000:1.0:1713279306.799916:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e689440, rc 0) 00000100:00100000:2.0:1713279306.799919:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785154 00000100:00100000:1.0:1713279306.799935:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3687:11932:x1796503281221504:12345-192.168.203.4@tcp:101:touch.0 Request processed in 280us (340us total) trans 4295183699 rc 0/0 00000100:00100000:1.0:1713279306.799942:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785153 00000100:00100000:0.0:1713279306.800015:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.800025:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.800031:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281221888 00000100:00100000:2.0:1713279306.800031:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281221824 00000100:00100000:2.0:1713279306.800034:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281221824 00000100:00100000:1.0:1713279306.800036:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281221888 00000100:00100000:0.0:1713279306.800037:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.800049:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281222144 00000100:00100000:2.0:1713279306.800050:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281222144 00000100:00100000:1.0:1713279306.800060:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785155 00000100:00100000:2.0:1713279306.800063:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785156 00000100:00100000:1.0:1713279306.800065:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3432:11204:x1796503281221824:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.800066:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281221888:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.800077:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785157 00000100:00100000:0.0:1713279306.800080:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3432:11374:x1796503281222144:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.800082:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.800087:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.800089:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda88c2 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391758c1 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.800093:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda88c9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7ad7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391758c8 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.800094:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.800103:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda88d0 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391758ba expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.800122:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda88d7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7ad7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.800123:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda88de lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.800127:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda88d7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7ad7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.800127:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda88de lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.800131:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda88de lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.800136:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda88e5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.800140:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda88e5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.800143:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda88e5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000004:00200000:2.0:1713279306.800151:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:1.0:1713279306.800154:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda88ec lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.800155:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda88de lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.800158:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda88de lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.800161:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda88ec lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.800161:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda88de lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.800164:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda88de lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.800166:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd11f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.800167:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda88ec lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.800168:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda88de lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.800171:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda88de lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.800173:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda88d7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7ad7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.800174:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880091b34600) 00010000:00010000:1.0:1713279306.800176:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda88f3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.800176:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.800177:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda88de lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.800180:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda88de lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000004:00200000:0.0:1713279306.800182:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7ad7:0x0]: returning size 0 00010000:00010000:2.0:1713279306.800184:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda88e5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.800185:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda88f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.800190:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda88f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.800190:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda88e5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.800192:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda88e5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.800195:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd12400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.800196:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda88e5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.800199:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda88e5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.800202:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880091b34800) 00010000:00010000:2.0:1713279306.800203:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.800204:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda88e5 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000004:00200000:1.0:1713279306.800205:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:2.0:1713279306.800206:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda88e5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.800212:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda88ec lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.800213:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda88c9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7ad7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758c8 expref: 3436 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.800217:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda88ec lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.800218:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda88c2 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758c1 expref: 3722 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.800220:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda88d7 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7ad7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758c8 expref: 3435 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.800222:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda88ec lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.800222:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda88c2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758c1 expref: 3722 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.800225:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ad7:0x0].0x0 (ffff880094168d00) 00010000:00010000:0.0:1713279306.800226:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1713279306.800227:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda88ec lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.800227:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd12ac0, rc 0) 00010000:00010000:0.0:1713279306.800228:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801245b46c0, rc 0) 00010000:00010000:1.0:1713279306.800232:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c86a880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.800234:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda88ec lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.800239:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda88ec lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.800245:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:1.0:1713279306.800247:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.800250:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda88ec lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.800252:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:11374:x1796503281222144:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 171us (214us total) trans 4295183700 rc 0/0 00000100:00100000:2.0:1713279306.800252:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281221888:12345-192.168.203.4@tcp:101:touch.0 Request processed in 184us (226us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.800255:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda88ec lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.800256:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785157 00000100:00100000:2.0:1713279306.800258:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785156 00010000:00010000:1.0:1713279306.800267:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda88f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.800271:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda88f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.800276:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda88f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.800280:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c868900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.800282:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda88f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.800287:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda88f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.800290:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.800293:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff8800940f8a00) 00010000:00010000:1.0:1713279306.800295:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.800296:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda88f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.800297:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281222272 00000100:00100000:2.0:1713279306.800299:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281222272 00010000:00010000:1.0:1713279306.800301:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda88f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.800308:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785158 00000100:00100000:2.0:1713279306.800310:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:11855:x1796503281222272:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.800315:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.800320:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda88d0 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758ba expref: 3435 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.800321:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129b33600/0xfc4b8e114eda8901 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x76fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391758cf expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.800327:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda88d0 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758ba expref: 3436 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.800334:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012068e400, rc 0) 00010000:00010000:2.0:1713279306.800335:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129b33600/0xfc4b8e114eda8901 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x76fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758cf expref: 3435 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.800340:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129b33600/0xfc4b8e114eda8901 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x76fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758cf expref: 3435 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.800347:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76fb:0x0].0x0 (ffff8800937ce800) 00010000:00010000:2.0:1713279306.800348:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1713279306.800349:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b33600, rc 0) 00000100:00100000:1.0:1713279306.800354:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:11204:x1796503281221824:12345-192.168.203.4@tcp:101:touch.0 Request processed in 288us (338us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.800360:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785155 00000100:00100000:2.0:1713279306.800362:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:11855:x1796503281222272:12345-192.168.203.4@tcp:101:touch.0 Request processed in 51us (73us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.800366:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785158 00000100:00100000:0.0:1713279306.800529:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.800538:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.800538:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281222336 00000100:00100000:2.0:1713279306.800541:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281222336 00000100:00100000:3.0:1713279306.800549:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281222208 00000100:00100000:2.0:1713279306.800550:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785159 00000100:00100000:0.0:1713279306.800552:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.800552:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3434:11666:x1796503281222336:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:3.0:1713279306.800552:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281222208 00010000:00010000:2.0:1713279306.800557:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.800560:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281222400 00010000:00010000:3.0:1713279306.800561:0:15711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9680/0xfc4b8e114eda3abf lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x7bca:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391744ee expref: 3687 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.800562:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114eda8908 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x261:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391758d6 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.800563:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281222400 00000100:00100000:3.0:1713279306.800578:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196522 00000100:00100000:1.0:1713279306.800580:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785160 00000100:00100000:3.0:1713279306.800581:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3687:1956:x1796503281222208:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.800585:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3721:11874:x1796503281222400:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.800585:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114eda8908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758d6 expref: 3435 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.800586:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.800589:0:15711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9680/0xfc4b8e114eda3abf lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x7bca:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391744ee expref: 3687 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.800590:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114eda8908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758d6 expref: 3435 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.800593:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.800594:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x0 (ffff8800908e1900) 00010000:00010000:2.0:1713279306.800595:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.800595:0:15711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9680/0xfc4b8e114eda3abf lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7bca:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391744ee expref: 3687 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.800596:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b31b00, rc 0) 00010000:00010000:1.0:1713279306.800600:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869200/0xfc4b8e114eda890f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391758dd expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.800603:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9680/0xfc4b8e114eda3abf lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7bca:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391744ee expref: 3687 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.800609:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7bca:0x0].0x0 (ffff880093598800) 00000100:00100000:2.0:1713279306.800610:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:11666:x1796503281222336:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 57us (82us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.800612:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279306.800613:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785159 00010000:00010000:3.0:1713279306.800616:0:15711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.800619:0:15711:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.800623:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda8916 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.800627:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.800630:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda8916 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.800632:0:15502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800636:0:15502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.800636:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda8916 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.800640:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3686:1956:x1796503281222208:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 58us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.800644:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196522 00010000:00010000:1.0:1713279306.800645:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda891d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.800650:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda891d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.800655:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda891d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.800674:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800677:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.800678:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda8924 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.800680:0:15502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800683:0:15502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008dae3180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.800684:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda8924 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.800685:0:15502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800688:0:15502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.800691:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda8924 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.800693:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7bca:0x0].0x0 (ffff880093598800) 00010000:00010000:0.0:1713279306.800695:0:15502:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1713279306.800696:0:15502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800699:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda87e9 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x7bca:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800704:0:15502:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114eda87d4 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800707:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114eda87d4 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800711:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114eda87d4 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800713:0:15502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114eda87d4 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800716:0:15502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008dae2d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.800717:0:15502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114eda87d4 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00000004:00200000:1.0:1713279306.800730:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.800733:0:15473:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1713279306.800741:0:15473:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda8924 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.800748:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda8916 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.800753:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda8916 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.800758:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda8916 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.800763:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda8916 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.800768:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c869f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.800771:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda8916 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.800776:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda8916 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.800783:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.800785:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.800787:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda8916 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.800791:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda8916 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.800799:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda891d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.800804:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda891d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.800809:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda891d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.800813:0:15502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114eda87d4 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.800813:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c86ad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.800815:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda891d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.800820:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda891d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.800821:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:0.0:1713279306.800822:0:15502:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.800824:0:15502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114eda87d4 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.800825:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff8800940f8200) 00010000:00010000:0.0:1713279306.800827:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114eda87d4 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.800828:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.800830:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda891d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.800831:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114eda87e2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800834:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114eda87e2 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.800834:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86ad00/0xfc4b8e114eda891d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.800837:0:15502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114eda87e2 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800840:0:15502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008dae3a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.800842:0:15502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114eda87e2 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800844:0:15502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114eda87e2 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800847:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3631 (ffff880096e84e00) 00010000:00010000:0.0:1713279306.800848:0:15502:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.800850:0:15502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114eda87e2 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.800851:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869200/0xfc4b8e114eda890f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758dd expref: 3723 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.800852:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114eda87e2 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.800860:0:15502:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.800860:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda8924 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758dd expref: 3722 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.800864:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.800866:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:0.0:1713279306.800868:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.800868:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713279306.800870:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c86b600, rc 0) 00010000:00010000:0.0:1713279306.800881:0:15502:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000004:00020000:0.0:1713279306.800884:0:15502:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0001: migrate [0x240000402:0x1:0x0]/16 failed: rc = -114 00000100:00100000:1.0:1713279306.800894:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3722:11874:x1796503281222400:12345-192.168.203.4@tcp:101:touch.0 Request processed in 308us (340us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.800898:0:6918:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1713279306.800900:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785160 00010000:00010000:2.0:1713279306.800902:0:6918:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.800904:0:15502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3434:11833:x1796503281205312:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 41467us (41521us total) trans 0 rc -114/-114 00010000:00010000:2.0:1713279306.800906:0:6918:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134a40b40 already unused, calling callback (ffffffffa0f0e520) 00000100:00100000:0.0:1713279306.800908:0:15502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14336 00010000:00010000:2.0:1713279306.800908:0:6918:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.800912:0:6918:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.800923:0:6918:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.800926:0:6918:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713279306.800935:0:6918:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.800939:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134a40b40/0xfc4b8e114eda8064 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda809c expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.800944:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279306.800945:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200037824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.800945:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.800946:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279306.800967:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.800994:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200037824 00000100:00100000:3.0:1713279306.800997:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200037824 00010000:00010000:3.0:1713279306.801005:0:15711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981f80/0xfc4b8e114eda809c lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8064 expref: 57 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.801015:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196523 00000100:00100000:3.0:1713279306.801017:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+57:3493:x1796503200037824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.801022:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.801024:0:15711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981f80/0xfc4b8e114eda809c lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda8064 expref: 57 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.801031:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981f80/0xfc4b8e114eda809c lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda8064 expref: 57 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.801037:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:3.0:1713279306.801040:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda81ad lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda81a6 expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.801044:0:15711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda81ad lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda81a6 expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.801048:0:15711:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda81ad lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda81a6 expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.801052:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.801060:0:15711:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda81ad lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda81a6 expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.801066:0:15711:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be06a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000_UUID:15711:1796503200037888:0@lo:105: 00000100:00100000:3.0:1713279306.801092:0:15711:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.801099:0:15711:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011f137180 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.801104:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200037888 00000100:00100000:0.0:1713279306.801107:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200037888 00000100:00100000:0.0:1713279306.801121:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33434 00000100:00100000:0.0:1713279306.801124:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15711:x1796503200037888:12345-0@lo:105: 00010000:00010000:0.0:1713279306.801128:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.801133:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.801137:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.801140:0:9213:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.801143:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.801147:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.801151:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.801233:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88008d982640) 00000100:00100000:2.0:1713279306.801236:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.801248:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.801253:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15711:x1796503200037888:12345-0@lo:105: Request processed in 128us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.801254:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.801256:0:15525:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.801257:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33434 00000100:00100000:3.0:1713279306.801260:0:15711:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be06a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000_UUID:15711:1796503200037888:0@lo:105: 00000100:00100000:2.0:1713279306.801261:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281222528 00000100:00100000:2.0:1713279306.801264:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281222528 00010000:00010000:3.0:1713279306.801267:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713279306.801270:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1713279306.801273:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281222784 00000100:00100000:2.0:1713279306.801274:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281222784 00000100:00100000:2.0:1713279306.801280:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785161 00000100:00100000:3.0:1713279306.801280:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+56:3493:x1796503200037824:12345-0@lo:103:ldlm_bl.0 Request processed in 262us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.801283:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3687:11933:x1796503281222528:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:0.0:1713279306.801284:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785162 00000100:00100000:3.0:1713279306.801284:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196523 00000100:00100000:0.0:1713279306.801287:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3687:11711:x1796503281222784:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.801288:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.801293:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.801293:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda892b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391758e4 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.801298:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200037824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.801299:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114eda8932 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391758eb expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.801320:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8939 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.801322:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181cb40/0xfc4b8e114eda8940 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.801324:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8939 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.801328:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8939 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.801328:0:15480:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754ed expref: 3433 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.801332:0:15480:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009181cb40/0xfc4b8e114eda8940 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.801334:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8947 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.801337:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8947 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.801341:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8947 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.801342:0:15480:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754ed expref: 3433 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.801344:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda894e lrc: 3/0,1 mode: --/CW res: [0x240000400:0x254:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.801351:0:15480:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754ed expref: 3433 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.801352:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda894e lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.801353:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8939 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.801356:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8939 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.801356:0:15480:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001_UUID:15480:1796503200037952:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.801358:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda894e lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.801359:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8939 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.801362:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8939 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.801365:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b61c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.801366:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8939 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.801367:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda8955 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x254:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.801369:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8939 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.801373:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880096e84a00) 00010000:00010000:1.0:1713279306.801373:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda8955 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.801373:0:15480:0:(client.c:2539:ptlrpc_set_wait()) set ffff880095a94780 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.801374:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.801376:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8939 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.801378:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8939 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.801378:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda8955 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.801383:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8947 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.801386:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8947 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.801389:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8947 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.801392:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b7180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.801393:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8947 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.801396:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8947 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.801399:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880096e84b00) 00010000:00010000:1.0:1713279306.801399:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.801400:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.801401:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8947 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.801404:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8947 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.801408:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114eda811a lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x7256:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756d0 expref: 3433 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.801432:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114eda8932 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758eb expref: 3689 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.801436:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114eda8932 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758eb expref: 3689 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.801441:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 4/0,1 mode: --/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.801442:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801245b58c0, rc 0) 00000100:00100000:0.0:1713279306.801457:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3688:11711:x1796503281222784:12345-192.168.203.4@tcp:101:touch.0 Request processed in 169us (202us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.801458:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114eda811a lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x7256:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756d0 expref: 3433 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.801460:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785162 00010000:00010000:1.0:1713279306.801466:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114eda811a lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x7256:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756d0 expref: 3433 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.801475:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001_UUID:15525:1796503200038016:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.801499:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.801653:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.801673:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.801691:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.801692:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281223360 00000100:00100000:1.0:1713279306.801696:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281223360 00000100:00100000:1.0:1713279306.801718:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281222656 00000100:00100000:1.0:1713279306.801721:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281222656 00000100:00100000:0.0:1713279306.801722:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281223232 00000100:00100000:0.0:1713279306.801725:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281223232 00000100:00100000:1.0:1713279306.801733:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785163 00000100:00100000:1.0:1713279306.801738:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3689:11912:x1796503281223360:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.801740:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785164 00000100:00100000:3.0:1713279306.801743:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3689:11932:x1796503281222656:12345-192.168.203.4@tcp:36:touch.0 00000100:00100000:2.0:1713279306.801744:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785165 00010000:00010000:1.0:1713279306.801746:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.801748:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11204:x1796503281223232:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.801754:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda8963 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175900 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.801756:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.801757:0:15485:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.801759:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.801761:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114eda896a lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391758f9 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.801764:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8898 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7ae9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758ac expref: 3690 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.801770:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ae9:0x0].0x0 (ffff88008da65800) 00010000:00010000:3.0:1713279306.801772:0:15485:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.801776:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281222848 00000100:00100000:2.0:1713279306.801778:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281222848 00010000:00010000:1.0:1713279306.801782:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda8971 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.801788:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda8971 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713279306.801789:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110486 00000100:00100000:2.0:1713279306.801792:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+82:11941:x1796503281222848:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.801792:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8978 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7ae9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.801794:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda8971 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.801795:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.801797:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8978 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7ae9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.801801:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda897f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1165:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391758f2 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.801801:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8978 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7ae9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.801803:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda8986 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.801808:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda8986 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.801810:0:15506:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114ed9cb7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1165:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391724c6 expref: 83 pid: 15556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.801813:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda8986 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.801814:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.801815:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.801817:0:15506:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda897f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x1165:0x0].0x0 rrc: 3 type: EXT [28672->57343] (req 28672->57343) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758f2 expref: 83 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.801825:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda8971 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713279306.801826:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.801827:0:15506:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114ed9cb7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1165:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391724c6 expref: 83 pid: 15556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.801829:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda8971 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00000004:00010000:3.0:1713279306.801829:0:15485:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007f07e680 reply state ffff8801234f2000 transno 4295183701 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8978 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7ae9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.801832:0:15506:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114ed9cb7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1165:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391724c6 expref: 83 pid: 15556 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.801834:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda8971 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.801834:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8978 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7ae9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.801838:0:15506:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15506:1796503200038080:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.801839:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda8971 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.801840:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ae9:0x0].0x0 (ffff88008da65800) 00010000:00010000:3.0:1713279306.801841:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.801843:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bf180 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.801843:0:15485:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713279306.801845:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda8971 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.801850:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda8971 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713279306.801853:0:15506:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606c180 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.801856:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff8800954bed00) 00000100:00100000:0.0:1713279306.801857:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.801858:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.801861:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda8971 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.801866:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda8971 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.801870:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281222976 00010000:00010000:2.0:1713279306.801871:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda898d lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.801872:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281222976 00010000:00010000:1.0:1713279306.801873:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda8986 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.801876:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda898d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.801879:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda8986 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.801880:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda898d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.801884:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda8986 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713279306.801886:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.801887:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935beac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.801890:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda8986 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.801892:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147245 00010000:00010000:1.0:1713279306.801894:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda8986 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.801895:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3722:1957:x1796503281222976:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.801897:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.801899:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281223040 00010000:00010000:3.0:1713279306.801899:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.801900:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88008da65700) 00000100:00100000:2.0:1713279306.801900:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281223040 00010000:00010000:1.0:1713279306.801902:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.801904:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281222912 00010000:00010000:1.0:1713279306.801904:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda8986 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.801905:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114eda886e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758a5 expref: 3722 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.801906:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281222912 00010000:00010000:1.0:1713279306.801909:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda8986 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713279306.801909:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110487 00010000:00010000:3.0:1713279306.801911:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00000100:00100000:2.0:1713279306.801912:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+84:1957:x1796503281223040:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:3.0:1713279306.801913:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.801914:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281223488 00000100:00100000:0.0:1713279306.801916:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281223488 00000100:00100000:0.0:1713279306.801923:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223045 00000100:00100000:3.0:1713279306.801925:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3722:1957:x1796503281222976:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 28us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.801926:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3722:11854:x1796503281222912:12345-192.168.203.4@tcp:37:lfs.0 00002000:00010000:2.0:1713279306.801926:0:15783:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x103f:0x0] initial LVB size: 0, mtime: 0x661e9148, atime: 0x661e9148, ctime: 0x661e9148, blocks: 0x0 00010000:00010000:1.0:1713279306.801927:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda8963 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175900 expref: 3691 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.801929:0:15783:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091dd73c0/0xfc4b8e114eda8994 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x103f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.801929:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147245 00010000:00010000:2.0:1713279306.801933:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.801934:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda8963 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175900 expref: 3691 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.801934:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.801936:0:15783:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091dd73c0/0xfc4b8e114eda8994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x103f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.801939:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3691:11932:x1796503281222656:12345-192.168.203.4@tcp:36:touch.0 Request processed in 195us (266us total) trans 4295183701 rc 0/0 00010000:00010000:2.0:1713279306.801941:0:15783:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091dd73c0/0xfc4b8e114eda8994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x103f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.801942:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785164 00010000:00010000:1.0:1713279306.801943:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bd8c0, rc 0) 00010000:00010000:2.0:1713279306.801946:0:15783:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091dd73c0/0xfc4b8e114eda8994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x103f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.801950:0:15783:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091dd73c0/0xfc4b8e114eda8994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x103f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.801953:0:15783:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091dd73c0/0xfc4b8e114eda8994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x103f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.801957:0:15783:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd73c0 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:2.0:1713279306.801959:0:15783:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091dd73c0/0xfc4b8e114eda8994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x103f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.801960:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3689:11912:x1796503281223360:12345-192.168.203.4@tcp:101:touch.0 Request processed in 221us (306us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.801963:0:15783:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091dd73c0/0xfc4b8e114eda8994 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x103f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.801963:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.801964:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785163 00010000:00010000:2.0:1713279306.801968:0:15783:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091dd73c0/0xfc4b8e114eda8994 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x103f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.801972:0:15783:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091dd73c0/0xfc4b8e114eda8994 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x103f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.801978:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281223552 00000100:00100000:1.0:1713279306.801980:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281223552 00000100:00100000:3.0:1713279306.801981:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.801995:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+84:1957:x1796503281223040:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 82us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.801997:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223046 00000100:00100000:2.0:1713279306.801999:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110487 00000100:00100000:1.0:1713279306.802001:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:11833:x1796503281223488:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.802001:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223047 00000100:00100000:3.0:1713279306.802004:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130147850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:11666:x1796503281223552:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:2.0:1713279306.802005:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281223104 00000100:00100000:2.0:1713279306.802006:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281223104 00000100:00100000:2.0:1713279306.802014:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110488 00000100:00100000:2.0:1713279306.802016:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+84:1956:x1796503281223104:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:1.0:1713279306.802025:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:11833:x1796503281223488:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 23us (126us total) trans 0 rc -116/-116 00000100:00100000:1.0:1713279306.802030:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223046 00000100:00100000:2.0:1713279306.802090:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+85:1956:x1796503281223104:12345-192.168.203.4@tcp:2:touch.0 Request processed in 72us (108us total) trans 4295010179 rc 0/0 00000100:00100000:2.0:1713279306.802094:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110488 00010000:00010000:2.0:1713279306.802109:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda899b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802114:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda899b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802118:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda899b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802131:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda898d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802134:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda898d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802137:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda898d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802140:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda898d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802144:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.802145:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda898d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802148:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda898d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802152:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:2.0:1713279306.802153:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.802155:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda898d lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802158:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114eda898d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802162:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda899b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802165:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda899b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802168:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda899b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802171:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.802172:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda899b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802174:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda899b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802177:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff88012d2e5000) 00010000:00010000:2.0:1713279306.802179:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.802180:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda899b lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802183:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114eda899b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.802194:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114eda896a lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758f9 expref: 3712 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.802198:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114eda896a lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758f9 expref: 3712 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.802203:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd5440, rc 0) 00000100:00100000:2.0:1713279306.802213:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11204:x1796503281223232:12345-192.168.203.4@tcp:101:touch.0 Request processed in 465us (522us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.802217:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785165 00000100:00100000:2.0:1713279306.802235:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.802261:0:15480:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001_UUID:15480:1796503200037952:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.802268:0:15480:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009181cb40/0xfc4b8e114eda8940 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.802312:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.802319:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281223616 00000100:00100000:2.0:1713279306.802321:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281223616 00010000:00010000:1.0:1713279306.802329:0:15525:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880131cdce00 x1796503200038016) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114eda811a lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x7256:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756d0 expref: 3434 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.802331:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281223680 00000100:00100000:2.0:1713279306.802332:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281223680 00010000:00010000:2.0:1713279306.802337:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754ed expref: 3435 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.802340:0:15525:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114eda811a lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x7256:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756d0 expref: 3435 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.802344:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196524 00000100:00100000:2.0:1713279306.802347:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:1957:x1796503281223680:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.802352:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114eda811a lrc: 0/0,0 mode: --/PW res: [0x240000403:0x7256:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756d0 expref: 3435 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.802352:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.802355:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754ed expref: 3435 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.802360:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754ed expref: 3434 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.802362:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001_UUID:15525:1796503200038016:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.802367:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda79cd lrc: 0/0,0 mode: --/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391754ed expref: 3434 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.802370:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7256:0x0].0x0 (ffff88007fdcac00) 00010000:00010000:2.0:1713279306.802373:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x753e:0x0].0x0 (ffff880095b48100) 00010000:00010000:1.0:1713279306.802374:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.802375:0:9215:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009181cb40/0xfc4b8e114eda8940 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.802378:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181cb40/0xfc4b8e114eda8940 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.802381:0:9215:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009181cb40/0xfc4b8e114eda8940 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.802384:0:15525:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.802388:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.802389:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802398:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.802398:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3434:1957:x1796503281223680:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 50us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.802402:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196524 00010000:00010000:1.0:1713279306.802404:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.802407:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147246 00010000:00010000:1.0:1713279306.802409:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.802409:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:385c4b71-808c-40cf-91de-b076b668d13f+3723:1956:x1796503281223616:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.802427:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.802433:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86b600/0xfc4b8e114eda8924 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758dd expref: 3723 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.802441:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:2.0:1713279306.802443:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.802451:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:385c4b71-808c-40cf-91de-b076b668d13f+3722:1956:x1796503281223616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 41us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.802454:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147246 00010000:00010000:2.0:1713279306.802463:0:15480:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009181cb40/0xfc4b8e114eda8940 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.802466:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181cb40/0xfc4b8e114eda8940 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:2.0:1713279306.802471:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x753e:0x0]: returning size 15382 00010000:00010000:1.0:1713279306.802479:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802485:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802490:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802494:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e608b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.802497:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802502:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.802502:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda892b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758e4 expref: 3690 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.802508:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181cb40/0xfc4b8e114eda8940 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x753e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758e4 expref: 3689 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.802509:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7256:0x0].0x0 (ffff88007fdcac00) 00010000:00010000:1.0:1713279306.802511:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.802512:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x753e:0x0].0x0 (ffff880095b48100) 00010000:00010000:1.0:1713279306.802513:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 2/0,0 mode: --/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.802513:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1713279306.802514:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009181cb40, rc 0) 00010000:00010000:1.0:1713279306.802518:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114eda895c lrc: 0/0,0 mode: --/EX res: [0x240000403:0x7256:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.802524:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3689:11933:x1796503281222528:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 1241us (1289us total) trans 4295183702 rc 0/0 00010000:00010000:1.0:1713279306.802527:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda894e lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.802528:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785161 00010000:00010000:1.0:1713279306.802532:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda894e lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802537:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda894e lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802542:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda894e lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802546:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c868480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.802548:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda894e lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802553:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda894e lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802559:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x254:0x0].0x0 (ffff8800940a8800) 00010000:00010000:1.0:1713279306.802561:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.802563:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda894e lrc: 3/0,0 mode: --/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802567:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda894e lrc: 0/0,0 mode: --/CW res: [0x240000400:0x254:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802576:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda8955 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802585:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda8955 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802590:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda8955 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802593:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.802596:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda8955 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802601:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda8955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802607:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x254:0x0].0x3931 (ffff880092ae7100) 00010000:00010000:1.0:1713279306.802610:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.802612:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda8955 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802617:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda8955 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x254:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.802629:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.802635:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.802641:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.802660:0:15525:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000004:00020000:1.0:1713279306.802664:0:15525:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0001: migrate [0x240000403:0x729c:0x0]/19 failed: rc = -114 00010000:00010000:3.0:1713279306.802672:0:8071:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.802676:0:8071:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.802684:0:8071:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982640 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.802687:0:8071:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.802691:0:8071:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.802697:0:15525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3433:9807:x1796503281207488:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 34247us (34425us total) trans 0 rc -114/-114 00010000:00010000:3.0:1713279306.802702:0:8071:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.802703:0:15525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14337 00010000:00010000:3.0:1713279306.802706:0:8071:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713279306.802718:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200038144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.802720:0:8071:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.802724:0:8071:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d982640/0xfc4b8e114eda81a6 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda81ad expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.802729:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.802730:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.802731:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279306.802732:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.802747:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200038144 00000100:00100000:1.0:1713279306.802750:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200038144 00010000:00010000:1.0:1713279306.802762:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda81ad lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda81a6 expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.802778:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196525 00000100:00100000:1.0:1713279306.802783:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+56:3490:x1796503200038144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.802790:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.802794:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda81ad lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda81a6 expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.802805:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda81ad lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda81a6 expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.802813:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.802816:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.802822:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.802826:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.802832:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.802847:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.802871:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+55:3490:x1796503200038144:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.802873:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200038144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.802878:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196525 00000100:00100000:2.0:1713279306.802911:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.802917:0:6943:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00000100:00100000:2.0:1713279306.802918:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281223808 00000100:00100000:2.0:1713279306.802920:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281223808 00010000:00010000:0.0:1713279306.802922:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00000004:00080000:0.0:1713279306.802933:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00000100:00100000:2.0:1713279306.802933:0:15506:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15506:1796503200038080:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.802941:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda897f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1165:0x0].0x0 rrc: 3 type: EXT [28672->57343] (req 28672->57343) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758f2 expref: 83 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.802948:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd5680, rc 0) 00000100:00100000:0.0:1713279306.802950:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038208:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.802958:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.802959:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+83:11941:x1796503281222848:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 1167us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.802963:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110486 00000100:00100000:0.0:1713279306.802968:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.802975:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123727180 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.802977:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281223936 00000100:00100000:2.0:1713279306.802978:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281223936 00000100:00100000:2.0:1713279306.802985:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785166 00000100:00100000:2.0:1713279306.802988:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3723:11711:x1796503281223808:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.802992:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785167 00010000:00010000:2.0:1713279306.802993:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.802997:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3722:11899:x1796503281223936:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.802998:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda89a9 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175907 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.803005:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.803013:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda89b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917590e expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.803031:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda89b7 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803035:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda89b7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803039:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda89b7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803045:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda89be lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803049:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda89be lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.803052:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda89c5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.803052:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda89be lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000004:00200000:2.0:1713279306.803059:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:1.0:1713279306.803060:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda89c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.803063:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda89b7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.803066:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda89c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.803066:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda89b7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803085:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda89b7 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803088:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda89b7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803091:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e8fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.803092:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda89cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.803092:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda89b7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803095:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda89b7 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.803096:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda89cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.803099:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880130675700) 00010000:00010000:1.0:1713279306.803100:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda89cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.803101:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.803102:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda89b7 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803105:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda89b7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803113:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda89be lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803116:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda89be lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803119:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda89be lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803121:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906eba80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.803122:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda89be lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803125:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda89be lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803128:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880130675a00) 00010000:00010000:2.0:1713279306.803129:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.803130:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda89be lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.803133:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda89be lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000004:00200000:1.0:1713279306.803141:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8266:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.803146:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda89c5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.803146:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda89a9 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175907 expref: 3724 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.803150:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda89c5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.803150:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda89a9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175907 expref: 3724 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.803153:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda89c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.803155:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd7a80, rc 0) 00010000:00010000:1.0:1713279306.803156:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda89c5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.803159:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.803160:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda89c5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.803163:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda89c5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.803167:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00000100:00100000:2.0:1713279306.803167:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3723:11711:x1796503281223808:12345-192.168.203.4@tcp:101:touch.0 Request processed in 178us (255us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.803169:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.803170:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda89c5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.803171:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785166 00010000:00010000:1.0:1713279306.803174:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda89c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.803181:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda89cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.803185:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda89cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.803189:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda89cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.803193:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.803196:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda89cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.803201:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda89cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.803207:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3731 (ffff88008dba4500) 00010000:00010000:1.0:1713279306.803208:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.803210:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda89cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.803214:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda89cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.803231:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda89b0 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917590e expref: 3722 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.803237:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda89b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917590e expref: 3722 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.803243:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bc480, rc 0) 00000100:00100000:2.0:1713279306.803260:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.803264:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3721:11899:x1796503281223936:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 266us (305us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.803270:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785167 00000100:00100000:1.0:1713279306.803281:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281224128 00000100:00100000:1.0:1713279306.803284:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281224128 00000100:00100000:2.0:1713279306.803294:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.803298:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785168 00000100:00100000:1.0:1713279306.803304:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3432:11833:x1796503281224128:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.803313:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281224000 00000100:00100000:1.0:1713279306.803315:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281224000 00010000:00010000:1.0:1713279306.803323:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114ed9cb7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1165:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391724c6 expref: 85 pid: 15556 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.803337:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196526 00000100:00100000:1.0:1713279306.803341:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+85:1956:x1796503281224000:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.803347:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.803357:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114ed9cb7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1165:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391724c6 expref: 85 pid: 15556 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.803366:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114ed9cb7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1165:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391724c6 expref: 85 pid: 15556 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.803379:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114ed9cb7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1165:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391724c6 expref: 85 pid: 15556 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.803387:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.803389:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.803393:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda897f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1165:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->57343) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758f2 expref: 82 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.803400:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda897f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1165:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->57343) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758f2 expref: 82 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.803434:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130147850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3432:11666:x1796503281223552:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1428us (1469us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.803435:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091dd5680/0xfc4b8e114eda897f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1165:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->57343) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758f2 expref: 82 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.803439:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223047 00000100:00100000:1.0:1713279306.803445:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6917:1796503200038272:192.168.203.4@tcp:105: 00000100:00100000:1.0:1713279306.803467:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0540 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.803478:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3720:11854:x1796503281222912:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1550us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.803482:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223045 00010000:00010000:1.0:1713279306.803482:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.803490:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda89d3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175915 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.803511:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.803519:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda89da lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.803522:0:15525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281224256 00000100:00100000:0.0:1713279306.803524:0:15525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281224256 00010000:00010000:1.0:1713279306.803526:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda89da lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.803532:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda89da lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.803535:0:15525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14342 00000100:00100000:2.0:1713279306.803536:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.803539:0:15525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3433:11374:x1796503281224256:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:1.0:1713279306.803540:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda89e1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.803545:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda89e1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.803550:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda89e1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.803551:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.803564:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 15525 initiator: MDT0 00000100:00100000:3.0:1713279306.803565:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281224448 00010000:00010000:0.0:1713279306.803568:0:15525:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 15525 initiator: MDT1 00000100:00100000:3.0:1713279306.803569:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281224448 00010000:00010000:0.0:1713279306.803572:0:15525:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.803574:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda89da lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.803578:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda89da lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.803579:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200038336:0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713279306.803582:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda89da lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.803587:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda89da lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.803588:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110489 00000100:00100000:0.0:1713279306.803593:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.803593:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+78:1957:x1796503281224448:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:1.0:1713279306.803595:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bf3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.803597:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda89da lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.803599:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880130637540 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.803601:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda89da lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.803602:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200038208 00000100:00100000:2.0:1713279306.803604:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200038208 00000100:00100000:0.0:1713279306.803607:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281224384 00010000:00010000:1.0:1713279306.803607:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:1.0:1713279306.803608:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.803609:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281224384 00010000:00010000:1.0:1713279306.803610:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda89da lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.803615:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda89da lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.803615:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200038336 00000100:00100000:2.0:1713279306.803616:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200038336 00000100:00100000:0.0:1713279306.803619:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223048 00000100:00100000:0.0:1713279306.803621:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3434:11855:x1796503281224384:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:1.0:1713279306.803621:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda89e1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.803625:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda89e1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.803625:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98759 00000100:00100000:2.0:1713279306.803628:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+124:6943:x1796503200038208:12345-0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1713279306.803629:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda89e1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.803633:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.803635:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda89e1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.803640:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda89e1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.803645:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3631 (ffff880123701600) 00010000:00010000:1.0:1713279306.803647:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.803649:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda89e1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.803653:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda89e1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.803657:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+79:1957:x1796503281224448:12345-192.168.203.4@tcp:2:touch.0 Request processed in 63us (104us total) trans 4295010121 rc 0/0 00000100:00100000:3.0:1713279306.803660:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110489 00000100:00100000:2.0:1713279306.803664:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+124:6943:x1796503200038208:12345-0@lo:1000:mdt_io00_002.0 Request processed in 35us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.803668:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98759 00010000:00010000:1.0:1713279306.803671:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda89d3 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175915 expref: 3435 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.803673:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98760 00000100:00100000:3.0:1713279306.803676:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200038336:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713279306.803678:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda89d3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175915 expref: 3435 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.803681:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.803685:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bfcc0, rc 0) 00000100:00100000:0.0:1713279306.803688:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3434:11855:x1796503281224384:12345-192.168.203.4@tcp:35:touch.0 Request processed in 64us (150us total) trans 4295183703 rc 0/0 00010000:00010000:3.0:1713279306.803688:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda89ef lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda89e8 expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.803692:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223048 00010000:00010000:3.0:1713279306.803696:0:15494:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.803701:0:15494:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda89ef lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda89e8 expref: 56 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.803704:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3433:11833:x1796503281224128:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 399us (443us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.803707:0:15494:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.803709:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038208:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.803710:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785168 00010000:00010000:3.0:1713279306.803713:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda89ef lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda89e8 expref: 56 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.803716:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:3.0:1713279306.803718:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.803719:0:15494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00010000:00010000:3.0:1713279306.803722:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cbc000, rc 0) 00000100:00100000:0.0:1713279306.803730:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038400:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.803739:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15525:x1796503200038336:12345-0@lo:101:mdt_io00_009.0 Request processed in 62us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.803745:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.803745:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98760 00000100:00100000:2.0:1713279306.803748:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200038336:0@lo:101:mdt_io00_009.0 00000100:00100000:0.0:1713279306.803751:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123727180 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.803752:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200038400 00000100:00100000:3.0:1713279306.803754:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200038400 00010000:00010000:2.0:1713279306.803755:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.803759:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.803762:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98761 00000100:00100000:3.0:1713279306.803764:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+124:6943:x1796503200038400:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.803786:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+124:6943:x1796503200038400:12345-0@lo:1000:mdt_io00_002.0 Request processed in 21us (41us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.803789:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98761 00000100:00100000:0.0:1713279306.803794:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038400:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.803811:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038464:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.803822:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.803828:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237273c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.803831:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200038464 00000100:00100000:3.0:1713279306.803833:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200038464 00000100:00100000:3.0:1713279306.803840:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98762 00000100:00100000:3.0:1713279306.803842:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+124:6943:x1796503200038464:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.803879:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+124:6943:x1796503200038464:12345-0@lo:1000:mdt_io00_002.0 Request processed in 36us (56us total) trans 0 rc 1/1 00000100:00100000:3.0:1713279306.803882:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98762 00000100:00100000:3.0:1713279306.803917:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.803918:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038464:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.803932:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281224576 00000100:00100000:1.0:1713279306.803937:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281224576 00010000:00010000:0.0:1713279306.803940:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008c366880/0xfc4b8e114eda89f6 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.803944:0:6943:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008c366880/0xfc4b8e114eda89f6 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.803948:0:6943:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008c366880/0xfc4b8e114eda89f6 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6943 initiator: MDT0 00000100:00100000:0.0:1713279306.803953:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090ebb100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038528:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1713279306.803954:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785169 00000100:00100000:1.0:1713279306.803959:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3433:11204:x1796503281224576:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.803966:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.803968:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.803971:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fb40 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.803975:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda89fd lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917591c expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.803975:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200038528 00000100:00100000:3.0:1713279306.803977:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200038528 00000100:00100000:3.0:1713279306.803986:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98763 00000100:00100000:3.0:1713279306.803989:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+124:6943:x1796503200038528:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1713279306.803993:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.803999:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114eda8a04 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda89f6 expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.804007:0:15494:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114eda8a04 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda89f6 expref: 125 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.804016:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114eda8a04 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda89f6 expref: 125 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.804019:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:1.0:1713279306.804020:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114eda8a0b lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.804020:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.804021:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c90240, rc 0) 00010000:00010000:1.0:1713279306.804028:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114eda8a0b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.804034:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114eda8a0b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.804035:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+125:6943:x1796503200038528:12345-0@lo:101:mdt_io00_002.0 Request processed in 46us (69us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.804039:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98763 00000100:00100000:0.0:1713279306.804042:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090ebb100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038528:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1713279306.804045:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda8a12 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.804047:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008c366880/0xfc4b8e114eda89f6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8a04 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.804050:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda8a12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.804052:0:6943:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008c366880/0xfc4b8e114eda89f6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8a04 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.804055:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda8a12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00080000:0.0:1713279306.804058:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:0.0:1713279306.804081:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6943 initiator: MDT0 00000004:00200000:1.0:1713279306.804081:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:0.0:1713279306.804084:0:6943:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.804088:0:6943:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.804089:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114eda8a0b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.804093:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090ebb100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038592:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1713279306.804094:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114eda8a0b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.804099:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114eda8a0b lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.804104:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114eda8a0b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.804105:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.804108:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcd80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.804111:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fb40 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.804111:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114eda8a0b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.804115:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200038592 00010000:00010000:1.0:1713279306.804116:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114eda8a0b lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.804117:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200038592 00010000:00010000:1.0:1713279306.804122:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:1.0:1713279306.804124:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.804125:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98764 00010000:00010000:1.0:1713279306.804127:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114eda8a0b lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.804127:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+125:6943:x1796503200038592:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1713279306.804131:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.804135:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114eda8a0b lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.804137:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90d80/0xfc4b8e114eda8a20 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda8a19 expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.804143:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda8a12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.804145:0:15494:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90d80/0xfc4b8e114eda8a20 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda8a19 expref: 126 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.804148:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda8a12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.804150:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90d80/0xfc4b8e114eda8a20 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8a19 expref: 126 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.804153:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda8a12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.804153:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x31 (ffff88008e59ca00) 00010000:00010000:3.0:1713279306.804154:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.804156:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c90d80, rc 0) 00010000:00010000:1.0:1713279306.804157:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c9b5200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.804159:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda8a12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.804164:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda8a12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.804168:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+126:6943:x1796503200038592:12345-0@lo:101:mdt_io00_002.0 Request processed in 41us (63us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.804170:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880123701d00) 00000100:00100000:3.0:1713279306.804172:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98764 00010000:00010000:1.0:1713279306.804173:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.804175:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090ebb100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038592:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1713279306.804175:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda8a12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.804180:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8a20 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.804180:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda8a12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.804184:0:6943:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8a20 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.804189:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:0.0:1713279306.804198:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.804201:0:6943:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.804201:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda89fd lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917591c expref: 3434 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.804205:0:6943:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.804209:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda89fd lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917591c expref: 3434 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.804211:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090ebb100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038656:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1713279306.804220:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.804221:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bd680, rc 0) 00000100:00100000:0.0:1713279306.804225:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.804229:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200038656 00000100:00100000:3.0:1713279306.804230:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200038656 00000100:00100000:3.0:1713279306.804238:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98765 00000100:00100000:3.0:1713279306.804240:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+126:6943:x1796503200038656:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1713279306.804244:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.804248:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93a80/0xfc4b8e114eda8a2e lrc: 2/0,0 mode: --/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda8a27 expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.804253:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3433:11204:x1796503281224576:12345-192.168.203.4@tcp:101:touch.0 Request processed in 292us (335us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.804256:0:15494:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6fb6 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x721d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175269 expref: 3433 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.804260:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785169 00010000:00010000:3.0:1713279306.804260:0:15494:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93a80/0xfc4b8e114eda8a2e lrc: 4/0,0 mode: --/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda8a27 expref: 127 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.804270:0:15494:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x721d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175269 expref: 3432 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.804276:0:15494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6fb6 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x721d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175269 expref: 3432 pid: 6929 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.804282:0:15494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:15494:1796503200038720:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.804297:0:15494:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.804330:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.804347:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.804362:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281224768 00000100:00100000:1.0:1713279306.804366:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281224768 00000100:00100000:0.0:1713279306.804369:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281224640 00000100:00100000:0.0:1713279306.804372:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281224640 00000100:00100000:1.0:1713279306.804381:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785170 00000100:00100000:1.0:1713279306.804386:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3720:11942:x1796503281224768:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:0.0:1713279306.804388:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110490 00000100:00100000:0.0:1713279306.804391:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+79:1956:x1796503281224640:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:1.0:1713279306.804393:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.804397:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.804401:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda8a35 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175923 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713279306.804453:0:15506:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb size from disk: 15382 -> 15382 00002000:00010000:0.0:1713279306.804455:0:15506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb mtime from disk: 1713279304 -> 1713279304 00002000:00010000:0.0:1713279306.804457:0:15506:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb atime from disk: 1713279304 -> 1713279304 00002000:00010000:0.0:1713279306.804458:0:15506:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279306.804460:0:15506:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb blocks from disk: 80 -> 80 00010000:00010000:1.0:1713279306.804467:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda8a3c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.804475:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+80:1956:x1796503281224640:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 83us (145us total) trans 4295010122 rc 0/0 00010000:00010000:1.0:1713279306.804476:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda8a3c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.804479:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110490 00010000:00010000:1.0:1713279306.804482:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda8a3c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804491:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda8a43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.804495:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281224896 00000100:00100000:0.0:1713279306.804497:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281224896 00010000:00010000:1.0:1713279306.804497:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda8a43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804502:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda8a43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.804505:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223049 00000100:00100000:0.0:1713279306.804508:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3433:9807:x1796503281224896:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1713279306.804531:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3433:9807:x1796503281224896:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 22us (135us total) trans 0 rc -116/-116 00000100:00100000:0.0:1713279306.804535:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223049 00000004:00200000:1.0:1713279306.804561:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7ccb:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.804569:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda8a3c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804575:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda8a3c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804579:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda8a3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804584:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda8a3c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804588:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009160a880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.804591:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda8a3c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804595:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda8a3c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804603:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:1.0:1713279306.804605:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.804607:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda8a3c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804612:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114eda8a3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804620:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda8a43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804624:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda8a43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804633:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda8a43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804638:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800950718c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.804640:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda8a43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804644:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda8a43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804650:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x30 (ffff880123701500) 00010000:00010000:1.0:1713279306.804652:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.804654:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda8a43 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804658:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950718c0/0xfc4b8e114eda8a43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.804677:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda8a35 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175923 expref: 3721 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.804685:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda8a35 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175923 expref: 3721 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.804691:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c9b5680, rc 0) 00000100:00100000:1.0:1713279306.804715:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3720:11942:x1796503281224768:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 328us (366us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.804721:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785170 00000100:00100000:0.0:1713279306.804999:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.805041:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281225024 00000100:00100000:1.0:1713279306.805045:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281225024 00000100:00100000:1.0:1713279306.805083:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785171 00000100:00100000:1.0:1713279306.805088:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3689:11711:x1796503281225024:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.805096:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.805105:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda8a4a lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917592a expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.805134:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda8a51 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.805140:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda8a51 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805147:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda8a51 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805156:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda8a58 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.805161:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda8a58 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805166:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda8a58 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805184:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda8a51 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805190:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda8a51 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805194:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda8a51 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805199:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda8a51 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805204:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dca880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.805206:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda8a51 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805211:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda8a51 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805218:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880123701a00) 00010000:00010000:1.0:1713279306.805219:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.805222:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda8a51 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805226:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda8a51 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805234:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda8a58 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805239:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda8a58 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805243:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda8a58 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805248:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ceacd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.805250:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda8a58 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805255:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda8a58 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805261:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880131204400) 00010000:00010000:1.0:1713279306.805263:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.805265:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda8a58 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805270:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda8a58 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.805289:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda8a4a lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917592a expref: 3690 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.805295:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda8a4a lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917592a expref: 3690 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.805304:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943f3600, rc 0) 00000100:00100000:1.0:1713279306.805335:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3689:11711:x1796503281225024:12345-192.168.203.4@tcp:101:touch.0 Request processed in 245us (334us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.805341:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785171 00000100:00100000:0.0:1713279306.806047:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.806063:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.806095:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281225216 00000100:00100000:3.0:1713279306.806099:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281225216 00000100:00100000:2.0:1713279306.806103:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.806112:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6917:1796503200038272:192.168.203.4@tcp:105: 00000100:00100000:3.0:1713279306.806116:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281225088 00000100:00100000:3.0:1713279306.806117:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281225088 00000100:00100000:2.0:1713279306.806120:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281225344 00010000:00010000:1.0:1713279306.806121:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.806123:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281225344 00000100:00100000:3.0:1713279306.806126:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785172 00000100:00100000:3.0:1713279306.806129:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3720:11900:x1796503281225216:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.806135:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.806139:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785173 00010000:00010000:3.0:1713279306.806140:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda8a5f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175938 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.806144:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3433:11666:x1796503281225088:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.806145:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+84:1956:x1796503281224000:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 2801us (2847us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.806149:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.806151:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.806152:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196526 00010000:00010000:2.0:1713279306.806158:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb840/0xfc4b8e114eda8a66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175931 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.806161:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281225408 00000100:00100000:0.0:1713279306.806164:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281225408 00000100:00100000:1.0:1713279306.806169:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785174 00010000:00010000:2.0:1713279306.806170:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb840/0xfc4b8e114eda8a66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175931 expref: 3434 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.806174:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3690:11912:x1796503281225344:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.806177:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8a6d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.806178:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb840/0xfc4b8e114eda8a66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175931 expref: 3434 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.806182:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223050 00010000:00010000:1.0:1713279306.806182:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.806182:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff880092193400) 00010000:00010000:3.0:1713279306.806182:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8a6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.806184:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.806185:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906eb840, rc 0) 00000100:00100000:0.0:1713279306.806186:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3690:11854:x1796503281225408:12345-192.168.203.4@tcp:37:lfs.0 00010000:00010000:3.0:1713279306.806186:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8a6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.806192:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114eda8a74 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917593f expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.806193:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda8a7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806197:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda8a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806200:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda8a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713279306.806202:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3434:11666:x1796503281225088:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 59us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.806206:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785173 00010000:00010000:3.0:1713279306.806219:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114eda8a82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806224:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114eda8a82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806227:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114eda8a82 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806230:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114eda8a82 lrc: 3/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806233:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800902ab840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.806235:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114eda8a82 lrc: 3/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806238:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114eda8a82 lrc: 4/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.806239:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114eda8a89 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.806241:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:3.0:1713279306.806244:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114eda8a82 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806246:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114eda8a82 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.806248:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114eda8a89 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000004:00200000:3.0:1713279306.806252:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7fe9:0x0]: returning size 46934 00010000:00010000:1.0:1713279306.806255:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114eda8a89 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.806264:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda8a97 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.806270:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda8a97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.806275:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda8a97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.806276:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8a6d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806279:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8a6d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806282:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8a6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806285:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8a6d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806287:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880130c93cc0 already unused, calling callback (ffffffffa0f0d730) 00000004:00200000:1.0:1713279306.806288:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:3.0:1713279306.806289:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8a6d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806291:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8a6d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.806295:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114eda8a89 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.806298:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.806299:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.806301:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114eda8a89 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.806301:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8a6d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806304:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8a6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.806306:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114eda8a89 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.806308:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda8a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.806311:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114eda8a89 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.806311:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda8a7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806314:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda8a7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.806315:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e640 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.806317:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.806317:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009681c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.806318:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114eda8a89 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.806318:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda8a7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806321:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda8a7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.806324:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114eda8a89 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.806324:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x38 (ffff88007fc53100) 00010000:00010000:3.0:1713279306.806325:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.806326:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda8a7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713279306.806327:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.806329:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda8a7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713279306.806333:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281225664 00010000:00010000:1.0:1713279306.806335:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00000100:00100000:2.0:1713279306.806336:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281225664 00010000:00010000:1.0:1713279306.806337:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.806339:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114eda8a89 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.806342:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda8a5f lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175938 expref: 3722 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.806344:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114eda8a89 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.806346:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223051 00010000:00010000:3.0:1713279306.806347:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114eda8a5f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175938 expref: 3722 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.806349:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3692:11933:x1796503281225664:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:1.0:1713279306.806351:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda8a97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.806352:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c92640, rc 0) 00010000:00010000:1.0:1713279306.806356:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda8a97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.806361:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda8a97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.806366:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e400 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.806367:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3721:11900:x1796503281225216:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 237us (322us total) trans 4295202676 rc 301/301 00010000:00010000:1.0:1713279306.806368:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda8a97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.806370:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785172 00010000:00010000:1.0:1713279306.806373:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda8a97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.806378:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281225536 00010000:00010000:1.0:1713279306.806379:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880131204f00) 00000100:00100000:3.0:1713279306.806380:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281225536 00010000:00010000:1.0:1713279306.806381:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.806383:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda8a97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.806388:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda8a97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.806389:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785175 00000100:00100000:3.0:1713279306.806391:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11204:x1796503281225536:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.806397:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.806400:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3693:11933:x1796503281225664:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 49us (71us total) trans 4295183704 rc 0/0 00010000:00010000:3.0:1713279306.806401:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d507cc0/0xfc4b8e114eda8a9e lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175946 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.806404:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223051 00010000:00010000:1.0:1713279306.806410:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114eda8a74 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917593f expref: 3692 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.806437:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114eda8aa5 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.806439:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114eda8a74 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917593f expref: 3692 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.806442:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114eda8aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806446:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114eda8aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.806447:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013597cd80, rc 0) 00010000:00010000:3.0:1713279306.806452:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092920240/0xfc4b8e114eda8aac lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806455:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092920240/0xfc4b8e114eda8aac lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806459:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092920240/0xfc4b8e114eda8aac lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713279306.806464:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.806468:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3691:11912:x1796503281225344:12345-192.168.203.4@tcp:101:touch.0 Request processed in 293us (366us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.806471:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281225792 00010000:00010000:3.0:1713279306.806471:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114eda8aa5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713279306.806473:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281225792 00000100:00100000:1.0:1713279306.806474:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785174 00010000:00010000:3.0:1713279306.806474:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114eda8aa5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806477:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114eda8aa5 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713279306.806481:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223052 00010000:00010000:3.0:1713279306.806482:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114eda8aa5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713279306.806484:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3434:9807:x1796503281225792:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:3.0:1713279306.806486:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800929098c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.806488:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114eda8aa5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806493:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114eda8aa5 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806500:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:3.0:1713279306.806502:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.806504:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114eda8aa5 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806509:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114eda8aa5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806515:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092920240/0xfc4b8e114eda8aac lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806521:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092920240/0xfc4b8e114eda8aac lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806526:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092920240/0xfc4b8e114eda8aac lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806530:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092920240 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.806531:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:9807:x1796503281225792:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 45us (67us total) trans 4295183705 rc 0/0 00010000:00010000:3.0:1713279306.806532:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092920240/0xfc4b8e114eda8aac lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713279306.806534:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223052 00010000:00010000:3.0:1713279306.806537:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092920240/0xfc4b8e114eda8aac lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806542:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880082706000) 00010000:00010000:3.0:1713279306.806543:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.806545:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092920240/0xfc4b8e114eda8aac lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.806550:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092920240/0xfc4b8e114eda8aac lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713279306.806552:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.806563:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.806567:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d507cc0/0xfc4b8e114eda8a9e lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175946 expref: 3712 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.806568:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281225856 00000100:00100000:1.0:1713279306.806573:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281225856 00010000:00010000:3.0:1713279306.806574:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d507cc0/0xfc4b8e114eda8a9e lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175946 expref: 3712 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.806581:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281225920 00010000:00010000:3.0:1713279306.806581:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d507cc0, rc 0) 00000100:00100000:1.0:1713279306.806583:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281225920 00000100:00100000:2.0:1713279306.806590:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.806592:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6fb6 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x721d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175269 expref: 3435 pid: 6929 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.806599:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11204:x1796503281225536:12345-192.168.203.4@tcp:101:touch.0 Request processed in 206us (282us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.806603:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785175 00000100:00100000:1.0:1713279306.806607:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196527 00000100:00100000:1.0:1713279306.806611:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:1957:x1796503281225920:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.806617:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.806621:0:15494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:15494:1796503200038720:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.806622:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6fb6 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x721d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175269 expref: 3435 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.806631:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x721d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175269 expref: 3435 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.806644:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096b9ed00/0xfc4b8e114eda6fb6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x721d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175269 expref: 3435 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.806644:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93a80/0xfc4b8e114eda8a2e lrc: 3/0,0 mode: --/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8a27 expref: 127 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.806648:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x721d:0x0].0x0 (ffff8800902cc000) 00010000:00010000:3.0:1713279306.806650:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1713279306.806652:0:15494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93a80/0xfc4b8e114eda8a2e lrc: 3/0,0 mode: --/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8a27 expref: 127 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.806656:0:15494:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93a80/0xfc4b8e114eda8a2e lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114eda8a27 expref: 127 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.806660:0:15494:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93a80/0xfc4b8e114eda8a2e lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114eda8a27 expref: 127 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.806666:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x721d:0x0].0x0 (ffff8800902cc000) 00010000:00010000:1.0:1713279306.806669:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.806674:0:15494:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93a80/0xfc4b8e114eda8a2e lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8a27 expref: 127 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.806679:0:15494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764c700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:15494:1796503200038784:0@lo:105: 00000100:00100000:1.0:1713279306.806683:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3434:1957:x1796503281225920:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 70us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.806689:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196527 00000100:00100000:3.0:1713279306.806693:0:15494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.806695:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281225984 00000100:00100000:0.0:1713279306.806698:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281225984 00000100:00100000:3.0:1713279306.806701:0:15494:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.806716:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110491 00000100:00100000:0.0:1713279306.806720:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281225984:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:1.0:1713279306.806720:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98766 00000100:00100000:1.0:1713279306.806724:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:1954:x1796503281225856:12345-192.168.203.4@tcp:63:ll_sa.0 00010000:00010000:1.0:1713279306.806740:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.806750:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda8ab3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x149:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917594d expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.806772:0:15542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda8aba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x149:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15542 initiator: MDT0 00010000:00010000:1.0:1713279306.806779:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda8aba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15542 initiator: MDT0 00002000:00010000:0.0:1713279306.806782:0:15506:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x1165:0x0] updating lvb size from disk: 32236 -> 32236 00002000:00010000:0.0:1713279306.806784:0:15506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1165:0x0] updating lvb mtime from disk: 1713279305 -> 1713279305 00002000:00010000:0.0:1713279306.806786:0:15506:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x1165:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1713279306.806786:0:15542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda8aba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15542 initiator: MDT0 00002000:00010000:0.0:1713279306.806787:0:15506:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x1165:0x0] updating lvb ctime from disk: 1713279305 -> 1713279305 00002000:00010000:0.0:1713279306.806788:0:15506:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x1165:0x0] updating lvb blocks from disk: 24 -> 24 00010000:00010000:1.0:1713279306.806795:0:15542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda8ac1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15542 initiator: MDT0 00010000:00010000:1.0:1713279306.806800:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda8ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15542 initiator: MDT0 00000100:00100000:0.0:1713279306.806801:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+84:1956:x1796503281225984:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 80us (210us total) trans 4295010180 rc 0/0 00000100:00100000:0.0:1713279306.806805:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110491 00010000:00010000:1.0:1713279306.806806:0:15542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda8ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15542 initiator: MDT0 00000100:00100000:0.0:1713279306.806817:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200038784 00000100:00100000:0.0:1713279306.806819:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200038784 00000100:00100000:0.0:1713279306.806829:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33435 00000100:00100000:0.0:1713279306.806832:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:15494:x1796503200038784:12345-0@lo:105: 00010000:00010000:0.0:1713279306.806836:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8a2e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.806841:0:15542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942f600/0xfc4b8e114eda8ac8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15542 initiator: MDT0 00010000:00010000:0.0:1713279306.806842:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8a2e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.806846:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8a2e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.806847:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942f600/0xfc4b8e114eda8ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15542 initiator: MDT0 00010000:00010000:0.0:1713279306.806850:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114eda8a2e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.806854:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 5/0,1 mode: EX/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114eda8a2e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.806854:0:15542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942f600/0xfc4b8e114eda8ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15542 initiator: MDT0 00010000:00010000:0.0:1713279306.806858:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 5/0,1 mode: EX/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfc4b8e114eda8a2e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713279306.806863:0:15542:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8264:0x0]: returning size 2 00010000:00010000:0.0:1713279306.806864:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88012154ef40) 00000004:00010000:1.0:1713279306.806877:0:15542:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008942f600/0xfc4b8e114eda8ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15542 initiator: MDT0 00010000:00010000:1.0:1713279306.806883:0:15542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda8aba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15542 initiator: MDT0 00000100:00100000:0.0:1713279306.806888:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:15494:x1796503200038784:12345-0@lo:105: Request processed in 56us (194us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.806888:0:15542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda8aba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15542 initiator: MDT0 00000100:00100000:0.0:1713279306.806892:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33435 00010000:00010000:1.0:1713279306.806894:0:15542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda8aba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15542 initiator: MDT0 00010000:00010000:1.0:1713279306.806898:0:15542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.806901:0:15542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda8aba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15542 initiator: MDT0 00000100:00100000:3.0:1713279306.806904:0:15494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764c700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:15494:1796503200038784:0@lo:105: 00010000:00010000:1.0:1713279306.806906:0:15542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda8aba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15542 initiator: MDT0 00010000:00010000:3.0:1713279306.806910:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c93a80, rc 0) 00010000:00010000:1.0:1713279306.806913:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x149:0x0].0x0 (ffff880097a5fd00) 00010000:00010000:1.0:1713279306.806915:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.806918:0:15542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda8aba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15542 initiator: MDT0 00010000:00010000:1.0:1713279306.806923:0:15542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda8aba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x149:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15542 initiator: MDT0 00010000:00010000:1.0:1713279306.806930:0:15542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda8ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15542 initiator: MDT0 00000100:00100000:3.0:1713279306.806932:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200038656:12345-0@lo:101:mdt_io00_002.0 Request processed in 2691us (2710us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.806935:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98765 00010000:00010000:1.0:1713279306.806939:0:15542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda8ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15542 initiator: MDT0 00000100:00100000:0.0:1713279306.806943:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090ebb100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038656:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1713279306.806943:0:15542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda8ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15542 initiator: MDT0 00010000:00010000:1.0:1713279306.806947:0:15542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942cb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.806949:0:6943:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8a2e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.806949:0:15542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda8ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15542 initiator: MDT0 00010000:00010000:1.0:1713279306.806954:0:15542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda8ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15542 initiator: MDT0 00000004:00080000:0.0:1713279306.806957:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x721d:0x0] 00010000:00010000:1.0:1713279306.806959:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x149:0x0].0x3331 (ffff88012ee68b00) 00010000:00010000:1.0:1713279306.806961:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.806963:0:15542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda8ac1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15542 initiator: MDT0 00010000:00010000:1.0:1713279306.806968:0:15542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda8ac1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x149:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15542 initiator: MDT0 00000100:00100000:0.0:1713279306.806970:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038848:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.806985:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.806985:0:15542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda8ab3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x149:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917594d expref: 3713 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.806991:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.806993:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200038848 00010000:00010000:1.0:1713279306.806995:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942f600/0xfc4b8e114eda8ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8264:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917594d expref: 3712 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.806996:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200038848 00010000:00010000:1.0:1713279306.807001:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8264:0x0].0x0 (ffff88012ee68d00) 00010000:00010000:1.0:1713279306.807003:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713279306.807005:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942f600, rc 0) 00000100:00100000:3.0:1713279306.807009:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98767 00000100:00100000:3.0:1713279306.807011:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200038848:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.807028:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1954:x1796503281225856:12345-192.168.203.4@tcp:63:ll_sa.0 Request processed in 302us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.807035:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98766 00000100:00100000:3.0:1713279306.807044:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200038848:12345-0@lo:1000:mdt_io00_002.0 Request processed in 32us (59us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.807048:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98767 00000100:00100000:0.0:1713279306.807049:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038848:0@lo:1000:mdt_io00_002.0 00000004:00080000:0.0:1713279306.807060:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x721d:0x0] 00000100:00100000:0.0:1713279306.807083:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038912:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.807095:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.807102:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.807104:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200038912 00000100:00100000:3.0:1713279306.807106:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200038912 00000100:00100000:3.0:1713279306.807114:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98768 00000100:00100000:3.0:1713279306.807117:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200038912:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.807145:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200038912:12345-0@lo:1000:mdt_io00_002.0 Request processed in 27us (48us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.807148:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98768 00000100:00100000:0.0:1713279306.807154:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038912:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.807514:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038976:0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1713279306.807531:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.807543:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.807567:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200038976 00000100:00100000:3.0:1713279306.807571:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200038976 00000100:00100000:3.0:1713279306.807593:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98769 00000100:00100000:3.0:1713279306.807597:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200038976:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1713279306.808148:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.808189:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281226240 00000100:00100000:2.0:1713279306.808194:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281226240 00000100:00100000:2.0:1713279306.808218:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785176 00000100:00100000:2.0:1713279306.808222:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281226240:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.808228:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.808235:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda8acf lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175962 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.808276:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda8ad6 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808281:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda8ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808285:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda8ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808290:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda8add lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808294:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda8add lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808297:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda8add lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000004:00200000:2.0:1713279306.808306:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:2.0:1713279306.808310:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda8ad6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808313:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda8ad6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808316:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda8ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808319:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda8ad6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808322:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906eb600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.808324:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda8ad6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808327:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda8ad6 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808331:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880092193800) 00010000:00010000:2.0:1713279306.808332:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.808334:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda8ad6 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808337:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda8ad6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808344:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda8add lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808348:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda8add lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808350:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda8add lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808353:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e8b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.808354:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda8add lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808357:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda8add lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808360:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880092193a00) 00010000:00010000:2.0:1713279306.808361:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.808362:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda8add lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808365:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda8add lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.808378:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda8acf lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175962 expref: 3722 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.808382:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda8acf lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175962 expref: 3722 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.808388:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906e8900, rc 0) 00000100:00100000:2.0:1713279306.808406:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281226240:12345-192.168.203.4@tcp:101:touch.0 Request processed in 184us (260us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.808410:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785176 00000100:00100000:0.0:1713279306.808739:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.808755:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.808768:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281226048 00000100:00100000:0.0:1713279306.808770:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.808771:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281226048 00000100:00100000:2.0:1713279306.808781:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281226112 00000100:00100000:2.0:1713279306.808782:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281226112 00000100:00100000:3.0:1713279306.808782:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200038976:12345-0@lo:403:mdt_io00_002.0 Request processed in 1183us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.808787:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98769 00000100:00100000:2.0:1713279306.808791:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785177 00000100:00100000:0.0:1713279306.808794:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200038976:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1713279306.808794:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:11944:x1796503281226048:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:1.0:1713279306.808798:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785178 00010000:00010000:2.0:1713279306.808800:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.808805:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:11855:x1796503281226112:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.808806:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda8ae4 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175954 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.808814:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.808822:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda8aeb lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917595b expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.808825:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda8af2 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.808830:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda8af2 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.808833:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda8af2 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.808838:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda8af9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.808841:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda8af9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.808844:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda8af9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.808849:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda8b00 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.808856:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda8af2 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.808858:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda8b00 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.808862:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda8af2 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.808863:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda8b00 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.808865:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda8af2 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.808867:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda8af2 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.808868:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.808870:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e9440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.808871:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda8af2 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.808872:0:15479:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90d80/0xfc4b8e114eda8a20 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8a19 expref: 126 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.808874:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda8af2 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.808876:0:15479:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.808878:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880130675600) 00010000:00010000:2.0:1713279306.808879:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.808881:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda8af2 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.808883:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda8af2 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.808887:0:15479:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90d80/0xfc4b8e114eda8a20 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda8a19 expref: 126 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.808888:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda8af9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.808890:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda8af9 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.808893:0:15479:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdd180 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:15479:1796503200039040:0@lo:104: 00010000:00010000:2.0:1713279306.808893:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda8af9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.808896:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012068e400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.808898:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda8af9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.808900:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda8af9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.808904:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x3331 (ffff880130675300) 00010000:00010000:2.0:1713279306.808905:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.808906:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda8af9 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.808909:0:15479:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.808909:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012068e400/0xfc4b8e114eda8af9 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.808918:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda8ae4 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175954 expref: 3437 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.808922:0:15479:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0540 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.808922:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda8ae4 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175954 expref: 3437 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.808927:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906ea640, rc 0) 00000100:00100000:1.0:1713279306.808932:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200039040 00000100:00100000:1.0:1713279306.808936:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200039040 00000100:00100000:2.0:1713279306.808952:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3436:11944:x1796503281226048:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 155us (212us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.808955:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785177 00000100:00100000:1.0:1713279306.808959:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33436 00000100:00100000:1.0:1713279306.808963:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:15479:x1796503200039040:12345-0@lo:104: 00010000:00010000:1.0:1713279306.808970:0:9213:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda8a20 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.808993:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.809003:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281226496 00010000:00010000:1.0:1713279306.809004:0:9213:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1713279306.809006:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281226496 00000100:00100000:1.0:1713279306.809008:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:15479:x1796503200039040:12345-0@lo:104: Request processed in 44us (98us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.809009:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1713279306.809013:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33436 00010000:00010000:3.0:1713279306.809013:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda8a20 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.809015:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785179 00010000:00010000:3.0:1713279306.809017:0:9214:0:(ldlm_lockd.c:1968:ldlm_handle_bl_callback()) Lock ffff88012154fa80 is referenced, will be cancelled later 00000100:00100000:2.0:1713279306.809018:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11940:x1796503281226496:12345-192.168.203.4@tcp:36:mkdir.0 00010000:00010000:3.0:1713279306.809019:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda8a20 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.809026:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.809026:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.809028:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279306.809031:0:15479:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdd180 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:15479:1796503200039040:0@lo:104: 00010000:00010000:1.0:1713279306.809039:0:15479:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713279306.809062:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11940:x1796503281226496:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 42us (69us total) trans 0 rc -17/-17 00000100:00100000:3.0:1713279306.809064:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.809083:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785179 00000100:00100000:2.0:1713279306.809092:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281226368 00000100:00100000:2.0:1713279306.809094:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281226368 00000100:00100000:2.0:1713279306.809101:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281226560 00000100:00100000:2.0:1713279306.809102:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281226560 00000100:00100000:2.0:1713279306.809109:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223053 00000100:00100000:2.0:1713279306.809111:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c569c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3691:11932:x1796503281226368:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:3.0:1713279306.809114:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.809163:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c569c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3692:11932:x1796503281226368:12345-192.168.203.4@tcp:35:touch.0 Request processed in 50us (392us total) trans 4295183706 rc 0/0 00000100:00100000:2.0:1713279306.809167:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223053 00000100:00100000:2.0:1713279306.809174:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223054 00000100:00100000:2.0:1713279306.809176:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3436:11666:x1796503281226560:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:3.0:1713279306.809192:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.809203:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.809212:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.809224:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.809315:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039104:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.809383:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.809391:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.809398:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200039104 00000100:00100000:0.0:1713279306.809401:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281227136 00000100:00100000:3.0:1713279306.809401:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200039104 00000100:00100000:0.0:1713279306.809404:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281227136 00000100:00100000:3.0:1713279306.809427:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98770 00000100:00100000:3.0:1713279306.809429:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039104:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.809432:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110492 00000100:00100000:0.0:1713279306.809435:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+80:11900:x1796503281227136:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.809441:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.809448:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012154d680/0xfc4b8e114eda8b0e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917597e expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.809457:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039104:12345-0@lo:1000:mdt_io00_002.0 Request processed in 27us (124us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.809461:0:15506:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009181fcc0/0xfc4b8e114ed9fc0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391732db expref: 89 pid: 15556 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.809461:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98770 00010000:00010000:0.0:1713279306.809465:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713279306.809466:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713279306.809468:0:15506:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012154d680/0xfc4b8e114eda8b0e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [24576->32767] (req 24576->32767) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917597e expref: 81 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.809475:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039104:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.809479:0:15506:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009181fcc0/0xfc4b8e114ed9fc0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391732db expref: 89 pid: 15556 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.809485:0:15506:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009181fcc0/0xfc4b8e114ed9fc0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391732db expref: 89 pid: 15556 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.809490:0:15506:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15506:1796503200039168:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.809496:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095210380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039232:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.809510:0:15506:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f549c00 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.809512:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3691:11854:x1796503281225408:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 3323us (3361us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.809516:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.809519:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281226688 00000100:00100000:1.0:1713279306.809519:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223050 00000100:00100000:0.0:1713279306.809522:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281226688 00000100:00100000:3.0:1713279306.809523:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.809532:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200039232 00000100:00100000:0.0:1713279306.809533:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281226816 00000100:00100000:0.0:1713279306.809534:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281226816 00000100:00100000:3.0:1713279306.809534:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200039232 00000100:00100000:0.0:1713279306.809541:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281226944 00000100:00100000:0.0:1713279306.809542:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281226944 00000100:00100000:3.0:1713279306.809546:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98771 00000100:00100000:3.0:1713279306.809549:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039232:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.809551:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281227072 00000100:00100000:1.0:1713279306.809554:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281227072 00000100:00100000:0.0:1713279306.809555:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785180 00000100:00100000:0.0:1713279306.809557:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3438:9807:x1796503281226688:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:1.0:1713279306.809573:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785181 00000100:00100000:1.0:1713279306.809577:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3439:11204:x1796503281226816:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.809583:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039232:12345-0@lo:1000:mdt_io00_002.0 Request processed in 32us (65us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.809584:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.809588:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98771 00010000:00010000:1.0:1713279306.809590:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda8b15 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175969 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.809594:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.809598:0:15749:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.809602:0:15749:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15749 initiator: MDT1 00000100:00100000:2.0:1713279306.809605:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785182 00000100:00100000:0.0:1713279306.809608:0:15749:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051880 pname:cluuid:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-mdtlov_UUID:15749:1796503200039296:0@lo:101:mdt00_031.0 00000100:00100000:2.0:1713279306.809608:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3691:11711:x1796503281226944:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.809608:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095210380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039232:0@lo:1000:mdt_io00_002.0 00010000:00010000:2.0:1713279306.809614:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.809619:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda8b23 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175970 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.809622:0:15749:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.809629:0:15749:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800976f9900 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.809636:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda8b2a lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.809638:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785183 00010000:00010000:2.0:1713279306.809639:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda8b31 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.809641:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3721:11897:x1796503281227072:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.809641:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda8b2a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809644:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda8b31 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.809646:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.809646:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda8b2a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809647:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda8b31 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.809651:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114eda8b3f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.809652:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed098c0/0xfc4b8e114eda8b38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175977 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.809655:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114eda8b3f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809655:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688240/0xfc4b8e114eda8b46 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.809658:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114eda8b3f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809658:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688240/0xfc4b8e114eda8b46 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.809661:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688240/0xfc4b8e114eda8b46 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000004:00200000:1.0:1713279306.809667:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:0.0:1713279306.809671:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda8b4d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.809671:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda8b31 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.809672:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda8b2a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809674:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda8b31 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.809675:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda8b2a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.809677:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda8b4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.809677:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda8b31 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.809678:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda8b2a lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809680:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda8b31 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.809681:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda8b4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.809681:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda8b2a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809683:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c86a880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.809684:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880089fe1680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.809684:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda8b31 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.809685:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda8b2a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809687:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda8b31 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.809688:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda8b54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.809688:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda8b2a lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809690:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880130675100) 00010000:00010000:0.0:1713279306.809691:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda8b54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.809692:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.809693:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda8b31 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.809694:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda8b54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.809695:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:2.0:1713279306.809696:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda8b31 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.809697:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.809699:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda8b2a lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809701:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688240/0xfc4b8e114eda8b46 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.809702:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114eda8b2a lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809704:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688240/0xfc4b8e114eda8b46 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.809707:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114eda8b3f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809707:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688240/0xfc4b8e114eda8b46 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.809709:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114eda8b3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809709:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.809711:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688240/0xfc4b8e114eda8b46 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.809712:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8b5b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.809712:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114eda8b3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809713:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688240/0xfc4b8e114eda8b46 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.809715:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134a41f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.809716:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8b5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.809716:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114eda8b3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809716:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880130675800) 00010000:00010000:2.0:1713279306.809718:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.809719:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8b5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.809719:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114eda8b3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.809719:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688240/0xfc4b8e114eda8b46 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.809721:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688240/0xfc4b8e114eda8b46 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.809723:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88012061f800) 00010000:00010000:0.0:1713279306.809724:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda8b4d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.809724:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.809725:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114eda8b3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.809727:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda8b4d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.809728:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114eda8b3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.809730:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda8b4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.809732:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda8b23 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175970 expref: 3692 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.809733:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda8b4d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.809736:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094669680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.809736:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda8b23 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175970 expref: 3692 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.809737:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda8b4d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.809740:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c868900, rc 0) 00010000:00010000:1.0:1713279306.809741:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda8b15 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175969 expref: 3440 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.809743:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda8b4d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.809746:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114eda8b15 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175969 expref: 3440 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.809747:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:0.0:1713279306.809749:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.809750:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda8b4d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.809750:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942cd80, rc 0) 00000100:00100000:2.0:1713279306.809751:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3691:11711:x1796503281226944:12345-192.168.203.4@tcp:101:touch.0 Request processed in 143us (538us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.809753:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda8b4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.809755:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785182 00010000:00010000:0.0:1713279306.809758:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda8b54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.809761:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda8b54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.809764:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda8b54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00000100:00100000:1.0:1713279306.809765:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3439:11204:x1796503281226816:12345-192.168.203.4@tcp:101:touch.0 Request processed in 188us (560us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.809767:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d2d7a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.809768:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda8b54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00000100:00100000:1.0:1713279306.809769:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785181 00010000:00010000:0.0:1713279306.809770:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda8b54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.809774:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x36 (ffff880096e84700) 00010000:00010000:0.0:1713279306.809775:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.809776:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda8b54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.809779:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda8b54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000100:00100000:1.0:1713279306.809782:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200039296 00000100:00100000:1.0:1713279306.809784:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200039296 00000100:00100000:2.0:1713279306.809786:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.809792:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed098c0/0xfc4b8e114eda8b38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175977 expref: 3723 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.809795:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281227264 00000100:00100000:1.0:1713279306.809797:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98772 00000100:00100000:2.0:1713279306.809797:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281227264 00010000:00010000:0.0:1713279306.809798:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8b5b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175977 expref: 3722 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.809799:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+56:15749:x1796503200039296:12345-0@lo:101:mdt00_031.0 00010000:00010000:0.0:1713279306.809802:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7afa:0x0].0x0 (ffff88008d729100) 00010000:00010000:0.0:1713279306.809803:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713279306.809804:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2d58c0, rc 0) 00010000:00010000:1.0:1713279306.809804:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.809806:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223055 00000100:00100000:2.0:1713279306.809809:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3723:11941:x1796503281227264:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:1.0:1713279306.809810:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda8b62 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda8b1c expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.809817:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3723:11897:x1796503281227072:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 175us (592us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.809818:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093aba1c0/0xfc4b8e114ed5766c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915d0dd expref: 3711 pid: 15659 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.809821:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785183 00010000:00010000:1.0:1713279306.809823:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801237db840/0xfc4b8e114ed57d5e lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915d322 expref: 3723 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.809827:0:15516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda8b62 lrc: 5/0,0 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda8b1c expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.809837:0:15516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801237db840/0xfc4b8e114ed57d5e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915d322 expref: 3722 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.809845:0:15516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801237db840/0xfc4b8e114ed57d5e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915d322 expref: 3722 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.809851:0:15516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdd180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000_UUID:15516:1796503200039360:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.809868:0:15516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093aba1c0/0xfc4b8e114ed5766c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915d0dd expref: 3711 pid: 15659 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1713279306.809868:0:15467:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4295202677 00010000:00010000:1.0:1713279306.809872:0:15516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093aba1c0/0xfc4b8e114ed5766c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915d0dd expref: 3711 pid: 15659 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.809876:0:15516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fd180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000_UUID:15516:1796503200039424:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.809884:0:15516:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.809892:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3724:11941:x1796503281227264:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 82us (106us total) trans 4295202678 rc 0/0 00000100:00100000:2.0:1713279306.809896:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223055 00000020:00080000:2.0:1713279306.809898:0:15467:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1713279306.809942:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.809962:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095210380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039488:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1713279306.809971:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281227392 00000100:00100000:1.0:1713279306.809974:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281227392 00000100:00100000:3.0:1713279306.809986:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.809992:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785184 00000100:00100000:1.0:1713279306.809996:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3691:11912:x1796503281227392:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.809997:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122e99b40 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.810003:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.810007:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200039488 00000100:00100000:3.0:1713279306.810009:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200039488 00010000:00010000:1.0:1713279306.810012:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda8b69 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175985 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.810022:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98773 00000100:00100000:3.0:1713279306.810025:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039488:12345-0@lo:403:mdt_io00_002.0 00010000:00010000:1.0:1713279306.810042:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda8b70 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.810049:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda8b70 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810055:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda8b70 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810065:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda8b77 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.810086:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda8b77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810091:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda8b77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810108:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda8b70 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810113:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda8b70 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810118:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda8b70 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810123:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda8b70 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810128:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880123732400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.810131:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda8b70 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810136:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda8b70 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810143:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88008c1d2100) 00010000:00010000:1.0:1713279306.810145:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.810148:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda8b70 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810153:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda8b70 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810160:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda8b77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810166:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda8b77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810171:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda8b77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810175:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094550fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.810177:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda8b77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810181:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda8b77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810187:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88009606b800) 00010000:00010000:1.0:1713279306.810190:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.810192:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda8b77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810196:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114eda8b77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.810213:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda8b69 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175985 expref: 3692 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.810220:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda8b69 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175985 expref: 3692 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.810227:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fef8b40, rc 0) 00000100:00100000:1.0:1713279306.810254:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3691:11912:x1796503281227392:12345-192.168.203.4@tcp:101:touch.0 Request processed in 257us (311us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.810259:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785184 00000100:00100000:0.0:1713279306.810884:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.810956:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281227520 00000100:00100000:3.0:1713279306.810959:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039488:12345-0@lo:403:mdt_io00_002.0 Request processed in 933us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.810961:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281227520 00000100:00100000:3.0:1713279306.810964:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98773 00000100:00100000:0.0:1713279306.810971:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095210380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039488:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1713279306.810978:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785185 00000100:00100000:1.0:1713279306.810982:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3691:11951:x1796503281227520:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.810989:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.810997:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e7ba400/0xfc4b8e114eda8b7e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917598c expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.811033:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda8b85 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x74d1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.811040:0:15658:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce51680/0xfc4b8e114eda3c63 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174542 expref: 3438 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.811045:0:15658:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114eda3e07 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391745b9 expref: 3692 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.811049:0:15658:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda8b85 lrc: 5/0,1 mode: --/CW res: [0x240000403:0x74d1:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.811060:0:15658:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114eda3e07 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391745b9 expref: 3692 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.811065:0:15658:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114eda3e07 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391745b9 expref: 3692 pid: 15471 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.811088:0:15658:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234c380 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001_UUID:15658:1796503200039552:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.811120:0:15658:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce51680/0xfc4b8e114eda3c63 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174542 expref: 3438 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.811125:0:15658:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce51680/0xfc4b8e114eda3c63 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174542 expref: 3438 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.811130:0:15658:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091beb480 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001_UUID:15658:1796503200039616:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.811139:0:15658:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0780 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.811379:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.811410:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281227712 00000100:00100000:1.0:1713279306.811426:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281227712 00000100:00100000:1.0:1713279306.811441:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785186 00000100:00100000:0.0:1713279306.811443:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039680:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.811444:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3724:11711:x1796503281227712:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.811449:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.811455:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114eda8b8c lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175993 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.811459:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.811471:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237273c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.811494:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda8b93 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811499:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda8b93 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811504:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda8b93 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811510:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda8b9a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811513:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda8b9a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811519:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda8b9a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000100:00100000:3.0:1713279306.811525:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200039680 00000004:00200000:1.0:1713279306.811528:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00000100:00100000:3.0:1713279306.811530:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200039680 00010000:00010000:1.0:1713279306.811533:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda8b93 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811536:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda8b93 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811539:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda8b93 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811542:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda8b93 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811545:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.811546:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda8b93 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811549:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda8b93 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811553:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88009426dd00) 00000100:00100000:3.0:1713279306.811553:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98774 00010000:00010000:1.0:1713279306.811555:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.811556:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda8b93 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000100:00100000:3.0:1713279306.811558:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039680:12345-0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1713279306.811559:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda8b93 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811565:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda8b9a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811570:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda8b9a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811573:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda8b9a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811575:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d3218c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.811577:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda8b9a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811579:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda8b9a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811582:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff88008fcbec00) 00010000:00010000:1.0:1713279306.811583:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.811585:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda8b9a lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811587:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda8b9a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.811601:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114eda8b8c lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175993 expref: 3725 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.811605:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114eda8b8c lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175993 expref: 3725 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.811605:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039680:12345-0@lo:1000:mdt_io00_002.0 Request processed in 46us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.811609:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98774 00010000:00010000:1.0:1713279306.811610:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d321b00, rc 0) 00000100:00100000:0.0:1713279306.811620:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039680:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.811628:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3724:11711:x1796503281227712:12345-192.168.203.4@tcp:101:touch.0 Request processed in 183us (252us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.811632:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785186 00000100:00100000:0.0:1713279306.811643:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039744:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.811656:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.811662:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.811666:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200039744 00000100:00100000:3.0:1713279306.811668:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200039744 00000100:00100000:3.0:1713279306.811676:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98775 00000100:00100000:3.0:1713279306.811679:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039744:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.811709:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039744:12345-0@lo:1000:mdt_io00_002.0 Request processed in 30us (52us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.811716:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98775 00000100:00100000:0.0:1713279306.811781:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039744:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.811784:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.811799:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039808:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.811806:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.811812:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.811814:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281227840 00000100:00100000:1.0:1713279306.811817:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281227840 00000100:00100000:0.0:1713279306.811818:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.811825:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200039808 00000100:00100000:1.0:1713279306.811827:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281228096 00000100:00100000:3.0:1713279306.811827:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200039808 00000100:00100000:1.0:1713279306.811829:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281228096 00000100:00100000:0.0:1713279306.811830:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785187 00000100:00100000:0.0:1713279306.811833:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3693:11897:x1796503281227840:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:3.0:1713279306.811837:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98776 00000100:00100000:1.0:1713279306.811839:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785188 00010000:00010000:0.0:1713279306.811840:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.811840:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039808:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.811842:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11204:x1796503281228096:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.811847:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.811848:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda8ba1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7afa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917599a expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.811852:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321680/0xfc4b8e114eda8ba8 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391759a1 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.811872:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda8baf lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.811876:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039808:12345-0@lo:1000:mdt_io00_002.0 Request processed in 35us (63us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.811877:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda8baf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.811880:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98776 00010000:00010000:1.0:1713279306.811881:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda8baf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.811882:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039808:0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1713279306.811886:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda8bb6 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.811889:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda8bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.811892:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda8bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.811898:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039872:0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1713279306.811904:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda8baf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.811907:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda8baf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.811910:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.811913:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda8baf lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.811916:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.811916:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda8baf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.811918:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321f80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.811918:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200039872 00010000:00010000:1.0:1713279306.811920:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda8baf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.811920:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200039872 00010000:00010000:1.0:1713279306.811923:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda8baf lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.811926:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:1.0:1713279306.811927:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.811927:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98777 00000004:00200000:0.0:1713279306.811929:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7afa:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.811929:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda8baf lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.811929:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039872:12345-0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1713279306.811931:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda8baf lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.811936:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda8bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.811939:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda8bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.811942:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda8bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.811944:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d322400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.811946:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda8bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.811951:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda8bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.811954:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880089f68700) 00010000:00010000:1.0:1713279306.811955:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.811957:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda8bb6 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.811958:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039872:12345-0@lo:1000:mdt_io00_002.0 Request processed in 28us (47us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.811959:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda8bb6 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.811962:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98777 00010000:00010000:0.0:1713279306.811963:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda8ba1 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917599a expref: 3695 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.811968:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda8ba1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917599a expref: 3695 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.811970:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321680/0xfc4b8e114eda8ba8 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759a1 expref: 3713 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.811974:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801349258c0, rc 0) 00010000:00010000:1.0:1713279306.811974:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321680/0xfc4b8e114eda8ba8 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759a1 expref: 3713 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.811978:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d321680, rc 0) 00000100:00100000:0.0:1713279306.811988:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039872:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.811995:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11204:x1796503281228096:12345-192.168.203.4@tcp:101:touch.0 Request processed in 152us (188us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.811999:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785188 00000100:00100000:0.0:1713279306.812004:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039936:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.812017:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.812030:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77a80 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.812030:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200039936 00000100:00100000:3.0:1713279306.812033:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200039936 00000100:00100000:3.0:1713279306.812042:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98778 00000100:00100000:3.0:1713279306.812044:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039936:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.812046:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3694:11897:x1796503281227840:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 211us (261us total) trans 4295183707 rc 301/301 00000100:00100000:0.0:1713279306.812050:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785187 00000100:00100000:3.0:1713279306.812084:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200039936:12345-0@lo:1000:mdt_io00_002.0 Request processed in 39us (66us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.812088:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98778 00000100:00100000:0.0:1713279306.812093:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200039936:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.812110:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040000:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.812121:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.812127:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.812129:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200040000 00000100:00100000:3.0:1713279306.812131:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200040000 00000100:00100000:3.0:1713279306.812143:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98779 00000100:00100000:3.0:1713279306.812145:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040000:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.812173:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040000:12345-0@lo:1000:mdt_io00_002.0 Request processed in 27us (51us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.812176:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98779 00000100:00100000:2.0:1713279306.812180:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3437:11666:x1796503281226560:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 3000us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.812181:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040000:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.812185:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223054 00000100:00100000:0.0:1713279306.812194:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040064:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.812207:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.812212:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.812215:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200040064 00000100:00100000:3.0:1713279306.812216:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200040064 00000100:00100000:3.0:1713279306.812223:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98780 00000100:00100000:3.0:1713279306.812225:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac44b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040064:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.812247:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac44b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040064:12345-0@lo:1000:mdt_io00_002.0 Request processed in 21us (39us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.812250:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98780 00000100:00100000:0.0:1713279306.812253:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040064:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.812267:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040128:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.812278:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.812283:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.812285:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200040128 00000100:00100000:3.0:1713279306.812287:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200040128 00000100:00100000:3.0:1713279306.812293:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98781 00000100:00100000:3.0:1713279306.812295:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040128:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.812317:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040128:12345-0@lo:1000:mdt_io00_002.0 Request processed in 20us (38us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.812320:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98781 00000100:00100000:0.0:1713279306.812368:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040128:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.812378:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.812385:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040192:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.812387:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.812396:0:15506:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15506:1796503200039168:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.812397:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.812398:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.812406:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012154d680/0xfc4b8e114eda8b0e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [24576->32767] (req 24576->32767) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917597e expref: 81 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.812410:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.812424:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200040192 00000100:00100000:3.0:1713279306.812426:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200040192 00010000:00010000:1.0:1713279306.812427:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012154d680, rc 0) 00000100:00100000:2.0:1713279306.812428:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281227584 00000100:00100000:0.0:1713279306.812432:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281227968 00000100:00100000:2.0:1713279306.812432:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281227584 00000100:00100000:0.0:1713279306.812435:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281227968 00000100:00100000:3.0:1713279306.812435:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98782 00000100:00100000:3.0:1713279306.812437:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040192:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.812442:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+81:11900:x1796503281227136:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 3006us (3250us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.812444:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009181fcc0/0xfc4b8e114ed9fc0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391732db expref: 90 pid: 15556 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.812447:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785189 00000100:00100000:1.0:1713279306.812449:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110492 00000100:00100000:0.0:1713279306.812450:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3724:11949:x1796503281227968:12345-192.168.203.4@tcp:36:mkdir.0 00000100:00100000:2.0:1713279306.812456:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281228160 00000100:00100000:2.0:1713279306.812457:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281228160 00000100:00100000:1.0:1713279306.812463:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196528 00000100:00100000:1.0:1713279306.812467:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+90:1957:x1796503281227584:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.812467:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147247 00000100:00100000:3.0:1713279306.812468:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040192:12345-0@lo:1000:mdt_io00_002.0 Request processed in 30us (69us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.812470:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3725:1956:x1796503281228160:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.812472:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.812472:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98782 00010000:00010000:2.0:1713279306.812475:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.812480:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009181fcc0/0xfc4b8e114ed9fc0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391732db expref: 90 pid: 15556 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.812482:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8b5b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175977 expref: 3725 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.812485:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009181fcc0/0xfc4b8e114ed9fc0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391732db expref: 90 pid: 15556 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.812489:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7afa:0x0].0x0 (ffff88008d729100) 00010000:00010000:2.0:1713279306.812491:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.812495:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009181fcc0/0xfc4b8e114ed9fc0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391732db expref: 90 pid: 15556 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.812500:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.812502:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713279306.812503:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3724:1956:x1796503281228160:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 32us (105us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.812505:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012154d680/0xfc4b8e114eda8b0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->32767) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917597e expref: 80 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.812507:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147247 00010000:00010000:1.0:1713279306.812510:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012154d680/0xfc4b8e114eda8b0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->32767) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917597e expref: 80 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.812521:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012154d680/0xfc4b8e114eda8b0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->32767) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917597e expref: 80 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.812523:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040192:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.812527:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6917:1796503200040256:192.168.203.4@tcp:105: 00000100:00100000:3.0:1713279306.812528:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.812540:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0840 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.812541:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090964000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040320:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.812547:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281228224 00000100:00100000:2.0:1713279306.812549:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281228224 00000100:00100000:1.0:1713279306.812553:0:15516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdd180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000_UUID:15516:1796503200039360:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.812556:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.812557:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223056 00000100:00100000:2.0:1713279306.812560:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3724:11854:x1796503281228224:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:3.0:1713279306.812561:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.812570:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.812574:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200040320 00000100:00100000:1.0:1713279306.812575:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.812576:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200040320 00000100:00100000:3.0:1713279306.812586:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98783 00000100:00100000:3.0:1713279306.812589:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040320:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.812602:0:15516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fd180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000_UUID:15516:1796503200039424:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.812612:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda8b62 lrc: 3/0,0 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8b1c expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.812616:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x729c:0x0].0x0 (ffff88007f2ad700) 00000100:00100000:3.0:1713279306.812616:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040320:12345-0@lo:1000:mdt_io00_002.0 Request processed in 27us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.812618:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3724:11949:x1796503281227968:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 167us (229us total) trans 0 rc -17/-17 00010000:00010000:1.0:1713279306.812618:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713279306.812620:0:15516:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda8b62 lrc: 3/0,0 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8b1c expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.812620:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98783 00000100:00100000:0.0:1713279306.812623:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785189 00010000:00010000:1.0:1713279306.812624:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134a40240, rc 0) 00000100:00100000:0.0:1713279306.812630:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281228672 00000100:00100000:0.0:1713279306.812632:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281228672 00000100:00100000:1.0:1713279306.812647:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+57:15749:x1796503200039296:12345-0@lo:101:mdt00_031.0 Request processed in 2847us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.812651:0:15749:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051880 pname:cluuid:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-mdtlov_UUID:15749:1796503200039296:0@lo:101:mdt00_031.0 00000100:00100000:1.0:1713279306.812651:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98772 00010000:00010000:0.0:1713279306.812658:0:15749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 4/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.812663:0:15749:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 4/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.812673:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090964000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040320:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.812689:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090964000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040384:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.812700:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.812706:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.812710:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200040384 00000100:00100000:3.0:1713279306.812712:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200040384 00000100:00100000:0.0:1713279306.812714:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785190 00000100:00100000:0.0:1713279306.812717:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3694:11711:x1796503281228672:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.812722:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98784 00000100:00100000:3.0:1713279306.812725:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040384:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.812751:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040384:12345-0@lo:1000:mdt_io00_002.0 Request processed in 26us (50us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.812754:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98784 00000100:00100000:3.0:1713279306.812769:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090964000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040384:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.812771:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.812778:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda8bc4 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391759af expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.812792:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040448:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.812800:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda8bcb lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.812805:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda8bcb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.812805:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.812811:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760a80 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.812812:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda8bcb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.812816:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200040448 00010000:00010000:0.0:1713279306.812818:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda8bd2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.812818:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200040448 00010000:00010000:0.0:1713279306.812821:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda8bd2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.812824:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda8bd2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.812833:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98785 00010000:00010000:0.0:1713279306.812836:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda8bcb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.812836:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040448:12345-0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.812839:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda8bcb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.812843:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda8bcb lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.812846:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda8bcb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.812848:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134926f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.812850:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda8bcb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.812850:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.812853:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda8bcb lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.812857:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880096e84800) 00010000:00010000:0.0:1713279306.812858:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.812860:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda8bcb lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.812863:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda8bcb lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.812863:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040448:12345-0@lo:1000:mdt_io00_002.0 Request processed in 26us (57us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.812866:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98785 00010000:00010000:0.0:1713279306.812868:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda8bd2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.812871:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda8bd2 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.812874:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda8bd2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.812876:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009524a640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.812878:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda8bd2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.812879:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040448:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.812880:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda8bd2 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.812883:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880096e84100) 00010000:00010000:0.0:1713279306.812885:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.812886:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda8bd2 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.812888:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda8bd2 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.812895:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040512:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.812900:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda8bc4 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759af expref: 3695 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.812904:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda8bc4 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759af expref: 3695 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.812906:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.812911:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fe40 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.812912:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134927180, rc 0) 00000100:00100000:3.0:1713279306.812915:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200040512 00000100:00100000:3.0:1713279306.812917:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200040512 00000100:00100000:3.0:1713279306.812924:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98786 00000100:00100000:3.0:1713279306.812927:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040512:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.812928:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3694:11711:x1796503281228672:12345-192.168.203.4@tcp:101:touch.0 Request processed in 210us (367us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.812932:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785190 00000100:00100000:3.0:1713279306.812949:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040512:12345-0@lo:1000:mdt_io00_002.0 Request processed in 21us (42us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.812952:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98786 00000100:00100000:2.0:1713279306.812953:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281228288 00000100:00100000:2.0:1713279306.812955:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281228288 00010000:00010000:2.0:1713279306.812963:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801237db840/0xfc4b8e114ed57d5e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915d322 expref: 3725 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.812964:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040512:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.812973:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281228352 00000100:00100000:2.0:1713279306.812974:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281228352 00000100:00100000:3.0:1713279306.812979:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040576:0@lo:1000:mdt_io00_002.0 00010000:00010000:2.0:1713279306.812980:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093aba1c0/0xfc4b8e114ed5766c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915d0dd expref: 3712 pid: 15659 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.812981:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196529 00000100:00100000:0.0:1713279306.812984:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3725:1957:x1796503281228288:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.812988:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196530 00010000:00010000:0.0:1713279306.812989:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.812989:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.812991:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281228352:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.812993:0:15711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801237db840/0xfc4b8e114ed57d5e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915d322 expref: 3725 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.812993:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fb40 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.812996:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.812998:0:15711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801237db840/0xfc4b8e114ed57d5e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915d322 expref: 3725 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.812998:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093aba1c0/0xfc4b8e114ed5766c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915d0dd expref: 3712 pid: 15659 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.812998:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200040576 00000100:00100000:3.0:1713279306.812999:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200040576 00010000:00010000:0.0:1713279306.813005:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801237db840/0xfc4b8e114ed57d5e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915d322 expref: 3725 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.813007:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093aba1c0/0xfc4b8e114ed5766c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915d0dd expref: 3712 pid: 15659 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.813007:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98787 00000100:00100000:3.0:1713279306.813010:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040576:12345-0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.813011:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x729c:0x0].0x0 (ffff88007f2ad700) 00010000:00010000:0.0:1713279306.813014:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda8b62 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8b1c expref: 56 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.813018:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.813023:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093aba1c0/0xfc4b8e114ed5766c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915d0dd expref: 3712 pid: 15659 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.813028:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x729c:0x0].0x0 (ffff88007f2ad700) 00010000:00010000:2.0:1713279306.813031:0:9215:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda8b62 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8b1c expref: 56 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.813032:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040576:12345-0@lo:1000:mdt_io00_002.0 Request processed in 21us (42us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.813035:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98787 00010000:00010000:2.0:1713279306.813036:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda8b62 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114eda8b1c expref: 56 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.813040:0:9215:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda8b62 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114eda8b1c expref: 56 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.813046:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040576:0@lo:1000:mdt_io00_002.0 00010000:00010000:2.0:1713279306.813050:0:9215:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda8b62 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8b1c expref: 56 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.813056:0:9215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f388380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9215:1796503200040640:0@lo:105: 00000100:00100000:3.0:1713279306.813060:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040704:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.813082:0:9215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.813086:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.813090:0:9215:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606c180 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.813092:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760a80 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.813094:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200040640 00000100:00100000:0.0:1713279306.813095:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:385c4b71-808c-40cf-91de-b076b668d13f+3724:1957:x1796503281228288:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 44us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.813097:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200040640 00000100:00100000:3.0:1713279306.813097:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200040704 00000100:00100000:3.0:1713279306.813099:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200040704 00000100:00100000:0.0:1713279306.813100:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196529 00000100:00100000:3.0:1713279306.813108:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98788 00000100:00100000:3.0:1713279306.813110:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040704:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.813114:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33437 00000100:00100000:2.0:1713279306.813114:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.813117:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:9215:x1796503200040640:12345-0@lo:105: 00010000:00010000:1.0:1713279306.813122:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 5/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.813126:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281228864 00010000:00010000:1.0:1713279306.813126:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 5/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.813129:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281228864 00010000:00010000:1.0:1713279306.813130:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 5/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.813132:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040704:12345-0@lo:1000:mdt_io00_002.0 Request processed in 20us (45us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.813135:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98788 00010000:00010000:1.0:1713279306.813138:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 5/0,1 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.813139:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785191 00010000:00010000:1.0:1713279306.813141:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 6/0,1 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.813142:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3437:11204:x1796503281228864:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.813145:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 6/0,1 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.813146:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040704:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.813147:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.813152:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda8bd9 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391759bd expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.813156:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88012ed0ba80) 00000100:00100000:3.0:1713279306.813163:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040768:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.813167:0:15749:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.813171:0:15749:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.813173:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:9215:x1796503200040640:12345-0@lo:105: Request processed in 55us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.813175:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.813176:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33437 00000100:00100000:3.0:1713279306.813180:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fe40 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.813181:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.813183:0:9215:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f388380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9215:1796503200040640:0@lo:105: 00000100:00100000:3.0:1713279306.813185:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200040768 00010000:00010000:0.0:1713279306.813186:0:15749:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800963ba1c0/0xfc4b8e114ed5e554 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x729c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915f41c expref: 3693 pid: 15469 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.813186:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200040768 00010000:00010000:2.0:1713279306.813189:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.813190:0:15749:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114ed9d817 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172807 expref: 3438 pid: 15486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.813194:0:15749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 5/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.813194:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98789 00000100:00100000:3.0:1713279306.813196:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040768:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.813202:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:1956:x1796503281228352:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 210us (352us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.813204:0:15749:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114ed9d817 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172807 expref: 3438 pid: 15486 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.813208:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196530 00010000:00010000:0.0:1713279306.813209:0:15749:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114ed9d817 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172807 expref: 3438 pid: 15486 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.813218:0:15749:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965500 pname:cluuid:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001_UUID:15749:1796503200040832:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.813218:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040768:12345-0@lo:1000:mdt_io00_002.0 Request processed in 21us (42us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.813222:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98789 00000100:00100000:3.0:1713279306.813233:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040768:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.813236:0:15749:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800963ba1c0/0xfc4b8e114ed5e554 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x729c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915f41c expref: 3693 pid: 15469 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.813247:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040960:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.813257:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.813262:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.813267:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200040960 00000100:00100000:2.0:1713279306.813269:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200040960 00000100:00100000:2.0:1713279306.813279:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98790 00000100:00100000:2.0:1713279306.813282:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040960:12345-0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.813292:0:15749:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800963ba1c0/0xfc4b8e114ed5e554 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x729c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915f41c expref: 3693 pid: 15469 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.813298:0:15749:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965f80 pname:cluuid:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001_UUID:15749:1796503200040896:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.813302:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.813309:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281228416 00000100:00100000:1.0:1713279306.813310:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281228416 00000100:00100000:0.0:1713279306.813315:0:15749:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.813317:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200040960:12345-0@lo:1000:mdt_io00_002.0 Request processed in 34us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.813319:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785192 00000100:00100000:2.0:1713279306.813321:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98790 00000100:00100000:1.0:1713279306.813322:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11940:x1796503281228416:12345-192.168.203.4@tcp:101:mkdir.0 00000100:00100000:3.0:1713279306.813322:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200040960:0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1713279306.813327:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.813332:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda8be7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391759a8 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.813336:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041024:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.813346:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.813348:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda8bee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.813350:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda8bf5 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.813351:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fe40 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.813354:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda8bf5 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.813354:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda8bee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.813355:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041024 00000100:00100000:2.0:1713279306.813357:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041024 00010000:00010000:0.0:1713279306.813358:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda8bf5 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.813358:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda8bee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.813364:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda8bfc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.813364:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98791 00010000:00010000:1.0:1713279306.813365:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda8c03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.813366:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041024:12345-0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.813367:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda8bfc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.813368:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda8c03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.813370:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda8bfc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.813371:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda8c03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000004:00200000:0.0:1713279306.813378:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:0.0:1713279306.813382:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda8bf5 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.813388:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda8bf5 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.813390:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda8c0a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8297:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.813391:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda8bf5 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.813394:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda8bf5 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.813394:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda8c0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8297:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.813396:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041024:12345-0@lo:1000:mdt_io00_002.0 Request processed in 29us (49us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.813397:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097887cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.813397:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda8c0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8297:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.813398:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda8bf5 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713279306.813400:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98791 00010000:00010000:0.0:1713279306.813401:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda8bf5 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.813402:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041024:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.813405:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:0.0:1713279306.813406:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.813408:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda8bf5 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.813410:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda8bf5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.813430:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda8bfc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.813432:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda8bfc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.813433:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041088:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.813435:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda8bfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.813438:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800978861c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.813440:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda8bfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.813443:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda8bfc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.813445:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.813446:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880096e84900) 00010000:00010000:0.0:1713279306.813447:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.813449:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda8bfc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.813451:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda8bfc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.813451:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.813454:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041088 00000004:00200000:1.0:1713279306.813456:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8297:0x0]: returning size 4096 00000100:00100000:2.0:1713279306.813456:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041088 00000004:00200000:1.0:1713279306.813458:0:15753:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 4 MDT count 2 00000100:00100000:2.0:1713279306.813463:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98792 00010000:00010000:0.0:1713279306.813465:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda8bd9 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759bd expref: 3438 pid: 9221 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713279306.813466:0:15753:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda8c0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8297:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.813466:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041088:12345-0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1713279306.813469:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda8bd9 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759bd expref: 3438 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.813470:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda8bee lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000100:00100000:3.0:1713279306.813472:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.813473:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009524b180, rc 0) 00010000:00010000:1.0:1713279306.813473:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda8bee lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.813476:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda8bee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.813479:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda8bee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.813484:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320900 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.813484:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281228480 00010000:00010000:1.0:1713279306.813486:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda8bee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.813486:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281228480 00000100:00100000:0.0:1713279306.813489:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3437:11204:x1796503281228864:12345-192.168.203.4@tcp:101:touch.0 Request processed in 346us (374us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.813489:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda8bee lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.813492:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114eda3e07 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391745b9 expref: 3694 pid: 15471 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.813493:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785191 00010000:00010000:1.0:1713279306.813493:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:1.0:1713279306.813494:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.813496:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda8bee lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.813499:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda8bee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.813505:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda8c03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.813505:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196531 00010000:00010000:1.0:1713279306.813508:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda8c03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.813508:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b25ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:385c4b71-808c-40cf-91de-b076b668d13f+3694:1957:x1796503281228480:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.813510:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda8c03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.813512:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.813513:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.813514:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda8c03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.813514:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114eda3e07 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391745b9 expref: 3694 pid: 15471 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.813517:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda8c03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.813519:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114eda3e07 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391745b9 expref: 3694 pid: 15471 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.813520:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x39 (ffff880089f68800) 00010000:00010000:1.0:1713279306.813521:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.813522:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda8c03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.813525:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda8c03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.813526:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74d1:0x0].0x0 (ffff88008d597900) 00010000:00010000:2.0:1713279306.813528:0:9215:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda8b85 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x74d1:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.813532:0:9215:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda8b85 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x74d1:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.813535:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.813536:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda8be7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759a8 expref: 3713 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.813542:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321440/0xfc4b8e114eda8c0a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8297:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759a8 expref: 3712 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.813545:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8297:0x0].0x0 (ffff880091b35100) 00010000:00010000:1.0:1713279306.813546:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:2.0:1713279306.813547:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b25ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:385c4b71-808c-40cf-91de-b076b668d13f+3694:1957:x1796503281228480:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 38us (75us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.813548:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d321440, rc 0) 00000100:00100000:2.0:1713279306.813550:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196531 00000100:00100000:1.0:1713279306.813562:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11940:x1796503281228416:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 240us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.813565:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.813566:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785192 00000100:00100000:2.0:1713279306.813568:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041088:12345-0@lo:1000:mdt_io00_002.0 Request processed in 102us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.813571:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98792 00000100:00100000:1.0:1713279306.813579:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281229184 00000100:00100000:1.0:1713279306.813581:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281229184 00000100:00100000:2.0:1713279306.813583:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041088:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.813590:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785193 00000100:00100000:1.0:1713279306.813593:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3724:11711:x1796503281229184:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.813598:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.813603:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3221c0/0xfc4b8e114eda8c11 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391759c4 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.813606:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f388380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041152:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.813620:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.813622:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.813628:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.813630:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281228544 00000100:00100000:3.0:1713279306.813630:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.813633:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281228544 00010000:00010000:1.0:1713279306.813633:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda8c18 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.813633:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041152 00000100:00100000:2.0:1713279306.813635:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041152 00010000:00010000:1.0:1713279306.813638:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda8c18 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.813641:0:15711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce51680/0xfc4b8e114eda3c63 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174542 expref: 3437 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.813642:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda8c18 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.813643:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98793 00000100:00100000:3.0:1713279306.813644:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.813646:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041152:12345-0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1713279306.813648:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8c1f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813651:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8c1f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.813652:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196532 00010000:00010000:1.0:1713279306.813654:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8c1f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.813655:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3437:1957:x1796503281228544:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.813656:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281228992 00000100:00100000:2.0:1713279306.813658:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281228992 00010000:00010000:0.0:1713279306.813659:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.813661:0:15711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce51680/0xfc4b8e114eda3c63 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x19/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174542 expref: 3437 pid: 15480 timeout: 509 lvb_type: 0 00000004:00200000:1.0:1713279306.813662:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:0.0:1713279306.813666:0:15711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce51680/0xfc4b8e114eda3c63 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x19/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174542 expref: 3437 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.813666:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda8c18 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.813666:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223057 00000100:00100000:2.0:1713279306.813668:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3694:11897:x1796503281228992:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:1.0:1713279306.813669:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda8c18 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813672:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda8c18 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.813673:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74d1:0x0].0x0 (ffff88008d597900) 00010000:00010000:0.0:1713279306.813675:0:15711:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda8b85 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x74d1:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.813675:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda8c18 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813678:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.813679:0:15711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda8b85 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x74d1:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.813679:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda8c18 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.813682:0:15711:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda8b85 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x74d1:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.813682:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda8c18 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813685:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88011eea5800) 00010000:00010000:1.0:1713279306.813687:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.813688:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.813688:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda8c18 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813691:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda8c18 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813696:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8c1f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813698:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8c1f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813701:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8c1f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813704:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.813705:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8c1f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813708:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8c1f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813711:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff88011eea5000) 00010000:00010000:1.0:1713279306.813712:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.813713:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8c1f lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813716:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8c1f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813728:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3221c0/0xfc4b8e114eda8c11 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759c4 expref: 3725 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.813736:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3221c0/0xfc4b8e114eda8c11 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759c4 expref: 3725 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.813741:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3221c0, rc 0) 00000100:00100000:0.0:1713279306.813750:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3437:1957:x1796503281228544:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 94us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.813754:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3695:11897:x1796503281228992:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 84us (109us total) trans 4295183708 rc 0/0 00000100:00100000:0.0:1713279306.813755:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196532 00000100:00100000:1.0:1713279306.813755:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3724:11711:x1796503281229184:12345-192.168.203.4@tcp:101:touch.0 Request processed in 162us (191us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.813758:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223057 00000100:00100000:1.0:1713279306.813759:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785193 00000100:00100000:1.0:1713279306.813765:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281228736 00000100:00100000:1.0:1713279306.813766:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281228736 00000100:00100000:1.0:1713279306.813775:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785194 00000100:00100000:1.0:1713279306.813777:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11944:x1796503281228736:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.813782:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.813787:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda8c26 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391759b6 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.813791:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041152:12345-0@lo:1000:mdt_io00_002.0 Request processed in 144us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.813794:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98793 00010000:00010000:1.0:1713279306.813800:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8c2d lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813804:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8c2d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.813807:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f388380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041152:0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1713279306.813808:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8c2d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813814:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8c34 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813817:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8c34 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813820:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8c34 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.813826:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122e6c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041216:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.813838:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.813843:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ca453c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.813846:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8c3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7e3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.813848:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041216 00010000:00010000:1.0:1713279306.813851:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8c3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e3c:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.813851:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041216 00010000:00010000:1.0:1713279306.813854:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8c3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e3c:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000004:00200000:1.0:1713279306.813861:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e3c:0x0]: returning size 0 00000100:00100000:3.0:1713279306.813862:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98794 00000004:00200000:1.0:1713279306.813863:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1713279306.813865:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041216:12345-0@lo:1000:mdt_io00_002.0 00000004:00010000:1.0:1713279306.813867:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8c3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e3c:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813871:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8c3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e3c:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813875:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8c2d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813878:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8c2d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813880:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8c2d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813883:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8c2d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813886:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.813887:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8c2d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813891:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8c2d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.813893:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041216:12345-0@lo:1000:mdt_io00_002.0 Request processed in 27us (55us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.813894:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88011eea5b00) 00010000:00010000:1.0:1713279306.813895:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.813896:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98794 00010000:00010000:1.0:1713279306.813897:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8c2d lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813899:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8c2d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813904:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8c34 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813906:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8c34 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813909:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8c34 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813911:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801222058c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.813913:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8c34 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813916:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8c34 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813919:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x3331 (ffff88011eea5d00) 00010000:00010000:1.0:1713279306.813920:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.813921:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8c34 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813924:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8c34 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.813934:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda8c26 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759b6 expref: 3714 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.813941:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8c3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7e3c:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759b6 expref: 3713 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.813944:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7e3c:0x0].0x0 (ffff880092193100) 00010000:00010000:1.0:1713279306.813945:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:1.0:1713279306.813947:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122205b00, rc 0) 00000100:00100000:1.0:1713279306.813962:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11944:x1796503281228736:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 183us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.813965:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785194 00000100:00100000:1.0:1713279306.813980:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6917:1796503200040256:192.168.203.4@tcp:105: 00010000:00010000:1.0:1713279306.813987:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.813997:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+89:1957:x1796503281227584:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1529us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.814001:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196528 00010000:00010000:1.0:1713279306.814023:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114eda3e07 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391745b9 expref: 3694 pid: 15471 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.814030:0:15658:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234c380 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001_UUID:15658:1796503200039552:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.814033:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.814035:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce51680/0xfc4b8e114eda3c63 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174542 expref: 3436 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.814041:0:15658:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091beb480 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001_UUID:15658:1796503200039616:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.814043:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.814045:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281229056 00000100:00100000:0.0:1713279306.814048:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281229056 00010000:00010000:1.0:1713279306.814049:0:15658:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda8b85 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x74d1:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.814053:0:15658:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda8b85 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x74d1:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.814056:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda8b85 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x74d1:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.814058:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.814061:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110493 00000004:00200000:1.0:1713279306.814061:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x74d1:0x0]: returning size 31314 00000100:00100000:0.0:1713279306.814064:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+81:1955:x1796503281229056:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:1.0:1713279306.814082:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281229312 00000100:00100000:1.0:1713279306.814084:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281229312 00010000:00010000:1.0:1713279306.814091:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114ed9d817 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172807 expref: 3436 pid: 15486 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.814101:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196533 00000100:00100000:1.0:1713279306.814103:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e607480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3436:1956:x1796503281229312:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.814107:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.814108:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.814110:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114ed9d817 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172807 expref: 3436 pid: 15486 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.814115:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114ed9d817 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172807 expref: 3436 pid: 15486 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.814121:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x729c:0x0].0x0 (ffff88008c0b0a00) 00010000:00010000:1.0:1713279306.814124:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.814127:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.814132:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.814135:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.814138:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.814140:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.814143:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:0.0:1713279306.814149:0:15506:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb size from disk: 46934 -> 46934 00002000:00010000:0.0:1713279306.814151:0:15506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279306.814152:0:15506:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:0.0:1713279306.814154:0:15506:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00000100:00100000:1.0:1713279306.814155:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e607480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3436:1956:x1796503281229312:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 51us (96us total) trans 0 rc 0/0 00002000:00010000:0.0:1713279306.814156:0:15506:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb blocks from disk: 72 -> 72 00000100:00100000:1.0:1713279306.814158:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196533 00000100:00100000:1.0:1713279306.814166:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281229248 00000100:00100000:1.0:1713279306.814168:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281229248 00000100:00100000:0.0:1713279306.814170:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+82:1955:x1796503281229056:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 105us (137us total) trans 4295010123 rc 0/0 00000100:00100000:1.0:1713279306.814174:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785195 00000100:00100000:0.0:1713279306.814175:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110493 00000100:00100000:1.0:1713279306.814177:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11666:x1796503281229248:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.814181:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.814187:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008af30000/0xfc4b8e114eda8c42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391759cb expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.814195:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008af30000/0xfc4b8e114eda8c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759cb expref: 3714 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.814201:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114ed9d817 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x729c:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172807 expref: 3435 pid: 15486 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.814201:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008af30000/0xfc4b8e114eda8c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759cb expref: 3714 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.814207:0:15749:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965500 pname:cluuid:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001_UUID:15749:1796503200040832:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.814207:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x0 (ffff88011eea5300) 00010000:00010000:1.0:1713279306.814209:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.814210:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008af30000, rc 0) 00000100:00100000:0.0:1713279306.814212:0:15749:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965f80 pname:cluuid:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001_UUID:15749:1796503200040896:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.814220:0:15749:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00000100:00100000:1.0:1713279306.814221:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:11666:x1796503281229248:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 43us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.814224:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785195 00000100:00100000:2.0:1713279306.814236:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3722:11854:x1796503281228224:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1675us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.814241:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223056 00000100:00100000:2.0:1713279306.814247:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281229440 00000100:00100000:2.0:1713279306.814249:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281229440 00000100:00100000:2.0:1713279306.814257:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223058 00000100:00100000:2.0:1713279306.814259:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130145050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3695:13161:x1796503281229440:12345-192.168.203.4@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1713279306.814264:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e7ba400/0xfc4b8e114eda8b7e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917598c expref: 3696 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.814270:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322f40/0xfc4b8e114eda8b85 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x74d1:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917598c expref: 3695 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.814274:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74d1:0x0].0x0 (ffff88008d597900) 00010000:00010000:1.0:1713279306.814275:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1713279306.814276:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d322f40, rc 0) 00000100:00100000:1.0:1713279306.814290:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3696:11951:x1796503281227520:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 3308us (3407us total) trans 4295183709 rc 0/0 00000100:00100000:1.0:1713279306.814293:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785185 00000100:00100000:2.0:1713279306.814307:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130145050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3695:13161:x1796503281229440:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 46us (199us total) trans 4295183710 rc 0/0 00000100:00100000:2.0:1713279306.814311:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223058 00000100:00100000:2.0:1713279306.814335:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122e6c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041216:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.814354:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122e6c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041280:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.814365:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.814378:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ca453c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.814380:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041280 00000100:00100000:3.0:1713279306.814383:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041280 00000100:00100000:3.0:1713279306.814394:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98795 00000100:00100000:3.0:1713279306.814396:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041280:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1713279306.814442:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041280:12345-0@lo:1000:mdt_io00_002.0 Request processed in 44us (75us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.814445:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98795 00000100:00100000:2.0:1713279306.814458:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.814468:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281229632 00000100:00100000:3.0:1713279306.814470:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281229632 00000100:00100000:3.0:1713279306.814484:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785196 00000100:00100000:3.0:1713279306.814487:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3695:11711:x1796503281229632:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.814490:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122e6c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041280:0@lo:1000:mdt_io00_002.0 00010000:00010000:3.0:1713279306.814492:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.814500:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda8c50 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391759d9 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.814512:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041344:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.814521:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.814524:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda8c57 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.814528:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.814529:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda8c57 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.814530:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281229696 00000100:00100000:1.0:1713279306.814533:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281229696 00010000:00010000:3.0:1713279306.814534:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda8c57 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.814535:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77780 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.814536:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041344 00000100:00100000:2.0:1713279306.814539:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041344 00010000:00010000:3.0:1713279306.814539:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda8c5e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.814542:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda8c5e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.814544:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785197 00010000:00010000:3.0:1713279306.814545:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda8c5e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.814547:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:11204:x1796503281229696:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.814548:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98796 00000100:00100000:2.0:1713279306.814551:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041344:12345-0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1713279306.814552:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.814557:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114eda8c65 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391759d2 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.814561:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda8c57 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.814565:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda8c57 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.814568:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda8c57 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.814571:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda8c57 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.814573:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181ed00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.814575:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda8c57 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.814578:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda8c6c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.814578:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda8c57 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.814580:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041344:12345-0@lo:1000:mdt_io00_002.0 Request processed in 29us (51us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.814582:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda8c6c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.814582:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88012fbfe200) 00000100:00100000:2.0:1713279306.814583:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98796 00010000:00010000:3.0:1713279306.814584:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.814585:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda8c57 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.814586:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041344:0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1713279306.814586:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda8c6c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.814588:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda8c57 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.814591:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda8c73 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.814593:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda8c5e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.814595:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda8c73 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.814596:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda8c5e lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.814598:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda8c73 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.814599:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda8c5e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.814602:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.814603:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda8c5e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.814606:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda8c5e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.814609:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda8c6c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.814609:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88012fbfe300) 00010000:00010000:3.0:1713279306.814610:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.814612:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda8c6c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.814612:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda8c5e lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.814614:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda8c6c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.814614:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda8c5e lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.814617:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda8c6c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.814620:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f2b3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.814622:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda8c6c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.814626:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda8c50 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759d9 expref: 3696 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.814627:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda8c6c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.814630:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda8c50 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759d9 expref: 3696 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.814631:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:1.0:1713279306.814632:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.814633:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda8c6c lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.814635:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801245b6400, rc 0) 00010000:00010000:1.0:1713279306.814636:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda8c6c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.814641:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda8c73 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.814644:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda8c73 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.814647:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda8c73 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.814649:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f29b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.814650:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda8c73 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.814651:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3695:11711:x1796503281229632:12345-192.168.203.4@tcp:101:touch.0 Request processed in 163us (193us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.814653:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda8c73 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.814656:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880131200300) 00000100:00100000:3.0:1713279306.814656:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785196 00010000:00010000:1.0:1713279306.814657:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.814658:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda8c73 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.814661:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda8c73 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.814672:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114eda8c65 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759d2 expref: 3715 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.814676:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114eda8c65 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759d2 expref: 3715 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.814683:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801251d5b00, rc 0) 00000100:00100000:1.0:1713279306.814695:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:11204:x1796503281229696:12345-192.168.203.4@tcp:101:touch.0 Request processed in 148us (176us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.814699:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785197 00000100:00100000:2.0:1713279306.814703:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.814708:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281229952 00000100:00100000:1.0:1713279306.814710:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281229952 00000100:00100000:1.0:1713279306.814718:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785198 00000100:00100000:1.0:1713279306.814721:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3695:11912:x1796503281229952:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.814726:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.814731:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda8c7a lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391759e0 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.814737:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.814744:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281229824 00000100:00100000:3.0:1713279306.814747:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281229824 00000100:00100000:3.0:1713279306.814755:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223059 00000100:00100000:3.0:1713279306.814758:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3722:11900:x1796503281229824:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:1.0:1713279306.814759:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda8c81 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.814763:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda8c81 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.814767:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda8c81 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.814773:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda8c88 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.814776:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda8c88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.814780:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda8c88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00200000:1.0:1713279306.814786:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:1.0:1713279306.814791:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda8c81 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.814794:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda8c81 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.814796:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda8c81 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.814799:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda8c81 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.814802:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f286c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.814804:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda8c81 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.814806:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda8c81 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.814810:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00010000:00010000:1.0:1713279306.814811:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.814812:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda8c81 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.814815:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda8c81 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.814822:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda8c88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.814823:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3723:11900:x1796503281229824:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 64us (86us total) trans 4295202679 rc 0/0 00010000:00010000:1.0:1713279306.814825:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda8c88 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.814828:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda8c88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.814828:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223059 00010000:00010000:1.0:1713279306.814830:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f28000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.814831:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda8c88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.814834:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda8c88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.814836:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.814837:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880131200900) 00010000:00010000:1.0:1713279306.814838:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.814839:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda8c88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.814842:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda8c88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.814847:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281230080 00000100:00100000:3.0:1713279306.814849:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281230080 00010000:00010000:1.0:1713279306.814853:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda8c7a lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759e0 expref: 3696 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.814857:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda8c7a lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759e0 expref: 3696 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.814860:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f2b180, rc 0) 00000100:00100000:3.0:1713279306.814860:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785199 00000100:00100000:3.0:1713279306.814862:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3723:11956:x1796503281230080:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.814867:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.814872:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.814873:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3695:11912:x1796503281229952:12345-192.168.203.4@tcp:101:touch.0 Request processed in 152us (171us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.814873:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda8c8f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391759e7 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.814878:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785198 00000100:00100000:0.0:1713279306.814887:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281230144 00000100:00100000:0.0:1713279306.814890:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281230144 00010000:00010000:0.0:1713279306.814899:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800963ba1c0/0xfc4b8e114ed5e554 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x729c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915f41c expref: 3695 pid: 15469 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.814907:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8c96 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.814912:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8c96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00000100:00100000:0.0:1713279306.814915:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196534 00010000:00010000:3.0:1713279306.814916:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8c96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000100:00100000:0.0:1713279306.814917:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:385c4b71-808c-40cf-91de-b076b668d13f+3695:1956:x1796503281230144:12345-192.168.203.4@tcp:102:ldlm_bl.0 00010000:00010000:3.0:1713279306.814922:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda8c9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.814923:0:9215:0:(ldlm_lockd.c:1700:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0001_UUID lock: ffff8800963ba1c0/0xfc4b8e114ed5e554 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x729c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915f41c expref: 3695 pid: 15469 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.814926:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda8c9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.814929:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800963ba1c0/0xfc4b8e114ed5e554 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x729c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915f41c expref: 3695 pid: 15469 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.814929:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda8c9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.814934:0:9215:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800963ba1c0/0xfc4b8e114ed5e554 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915f41c expref: 3695 pid: 15469 timeout: 509 lvb_type: 0 00000004:00200000:3.0:1713279306.814937:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8516:0x0]: returning size 1 00010000:00010000:0.0:1713279306.814938:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x729c:0x0].0x0 (ffff88008c0b0a00) 00010000:00010000:0.0:1713279306.814939:0:9215:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1713279306.814941:0:9215:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.814943:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8c96 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.814945:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.814946:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8c96 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.814948:0:9215:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.814949:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8c96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.814952:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8c96 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.814955:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8cb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.814956:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8c96 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.814957:0:9215:0:(ldlm_lockd.c:1748:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800963ba1c0/0xfc4b8e114ed5e554 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915f41c expref: 3695 pid: 15469 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.814959:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8c96 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.814961:0:15749:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.814963:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.814964:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.814965:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.814965:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8c96 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.814968:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8c96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000100:00100000:0.0:1713279306.814972:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:385c4b71-808c-40cf-91de-b076b668d13f+3695:1956:x1796503281230144:12345-192.168.203.4@tcp:102:ldlm_bl.0 Request processed in 54us (100us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.814973:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda8c9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00000100:00100000:0.0:1713279306.814975:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196534 00010000:00010000:1.0:1713279306.814975:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda8ca4 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x254:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.814975:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda8c9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.814978:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda8c9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.814979:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda8ca4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x254:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.814981:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131f3f3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.814983:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda8ca4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x254:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.814983:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda8c9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.814985:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda8c9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.814989:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3931 (ffff88012fbfef00) 00010000:00010000:3.0:1713279306.814990:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.814991:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda8c9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.814994:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce533c0/0xfc4b8e114eda8cab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x149:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.814994:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda8c9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.814997:0:15749:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce533c0/0xfc4b8e114eda8cab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.815001:0:15749:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce533c0/0xfc4b8e114eda8cab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.815007:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda8c8f lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759e7 expref: 3724 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.815009:0:15749:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-mdtlov_UUID:15749:1796503200041408:0@lo:101:mdt00_031.0 00010000:00010000:3.0:1713279306.815011:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda8c8f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759e7 expref: 3724 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.815015:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bf8dd40, rc 0) 00000100:00100000:1.0:1713279306.815026:0:15749:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.815031:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3723:11956:x1796503281230080:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 167us (195us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.815034:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785199 00000100:00100000:1.0:1713279306.815041:0:15749:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.815041:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041408 00000100:00100000:2.0:1713279306.815044:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041408 00000100:00100000:2.0:1713279306.815058:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98797 00000100:00100000:2.0:1713279306.815060:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15749:x1796503200041408:12345-0@lo:101:mdt00_031.0 00010000:00010000:2.0:1713279306.815065:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.815081:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda8cb2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x149:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda8cab expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.815090:0:15494:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda8cb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda8cab expref: 58 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.815099:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda8cb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8cab expref: 58 pid: 15494 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.815108:0:15494:0:(mdt_lvb.c:110:mdt_dom_disk_lvbo_update()) res: [0x200000401:0x149:0x0] updating lvb size from disk: 0 -> 4096 00000004:00010000:2.0:1713279306.815109:0:15494:0:(mdt_lvb.c:117:mdt_dom_disk_lvbo_update()) res: [0x200000401:0x149:0x0] updating lvb mtime from disk: 0 -> 1713279302 00000004:00010000:2.0:1713279306.815111:0:15494:0:(mdt_lvb.c:123:mdt_dom_disk_lvbo_update()) res: [0x200000401:0x149:0x0] updating lvb atime from disk: 0 -> 1713279302 00000004:00010000:2.0:1713279306.815112:0:15494:0:(mdt_lvb.c:129:mdt_dom_disk_lvbo_update()) res: [0x200000401:0x149:0x0] updating lvb ctime from disk: 0 -> 1713279302 00000004:00010000:2.0:1713279306.815113:0:15494:0:(mdt_lvb.c:135:mdt_dom_disk_lvbo_update()) res: [0x200000401:0x149:0x0] updating lvb blocks from disk: 18427282363563114435 -> 16 00010000:00010000:2.0:1713279306.815116:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x149:0x0].0x0 (ffff88012d2e5000) 00010000:00010000:2.0:1713279306.815118:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:2.0:1713279306.815119:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68a1c0, rc 0) 00000100:00100000:2.0:1713279306.815135:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+58:15749:x1796503200041408:12345-0@lo:101:mdt00_031.0 Request processed in 74us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.815138:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98797 00000100:00100000:0.0:1713279306.815143:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041472:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1713279306.815143:0:15749:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-mdtlov_UUID:15749:1796503200041408:0@lo:101:mdt00_031.0 00010000:00010000:1.0:1713279306.815149:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce533c0/0xfc4b8e114eda8cab lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8cb2 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.815157:0:15749:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce533c0/0xfc4b8e114eda8cab lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8cb2 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.815160:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.815167:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f77a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.815167:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041472 00000100:00100000:2.0:1713279306.815169:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041472 00000100:00100000:2.0:1713279306.815176:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98798 00000100:00100000:2.0:1713279306.815178:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041472:12345-0@lo:403:mdt_io00_002.0 00010000:00010000:1.0:1713279306.815191:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda8ca4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x254:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.815194:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda8ca4 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x254:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.815197:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda8ca4 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x254:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.815200:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ce52640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.815202:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda8ca4 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x254:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.815204:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda8ca4 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x254:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.815208:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x254:0x0].0x0 (ffff88011f3ebc00) 00010000:00010000:1.0:1713279306.815210:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:1.0:1713279306.815211:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda8ca4 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x254:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.815214:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114eda8ca4 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x254:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.815220:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce533c0/0xfc4b8e114eda8cab lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8cb2 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.815224:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce533c0/0xfc4b8e114eda8cab lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda8cb2 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.815230:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce533c0/0xfc4b8e114eda8cab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda8cb2 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.815245:0:15749:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1713279306.815248:0:15749:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x149:0x0] 00010000:00010000:1.0:1713279306.815251:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.815254:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.815257:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.815259:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095249d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.815259:0:6919:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713279306.815261:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.815263:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.815263:0:6919:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce533c0/0xfc4b8e114eda8cab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114eda8cb2 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.815267:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x729c:0x0].0x0 (ffff88008c0b0a00) 00010000:00010000:3.0:1713279306.815267:0:6919:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ce533c0 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:1.0:1713279306.815268:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7e 00010000:00010000:1.0:1713279306.815269:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.815270:0:6919:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce533c0/0xfc4b8e114eda8cab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda8cb2 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.815272:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda8be0 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x7e/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.815276:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.815278:0:6919:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce533c0/0xfc4b8e114eda8cab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda8cb2 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.815283:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.815286:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.815290:0:6919:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce533c0/0xfc4b8e114eda8cab lrc: 2/0,0 mode: --/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda8cb2 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.815291:0:15749:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1713279306.815294:0:6919:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713279306.815297:0:15544:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713279306.815300:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.815308:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed0ba80 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.815308:0:6919:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce533c0/0xfc4b8e114eda8cab lrc: 1/0,0 mode: --/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda8cb2 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.815310:0:15544:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.815312:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3434:9807:x1796503281226688:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 5753us (6197us total) trans 0 rc -114/-114 00000100:00100000:2.0:1713279306.815312:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1713279306.815312:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce533c0/0xfc4b8e114eda8cab lrc: 0/0,0 mode: --/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda8cb2 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713279306.815314:0:15544:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.815315:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785180 00000100:00100000:2.0:1713279306.815318:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200041536:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.815320:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.815320:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.815321:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.815325:0:15544:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 2/0,0 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.815328:0:15544:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713279306.815333:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.815341:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 1/0,0 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.815344:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200041600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.815345:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed0ba80/0xfc4b8e114eda8b1c lrc: 0/0,0 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda8b62 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.815352:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.815353:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.815354:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279306.815357:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.815363:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041536 00000100:00100000:0.0:1713279306.815365:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041536 00000100:00100000:1.0:1713279306.815370:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041600 00000100:00100000:1.0:1713279306.815372:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041600 00000100:00100000:0.0:1713279306.815375:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147248 00000100:00100000:0.0:1713279306.815378:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+59:3490:x1796503200041536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.815382:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.815383:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147249 00000100:00100000:1.0:1713279306.815385:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+59:3492:x1796503200041600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.815390:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.815391:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda8cb2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x149:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda8cab expref: 59 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.815396:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda8b62 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x729c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda8b1c expref: 58 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.815397:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x149:0x0].0x0 (ffff88012d2e5000) 00010000:00010000:1.0:1713279306.815401:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x729c:0x0].0x0 (ffff88007f2ad700) 00010000:00010000:1.0:1713279306.815404:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.815432:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+57:3492:x1796503200041600:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.815435:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147249 00000100:00100000:1.0:1713279306.815449:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200041600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.815475:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.815494:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+56:3490:x1796503200041536:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.815498:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147248 00000100:00100000:3.0:1713279306.815504:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200041536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.815715:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.815763:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281230528 00000100:00100000:1.0:1713279306.815767:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281230528 00000100:00100000:0.0:1713279306.815776:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.815784:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281230208 00000100:00100000:0.0:1713279306.815786:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281230208 00000100:00100000:1.0:1713279306.815786:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785200 00000100:00100000:1.0:1713279306.815790:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3723:11711:x1796503281230528:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.815793:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.815797:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110494 00010000:00010000:1.0:1713279306.815798:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.815799:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+82:1954:x1796503281230208:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:3.0:1713279306.815802:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281230272 00000100:00100000:3.0:1713279306.815804:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281230272 00010000:00010000:1.0:1713279306.815805:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda8cb9 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391759ee expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.815814:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223060 00000100:00100000:3.0:1713279306.815817:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:11666:x1796503281230272:12345-192.168.203.4@tcp:37:lfs.0 00002000:00010000:0.0:1713279306.815851:0:9197:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb size from disk: 31314 -> 39808 00002000:00010000:0.0:1713279306.815853:0:9197:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb mtime from disk: 1713279304 -> 1713279306 00002000:00010000:0.0:1713279306.815855:0:9197:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb atime from disk: 1713279299 -> 1713279299 00010000:00010000:1.0:1713279306.815855:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda8cc0 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00002000:00010000:0.0:1713279306.815856:0:9197:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279306.815857:0:9197:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb blocks from disk: 56 -> 56 00010000:00010000:1.0:1713279306.815862:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda8cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.815869:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda8cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.815873:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+83:1954:x1796503281230208:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 72us (97us total) trans 4295010124 rc 0/0 00000100:00100000:0.0:1713279306.815876:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110494 00010000:00010000:1.0:1713279306.815878:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda8cc7 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.815884:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda8cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.815889:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda8cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.815895:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.815902:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281230336 00000100:00100000:0.0:1713279306.815904:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281230336 00000004:00200000:1.0:1713279306.815904:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:1.0:1713279306.815911:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda8cc0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.815913:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147250 00000100:00100000:0.0:1713279306.815916:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:1956:x1796503281230336:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.815916:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda8cc0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.815920:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.815924:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda8cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.815926:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8c3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7e3c:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759b6 expref: 3715 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.815930:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda8cc0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.815935:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7e3c:0x0].0x0 (ffff880092193100) 00010000:00010000:1.0:1713279306.815935:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800963e0240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.815937:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.815937:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda8cc0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.815942:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda8cc0 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.815945:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:1956:x1796503281230336:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 29us (50us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.815949:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147250 00010000:00010000:1.0:1713279306.815949:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880097910400) 00010000:00010000:1.0:1713279306.815951:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.815953:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda8cc0 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.815958:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda8cc0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.815965:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda8cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.815970:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda8cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.815975:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda8cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.815979:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ee880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.815981:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda8cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.815988:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda8cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.815992:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880097910000) 00010000:00010000:1.0:1713279306.815993:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.815994:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda8cc7 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.815997:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda8cc7 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.816013:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda8cb9 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759ee expref: 3724 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.816018:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda8cb9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759ee expref: 3724 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.816023:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce53a80, rc 0) 00000100:00100000:0.0:1713279306.816037:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.816038:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3723:11711:x1796503281230528:12345-192.168.203.4@tcp:101:touch.0 Request processed in 248us (324us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.816042:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785200 00000100:00100000:1.0:1713279306.816049:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281230400 00000100:00100000:1.0:1713279306.816051:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281230400 00000100:00100000:0.0:1713279306.816054:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.816061:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281230656 00000100:00100000:1.0:1713279306.816063:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281230656 00000100:00100000:1.0:1713279306.816090:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785201 00000100:00100000:1.0:1713279306.816094:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3723:11854:x1796503281230400:12345-192.168.203.4@tcp:34:lfs.0 00000100:00100000:0.0:1713279306.816098:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.816113:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.816116:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8cce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x148:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.816123:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281230848 00000100:00100000:0.0:1713279306.816125:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281230848 00010000:00010000:1.0:1713279306.816125:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8cce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.816132:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8cce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.816134:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281230784 00000100:00100000:0.0:1713279306.816136:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281230784 00010000:00010000:1.0:1713279306.816140:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8cd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x148:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.816143:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785202 00010000:00010000:1.0:1713279306.816145:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.816146:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:11204:x1796503281230656:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.816150:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.816151:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.816158:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133317840/0xfc4b8e114eda8cdc lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391759f5 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.816180:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda8ce3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x843e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.816186:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda8ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x843e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.816191:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda8cea lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.816192:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda8ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x843e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.816195:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda8cea lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.816199:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda8cea lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.816208:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8cf1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000004:00010000:1.0:1713279306.816209:0:15749:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda8ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x843e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.816211:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8cf1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.816214:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8cf1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.816215:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785203 00010000:00010000:1.0:1713279306.816216:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8cce lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:3.0:1713279306.816218:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3724:11949:x1796503281230848:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:1.0:1713279306.816220:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8cce lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00000004:00200000:0.0:1713279306.816221:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:3.0:1713279306.816223:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.816225:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8cce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.816226:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda8cea lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.816230:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5b00/0xfc4b8e114eda8cf8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a03 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.816231:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8cce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.816235:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ecd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.816237:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8cce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.816241:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8cce lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.816247:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x0 (ffff880091b34100) 00010000:00010000:1.0:1713279306.816249:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.816250:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114eda8cff lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.816251:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8cce lrc: 3/0,0 mode: --/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.816254:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8cce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.816255:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114eda8cff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.816259:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041472:12345-0@lo:403:mdt_io00_002.0 Request processed in 1078us (1097us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.816259:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114eda8cff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.816260:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.816263:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8cd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.816263:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98798 00010000:00010000:1.0:1713279306.816266:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.816266:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8d06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.816268:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ed8c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.816269:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8d06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.816270:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.816272:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8cd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.816273:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8d06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.816278:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x38 (ffff880129b60a00) 00010000:00010000:1.0:1713279306.816280:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.816280:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041472:0@lo:403:mdt_io00_002.0 00010000:00010000:1.0:1713279306.816281:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8cd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.816283:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8cd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.816289:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda8ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x843e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.816292:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda8ce3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x843e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.816292:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076cb40/0xfc4b8e114eda8d0d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.816294:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda8ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x843e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.816295:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013076cb40/0xfc4b8e114eda8d0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.816297:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ec900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.816298:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda8ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x843e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.816299:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076cb40/0xfc4b8e114eda8d0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.816301:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda8ce3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x843e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.816304:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x843e:0x0].0x0 (ffff88008e4c8b00) 00010000:00010000:0.0:1713279306.816305:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda8cea lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.816305:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.816307:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda8ce3 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x843e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.816309:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda8cea lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.816309:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda8ce3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x843e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.816312:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda8cea lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000004:00200000:3.0:1713279306.816312:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x84eb:0x0]: returning size 6184 00000004:00200000:3.0:1713279306.816313:0:15753:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713279306.816314:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133315b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.816316:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda8cea lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000004:00010000:3.0:1713279306.816318:0:15753:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013076cb40/0xfc4b8e114eda8d0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.816319:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda8cea lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.816322:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013076cb40/0xfc4b8e114eda8d0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.816324:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:0.0:1713279306.816325:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.816326:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114eda8cff lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.816327:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda8cea lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.816329:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3725:11854:x1796503281230400:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 234us (292us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.816329:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114eda8cff lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.816332:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda8cea lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.816332:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114eda8cff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00000100:00100000:1.0:1713279306.816333:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785201 00010000:00010000:3.0:1713279306.816335:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114eda8cff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.816337:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076d200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.816339:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8cf1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.816339:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114eda8cff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.816341:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8cf1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.816342:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785204 00010000:00010000:3.0:1713279306.816342:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114eda8cff lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.816344:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8cf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.816345:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3436:9807:x1796503281230784:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.816346:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:0.0:1713279306.816347:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800958d5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.816347:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.816348:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8cf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.816349:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114eda8cff lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:1.0:1713279306.816350:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.816351:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8cf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.816351:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114eda8cff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.816354:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88012061f600) 00010000:00010000:1.0:1713279306.816354:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114eda8d14 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x74de:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391759fc expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.816355:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.816356:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8d06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.816357:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8cf1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.816359:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8cf1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.816359:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8d06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.816362:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8d06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.816365:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.816367:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8d06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.816370:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8d06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.816373:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff88012fbfe700) 00010000:00010000:0.0:1713279306.816374:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880133317840/0xfc4b8e114eda8cdc lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759f5 expref: 3437 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.816374:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.816375:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8d06 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.816378:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133317840/0xfc4b8e114eda8cdc lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759f5 expref: 3437 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.816378:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8d06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000004:00200000:1.0:1713279306.816379:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x74de:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.816387:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133317840, rc 0) 00010000:00010000:3.0:1713279306.816389:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5b00/0xfc4b8e114eda8cf8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a03 expref: 3725 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.816395:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076cb40/0xfc4b8e114eda8d0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a03 expref: 3724 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.816398:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84eb:0x0].0x0 (ffff88012061ff00) 00010000:00010000:3.0:1713279306.816399:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:0.0:1713279306.816400:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3437:11204:x1796503281230656:12345-192.168.203.4@tcp:101:touch.0 Request processed in 253us (345us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.816401:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013076cb40, rc 0) 00000100:00100000:0.0:1713279306.816404:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785202 00010000:00010000:1.0:1713279306.816404:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114eda8d14 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x74de:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759fc expref: 3437 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.816408:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114eda8d14 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x74de:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391759fc expref: 3437 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.816431:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3724:11949:x1796503281230848:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 212us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.816436:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785203 00010000:00010000:1.0:1713279306.816438:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ef180, rc 0) 00000100:00100000:0.0:1713279306.816451:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.816452:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:9807:x1796503281230784:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 106us (337us total) trans 4295183711 rc 301/301 00000100:00100000:1.0:1713279306.816456:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785204 00000100:00100000:1.0:1713279306.816464:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281230976 00000100:00100000:1.0:1713279306.816465:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281230976 00000100:00100000:3.0:1713279306.816479:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785205 00000100:00100000:3.0:1713279306.816482:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3695:11912:x1796503281230976:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.816488:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.816494:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114eda8d22 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a0a expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.816513:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076f840/0xfc4b8e114eda8d29 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.816517:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013076f840/0xfc4b8e114eda8d29 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816521:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013076f840/0xfc4b8e114eda8d29 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816525:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda8d30 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.816529:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda8d30 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816532:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda8d30 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816542:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076f840/0xfc4b8e114eda8d29 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816545:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076f840/0xfc4b8e114eda8d29 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816548:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013076f840/0xfc4b8e114eda8d29 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816551:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013076f840/0xfc4b8e114eda8d29 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816553:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076f840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.816555:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076f840/0xfc4b8e114eda8d29 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816558:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076f840/0xfc4b8e114eda8d29 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816562:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012fbfe000) 00010000:00010000:3.0:1713279306.816564:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.816565:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013076f840/0xfc4b8e114eda8d29 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816568:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076f840/0xfc4b8e114eda8d29 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816572:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda8d30 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816575:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda8d30 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816577:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda8d30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816579:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076e880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.816581:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda8d30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816583:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda8d30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816587:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88012fbfe400) 00010000:00010000:3.0:1713279306.816588:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.816589:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda8d30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816594:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda8d30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816605:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114eda8d22 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a0a expref: 3696 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.816609:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114eda8d22 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a0a expref: 3696 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.816614:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013076e1c0, rc 0) 00000100:00100000:3.0:1713279306.816627:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3695:11912:x1796503281230976:12345-192.168.203.4@tcp:101:touch.0 Request processed in 144us (176us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.816630:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785205 00000100:00100000:1.0:1713279306.816646:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.816647:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.816675:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281231232 00000100:00100000:3.0:1713279306.816677:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281231232 00000100:00100000:3.0:1713279306.816687:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785206 00000100:00100000:3.0:1713279306.816690:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3695:11711:x1796503281231232:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.816695:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.816701:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114eda8d37 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a11 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.816718:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8d3e lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.816723:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8d3e lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816726:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8d3e lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.816732:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281231104 00010000:00010000:3.0:1713279306.816734:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8d45 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.816735:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281231104 00010000:00010000:3.0:1713279306.816737:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8d45 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816741:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8d45 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.816747:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223061 00000100:00100000:2.0:1713279306.816749:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3697:11951:x1796503281231104:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:3.0:1713279306.816750:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8d3e lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816753:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8d3e lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816756:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8d3e lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816759:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8d3e lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816761:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b7180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.816763:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8d3e lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816766:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8d3e lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816769:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88012fbfee00) 00010000:00010000:3.0:1713279306.816770:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.816772:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8d3e lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816774:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114eda8d3e lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816780:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8d45 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816783:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8d45 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816786:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8d45 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816788:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b61c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.816789:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8d45 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816792:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8d45 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816795:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88012fbfe500) 00010000:00010000:3.0:1713279306.816796:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.816797:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8d45 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816799:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114eda8d45 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.816810:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114eda8d37 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a11 expref: 3698 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.816814:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114eda8d37 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a11 expref: 3698 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.816818:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801245b58c0, rc 0) 00000100:00100000:2.0:1713279306.816824:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3697:11951:x1796503281231104:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 73us (177us total) trans 4295183712 rc 0/0 00000100:00100000:2.0:1713279306.816828:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223061 00000100:00100000:3.0:1713279306.816831:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3697:11711:x1796503281231232:12345-192.168.203.4@tcp:101:touch.0 Request processed in 140us (184us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.816835:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785206 00000100:00100000:2.0:1713279306.816857:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041664:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.816899:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.816906:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.816912:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041664 00000100:00100000:2.0:1713279306.816913:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041664 00000100:00100000:2.0:1713279306.816929:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98799 00000100:00100000:2.0:1713279306.816932:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041664:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.816956:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041664:12345-0@lo:1000:mdt_io00_002.0 Request processed in 24us (56us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.816959:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98799 00000100:00100000:0.0:1713279306.816968:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041664:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.817004:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041728:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.817017:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.817024:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090760a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.817027:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041728 00000100:00100000:2.0:1713279306.817029:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041728 00000100:00100000:2.0:1713279306.817036:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98800 00000100:00100000:2.0:1713279306.817038:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041728:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.817058:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041728:12345-0@lo:1000:mdt_io00_002.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.817061:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98800 00000100:00100000:0.0:1713279306.817066:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041728:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.817094:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041792:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1713279306.817106:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.817111:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011f137180 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.817115:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041792 00000100:00100000:2.0:1713279306.817117:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041792 00000100:00100000:2.0:1713279306.817124:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98801 00000100:00100000:2.0:1713279306.817126:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041792:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1713279306.817146:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:6943:x1796503200041792:12345-0@lo:1000:mdt_io00_002.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.817149:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98801 00000100:00100000:0.0:1713279306.817153:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041792:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1713279306.817258:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.817267:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281231616 00000100:00100000:2.0:1713279306.817268:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281231616 00000100:00100000:2.0:1713279306.817276:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223062 00000100:00100000:2.0:1713279306.817279:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:9807:x1796503281231616:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.817296:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11666:x1796503281230272:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1477us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.817301:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223060 00000100:00100000:2.0:1713279306.817322:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3436:9807:x1796503281231616:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 41us (64us total) trans 4295183713 rc 0/0 00000100:00100000:2.0:1713279306.817326:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223062 00000100:00100000:1.0:1713279306.817501:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.817510:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.817511:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281231360 00000100:00100000:2.0:1713279306.817512:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281231360 00000100:00100000:2.0:1713279306.817521:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281231488 00000100:00100000:1.0:1713279306.817523:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.817523:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281231488 00000100:00100000:3.0:1713279306.817525:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785207 00000100:00100000:3.0:1713279306.817527:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3724:11854:x1796503281231360:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:2.0:1713279306.817532:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281231744 00000100:00100000:2.0:1713279306.817533:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281231744 00010000:00010000:3.0:1713279306.817533:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.817535:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785208 00000100:00100000:1.0:1713279306.817538:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11204:x1796503281231488:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.817539:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3a80/0xfc4b8e114eda8d4c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x843e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a18 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.817541:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785209 00000100:00100000:2.0:1713279306.817544:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3726:11711:x1796503281231744:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.817545:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.817549:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.817550:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114eda8d53 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a1f expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.817554:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689f80/0xfc4b8e114eda8d5a lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a26 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.817565:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114eda8d61 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x843e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.817570:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda8d68 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.817570:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114eda8d61 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x843e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.817574:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114eda8d61 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x843e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.817575:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda8d68 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000004:00200000:3.0:1713279306.817578:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x843e:0x0]: returning size 0 00010000:00010000:1.0:1713279306.817579:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda8d68 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.817584:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda8d6f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.817588:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda8d6f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.817591:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda8d6f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.817591:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda8d7d lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.817596:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda8d7d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.817601:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda8d7d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.817602:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda8d68 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.817605:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda8d68 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.817605:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3a80/0xfc4b8e114eda8d4c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x843e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a18 expref: 3729 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.817606:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda8d84 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.817607:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda8d68 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.817610:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda8d84 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.817611:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda8d68 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.817612:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114eda8d61 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x843e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a18 expref: 3728 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.817613:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ecb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.817613:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda8d84 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.817615:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda8d68 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.817616:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x843e:0x0].0x0 (ffff88008e4c8b00) 00010000:00010000:3.0:1713279306.817617:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1713279306.817618:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda8d68 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.817619:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dae2d00, rc 0) 00000004:00200000:2.0:1713279306.817621:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:1.0:1713279306.817622:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:1.0:1713279306.817624:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.817625:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda8d68 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.817626:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda8d7d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.817628:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114eda8d68 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.817629:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda8d7d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.817632:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda8d7d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.817633:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda8d6f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000100:00100000:3.0:1713279306.817634:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3728:11854:x1796503281231360:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 106us (134us total) trans 4295202680 rc 0/0 00010000:00010000:2.0:1713279306.817635:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda8d7d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.817636:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda8d6f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.817638:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68ad00 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.817638:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785207 00010000:00010000:1.0:1713279306.817639:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda8d6f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.817640:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda8d7d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.817641:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ec000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.817642:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda8d6f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.817643:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda8d7d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.817645:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda8d6f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.817647:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012ee68b00) 00010000:00010000:1.0:1713279306.817648:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880129b60300) 00010000:00010000:2.0:1713279306.817648:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.817649:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.817650:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda8d6f lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.817650:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda8d7d lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.817653:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114eda8d7d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.817655:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114eda8d6f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.817658:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda8d84 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.817661:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda8d84 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.817664:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda8d84 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.817666:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114eda8d53 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a1f expref: 3714 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.817666:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.817668:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda8d84 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.817670:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114eda8d53 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a1f expref: 3714 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.817671:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda8d84 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.817674:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ef600, rc 0) 00010000:00010000:2.0:1713279306.817674:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880123701a00) 00010000:00010000:2.0:1713279306.817675:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.817676:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda8d84 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.817679:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114eda8d84 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.817687:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.817690:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11204:x1796503281231488:12345-192.168.203.4@tcp:101:touch.0 Request processed in 151us (179us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.817692:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689f80/0xfc4b8e114eda8d5a lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a26 expref: 3727 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.817694:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785208 00010000:00010000:2.0:1713279306.817700:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689f80/0xfc4b8e114eda8d5a lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a26 expref: 3727 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.817701:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281231872 00000100:00100000:1.0:1713279306.817703:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281231872 00010000:00010000:2.0:1713279306.817705:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e689f80, rc 0) 00000100:00100000:1.0:1713279306.817712:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785210 00000100:00100000:1.0:1713279306.817714:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3696:11912:x1796503281231872:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.817717:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3726:11711:x1796503281231744:12345-192.168.203.4@tcp:101:touch.0 Request processed in 173us (193us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.817719:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.817721:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785209 00010000:00010000:1.0:1713279306.817723:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936eed00/0xfc4b8e114eda8d8b lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a2d expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.817750:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda8d92 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.817754:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda8d92 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817757:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda8d92 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817765:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda8d99 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.817768:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda8d99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817772:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda8d99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000004:00200000:1.0:1713279306.817778:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:1.0:1713279306.817783:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda8d92 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817786:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda8d92 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817789:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda8d92 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817792:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda8d92 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817795:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ef840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.817796:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda8d92 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817799:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda8d92 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817802:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00010000:00010000:1.0:1713279306.817803:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.817805:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda8d92 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817810:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef840/0xfc4b8e114eda8d92 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817814:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda8d99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817817:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda8d99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817820:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda8d99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817823:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d507cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.817824:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda8d99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817827:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda8d99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817829:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880129b60f00) 00010000:00010000:1.0:1713279306.817831:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.817832:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda8d99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817834:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d507cc0/0xfc4b8e114eda8d99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.817845:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936eed00/0xfc4b8e114eda8d8b lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a2d expref: 3697 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.817849:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936eed00/0xfc4b8e114eda8d8b lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a2d expref: 3697 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.817856:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936eed00, rc 0) 00000100:00100000:1.0:1713279306.817871:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3696:11912:x1796503281231872:12345-192.168.203.4@tcp:101:touch.0 Request processed in 156us (184us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.817875:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785210 00000040:00080000:0.0:1713279306.818231:0:6943:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x1b7:0x0].194, 4264 off115056 00000040:00080000:0.0:1713279306.818276:0:6943:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0xf2:0x0].679, 4344 off484136 00000004:00080000:0.0:1713279306.818279:0:6943:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880096f77780 with version 29433 00000004:00080000:2.0:1713279306.818345:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29433 rpc_version 29433 00000020:00100000:2.0:1713279306.818377:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.818382:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880082549f80 x1796503200041920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 272/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1713279306.818392:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200041920:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1713279306.818428:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.818437:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a06b0540 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.818441:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041920 00000100:00100000:0.0:1713279306.818443:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041920 00000100:00100000:0.0:1713279306.818459:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98802 00000100:00100000:0.0:1713279306.818462:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+127:8634:x1796503200041920:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.818959:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+128:8634:x1796503200041920:12345-0@lo:1000:osp_up1-0.0 Request processed in 494us (545us total) trans 4295183714 rc 0/0 00000100:00100000:0.0:1713279306.818964:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98802 00000100:00100000:2.0:1713279306.819038:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200041920:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713279306.819053:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda8da0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x84a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819058:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda8da0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x84a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819063:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda8da0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x84a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819085:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919a0000/0xfc4b8e114eda8da7 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819088:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919a0000/0xfc4b8e114eda8da7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819092:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919a0000/0xfc4b8e114eda8da7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819103:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880092455d40/0xfc4b8e114eda8dae lrc: 3/0,1 mode: --/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819106:0:6943:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880092455d40/0xfc4b8e114eda8dae lrc: 3/0,1 mode: --/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819110:0:6943:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880092455d40/0xfc4b8e114eda8dae lrc: 3/0,1 mode: --/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6943 initiator: MDT0 00000100:00100000:0.0:1713279306.819116:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041984:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1713279306.819130:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.819143:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ca45d80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.819156:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200041984 00000100:00100000:2.0:1713279306.819160:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200041984 00000100:00100000:2.0:1713279306.819180:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98803 00000100:00100000:2.0:1713279306.819183:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+128:6943:x1796503200041984:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1713279306.819191:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.819199:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8db5 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda8dae expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.819210:0:15494:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8db5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda8dae expref: 129 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.819219:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8db5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8dae expref: 129 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.819223:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x13a:0x0].0x0 (ffff880123701d00) 00010000:00010000:2.0:1713279306.819224:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.819225:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e688fc0, rc 0) 00000100:00100000:2.0:1713279306.819244:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+129:6943:x1796503200041984:12345-0@lo:101:mdt_io00_002.0 Request processed in 61us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.819248:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98803 00000100:00100000:0.0:1713279306.819251:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200041984:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1713279306.819257:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880092455d40/0xfc4b8e114eda8dae lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8db5 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819263:0:6943:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880092455d40/0xfc4b8e114eda8dae lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8db5 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819275:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fca9b00/0xfc4b8e114eda8dbc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819279:0:6943:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fca9b00/0xfc4b8e114eda8dbc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819282:0:6943:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fca9b00/0xfc4b8e114eda8dbc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6943 initiator: MDT0 00000100:00100000:0.0:1713279306.819288:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200042048:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1713279306.819298:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.819304:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ca45d80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.819307:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200042048 00000100:00100000:2.0:1713279306.819310:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200042048 00000100:00100000:2.0:1713279306.819322:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98804 00000100:00100000:2.0:1713279306.819324:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+129:6943:x1796503200042048:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1713279306.819328:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.819334:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114eda8dc3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda8dbc expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.819341:0:15494:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114eda8dc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda8dbc expref: 130 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.819346:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114eda8dc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8dbc expref: 130 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.819350:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880123701600) 00010000:00010000:2.0:1713279306.819351:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.819352:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68a640, rc 0) 00000100:00100000:2.0:1713279306.819366:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+130:6943:x1796503200042048:12345-0@lo:101:mdt_io00_002.0 Request processed in 41us (67us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.819370:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98804 00000100:00100000:0.0:1713279306.819404:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6943:1796503200042048:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1713279306.819406:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.819411:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fca9b00/0xfc4b8e114eda8dbc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8dc3 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.819426:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281231936 00000100:00100000:2.0:1713279306.819428:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281231936 00010000:00010000:0.0:1713279306.819429:0:6943:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fca9b00/0xfc4b8e114eda8dbc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8dc3 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713279306.819437:0:6943:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880122c02d80 reply state ffff88012fc08000 transno 4295202681 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919a0000/0xfc4b8e114eda8da7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00000100:00100000:2.0:1713279306.819439:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785211 00000100:00100000:2.0:1713279306.819441:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11940:x1796503281231936:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:0.0:1713279306.819443:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919a0000/0xfc4b8e114eda8da7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819446:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x0 (ffff880096e84a00) 00010000:00010000:2.0:1713279306.819446:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.819448:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.819450:0:6943:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.819451:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114eda8dca lrc: 2/0,0 mode: --/CR res: [0x200000400:0x234:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a34 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819452:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880092455d40/0xfc4b8e114eda8dae lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8db5 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819456:0:6943:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880092455d40/0xfc4b8e114eda8dae lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8db5 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819459:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fca9b00/0xfc4b8e114eda8dbc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8dc3 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819463:0:6943:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fca9b00/0xfc4b8e114eda8dbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8dc3 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.819467:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x13a:0x0] 00000004:00080000:0.0:1713279306.819468:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x233:0x0] 00000004:00010000:0.0:1713279306.819472:0:6943:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880122c02d80 reply state ffff88012fc08000 transno 4295202681 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda8da0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x84a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819476:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda8da0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x84a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819479:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x84a3:0x0].0x0 (ffff880096e84e00) 00010000:00010000:0.0:1713279306.819480:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.819481:0:6943:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1713279306.819484:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x721d:0x0] 00010000:00010000:0.0:1713279306.819489:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8a2e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.819491:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda8dd1 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x234:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.819493:0:6943:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8a2e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.819496:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda8dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x234:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000004:00080000:0.0:1713279306.819497:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:0.0:1713279306.819500:0:6943:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008c366880/0xfc4b8e114eda89f6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8a04 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.819500:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda8dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x234:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.819503:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008c366880/0xfc4b8e114eda89f6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda8a04 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819507:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008c366880/0xfc4b8e114eda89f6 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda8a04 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819514:0:6943:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1713279306.819515:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00000004:00200000:2.0:1713279306.819515:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x234:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.819517:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda8a20 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713279306.819517:0:15473:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 4 MDT count 2 00010000:00010000:3.0:1713279306.819520:0:6918:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713279306.819521:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda8a20 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819526:0:6943:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1713279306.819526:0:6918:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008c366880/0xfc4b8e114eda89f6 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114eda8a04 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.819527:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114eda8dca lrc: 0/0,0 mode: --/CR res: [0x200000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a34 expref: 3715 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.819532:0:6918:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c366880 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:2.0:1713279306.819533:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688240/0xfc4b8e114eda8dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x234:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a34 expref: 3714 pid: 15473 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.819535:0:6943:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:3.0:1713279306.819535:0:6918:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008c366880/0xfc4b8e114eda89f6 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda8a04 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.819537:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x234:0x0].0x0 (ffff880123701500) 00010000:00010000:0.0:1713279306.819538:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.819538:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713279306.819540:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e688240, rc 0) 00000004:00010000:3.0:1713279306.819540:0:6918:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008c366880/0xfc4b8e114eda89f6 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda8a04 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819541:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819544:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819547:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.819548:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.819551:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.819554:0:6918:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008c366880/0xfc4b8e114eda89f6 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda8a04 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819556:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:0.0:1713279306.819557:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.819558:0:6918:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713279306.819559:0:6943:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00000100:00100000:2.0:1713279306.819562:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:11940:x1796503281231936:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 120us (156us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.819563:0:6943:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.819566:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15534 initiator: MDT0 00000100:00100000:2.0:1713279306.819566:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785211 00010000:00010000:3.0:1713279306.819566:0:6918:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008c366880/0xfc4b8e114eda89f6 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda8a04 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819570:0:6943:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda83eb lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda83cf expref: 55 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.819570:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008c366880/0xfc4b8e114eda89f6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda8a04 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.819574:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1713279306.819578:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.819579:0:6918:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1713279306.819581:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200042112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.819582:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980fc0/0xfc4b8e114eda830b lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.819582:0:6918:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda8a20 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.819586:0:6918:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012154fa80 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.819590:0:6918:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda8a20 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.819596:0:6918:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda8a20 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.819597:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.819598:0:15534:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.819601:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00010000:00010000:3.0:1713279306.819607:0:6918:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda8a20 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.819612:0:6918:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.819622:0:6918:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda8a20 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.819626:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200042176:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.819627:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154fa80/0xfc4b8e114eda8a19 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda8a20 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.819635:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.819637:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.819638:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279306.819641:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.819643:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279306.819655:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200042112 00010000:00010000:0.0:1713279306.819656:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda8dd8 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00000100:00100000:2.0:1713279306.819657:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200042112 00010000:00010000:0.0:1713279306.819660:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda8dd8 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.819664:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda8dd8 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00000100:00100000:2.0:1713279306.819665:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200042176 00000100:00100000:2.0:1713279306.819666:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200042176 00010000:00010000:2.0:1713279306.819671:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90d80/0xfc4b8e114eda8a20 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfc4b8e114eda8a19 expref: 131 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.819677:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147251 00000100:00100000:1.0:1713279306.819681:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1478850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+131:3492:x1796503200042112:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.819683:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196535 00000100:00100000:2.0:1713279306.819685:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+131:3490:x1796503200042176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.819689:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.819690:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.819699:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114eda8a04 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda89f6 expref: 131 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.819708:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:1.0:1713279306.819710:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.819732:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1478850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+130:3492:x1796503200042112:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.819738:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147251 00010000:00010000:0.0:1713279306.819748:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda8ddf lrc: 3/0,1 mode: --/PW res: [0x200000400:0x235:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.819753:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda8ddf lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.819757:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda8ddf lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00000100:00100000:2.0:1713279306.819762:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.819772:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.819775:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200042112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.819778:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114ed9e3cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b8e expref: 3727 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.819779:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.819783:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114ed9e4dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172c05 expref: 3713 pid: 15657 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819787:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda370e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391743ac expref: 3713 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.819788:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281232000 00000100:00100000:1.0:1713279306.819790:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281232000 00010000:00010000:0.0:1713279306.819791:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda81de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7efd:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175708 expref: 3727 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819794:0:15534:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 7/0,1 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.819805:0:15534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda81de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7efd:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175708 expref: 3727 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.819806:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147252 00000100:00100000:1.0:1713279306.819810:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:1956:x1796503281232000:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:0.0:1713279306.819811:0:15534:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda81de lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7efd:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175708 expref: 3727 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.819816:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:0.0:1713279306.819817:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200042240:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.819825:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689b00/0xfc4b8e114eda28eb lrc: 0/0,0 mode: --/PR res: [0x200000400:0x20a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173f76 expref: 3714 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.819833:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114ed9ad3e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39171ca0 expref: 3713 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819837:0:15534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda370e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391743ac expref: 3712 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.819838:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x20a:0x0].0x0 (ffff880123701e00) 00010000:00010000:1.0:1713279306.819842:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.819843:0:15534:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda370e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391743ac expref: 3712 pid: 15474 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.819847:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200042304:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.819854:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281232000:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 44us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.819857:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147252 00010000:00010000:0.0:1713279306.819858:0:15534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114ed9e4dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172c05 expref: 3712 pid: 15657 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819863:0:15534:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114ed9e4dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172c05 expref: 3711 pid: 15657 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.819867:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200042368:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.819876:0:15534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114ed9e3cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b8e expref: 3727 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819881:0:15534:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114ed9e3cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b8e expref: 3727 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.819885:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be59180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200042432:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.819892:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237273c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.819906:0:15502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281232128 00000100:00100000:0.0:1713279306.819908:0:15502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281232128 00000100:00100000:0.0:1713279306.819923:0:15502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14343 00000100:00100000:0.0:1713279306.819926:0:15502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3436:9807:x1796503281232128:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:0.0:1713279306.819939:0:15502:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1713279306.819947:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122207180/0xfc4b8e114ed631f2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39160c1e expref: 3436 pid: 6930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.819998:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74de:0x0].0x0 (ffff880096da6e00) 00010000:00010000:0.0:1713279306.820008:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda2564 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x234:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173eab expref: 3435 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.820015:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114ed9a74f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39171af5 expref: 3434 pid: 6930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.820020:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x234:0x0].0x0 (ffff880089dc2900) 00000100:00100000:1.0:1713279306.820022:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.820026:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114eda1ffa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7234:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173d46 expref: 3433 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.820031:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7234:0x0].0x0 (ffff88008d7fc000) 00010000:00010000:0.0:1713279306.820033:0:15502:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.820044:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 15502 initiator: MDT0 00010000:00010000:0.0:1713279306.820048:0:15502:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279306.820049:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281232384 00000100:00100000:2.0:1713279306.820051:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281232384 00010000:00010000:0.0:1713279306.820052:0:15502:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x1000000000000 pid: 15502 initiator: MDT1 00000100:00100000:0.0:1713279306.820058:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be5aa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200042496:0@lo:101:mdt_io00_004.0 00000100:00100000:2.0:1713279306.820064:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785212 00000100:00100000:2.0:1713279306.820076:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3696:11711:x1796503281232384:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.820082:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.820082:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.820088:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda8df4 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a42 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.820109:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda8dfb lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.820113:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda8dfb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.820118:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda8dfb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.820123:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda8e02 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.820126:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda8e02 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.820130:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda8e02 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.820136:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.820138:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281232256 00000100:00100000:1.0:1713279306.820142:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281232256 00010000:00010000:2.0:1713279306.820142:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda8dfb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.820144:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123727180 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.820145:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda8dfb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.820149:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda8dfb lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.820152:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda8dfb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.820154:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.820156:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda8dfb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.820158:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda8dfb lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.820159:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785213 00010000:00010000:2.0:1713279306.820162:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880092193800) 00000100:00100000:0.0:1713279306.820163:0:6943:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:385c4b71-808c-40cf-91de-b076b668d13f+3727:11876:x1796503281210752:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 46630us (46839us total) trans 4295202681 rc 0/0 00000100:00100000:1.0:1713279306.820163:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3433:11204:x1796503281232256:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.820164:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.820166:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda8dfb lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.820167:0:6943:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14338 00010000:00010000:2.0:1713279306.820169:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689200/0xfc4b8e114eda8dfb lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.820171:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.820174:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda8e02 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.820177:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda8e02 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.820178:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114eda8e09 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a3b expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.820180:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda8e02 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.820182:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68bcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.820183:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda8e02 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.820186:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda8e02 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.820189:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88008dba4500) 00010000:00010000:2.0:1713279306.820190:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.820191:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda8e02 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.820194:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68bcc0/0xfc4b8e114eda8e02 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.820205:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda8df4 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a42 expref: 3697 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.820209:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b840/0xfc4b8e114eda8df4 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a42 expref: 3697 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.820214:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68b840, rc 0) 00010000:00010000:1.0:1713279306.820221:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda8e10 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.820226:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda8e10 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.820230:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3696:11711:x1796503281232384:12345-192.168.203.4@tcp:101:touch.0 Request processed in 163us (210us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.820231:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda8e10 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.820234:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785212 00010000:00010000:1.0:1713279306.820238:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda8e17 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.820241:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda8e17 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820244:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda8e17 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.820245:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200042496 00000100:00100000:2.0:1713279306.820247:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200042496 00000004:00200000:1.0:1713279306.820254:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00000100:00100000:2.0:1713279306.820255:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98805 00000100:00100000:2.0:1713279306.820257:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15502:x1796503200042496:12345-0@lo:101:mdt_io00_004.0 00010000:00010000:1.0:1713279306.820258:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda8e10 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820261:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda8e10 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.820261:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.820264:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda8e10 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.820266:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda8e1e lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda8ded expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.820267:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda8e10 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820270:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800929098c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.820271:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda8e10 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820274:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda8e10 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.820274:0:15494:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda89ef lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda89e8 expref: 57 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.820278:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:2.0:1713279306.820278:0:15494:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda8e1e lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda8ded expref: 57 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.820279:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.820280:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda8e10 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820285:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114eda8e10 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820290:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda8e17 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.820292:0:15494:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda89ef lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda89e8 expref: 57 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.820293:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda8e17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820296:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda8e17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.820297:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda8e1e lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8ded expref: 57 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.820299:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009681c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.820300:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda8e17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.820300:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:2.0:1713279306.820302:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.820303:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda8e17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.820303:0:15494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda83eb lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda83cf expref: 57 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.820306:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880096e84f00) 00010000:00010000:1.0:1713279306.820307:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.820307:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e689d40, rc 0) 00010000:00010000:1.0:1713279306.820308:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda8e17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820310:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114eda8e17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820323:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114eda8e09 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a3b expref: 3434 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.820323:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15502:x1796503200042496:12345-0@lo:101:mdt_io00_004.0 Request processed in 65us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.820326:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98805 00010000:00010000:1.0:1713279306.820327:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114eda8e09 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a3b expref: 3434 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.820331:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be5aa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200042496:0@lo:101:mdt_io00_004.0 00010000:00010000:1.0:1713279306.820334:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092920240, rc 0) 00010000:00010000:0.0:1713279306.820337:0:15502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.820342:0:15502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.820350:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3433:11204:x1796503281232256:12345-192.168.203.4@tcp:101:touch.0 Request processed in 187us (282us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.820354:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785213 00000100:00100000:0.0:1713279306.820692:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.820731:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281232512 00000100:00100000:1.0:1713279306.820734:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281232512 00000100:00100000:1.0:1713279306.820751:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785214 00000100:00100000:1.0:1713279306.820754:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3696:11912:x1796503281232512:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.820759:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.820765:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130c92640/0xfc4b8e114eda8e25 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a49 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.820784:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8e2c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.820789:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8e2c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820793:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8e2c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820798:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda8e33 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.820801:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda8e33 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820804:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda8e33 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820816:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8e2c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820820:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8e2c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820823:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8e2c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820825:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8e2c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820828:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880130c93cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.820829:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8e2c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820832:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8e2c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820836:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88007fc53100) 00010000:00010000:1.0:1713279306.820837:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.820838:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8e2c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820841:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93cc0/0xfc4b8e114eda8e2c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820845:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda8e33 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820848:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda8e33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820851:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda8e33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820854:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800902ab840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.820855:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda8e33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820858:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda8e33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820861:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff880135caaa00) 00010000:00010000:1.0:1713279306.820862:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.820863:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda8e33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820866:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114eda8e33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.820875:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880130c92640/0xfc4b8e114eda8e25 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a49 expref: 3697 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.820879:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130c92640/0xfc4b8e114eda8e25 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a49 expref: 3697 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.820883:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c92640, rc 0) 00000100:00100000:1.0:1713279306.820898:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3696:11912:x1796503281232512:12345-192.168.203.4@tcp:101:touch.0 Request processed in 144us (207us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.820902:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785214 00010000:00010000:3.0:1713279306.821095:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008e68ba80/0xfc4b8e114eda7c19 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda7c20 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.821103:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008e68ba80/0xfc4b8e114eda7c19 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda7c20 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.821116:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008e68ba80/0xfc4b8e114eda7c19 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7c20 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.821119:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.821135:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008e68ba80/0xfc4b8e114eda7c19 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7c20 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.821136:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200042624:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1713279306.821147:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942eac0/0xfc4b8e114eda7646 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda765b expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.821151:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1713279306.821151:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942eac0/0xfc4b8e114eda7646 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda765b expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.821157:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942eac0/0xfc4b8e114eda7646 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda765b expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.821160:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.821166:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008942eac0/0xfc4b8e114eda7646 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda765b expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.821171:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1713279306.821172:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6400/0xfc4b8e114eda706c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda7073 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.821175:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6400/0xfc4b8e114eda706c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda7073 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.821179:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200042624 00000100:00100000:2.0:1713279306.821180:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200042688:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1713279306.821182:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200042624 00010000:00010000:3.0:1713279306.821182:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6400/0xfc4b8e114eda706c lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7073 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.821185:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.821188:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd6400/0xfc4b8e114eda706c lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda7073 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.821193:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda6f77 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.821194:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147253 00000100:00100000:1.0:1713279306.821197:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+57:3491:x1796503200042624:12345-0@lo:103:jbd2/dm-1-8.0 00000004:00010000:3.0:1713279306.821197:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda6f77 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.821199:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.821203:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.821203:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6f77 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.821206:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713279306.821209:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114eda7c20 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3731 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda7c19 expref: 57 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.821211:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200042752:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1713279306.821211:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880131f3c480/0xfc4b8e114eda6f70 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda6f77 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.821216:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x3731 (ffff88008e766000) 00000001:00080000:3.0:1713279306.821217:0:8061:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4295183714 is committed 00000100:00100000:0.0:1713279306.821219:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1713279306.821219:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.821219:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.821224:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200042816:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1713279306.821230:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200042688 00000100:00100000:2.0:1713279306.821232:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200042688 00000001:00080000:3.0:1713279306.821233:0:8061:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4295183713 is committed 00000100:00100000:1.0:1713279306.821234:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+56:3491:x1796503200042624:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 37us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.821238:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147253 00000100:00100000:0.0:1713279306.821239:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1713279306.821239:0:8061:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4295183712 is committed 00000100:00100000:1.0:1713279306.821245:0:15711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200042752 00000100:00100000:1.0:1713279306.821246:0:15711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200042752 00000100:00100000:2.0:1713279306.821247:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200042816 00000100:00100000:2.0:1713279306.821248:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200042816 00000100:00100000:0.0:1713279306.821251:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200042624:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1713279306.821256:0:15711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147254 00000100:00100000:1.0:1713279306.821258:0:15711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+58:3493:x1796503200042688:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1713279306.821259:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147255 00010000:00010000:1.0:1713279306.821261:0:15711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.821262:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+58:3493:x1796503200042752:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1713279306.821263:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147256 00010000:00010000:1.0:1713279306.821266:0:15711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda765b lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3331 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda7646 expref: 58 pid: 6934 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.821267:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+58:3491:x1796503200042816:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1713279306.821267:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.821271:0:15711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x3331 (ffff880096b8e200) 00010000:00010000:0.0:1713279306.821272:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.821273:0:15711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.821275:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009435eac0/0xfc4b8e114eda7073 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3431 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda706c expref: 57 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.821280:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9d40/0xfc4b8e114eda6f77 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x221:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda6f70 expref: 57 pid: 15494 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1713279306.821281:0:8061:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 17677 batchid updated 00010000:00010000:2.0:1713279306.821283:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x3431 (ffff880092a4ca00) 00000100:00100000:1.0:1713279306.821284:0:15711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+55:3493:x1796503200042688:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 25us (85us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.821286:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x221:0x0].0x0 (ffff88008ea88000) 00010000:00010000:2.0:1713279306.821287:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.821288:0:15711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147254 00000020:00080000:3.0:1713279306.821289:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8800936db6c0 refcount 2 committed 0 result 0 batchid 17683 00010000:00010000:0.0:1713279306.821290:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:3.0:1713279306.821291:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012bac7400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008f549c00 00000020:00080000:3.0:1713279306.821293:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2151 00000020:00080000:3.0:1713279306.821294:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007f009300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880096891600 00000020:00080000:3.0:1713279306.821296:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1544 00010000:00010000:1.0:1713279306.821298:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114eda6e43 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7ac4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.821300:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+54:3493:x1796503200042752:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 37us (80us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.821302:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114eda6e43 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7ac4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.821303:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+54:3491:x1796503200042816:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 36us (64us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.821304:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147255 00000020:00080000:3.0:1713279306.821305:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88009e75f0c0 refcount 2 committed 0 result 0 batchid 17682 00010000:00010000:1.0:1713279306.821306:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114eda6e43 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7ac4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000020:00080000:3.0:1713279306.821306:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880090a56700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8801360c7780 00000100:00100000:0.0:1713279306.821307:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147256 00000020:00080000:3.0:1713279306.821308:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2150 00010000:00010000:1.0:1713279306.821309:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800963b9680 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:3.0:1713279306.821309:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880090a56800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800922c6400 00010000:00010000:1.0:1713279306.821310:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114eda6e43 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7ac4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000020:00080000:3.0:1713279306.821311:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1543 00010000:00010000:1.0:1713279306.821314:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114eda6e43 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7ac4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.821317:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ac4:0x0].0x0 (ffff880090a56400) 00010000:00010000:1.0:1713279306.821318:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821318:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114eda7081 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713279306.821320:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200042816:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1713279306.821320:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114eda6e43 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7ac4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.821322:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114eda6e43 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7ac4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821325:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114eda7081 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.821328:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821328:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114eda7081 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.821331:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8d440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821332:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821333:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114eda7081 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00000020:00080000:3.0:1713279306.821334:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880129a98000 refcount 2 committed 0 result 0 batchid 17681 00010000:00010000:1.0:1713279306.821335:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821336:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114eda7081 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00000020:00080000:3.0:1713279306.821336:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880090a56e00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880092078e40 00010000:00010000:1.0:1713279306.821337:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a4ca400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821338:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000020:00080000:3.0:1713279306.821338:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880090a56100 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008ca459c0 00010000:00010000:2.0:1713279306.821340:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x3431 (ffff880089dc2200) 00000020:00080000:3.0:1713279306.821340:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880090a56200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880094f8ef00 00010000:00010000:1.0:1713279306.821341:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00000020:00080000:3.0:1713279306.821341:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2149 00010000:00010000:2.0:1713279306.821342:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821343:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114eda7081 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000020:00080000:3.0:1713279306.821343:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880090a56c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800977c7600 00010000:00010000:1.0:1713279306.821344:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25a:0x0].0x0 (ffff880095863200) 00000020:00080000:3.0:1713279306.821344:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1541 00010000:00010000:1.0:1713279306.821346:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821346:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114eda7081 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x134:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.821347:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.821350:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda6e4a lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x25a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821352:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.821355:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.821358:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.821359:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114eda7520 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.821361:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821362:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114eda7520 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.821362:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00000020:00080000:3.0:1713279306.821362:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880129a98480 refcount 2 committed 0 result 0 batchid 17680 00000020:00080000:3.0:1713279306.821363:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009588c100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880129a98180 00010000:00010000:1.0:1713279306.821364:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114eda7520 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000020:00080000:3.0:1713279306.821364:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2148 00010000:00010000:2.0:1713279306.821366:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00000020:00080000:3.0:1713279306.821366:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009588c500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800940a2600 00010000:00010000:1.0:1713279306.821367:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e6898c0 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:3.0:1713279306.821367:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1540 00010000:00010000:1.0:1713279306.821369:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114eda7520 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.821370:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x763e:0x0].0x0 (ffff88012fbfeb00) 00010000:00010000:1.0:1713279306.821371:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114eda7520 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x20b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.821371:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.821372:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.821375:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3531 (ffff88012ee68400) 00010000:00010000:2.0:1713279306.821375:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114eda7088 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x763e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.821376:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.821377:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114eda7520 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x20b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.821379:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114eda7520 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x20b:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.821381:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda7669 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.821384:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda7669 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.821386:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda7669 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00000020:00080000:3.0:1713279306.821387:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88008ca45a80 refcount 2 committed 0 result 0 batchid 17679 00000020:00080000:3.0:1713279306.821388:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880089dfb600 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880130ade300 00010000:00010000:2.0:1713279306.821389:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f298c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821390:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda7631 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.821390:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda7669 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00000020:00080000:3.0:1713279306.821390:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009e5e1d00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8800968dde40 00000020:00080000:3.0:1713279306.821391:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007f23d400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8800925450c0 00000020:00080000:3.0:1713279306.821392:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2147 00010000:00010000:2.0:1713279306.821393:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda7669 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT1 00000020:00080000:3.0:1713279306.821393:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880092a4c100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880091d45600 00010000:00010000:1.0:1713279306.821395:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda7631 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x76e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00000020:00080000:3.0:1713279306.821395:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1539 00010000:00010000:2.0:1713279306.821397:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x3331 (ffff88008f645100) 00010000:00010000:2.0:1713279306.821398:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821399:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda7669 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821401:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda7631 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.821402:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114eda7669 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x134:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00000020:00080000:3.0:1713279306.821403:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880092078540 refcount 2 committed 0 result 0 batchid 17678 00010000:00010000:1.0:1713279306.821405:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a064480 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:3.0:1713279306.821405:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880130675d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8800958e3c00 00000020:00080000:3.0:1713279306.821406:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2146 00010000:00010000:1.0:1713279306.821407:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda7631 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000020:00080000:3.0:1713279306.821407:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880130675900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880094347e00 00010000:00010000:2.0:1713279306.821408:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00000020:00080000:3.0:1713279306.821408:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1538 00010000:00010000:2.0:1713279306.821428:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821430:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda7631 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x76e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.821431:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00000020:00080000:3.0:1713279306.821433:0:8061:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 17676 batchid updated 00010000:00010000:2.0:1713279306.821434:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f2b600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821435:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821437:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76e5:0x0].0x0 (ffff880096051f00) 00010000:00010000:2.0:1713279306.821438:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821439:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.821441:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda7631 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x76e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.821442:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x750e:0x0].0x0 (ffff88007fe82800) 00010000:00010000:2.0:1713279306.821443:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.821444:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00000020:00080000:3.0:1713279306.821445:0:8082:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 17683 committed batchid 17677 00010000:00010000:1.0:1713279306.821446:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda7631 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x76e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.821447:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114eda7670 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x750e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.821454:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda78a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.821457:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda78a0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821458:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda79d4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.821460:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda78a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00000100:00100000:0.0:1713279306.821461:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200042752:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1713279306.821463:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda79d4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.821465:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200042688:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1713279306.821465:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d322640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821466:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda78a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821468:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda79d4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.821469:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda78a0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821472:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ed200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821472:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x262:0x0].0x3531 (ffff8800938ab300) 00010000:00010000:2.0:1713279306.821473:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821474:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda78a0 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x262:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821475:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda79d4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.821477:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda78a0 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x262:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821479:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda79d4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.821483:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936efcc0/0xfc4b8e114eda799c lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00000100:00100000:0.0:1713279306.821485:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.821486:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6ed2:0x0].0x0 (ffff8800939e3a00) 00010000:00010000:2.0:1713279306.821486:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936efcc0/0xfc4b8e114eda799c lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821488:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821488:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936efcc0/0xfc4b8e114eda799c lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821490:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda79d4 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.821491:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936efcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821492:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936efcc0/0xfc4b8e114eda799c lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.821493:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90d80/0xfc4b8e114eda8a20 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfc4b8e114eda8a19 expref: 90 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.821494:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed200/0xfc4b8e114eda79d4 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.821495:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.821495:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936efcc0/0xfc4b8e114eda799c lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.821499:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25c:0x0].0x3531 (ffff8800960e8100) 00010000:00010000:2.0:1713279306.821500:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821502:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936efcc0/0xfc4b8e114eda799c lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00000100:00100000:0.0:1713279306.821503:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.821503:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x31 (ffff88008e59ca00) 00010000:00010000:1.0:1713279306.821504:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda7dc4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821504:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936efcc0/0xfc4b8e114eda799c lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x25c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.821506:0:9215:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.821508:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda7dc4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821510:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.821510:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.821513:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda7dc4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821513:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.821513:0:9215:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.821516:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821517:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.821519:0:15534:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880090965c00 x1796503200042240) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda81de lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7efd:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175708 expref: 3726 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.821519:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda7dc4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821519:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936edf80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821520:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821522:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda7dc4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.821522:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.821523:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.821525:0:15534:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda81de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7efd:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175708 expref: 3726 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.821526:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7892:0x0].0x0 (ffff88008d7fcd00) 00010000:00010000:1.0:1713279306.821527:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7831:0x0].0x0 (ffff88008bde0600) 00010000:00010000:2.0:1713279306.821527:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1713279306.821528:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821528:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821529:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda7dc4 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821531:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936edf80/0xfc4b8e114eda79a3 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7892:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.821532:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd133c0/0xfc4b8e114eda81de lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7efd:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175708 expref: 3726 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.821532:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda7dc4 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821536:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7c2e lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713279306.821538:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200042240:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.821538:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7c2e lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.821539:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.821540:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+89:3490:x1796503200042176:12345-0@lo:103:ldlm_bl.0 Request processed in 1853us (1897us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.821542:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821542:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7c2e lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.821544:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e6886c0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.821544:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196535 00010000:00010000:1.0:1713279306.821545:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821546:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7c2e lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.821547:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821548:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821548:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7c2e lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.821551:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821552:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x3731 (ffff8800934f8c00) 00010000:00010000:2.0:1713279306.821553:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821554:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7c2e lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.821555:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00010000:00010000:1.0:1713279306.821556:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.821557:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821557:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114eda7c2e lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x134:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.821560:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114eda7cb3 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821562:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713279306.821562:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200042176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.821565:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821565:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.821568:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821568:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713279306.821570:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.821570:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821571:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821571:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.821571:0:15479:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.821573:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd5200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821574:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821574:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.821575:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.821578:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7644:0x0].0x0 (ffff88008e766f00) 00010000:00010000:2.0:1713279306.821579:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1713279306.821580:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821581:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.821583:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76da:0x0].0x0 (ffff88012514d600) 00010000:00010000:2.0:1713279306.821583:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114eda7c35 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x7644:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.821584:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:1.0:1713279306.821586:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821588:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda8319 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821589:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5200/0xfc4b8e114eda7d46 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x76da:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821591:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda8319 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821594:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114eda7e03 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821594:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda8319 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.821596:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821597:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114eda7e03 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821598:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda8319 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00000100:00100000:0.0:1713279306.821599:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200042304:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.821599:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114eda7e03 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821601:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda8319 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821602:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821603:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114eda7e03 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821604:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x3131 (ffff880091714100) 00010000:00010000:2.0:1713279306.821605:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.821606:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114eda7e03 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821607:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda8319 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821609:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25c:0x0].0x0 (ffff880096d67b00) 00010000:00010000:1.0:1713279306.821610:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:2.0:1713279306.821610:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda8319 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821611:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114eda7e03 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.821613:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.821614:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114eda7e03 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x25c:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821615:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ad00/0xfc4b8e114eda835f lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00000100:00100000:3.0:1713279306.821615:0:15479:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-mdtlov_UUID:15479:1796503200042880:0@lo:1000:mdt00_015.0 00010000:00010000:2.0:1713279306.821618:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ad00/0xfc4b8e114eda835f lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821620:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114eda7dfc lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821621:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ad00/0xfc4b8e114eda835f lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821623:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114eda7dfc lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821623:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c53ad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821624:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ad00/0xfc4b8e114eda835f lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00000100:00100000:0.0:1713279306.821626:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200042368:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.821626:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114eda7dfc lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821627:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ad00/0xfc4b8e114eda835f lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821628:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd61c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821630:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114eda7dfc lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821630:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x3131 (ffff880089dc2800) 00010000:00010000:1.0:1713279306.821632:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114eda7dfc lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821632:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.821632:0:15479:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.821633:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ad00/0xfc4b8e114eda835f lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.821635:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ad00/0xfc4b8e114eda835f lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821636:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x262:0x0].0x0 (ffff8800937ce400) 00000100:00100000:0.0:1713279306.821637:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.821637:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:1.0:1713279306.821638:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114eda7dfc lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.821639:0:15479:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f48f600 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.821641:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114eda7dfc lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x262:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821642:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00000100:00100000:0.0:1713279306.821643:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281232640 00000100:00100000:0.0:1713279306.821645:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281232640 00010000:00010000:2.0:1713279306.821645:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.821647:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821649:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda8167 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.821650:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c538900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821651:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda8167 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.821651:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821654:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda8167 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.821654:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.821658:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e09:0x0].0x0 (ffff880135885c00) 00010000:00010000:1.0:1713279306.821659:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f192ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821659:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.821660:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821661:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda8167 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.821663:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda8366 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x6e09:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821664:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda8167 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.821667:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x37 (ffff880090a56f00) 00010000:00010000:1.0:1713279306.821668:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821668:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114eda8542 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821669:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda8167 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x233:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.821671:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114eda8542 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821672:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda8167 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x233:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713279306.821673:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281232704 00010000:00010000:2.0:1713279306.821674:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114eda8542 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00000100:00100000:3.0:1713279306.821675:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281232704 00010000:00010000:2.0:1713279306.821676:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821677:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114eda8542 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821679:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda8216 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821680:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114eda8542 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821681:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda8216 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x76f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.821684:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda8216 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821684:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76ef:0x0].0x0 (ffff880130675200) 00010000:00010000:2.0:1713279306.821685:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.821685:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114ed9e4dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172c05 expref: 3713 pid: 15657 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.821686:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe14480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821686:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114eda8542 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821688:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda8216 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821689:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114eda8542 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821690:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda8216 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x76f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.821694:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76f3:0x0].0x0 (ffff8800909b0e00) 00010000:00010000:0.0:1713279306.821695:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda370e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391743ac expref: 3713 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.821695:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda8550 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821696:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.821696:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196536 00010000:00010000:1.0:1713279306.821697:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda8216 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x76f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821698:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda8550 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00000100:00100000:3.0:1713279306.821699:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:1957:x1796503281232704:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.821700:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda8216 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x76f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821701:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda8550 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:2.0:1713279306.821703:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821704:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda8550 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.821704:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.821705:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda84d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x708d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713279306.821707:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196537 00010000:00010000:2.0:1713279306.821707:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda8550 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00010000:00010000:3.0:1713279306.821707:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114ed9e4dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172c05 expref: 3713 pid: 15657 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.821708:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda84d9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x708d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713279306.821710:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:1957:x1796503281232640:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.821710:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda84d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x708d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.821711:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x242:0x0].0x0 (ffff880130675b00) 00010000:00010000:2.0:1713279306.821712:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.821712:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114ed9e4dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172c05 expref: 3713 pid: 15657 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.821713:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a0d8480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821713:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda8550 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821714:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda84d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x708d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.821716:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda8550 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821717:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda84d9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x708d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.821719:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114ed9e4dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172c05 expref: 3713 pid: 15657 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.821720:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda8549 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821721:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x708d:0x0].0x0 (ffff88008c1d2f00) 00010000:00010000:1.0:1713279306.821722:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.821723:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda84d9 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x708d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.821723:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda8549 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.821724:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.821725:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7efd:0x0].0x0 (ffff880122df6700) 00010000:00010000:1.0:1713279306.821726:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda84d9 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x708d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.821726:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda8549 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:0.0:1713279306.821727:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda370e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391743ac expref: 3712 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.821727:0:9215:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.821728:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821730:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda8549 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821731:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda8795 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.821731:0:9215:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.821733:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda8549 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821734:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda8795 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.821734:0:9215:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.821737:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda8795 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.821737:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x264:0x0].0x0 (ffff880130675400) 00010000:00010000:3.0:1713279306.821737:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.821738:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821739:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda8549 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821740:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092343840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821742:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda8795 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.821742:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda8549 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15507 initiator: MDT1 00010000:00010000:1.0:1713279306.821744:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda8795 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.821747:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda86ae lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821748:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x39 (ffff8800960e8d00) 00000100:00100000:3.0:1713279306.821748:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281232704:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 48us (111us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.821749:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.821750:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda8795 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x233:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.821750:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda86ae lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821752:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda8795 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x233:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.821752:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda86ae lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00000100:00100000:3.0:1713279306.821752:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196536 00010000:00010000:2.0:1713279306.821755:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bdb00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821756:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda86ae lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821759:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda8860 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76fb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821759:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda86ae lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821761:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda8860 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x76fb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821762:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x65656ce3 (ffff8800960e8800) 00010000:00010000:2.0:1713279306.821763:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.821764:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda8860 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76fb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821765:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda86ae lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821766:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800923421c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821768:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda8860 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76fb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.821770:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda8860 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x76fb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821770:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda86ae lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279306.821772:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda370e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391743ac expref: 3712 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.821774:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76fb:0x0].0x0 (ffff8800937ce800) 00010000:00010000:1.0:1713279306.821775:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821776:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda8756 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821777:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda8860 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x76fb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.821779:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda8756 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821780:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda8860 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x76fb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.821781:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda370e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391743ac expref: 3711 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.821781:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda8756 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821784:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda812f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821784:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821785:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda8756 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821787:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda812f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00000100:00100000:3.0:1713279306.821787:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281232960 00010000:00010000:0.0:1713279306.821788:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7efd:0x0].0x0 (ffff880122df6700) 00010000:00010000:2.0:1713279306.821788:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda8756 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT1 00000100:00100000:3.0:1713279306.821789:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281232960 00010000:00010000:0.0:1713279306.821790:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.821790:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda812f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821791:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x65656ce3 (ffff8800960e8a00) 00010000:00010000:1.0:1713279306.821792:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821792:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821793:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda8756 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279306.821794:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.821794:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda812f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.821796:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.821796:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda8756 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x65656ce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821797:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda812f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00000100:00100000:3.0:1713279306.821798:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281232576 00010000:00010000:0.0:1713279306.821799:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.821799:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281232576 00010000:00010000:1.0:1713279306.821800:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3731 (ffff880090a56a00) 00010000:00010000:1.0:1713279306.821801:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.821802:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda812f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821802:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821805:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda812f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821805:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00000100:00100000:3.0:1713279306.821806:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281233088 00000100:00100000:3.0:1713279306.821807:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281233088 00010000:00010000:1.0:1713279306.821810:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821810:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00000100:00100000:0.0:1713279306.821811:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3710:1957:x1796503281232640:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 100us (196us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.821812:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd5f80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.821812:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281233216 00010000:00010000:1.0:1713279306.821813:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00000100:00100000:3.0:1713279306.821813:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281233216 00010000:00010000:2.0:1713279306.821814:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.821816:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT1 00000100:00100000:0.0:1713279306.821817:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196537 00010000:00010000:1.0:1713279306.821817:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.821819:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298eef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821820:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821820:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x793a:0x0].0x0 (ffff88008c002700) 00000100:00100000:3.0:1713279306.821820:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785215 00010000:00010000:2.0:1713279306.821821:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.821822:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821823:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00000100:00100000:3.0:1713279306.821823:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3648:11906:x1796503281232960:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.821825:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda875d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x793a:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.821826:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7213:0x0].0x0 (ffff880124f55f00) 00010000:00010000:1.0:1713279306.821827:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1713279306.821829:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821829:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda6fa1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.821829:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.821831:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114eda8136 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x7213:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821832:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda6fa1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.821835:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda6fa1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.821835:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda8e3a lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a5e expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.821837:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114eda82a2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7d86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821837:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f085b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821838:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda6fa1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.821840:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114eda82a2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7d86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821841:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda6fa1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.821842:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114eda82a2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7d86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.821845:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf46c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821845:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x72a2:0x0].0x0 (ffff8800927b4000) 00010000:00010000:1.0:1713279306.821846:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114eda82a2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7d86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821846:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821848:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda6fa1 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.821850:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114eda82a2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7d86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821851:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda6fa1 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.821853:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d86:0x0].0x0 (ffff880090a56500) 00010000:00010000:1.0:1713279306.821854:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.821855:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114eda82a2 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7d86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821857:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda71df lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.821858:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114eda82a2 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7d86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821860:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda71df lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.821862:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda71df lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.821863:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda82d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.821865:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda82d3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821865:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008957c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821866:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda71df lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.821868:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda82d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821869:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda71df lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.821870:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.821872:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda82d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821873:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71e6:0x0].0x0 (ffff880090bee600) 00010000:00010000:3.0:1713279306.821873:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114eda8e41 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.821874:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda82d3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821874:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821876:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda71df lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.821878:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x0 (ffff88012514da00) 00010000:00010000:2.0:1713279306.821878:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda71df lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.821879:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.821879:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114eda8e41 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.821880:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be59180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200042432:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.821880:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda82d3 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.821882:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda82d3 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713279306.821883:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114eda8e41 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.821884:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda7336 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.821887:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6400/0xfc4b8e114eda82a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821887:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda7336 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.821888:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda8e48 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.821890:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6400/0xfc4b8e114eda82a9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821890:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda7336 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.821891:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7efd:0x0].0x0 (ffff880122df6700) 00010000:00010000:2.0:1713279306.821892:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.821892:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda8e48 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.821893:0:15534:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.821893:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6400/0xfc4b8e114eda82a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821894:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda7336 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.821895:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf6400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.821895:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda8e48 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.821896:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda7336 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.821897:0:15534:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.821897:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6400/0xfc4b8e114eda82a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713279306.821899:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6400/0xfc4b8e114eda82a9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713279306.821900:0:15534:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.821900:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x777b:0x0].0x0 (ffff880097e7bf00) 00010000:00010000:2.0:1713279306.821901:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.821902:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x263:0x0].0x0 (ffff880090a56d00) 00010000:00010000:2.0:1713279306.821902:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda7336 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.821903:0:15534:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.821903:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.821905:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6400/0xfc4b8e114eda82a9 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821905:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda7336 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x777b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.821907:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6400/0xfc4b8e114eda82a9 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713279306.821911:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda73e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x71ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821914:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda73e5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x71ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821917:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda73e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x71ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821919:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821920:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda73e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x71ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.821923:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785216 00000100:00100000:1.0:1713279306.821926:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3727:11854:x1796503281232576:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.821926:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda73e5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x71ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821930:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71ea:0x0].0x0 (ffff8800925a8100) 00010000:00010000:2.0:1713279306.821931:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.821932:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.821932:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda73e5 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x71ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.821934:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009175d200/0xfc4b8e114eda8e4f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x708d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.821935:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda73e5 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x71ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.821938:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.821938:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3600/0xfc4b8e114eda8e56 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x843e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a50 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.821939:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009175d200/0xfc4b8e114eda8e4f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x708d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.821941:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda7590 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x71eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.821943:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009175d200/0xfc4b8e114eda8e4f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x708d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.821944:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda7590 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x71eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.821946:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281233408 00010000:00010000:2.0:1713279306.821947:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda7590 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x71eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.821948:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281233408 00000004:00200000:3.0:1713279306.821948:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x708d:0x0]: returning size 4259840 00010000:00010000:2.0:1713279306.821949:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ee640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.821950:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda7590 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x71eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.821953:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3600/0xfc4b8e114eda8e56 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x843e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a50 expref: 3728 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.821953:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda7590 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x71eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.821956:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71eb:0x0].0x0 (ffff88008d3fed00) 00000100:00100000:0.0:1713279306.821958:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785217 00010000:00010000:2.0:1713279306.821958:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.821959:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3600/0xfc4b8e114eda8e56 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x843e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a50 expref: 3728 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.821959:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda7590 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x71eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.821961:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3644:11876:x1796503281233088:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.821962:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ee640/0xfc4b8e114eda7590 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x71eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.821966:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x843e:0x0].0x0 (ffff88008e4c8b00) 00000100:00100000:3.0:1713279306.821966:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785218 00010000:00010000:0.0:1713279306.821967:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.821968:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1713279306.821968:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114eda7796 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7afa:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.821969:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800926b3600, rc 0) 00000100:00100000:3.0:1713279306.821969:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3728:11711:x1796503281233216:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.821971:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114eda7796 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7afa:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.821973:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114eda8e64 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a65 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.821974:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114eda7796 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7afa:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.821976:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f2aac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.821976:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.821977:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114eda7796 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7afa:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.821980:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114eda7796 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7afa:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.821982:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3728:11854:x1796503281232576:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 55us (486us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.821982:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114eda8e6b lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a6c expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.821984:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7afa:0x0].0x37 (ffff880091b1c700) 00000100:00100000:1.0:1713279306.821985:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785216 00010000:00010000:2.0:1713279306.821985:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.821986:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114eda7796 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7afa:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.821988:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114eda7796 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7afa:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.821993:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785219 00000100:00100000:1.0:1713279306.821995:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3710:11204:x1796503281233408:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.821996:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114eda7a7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7d80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.821998:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114eda7a7c lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7d80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.822000:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.822001:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114eda7a7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7d80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.822004:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda8e72 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a73 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.822006:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b21c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.822008:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114eda7a7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7d80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.822009:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114eda8e79 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.822010:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114eda7a7c lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7d80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.822014:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114eda8e79 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.822014:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d80:0x0].0x0 (ffff88008e735000) 00010000:00010000:2.0:1713279306.822015:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.822016:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114eda7a7c lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7d80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.822019:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114eda7a7c lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7d80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00000004:00080000:3.0:1713279306.822020:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880098cc5300 with version 31975 00010000:00010000:0.0:1713279306.822021:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114eda8e79 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.822021:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda8e80 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.822024:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8978 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7ae9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000020:00080000:3.0:1713279306.822024:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17643 cancel update log [0x200000401:0xf8:0x0].2110: rc = 0 00010000:00010000:0.0:1713279306.822026:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114eda8e87 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.822026:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda8e80 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.822027:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8978 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7ae9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.822029:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114eda8e87 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.822029:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda8e80 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.822029:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8978 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7ae9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.822032:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114eda8e87 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.822032:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d866d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.822033:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8978 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7ae9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.822034:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda8e8e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.822036:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8978 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7ae9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.822038:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda8e8e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.822040:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ae9:0x0].0x0 (ffff88008da65800) 00010000:00010000:2.0:1713279306.822041:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1713279306.822041:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17643 cancel update log [0x240000400:0x1c0:0x0].1502: rc = 0 00010000:00010000:1.0:1713279306.822042:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda8e8e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.822042:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8978 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7ae9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.822045:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda8978 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7ae9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.822052:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda8e80 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000004:00080000:3.0:1713279306.822052:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009e70d900 with version 31976 00000020:00080000:3.0:1713279306.822053:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17644 cancel update log [0x200000401:0xf8:0x0].2111: rc = 0 00010000:00010000:1.0:1713279306.822055:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda8e80 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.822058:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda8e80 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00000004:00080000:2.0:1713279306.822059:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31975 rpc_version 31975 00000020:00080000:3.0:1713279306.822060:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17644 cancel update log [0x240000400:0x1c0:0x0].1503: rc = 0 00010000:00010000:1.0:1713279306.822061:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda8e80 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.822063:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b0480 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.822065:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.822065:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda8e80 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000020:00100000:2.0:1713279306.822080:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1713279306.822082:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda8e80 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.822084:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801313c1880 x1796503200043008/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000004:00080000:3.0:1713279306.822084:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880092078600 with version 31977 00010000:00010000:1.0:1713279306.822085:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00000020:00080000:3.0:1713279306.822085:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17645 cancel update log [0x200000401:0xf8:0x0].2112: rc = 0 00010000:00010000:1.0:1713279306.822086:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.822087:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281232768 00010000:00010000:1.0:1713279306.822088:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda8e80 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.822089:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281232768 00010000:00010000:1.0:1713279306.822090:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda8e80 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.822092:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200043008:0@lo:1000:osp_up0-1.0 00000020:00080000:3.0:1713279306.822094:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17645 cancel update log [0x240000400:0x1c0:0x0].1504: rc = 0 00010000:00010000:1.0:1713279306.822095:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda8e8e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.822098:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda8e8e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00000100:00100000:0.0:1713279306.822100:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110495 00010000:00010000:1.0:1713279306.822102:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda8e8e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000004:00080000:3.0:1713279306.822102:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880093a83000 with version 31978 00000100:00100000:0.0:1713279306.822103:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+83:1955:x1796503281232768:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:1.0:1713279306.822104:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b1b00 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:3.0:1713279306.822104:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17646 cancel update log [0x200000401:0xf8:0x0].2113: rc = 0 00010000:00010000:1.0:1713279306.822105:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda8e8e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.822107:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.822107:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.822108:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda8e8e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00000020:00080000:3.0:1713279306.822110:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17646 cancel update log [0x240000400:0x1c0:0x0].1505: rc = 0 00010000:00010000:1.0:1713279306.822111:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff88008c2e7f00) 00010000:00010000:1.0:1713279306.822112:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.822113:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091baa640/0xfc4b8e114eda8e95 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a57 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.822113:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda8e8e lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.822114:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba289c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.822116:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda8e8e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000004:00080000:3.0:1713279306.822119:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012d98f3c0 with version 31979 00000100:00100000:2.0:1713279306.822121:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200042880 00000020:00080000:3.0:1713279306.822121:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17647 cancel update log [0x200000401:0xf8:0x0].2114: rc = 0 00000100:00100000:2.0:1713279306.822123:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200042880 00010000:00010000:1.0:1713279306.822126:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda8e72 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a73 expref: 3711 pid: 15749 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1713279306.822127:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17647 cancel update log [0x240000400:0x1c0:0x0].1506: rc = 0 00010000:00010000:1.0:1713279306.822130:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda8e72 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a73 expref: 3711 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.822131:0:15506:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15506:1796503200043072:192.168.203.4@tcp:106: 00000100:00100000:2.0:1713279306.822131:0:6934:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200043008 00000100:00100000:2.0:1713279306.822133:0:6934:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200043008 00010000:00010000:1.0:1713279306.822134:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800926b0240, rc 0) 00000004:00080000:3.0:1713279306.822136:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800994e0e40 with version 31980 00000020:00080000:3.0:1713279306.822138:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17648 cancel update log [0x200000401:0xf8:0x0].2115: rc = 0 00000100:00100000:2.0:1713279306.822139:0:6934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98806 00000100:00100000:2.0:1713279306.822142:0:6934:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+54:15479:x1796503200042880:12345-0@lo:1000:mdt00_015.0 00000100:00100000:0.0:1713279306.822144:0:15506:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237273c0 going to sleep for 11 seconds 00000020:00080000:3.0:1713279306.822144:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17648 cancel update log [0x240000400:0x1c0:0x0].1508: rc = 0 00000100:00100000:1.0:1713279306.822148:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3710:11204:x1796503281233408:12345-192.168.203.4@tcp:101:touch.0 Request processed in 152us (210us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.822152:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785219 00000004:00080000:3.0:1713279306.822152:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880124ce2300 with version 31981 00000020:00080000:3.0:1713279306.822154:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17649 cancel update log [0x200000401:0xf8:0x0].2116: rc = 0 00000020:00080000:3.0:1713279306.822161:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17649 cancel update log [0x240000400:0x1c0:0x0].1509: rc = 0 00000100:00100000:1.0:1713279306.822164:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98807 00000100:00100000:1.0:1713279306.822167:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+54:8074:x1796503200043008:12345-0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1713279306.822168:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880124ce2d80 with version 31982 00000100:00100000:2.0:1713279306.822169:0:6934:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+54:15479:x1796503200042880:12345-0@lo:1000:mdt00_015.0 Request processed in 26us (536us total) trans 0 rc 0/0 00000020:00080000:3.0:1713279306.822169:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17650 cancel update log [0x200000401:0xf8:0x0].2117: rc = 0 00000100:00100000:2.0:1713279306.822172:0:6934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98806 00000020:00080000:3.0:1713279306.822175:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17650 cancel update log [0x240000400:0x1c0:0x0].1510: rc = 0 00000100:00100000:0.0:1713279306.822181:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00080000:3.0:1713279306.822185:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88008c213b40 with version 31983 00000100:00100000:2.0:1713279306.822186:0:15479:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-mdtlov_UUID:15479:1796503200042880:0@lo:1000:mdt00_015.0 00000020:00080000:3.0:1713279306.822186:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17651 cancel update log [0x200000401:0xf8:0x0].2118: rc = 0 00000020:00080000:3.0:1713279306.822192:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17651 cancel update log [0x240000400:0x1c0:0x0].1511: rc = 0 00000100:00100000:0.0:1713279306.822194:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00080000:3.0:1713279306.822200:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800994df000 with version 31984 00000020:00080000:3.0:1713279306.822202:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17652 cancel update log [0x200000401:0xf8:0x0].2119: rc = 0 00000020:00080000:3.0:1713279306.822208:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17652 cancel update log [0x240000400:0x1c0:0x0].1512: rc = 0 00010000:00010000:2.0:1713279306.822212:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8e9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.822215:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaac0/0xfc4b8e114eda8ea3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000004:00080000:3.0:1713279306.822216:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880099728780 with version 31985 00010000:00010000:2.0:1713279306.822217:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000020:00080000:3.0:1713279306.822218:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17653 cancel update log [0x200000401:0xf8:0x0].2120: rc = 0 00000100:00100000:1.0:1713279306.822220:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+54:8074:x1796503200043008:12345-0@lo:1000:osp_up0-1.0 Request processed in 52us (112us total) trans 4295202682 rc 0/0 00010000:00010000:2.0:1713279306.822224:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000020:00080000:3.0:1713279306.822224:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17653 cancel update log [0x240000400:0x1c0:0x0].1513: rc = 0 00010000:00010000:0.0:1713279306.822225:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaac0/0xfc4b8e114eda8ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.822225:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98807 00010000:00010000:0.0:1713279306.822231:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaac0/0xfc4b8e114eda8ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000004:00010000:2.0:1713279306.822231:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000004:00080000:3.0:1713279306.822232:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800900a5240 with version 31986 00000020:00080000:3.0:1713279306.822233:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17654 cancel update log [0x200000401:0xf8:0x0].2121: rc = 0 00010000:00010000:2.0:1713279306.822235:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda8b00 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.822237:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114eda8e79 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.822239:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda8b00 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00000020:00080000:3.0:1713279306.822239:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17654 cancel update log [0x240000400:0x1c0:0x0].1514: rc = 0 00010000:00010000:2.0:1713279306.822242:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda8b00 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713279306.822244:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200043008:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713279306.822245:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114eda8e79 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.822245:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda8b00 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000004:00080000:3.0:1713279306.822247:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009e7ab900 with version 31987 00010000:00010000:0.0:1713279306.822248:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114eda8e79 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00000004:00080000:1.0:1713279306.822248:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31976 rpc_version 31976 00000020:00080000:3.0:1713279306.822248:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17655 cancel update log [0x200000401:0xf8:0x0].2122: rc = 0 00010000:00010000:2.0:1713279306.822251:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.822252:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114eda8e79 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.822253:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda8b00 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.822254:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8900 already unused, calling callback (ffffffffa0f0d730) 00000020:00100000:1.0:1713279306.822255:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:3.0:1713279306.822255:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17655 cancel update log [0x240000400:0x1c0:0x0].1515: rc = 0 00010000:00010000:0.0:1713279306.822256:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114eda8e79 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.822256:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda8b00 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713279306.822258:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009387df80 x1796503200043200/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1713279306.822260:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114eda8e79 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.822260:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:2.0:1713279306.822261:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.822262:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda8b00 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.822264:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00000004:00080000:3.0:1713279306.822264:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009e7ab600 with version 31988 00010000:00010000:0.0:1713279306.822265:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.822265:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda8b00 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000020:00080000:3.0:1713279306.822265:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17656 cancel update log [0x200000401:0xf8:0x0].2123: rc = 0 00010000:00010000:0.0:1713279306.822267:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114eda8e79 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.822267:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200043200:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713279306.822270:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114eda8e79 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.822270:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000020:00080000:3.0:1713279306.822271:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17656 cancel update log [0x240000400:0x1c0:0x0].1516: rc = 0 00010000:00010000:2.0:1713279306.822273:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.822276:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.822277:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114eda8e87 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.822279:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713279306.822279:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012fb0e540 with version 31989 00010000:00010000:0.0:1713279306.822280:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114eda8e87 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00000020:00080000:3.0:1713279306.822280:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17657 cancel update log [0x200000401:0xf8:0x0].2124: rc = 0 00010000:00010000:0.0:1713279306.822283:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114eda8e87 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.822283:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942c240 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.822284:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0b40 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.822284:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.822286:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba98c0 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:3.0:1713279306.822286:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17657 cancel update log [0x240000400:0x1c0:0x0].1517: rc = 0 00010000:00010000:0.0:1713279306.822287:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114eda8e87 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.822287:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713279306.822290:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200043200 00010000:00010000:0.0:1713279306.822291:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114eda8e87 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.822291:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x31 (ffff88008e59ca00) 00000100:00100000:1.0:1713279306.822292:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200043200 00010000:00010000:2.0:1713279306.822292:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.822293:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.822294:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x31 (ffff88008e59ca00) 00000004:00080000:3.0:1713279306.822294:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880095aef3c0 with version 31990 00010000:00010000:0.0:1713279306.822295:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.822296:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda8b07 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000020:00080000:3.0:1713279306.822296:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17658 cancel update log [0x200000401:0xf8:0x0].2125: rc = 0 00010000:00010000:0.0:1713279306.822297:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114eda8e87 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.822299:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114eda8e87 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000020:00080000:3.0:1713279306.822302:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17658 cancel update log [0x240000400:0x1c0:0x0].1518: rc = 0 00010000:00010000:2.0:1713279306.822308:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda8aeb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917595b expref: 3361 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.822309:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98808 00000004:00080000:3.0:1713279306.822310:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012445bb40 with version 31991 00000020:00080000:3.0:1713279306.822311:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17659 cancel update log [0x200000401:0xf8:0x0].2126: rc = 0 00000100:00100000:1.0:1713279306.822312:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+54:8074:x1796503200043200:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1713279306.822314:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b180/0xfc4b8e114eda8e9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917595b expref: 3360 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.822315:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114eda8e64 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a65 expref: 3642 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.822317:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x84a3:0x0].0x0 (ffff880092ae7100) 00000020:00080000:3.0:1713279306.822317:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17659 cancel update log [0x240000400:0x1c0:0x0].1519: rc = 0 00010000:00010000:2.0:1713279306.822318:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1713279306.822319:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68b180, rc 0) 00010000:00010000:0.0:1713279306.822320:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaac0/0xfc4b8e114eda8ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a65 expref: 3641 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.822323:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x84a3:0x0].0x0 (ffff880092ae7100) 00010000:00010000:0.0:1713279306.822324:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713279306.822325:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baaac0, rc 0) 00000004:00080000:3.0:1713279306.822325:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012445ba80 with version 31992 00000020:00080000:3.0:1713279306.822326:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17660 cancel update log [0x200000401:0xf8:0x0].2127: rc = 0 00000020:00080000:3.0:1713279306.822332:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17660 cancel update log [0x240000400:0x1c0:0x0].1520: rc = 0 00000100:00100000:2.0:1713279306.822334:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3360:11855:x1796503281226112:12345-192.168.203.4@tcp:101:touch.0 Request processed in 13530us (13578us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.822338:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785178 00000004:00080000:3.0:1713279306.822340:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012445b540 with version 31993 00000100:00100000:0.0:1713279306.822342:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3641:11876:x1796503281233088:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 380us (838us total) trans 0 rc 0/0 00000020:00080000:3.0:1713279306.822342:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17661 cancel update log [0x200000401:0xf8:0x0].2129: rc = 0 00000100:00100000:2.0:1713279306.822345:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281233472 00000100:00100000:0.0:1713279306.822346:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785217 00000100:00100000:2.0:1713279306.822347:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281233472 00000020:00080000:3.0:1713279306.822349:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17661 cancel update log [0x240000400:0x1c0:0x0].1522: rc = 0 00000100:00100000:1.0:1713279306.822350:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:8074:x1796503200043200:12345-0@lo:1000:osp_up0-1.0 Request processed in 37us (70us total) trans 4295202683 rc 0/0 00000100:00100000:1.0:1713279306.822354:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98808 00000100:00100000:0.0:1713279306.822355:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785220 00000004:00080000:3.0:1713279306.822357:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012445b900 with version 31994 00000100:00100000:0.0:1713279306.822358:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3641:11912:x1796503281233472:12345-192.168.203.4@tcp:101:touch.0 00000020:00080000:3.0:1713279306.822358:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17662 cancel update log [0x200000401:0xf8:0x0].2128: rc = 0 00000100:00100000:2.0:1713279306.822361:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281232832 00010000:00010000:0.0:1713279306.822363:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.822363:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281232832 00000020:00080000:3.0:1713279306.822365:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17662 cancel update log [0x240000400:0x1c0:0x0].1521: rc = 0 00010000:00010000:0.0:1713279306.822368:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114eda8eaa lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a7a expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.822369:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200043200:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1713279306.822369:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114ed9e3cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b8e expref: 3728 pid: 15480 timeout: 509 lvb_type: 0 00000004:00080000:1.0:1713279306.822373:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31977 rpc_version 31977 00000004:00080000:3.0:1713279306.822373:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880097ee6b40 with version 31995 00000020:00080000:3.0:1713279306.822374:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17663 cancel update log [0x200000401:0xf8:0x0].2130: rc = 0 00000100:00100000:2.0:1713279306.822377:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196538 00000020:00100000:1.0:1713279306.822379:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.822379:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+3728:1957:x1796503281232832:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000020:00080000:3.0:1713279306.822381:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17663 cancel update log [0x240000400:0x1c0:0x0].1523: rc = 0 00000100:00100000:1.0:1713279306.822382:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012227f480 x1796503200043328/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:2.0:1713279306.822384:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.822386:0:15496:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114ed9e3cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b8e expref: 3728 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.822389:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200043328:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1713279306.822390:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880097ee6180 with version 31996 00000020:00080000:3.0:1713279306.822391:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17664 cancel update log [0x200000401:0xf8:0x0].2131: rc = 0 00010000:00010000:2.0:1713279306.822392:0:15496:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114ed9e3cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b8e expref: 3728 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.822398:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114ed9e3cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7efd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172b8e expref: 3728 pid: 15480 timeout: 509 lvb_type: 0 00000020:00080000:3.0:1713279306.822398:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17664 cancel update log [0x240000400:0x1c0:0x0].1524: rc = 0 00010000:00010000:0.0:1713279306.822401:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda8eb1 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.822402:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.822403:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7efd:0x0].0x0 (ffff880122df6700) 00010000:00010000:0.0:1713279306.822405:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda8eb1 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.822405:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.822407:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0b40 going to sleep for 11 seconds 00000004:00080000:3.0:1713279306.822408:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800a7f0f3c0 with version 31997 00010000:00010000:0.0:1713279306.822409:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda8eb1 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.822409:0:15496:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15534 initiator: MDT0 00000020:00080000:3.0:1713279306.822409:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17665 cancel update log [0x200000401:0xf8:0x0].2132: rc = 0 00000100:00100000:1.0:1713279306.822426:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200043328 00010000:00010000:2.0:1713279306.822427:0:15496:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.822428:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200043328 00010000:00010000:0.0:1713279306.822429:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda8eb8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.822433:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda8eb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000020:00080000:3.0:1713279306.822434:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17665 cancel update log [0x240000400:0x1c0:0x0].1525: rc = 0 00000100:00100000:1.0:1713279306.822437:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98809 00010000:00010000:0.0:1713279306.822438:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda8eb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.822439:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:8074:x1796503200043328:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1713279306.822439:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1713279306.822444:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8801205139c0 with version 31998 00000020:00080000:3.0:1713279306.822445:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17666 cancel update log [0x200000401:0xf8:0x0].2133: rc = 0 00000100:00100000:2.0:1713279306.822449:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+3727:1957:x1796503281232832:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 69us (254us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.822450:0:15534:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00000020:00080000:3.0:1713279306.822451:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17666 cancel update log [0x240000400:0x1c0:0x0].1526: rc = 0 00010000:00010000:0.0:1713279306.822453:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00000100:00100000:2.0:1713279306.822453:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196538 00000004:00080000:3.0:1713279306.822460:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880097d1f300 with version 31999 00000020:00080000:3.0:1713279306.822461:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17667 cancel update log [0x200000401:0xf8:0x0].2134: rc = 0 00000020:00080000:3.0:1713279306.822467:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17667 cancel update log [0x240000400:0x1c0:0x0].1527: rc = 0 00000004:00080000:3.0:1713279306.822475:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091a0e540 with version 32000 00000100:00100000:1.0:1713279306.822476:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+56:8074:x1796503200043328:12345-0@lo:1000:osp_up0-1.0 Request processed in 35us (73us total) trans 4295202684 rc 0/0 00000020:00080000:3.0:1713279306.822477:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17668 cancel update log [0x200000401:0xf8:0x0].2135: rc = 0 00000100:00100000:1.0:1713279306.822479:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98809 00000020:00080000:3.0:1713279306.822483:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17668 cancel update log [0x240000400:0x1c0:0x0].1528: rc = 0 00010000:00010000:0.0:1713279306.822489:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00000004:00080000:3.0:1713279306.822490:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88008e4a2f00 with version 32001 00000020:00080000:3.0:1713279306.822491:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17669 cancel update log [0x200000401:0xf8:0x0].2136: rc = 0 00010000:00010000:0.0:1713279306.822493:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.822495:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200043328:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713279306.822496:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00000020:00080000:3.0:1713279306.822497:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17669 cancel update log [0x240000400:0x1c0:0x0].1529: rc = 0 00010000:00010000:0.0:1713279306.822499:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9200 already unused, calling callback (ffffffffa0f0d730) 00000004:00080000:1.0:1713279306.822499:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31978 rpc_version 31978 00010000:00010000:0.0:1713279306.822500:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.822503:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT0 00000020:00100000:1.0:1713279306.822504:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000004:00080000:3.0:1713279306.822506:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800960d0a80 with version 32002 00000100:00100000:1.0:1713279306.822507:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880122e6c380 x1796503200043456/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000020:00080000:3.0:1713279306.822507:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17670 cancel update log [0x200000401:0xf8:0x0].2137: rc = 0 00010000:00010000:0.0:1713279306.822508:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7efd:0x0].0x0 (ffff880122df6700) 00010000:00010000:0.0:1713279306.822509:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1713279306.822510:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.822513:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114eda8de6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7efd:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.822514:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122e6c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200043456:0@lo:1000:osp_up0-1.0 00000020:00080000:3.0:1713279306.822514:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17670 cancel update log [0x240000400:0x1c0:0x0].1530: rc = 0 00010000:00010000:0.0:1713279306.822518:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda8dd8 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.822520:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda8dd8 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT0 00000004:00080000:3.0:1713279306.822522:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880097e2ad80 with version 32003 00010000:00010000:0.0:1713279306.822523:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda8dd8 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT0 00000020:00080000:3.0:1713279306.822524:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17671 cancel update log [0x200000401:0xf8:0x0].2138: rc = 0 00000100:00100000:1.0:1713279306.822525:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.822526:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda8dd8 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.822528:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fca86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.822530:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda8dd8 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.822530:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0b40 going to sleep for 11 seconds 00000020:00080000:3.0:1713279306.822530:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17671 cancel update log [0x240000400:0x1c0:0x0].1531: rc = 0 00010000:00010000:0.0:1713279306.822535:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda8dd8 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.822536:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200043456 00010000:00010000:0.0:1713279306.822538:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff88012061fd00) 00000100:00100000:1.0:1713279306.822538:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200043456 00010000:00010000:0.0:1713279306.822539:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.822540:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda8dd8 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00000004:00080000:3.0:1713279306.822540:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880097e2a840 with version 32004 00000020:00080000:3.0:1713279306.822541:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17672 cancel update log [0x200000401:0xf8:0x0].2139: rc = 0 00010000:00010000:0.0:1713279306.822543:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007fca86c0/0xfc4b8e114eda8dd8 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.822546:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98810 00000020:00080000:3.0:1713279306.822547:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17672 cancel update log [0x240000400:0x1c0:0x0].1532: rc = 0 00010000:00010000:0.0:1713279306.822548:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda8ddf lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.822549:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+56:8074:x1796503200043456:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713279306.822551:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda8ddf lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.822553:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda8ddf lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.822556:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091babcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.822557:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda8ddf lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.822560:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda8ddf lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT0 00000004:00080000:3.0:1713279306.822561:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012ffbd180 with version 32005 00010000:00010000:0.0:1713279306.822563:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x3031 (ffff88012061fc00) 00000020:00080000:3.0:1713279306.822563:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17673 cancel update log [0x200000401:0xf8:0x0].2141: rc = 0 00010000:00010000:0.0:1713279306.822564:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.822565:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda8ddf lrc: 2/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.822568:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114eda8ddf lrc: 0/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00000020:00080000:3.0:1713279306.822572:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17673 cancel update log [0x240000400:0x1c0:0x0].1533: rc = 0 00010000:00010000:0.0:1713279306.822575:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.822578:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.822581:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00000004:00080000:3.0:1713279306.822581:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8801250c00c0 with version 32006 00000100:00100000:1.0:1713279306.822582:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+57:8074:x1796503200043456:12345-0@lo:1000:osp_up0-1.0 Request processed in 32us (56us total) trans 4295202685 rc 0/0 00010000:00010000:0.0:1713279306.822583:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d9833c0 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:3.0:1713279306.822583:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17674 cancel update log [0x200000401:0xf8:0x0].2142: rc = 0 00010000:00010000:0.0:1713279306.822584:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.822586:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98810 00010000:00010000:0.0:1713279306.822587:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 15534 initiator: MDT0 00000020:00080000:3.0:1713279306.822589:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17674 cancel update log [0x240000400:0x1c0:0x0].1534: rc = 0 00010000:00010000:0.0:1713279306.822590:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:0.0:1713279306.822591:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.822593:0:15534:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda83eb lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda83cf expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.822597:0:15534:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda83eb lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda83cf expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713279306.822598:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8801250c0240 with version 32007 00000020:00080000:3.0:1713279306.822599:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17675 cancel update log [0x200000401:0xf8:0x0].2143: rc = 0 00000100:00100000:1.0:1713279306.822600:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122e6c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200043456:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713279306.822601:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda83eb lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda83cf expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713279306.822603:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31979 rpc_version 31979 00010000:00010000:0.0:1713279306.822604:0:15534:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00000020:00080000:3.0:1713279306.822606:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17675 cancel update log [0x240000400:0x1c0:0x0].1535: rc = 0 00000020:00100000:1.0:1713279306.822609:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1713279306.822612:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880097baca80 x1796503200043584/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1713279306.822614:0:15534:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda83eb lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda83cf expref: 56 pid: 15542 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713279306.822614:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8801250c03c0 with version 32008 00000020:00080000:3.0:1713279306.822615:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17676 cancel update log [0x200000401:0xf8:0x0].2144: rc = 0 00000100:00100000:1.0:1713279306.822618:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097baca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200043584:0@lo:1000:osp_up0-1.0 00000020:00080000:3.0:1713279306.822622:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17676 cancel update log [0x240000400:0x1c0:0x0].1536: rc = 0 00000100:00100000:0.0:1713279306.822623:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d182d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200043648:0@lo:105: 00000100:00100000:1.0:1713279306.822629:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713279306.822630:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8801250c0540 with version 32009 00000020:00080000:3.0:1713279306.822631:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17677 cancel update log [0x200000401:0xf8:0x0].2145: rc = 0 00000100:00100000:1.0:1713279306.822636:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0b40 going to sleep for 11 seconds 00000020:00080000:3.0:1713279306.822638:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17677 cancel update log [0x240000400:0x1c0:0x0].1537: rc = 0 00000100:00100000:0.0:1713279306.822639:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.822641:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200043584 00000020:00080000:3.0:1713279306.822641:0:8082:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17677 00000100:00100000:1.0:1713279306.822642:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200043584 00000100:00100000:0.0:1713279306.822647:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606cd80 going to sleep for 11 seconds 00000004:00200000:0.0:1713279306.822654:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00000100:00100000:1.0:1713279306.822658:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98811 00010000:00010000:0.0:1713279306.822660:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda8eb1 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.822660:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+57:8074:x1796503200043584:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713279306.822663:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda8eb1 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.822665:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114eda8e41 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.822666:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda8eb1 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.822669:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda8eb1 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.822669:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114eda8e41 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.822671:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baa880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.822672:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114eda8e41 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.822673:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda8eb1 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.822675:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114eda8e41 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.822676:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda8eb1 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.822678:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008be63600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.822679:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880130675e00) 00010000:00010000:3.0:1713279306.822680:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114eda8e41 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.822681:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.822682:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda8eb1 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.822683:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114eda8e41 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.822684:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa880/0xfc4b8e114eda8eb1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.822687:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880123701600) 00010000:00010000:0.0:1713279306.822689:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda8eb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.822689:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.822691:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114eda8e41 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.822692:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda8eb8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.822693:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114eda8e41 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.822695:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda8eb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.822696:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+58:8074:x1796503200043584:12345-0@lo:1000:osp_up0-1.0 Request processed in 34us (66us total) trans 4295202686 rc 0/0 00010000:00010000:0.0:1713279306.822697:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.822698:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda8e48 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.822699:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda8eb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.822699:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98811 00010000:00010000:0.0:1713279306.822701:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda8eb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.822701:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda8e48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.822704:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880130675300) 00010000:00010000:3.0:1713279306.822704:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda8e48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.822705:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.822706:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda8eb8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.822706:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008be61680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.822708:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda8e48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.822709:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114eda8eb8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.822713:0:9213:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1713279306.822713:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda8e48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.822717:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200043648 00010000:00010000:3.0:1713279306.822717:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x38 (ffff8801250c1800) 00000100:00100000:1.0:1713279306.822718:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200043648 00010000:00010000:3.0:1713279306.822718:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.822719:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda8e48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.822722:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114eda8eaa lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a7a expref: 3643 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.822722:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda8e48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.822726:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33438 00010000:00010000:0.0:1713279306.822727:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114eda8eaa lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a7a expref: 3643 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.822728:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009630f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15534:x1796503200043648:12345-0@lo:105: 00010000:00010000:0.0:1713279306.822732:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bab840, rc 0) 00010000:00010000:1.0:1713279306.822733:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.822738:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.822738:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda8e3a lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a5e expref: 3643 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.822743:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.822744:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3642:11912:x1796503281233472:12345-192.168.203.4@tcp:101:touch.0 Request processed in 384us (563us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.822744:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009175d200/0xfc4b8e114eda8e4f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x708d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a5e expref: 3642 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.822746:0:9213:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.822747:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785220 00010000:00010000:3.0:1713279306.822747:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x708d:0x0].0x0 (ffff88008c1d2f00) 00010000:00010000:3.0:1713279306.822749:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713279306.822750:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009175d200, rc 0) 00010000:00010000:1.0:1713279306.822753:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.822757:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.822760:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.822764:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3641:11906:x1796503281232960:12345-192.168.203.4@tcp:101:touch.0 Request processed in 940us (1279us total) trans 4295183715 rc 0/0 00010000:00010000:1.0:1713279306.822768:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880092342ac0) 00000100:00100000:3.0:1713279306.822769:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785215 00010000:00010000:2.0:1713279306.822775:0:15526:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.822780:0:15526:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.822788:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009630f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15534:x1796503200043648:12345-0@lo:105: Request processed in 59us (148us total) trans 0 rc 0/0 00000004:00080000:2.0:1713279306.822789:0:15526:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1713279306.822791:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33438 00000100:00100000:0.0:1713279306.822794:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d182d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200043648:0@lo:105: 00010000:00010000:0.0:1713279306.822801:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.822805:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114eda8358 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 15534 initiator: MDT0 00000004:00020000:0.0:1713279306.822810:0:15534:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200000402:0x7f51:0x0]/10 failed: rc = -114 00010000:00010000:3.0:1713279306.822811:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda8ebf lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.822816:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda8ebf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.822820:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097baca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200043584:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.822820:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda8ebf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000004:00080000:1.0:1713279306.822823:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31980 rpc_version 31980 00010000:00010000:2.0:1713279306.822823:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda8ec6 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00000100:00100000:0.0:1713279306.822826:0:15534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_011:385c4b71-808c-40cf-91de-b076b668d13f+3727:11736:x1796503281211584:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 46581us (46619us total) trans 0 rc -114/-114 00010000:00010000:3.0:1713279306.822826:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8ecd lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.822828:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda8ec6 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00000020:00100000:1.0:1713279306.822829:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1713279306.822829:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8ecd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00000100:00100000:0.0:1713279306.822830:0:15534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14339 00000100:00100000:1.0:1713279306.822831:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009764d500 x1796503200043776/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:2.0:1713279306.822832:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda8ec6 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.822832:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8ecd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.822838:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764d500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200043776:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1713279306.822838:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8ed4 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00000004:00200000:3.0:1713279306.822840:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:2.0:1713279306.822841:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8ed4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.822844:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda8ebf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.822845:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8ed4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.822847:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda8ebf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.822850:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.822850:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 3/0,1 mode: --/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00010000:00010000:3.0:1713279306.822851:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda8ebf lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.822853:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda8ebf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.822854:0:15526:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda7ac9 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175517 expref: 3359 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.822855:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0b40 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.822856:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093691440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.822857:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda8ebf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.822859:0:15526:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 4/0,1 mode: --/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00000100:00100000:1.0:1713279306.822860:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200043776 00010000:00010000:3.0:1713279306.822860:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda8ebf lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.822862:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200043776 00010000:00010000:3.0:1713279306.822864:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8801250c1900) 00010000:00010000:3.0:1713279306.822865:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.822866:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda8ebf lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.822869:0:15526:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda7ac9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175517 expref: 3359 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.822870:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98812 00010000:00010000:3.0:1713279306.822871:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093691440/0xfc4b8e114eda8ebf lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.822873:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+58:8074:x1796503200043776:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1713279306.822874:0:15526:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda7ac9 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175517 expref: 3359 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.822876:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8ecd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.822879:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8ecd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00000100:00100000:2.0:1713279306.822880:0:15526:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001_UUID:15526:1796503200043840:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.822882:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8ecd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.822884:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925433c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.822886:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8ecd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.822888:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8ecd lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.822891:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff8801250c1700) 00010000:00010000:3.0:1713279306.822892:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.822894:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8ecd lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:0.0:1713279306.822895:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.822896:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114eda8ecd lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:2.0:1713279306.822897:0:15526:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba28d80 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.822909:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+59:8074:x1796503200043776:12345-0@lo:1000:osp_up0-1.0 Request processed in 35us (58us total) trans 4295202687 rc 0/0 00010000:00010000:3.0:1713279306.822909:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114eda8e6b lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a6c expref: 3726 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.822913:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98812 00010000:00010000:3.0:1713279306.822914:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114eda8e6b lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a6c expref: 3726 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.822922:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093693a80, rc 0) 00000100:00100000:1.0:1713279306.822928:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764d500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200043776:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1713279306.822931:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31981 rpc_version 31981 00000020:00100000:1.0:1713279306.822936:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.822938:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3725:11711:x1796503281233216:12345-192.168.203.4@tcp:101:touch.0 Request processed in 968us (1368us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.822939:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880097a18700 x1796503200043968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.822942:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785218 00000100:00100000:1.0:1713279306.822945:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a18700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200043968:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.822949:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281233536 00000100:00100000:3.0:1713279306.822951:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281233536 00000100:00100000:1.0:1713279306.822956:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.822961:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.822962:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785221 00000100:00100000:3.0:1713279306.822965:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3360:11940:x1796503281233536:12345-192.168.203.4@tcp:101:mkdir.0 00000100:00100000:1.0:1713279306.822967:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200043968 00000100:00100000:1.0:1713279306.822968:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200043968 00010000:00010000:3.0:1713279306.822970:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.822975:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda8ee2 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x135:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a81 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.822984:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98813 00000100:00100000:1.0:1713279306.822986:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+59:8074:x1796503200043968:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.823003:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8ee9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x135:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.823007:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8ee9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.823011:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8ee9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.823014:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8ee9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.823018:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8ee9 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.823020:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+60:8074:x1796503200043968:12345-0@lo:1000:osp_up0-1.0 Request processed in 33us (63us total) trans 4295202688 rc 0/0 00010000:00010000:3.0:1713279306.823021:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8ee9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.823024:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98813 00010000:00010000:3.0:1713279306.823026:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.823027:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8ee9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.823030:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8ee9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00000100:00100000:0.0:1713279306.823033:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a18700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200043968:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.823034:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x135:0x0].0x0 (ffff8801250c1500) 00010000:00010000:3.0:1713279306.823035:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713279306.823036:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8ee9 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000004:00080000:0.0:1713279306.823038:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31982 rpc_version 31982 00010000:00010000:3.0:1713279306.823039:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda8ee9 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000020:00100000:0.0:1713279306.823044:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.823047:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d183100 x1796503200044096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1713279306.823051:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda8ee2 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x135:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a81 expref: 3361 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.823055:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d183100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044096:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.823055:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda8ee2 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x135:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a81 expref: 3361 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.823060:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925421c0, rc 0) 00000100:00100000:0.0:1713279306.823086:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.823096:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3360:11940:x1796503281233536:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 130us (201us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.823097:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.823100:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785221 00000100:00100000:1.0:1713279306.823113:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200044096 00000100:00100000:1.0:1713279306.823116:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200044096 00000100:00100000:1.0:1713279306.823132:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98814 00000100:00100000:1.0:1713279306.823134:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+60:8074:x1796503200044096:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.823174:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+61:8074:x1796503200044096:12345-0@lo:1000:osp_up0-1.0 Request processed in 39us (87us total) trans 4295202689 rc 0/0 00000100:00100000:1.0:1713279306.823178:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98814 00000100:00100000:0.0:1713279306.823183:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d183100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044096:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.823186:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31983 rpc_version 31983 00000020:00100000:0.0:1713279306.823192:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.823194:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d181180 x1796503200044224/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.823201:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d181180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044224:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.823213:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.823220:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.823224:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200044224 00000100:00100000:2.0:1713279306.823227:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200044224 00000100:00100000:2.0:1713279306.823238:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98815 00000100:00100000:2.0:1713279306.823241:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+61:8074:x1796503200044224:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1713279306.823291:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+62:8074:x1796503200044224:12345-0@lo:1000:osp_up0-1.0 Request processed in 48us (76us total) trans 4295202690 rc 0/0 00000100:00100000:2.0:1713279306.823294:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98815 00000100:00100000:0.0:1713279306.823297:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d181180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044224:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.823300:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31984 rpc_version 31984 00000020:00100000:0.0:1713279306.823305:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.823307:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008be59180 x1796503200044352/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.823313:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be59180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044352:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.823323:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.823328:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.823332:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200044352 00000100:00100000:2.0:1713279306.823334:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200044352 00000100:00100000:2.0:1713279306.823341:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98816 00000100:00100000:2.0:1713279306.823343:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+62:8074:x1796503200044352:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1713279306.823378:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+63:8074:x1796503200044352:12345-0@lo:1000:osp_up0-1.0 Request processed in 34us (54us total) trans 4295202691 rc 0/0 00000100:00100000:2.0:1713279306.823381:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98816 00000100:00100000:0.0:1713279306.823384:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be59180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044352:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.823388:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31985 rpc_version 31985 00000020:00100000:0.0:1713279306.823392:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.823395:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88007f02c380 x1796503200044480/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.823400:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044480:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.823426:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.823431:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.823435:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200044480 00000100:00100000:2.0:1713279306.823437:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200044480 00000100:00100000:2.0:1713279306.823444:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98817 00000100:00100000:2.0:1713279306.823446:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+63:8074:x1796503200044480:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1713279306.823489:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+64:8074:x1796503200044480:12345-0@lo:1000:osp_up0-1.0 Request processed in 41us (76us total) trans 4295202692 rc 0/0 00000100:00100000:2.0:1713279306.823492:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98817 00000100:00100000:0.0:1713279306.823495:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044480:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.823499:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31986 rpc_version 31986 00000020:00100000:0.0:1713279306.823504:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.823506:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012f38ad80 x1796503200044608/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.823512:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f38ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044608:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.823522:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.823527:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.823531:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200044608 00000100:00100000:2.0:1713279306.823533:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200044608 00000100:00100000:2.0:1713279306.823539:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98818 00000100:00100000:2.0:1713279306.823541:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+64:8074:x1796503200044608:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1713279306.823574:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+65:8074:x1796503200044608:12345-0@lo:1000:osp_up0-1.0 Request processed in 32us (50us total) trans 4295202693 rc 0/0 00000100:00100000:2.0:1713279306.823577:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98818 00000100:00100000:0.0:1713279306.823581:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f38ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044608:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.823584:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31987 rpc_version 31987 00000020:00100000:0.0:1713279306.823589:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.823591:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008e607b80 x1796503200044736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.823596:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e607b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044736:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.823687:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.823699:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.823716:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.823727:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281233664 00000100:00100000:0.0:1713279306.823730:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281233664 00000100:00100000:0.0:1713279306.823743:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785222 00000100:00100000:0.0:1713279306.823746:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3710:11945:x1796503281233664:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.823751:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.823752:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200044736 00000100:00100000:3.0:1713279306.823756:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200044736 00010000:00010000:0.0:1713279306.823757:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114eda8ef0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a88 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.823776:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda8ef7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.823779:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98819 00010000:00010000:0.0:1713279306.823781:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda8ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.823782:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+65:8074:x1796503200044736:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713279306.823786:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda8ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.823791:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114eda8efe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.823795:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114eda8efe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.823798:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114eda8efe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.823841:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+66:8074:x1796503200044736:12345-0@lo:1000:osp_up0-1.0 Request processed in 58us (154us total) trans 4295202694 rc 0/0 00000100:00100000:3.0:1713279306.823845:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98819 00000100:00100000:1.0:1713279306.823862:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e607b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044736:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1713279306.823868:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31988 rpc_version 31988 00000020:00100000:1.0:1713279306.823877:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1713279306.823880:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880097a1aa00 x1796503200044864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1713279306.823889:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044864:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1713279306.823896:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7f51:0x0]: returning size 4096 00000100:00100000:1.0:1713279306.823906:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.823916:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.823917:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200044864 00002000:00010000:0.0:1713279306.823918:0:15506:0:(ofd_lvb.c:290:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb atime: 0 -> 1713279300 00000100:00100000:3.0:1713279306.823919:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200044864 00000100:00100000:0.0:1713279306.823924:0:15506:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15506:1796503200043072:192.168.203.4@tcp:106: 00000100:00100000:3.0:1713279306.823928:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98820 00000100:00100000:3.0:1713279306.823930:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+66:8074:x1796503200044864:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713279306.823934:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091baa640/0xfc4b8e114eda8e95 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a57 expref: 84 pid: 15506 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713279306.823940:0:15506:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091baa640/0xfc4b8e114eda8e95 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a57 expref: 84 pid: 15506 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713279306.823945:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baa640, rc 0) 00000100:00100000:0.0:1713279306.823966:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+83:1955:x1796503281232768:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 1863us (1901us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.823969:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+67:8074:x1796503200044864:12345-0@lo:1000:osp_up0-1.0 Request processed in 37us (61us total) trans 4295202695 rc 0/0 00000100:00100000:0.0:1713279306.823970:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110495 00000100:00100000:3.0:1713279306.823972:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98820 00000100:00100000:1.0:1713279306.823984:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044864:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1713279306.823988:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31989 rpc_version 31989 00000020:00100000:1.0:1713279306.823994:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1713279306.823996:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda8ef7 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.823997:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880097a19c00 x1796503200044992/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1713279306.824000:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda8ef7 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.824003:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda8ef7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.824004:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044992:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713279306.824006:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda8ef7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.824009:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baa1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.824010:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda8ef7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.824015:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda8ef7 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.824020:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:0.0:1713279306.824022:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.824023:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda8ef7 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.824026:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda8ef7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.824026:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.824031:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114eda8efe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.824033:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114eda8efe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.824033:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.824036:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200044992 00010000:00010000:0.0:1713279306.824037:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114eda8efe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.824037:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200044992 00010000:00010000:0.0:1713279306.824039:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.824040:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114eda8efe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.824043:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114eda8efe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.824046:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3631 (ffff880130675a00) 00010000:00010000:0.0:1713279306.824047:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.824048:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114eda8efe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.824050:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98821 00010000:00010000:0.0:1713279306.824051:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114eda8efe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.824052:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+67:8074:x1796503200044992:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713279306.824066:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114eda8ef0 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a88 expref: 3712 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.824081:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114eda8ef0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a88 expref: 3712 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.824085:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba8d80, rc 0) 00000100:00100000:0.0:1713279306.824105:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11945:x1796503281233664:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 358us (389us total) trans 4295202696 rc 301/301 00000100:00100000:0.0:1713279306.824108:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785222 00000100:00100000:3.0:1713279306.824115:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+68:8074:x1796503200044992:12345-0@lo:1000:osp_up0-1.0 Request processed in 61us (88us total) trans 4295202697 rc 0/0 00000100:00100000:3.0:1713279306.824119:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98821 00000100:00100000:1.0:1713279306.824127:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200044992:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1713279306.824131:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31990 rpc_version 31990 00000020:00100000:1.0:1713279306.824138:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1713279306.824140:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012e7eb100 x1796503200045120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1713279306.824147:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7eb100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200045120:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.824160:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.824166:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.824169:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200045120 00000100:00100000:3.0:1713279306.824171:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200045120 00000100:00100000:3.0:1713279306.824183:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98822 00000100:00100000:3.0:1713279306.824186:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+68:8074:x1796503200045120:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.824221:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+69:8074:x1796503200045120:12345-0@lo:1000:osp_up0-1.0 Request processed in 35us (60us total) trans 4295202698 rc 0/0 00000100:00100000:3.0:1713279306.824224:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98822 00000100:00100000:1.0:1713279306.824229:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7eb100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200045120:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1713279306.824232:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31991 rpc_version 31991 00000020:00100000:1.0:1713279306.824238:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1713279306.824240:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012e7e8380 x1796503200045248/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1713279306.824246:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e8380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200045248:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.824258:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.824263:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.824266:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200045248 00000100:00100000:3.0:1713279306.824268:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200045248 00000100:00100000:3.0:1713279306.824276:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98823 00000100:00100000:3.0:1713279306.824278:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+69:8074:x1796503200045248:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.824310:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+70:8074:x1796503200045248:12345-0@lo:1000:osp_up0-1.0 Request processed in 31us (51us total) trans 4295202699 rc 0/0 00000100:00100000:3.0:1713279306.824313:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98823 00000100:00100000:1.0:1713279306.824317:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e8380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200045248:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1713279306.824320:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31992 rpc_version 31992 00000020:00100000:1.0:1713279306.824325:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1713279306.824327:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012e7ead80 x1796503200045376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1713279306.824333:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7ead80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200045376:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.824344:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.824348:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.824352:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200045376 00000100:00100000:3.0:1713279306.824354:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200045376 00000100:00100000:3.0:1713279306.824360:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98824 00000100:00100000:3.0:1713279306.824362:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+70:8074:x1796503200045376:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.824395:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+71:8074:x1796503200045376:12345-0@lo:1000:osp_up0-1.0 Request processed in 31us (50us total) trans 4295202700 rc 0/0 00000100:00100000:3.0:1713279306.824399:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98824 00000100:00100000:1.0:1713279306.824402:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7ead80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200045376:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1713279306.824405:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31993 rpc_version 31993 00000020:00100000:1.0:1713279306.824410:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1713279306.824426:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012e7e8000 x1796503200045504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1713279306.824432:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e8000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200045504:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.824451:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.824457:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.824460:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200045504 00000100:00100000:3.0:1713279306.824462:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200045504 00000100:00100000:3.0:1713279306.824469:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98825 00000100:00100000:3.0:1713279306.824471:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+71:8074:x1796503200045504:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.824482:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.824492:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281233856 00000100:00100000:1.0:1713279306.824494:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281233856 00000100:00100000:0.0:1713279306.824497:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.824504:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281233728 00000100:00100000:0.0:1713279306.824507:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281233728 00000100:00100000:1.0:1713279306.824515:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785223 00000100:00100000:0.0:1713279306.824517:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110496 00000100:00100000:1.0:1713279306.824519:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11855:x1796503281233856:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.824520:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281233728:12345-192.168.203.4@tcp:1:lfs.0 00000100:00100000:3.0:1713279306.824521:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+72:8074:x1796503200045504:12345-0@lo:1000:osp_up0-1.0 Request processed in 48us (68us total) trans 4295202701 rc 0/0 00000100:00100000:3.0:1713279306.824525:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98825 00000100:00100000:1.0:1713279306.824532:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e8000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200045504:0@lo:1000:osp_up0-1.0 00002000:00010000:0.0:1713279306.824536:0:15506:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x1151:0x0] initial LVB size: 0, mtime: 0x661e9143, atime: 0x661e9143, ctime: 0x661e9143, blocks: 0x0 00000004:00080000:1.0:1713279306.824537:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31994 rpc_version 31994 00010000:00010000:0.0:1713279306.824540:0:15506:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda8f0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1151:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1713279306.824543:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1713279306.824545:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713279306.824545:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008c161f80 x1796503200045632/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1713279306.824546:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.824549:0:15506:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda8f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1151:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.824551:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c161f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200045632:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713279306.824554:0:15506:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda8f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1151:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.824563:0:15506:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda8f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1151:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.824564:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.824567:0:15506:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda8f0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1151:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.824569:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.824570:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200045632 00010000:00010000:0.0:1713279306.824571:0:15506:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda8f0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1151:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.824572:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200045632 00010000:00010000:0.0:1713279306.824574:0:15506:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8240 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:0.0:1713279306.824575:0:15506:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda8f0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1151:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.824576:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.824579:0:15506:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda8f0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1151:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.824583:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98826 00010000:00010000:0.0:1713279306.824585:0:15506:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda8f0c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1151:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.824585:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+72:8074:x1796503200045632:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713279306.824589:0:15506:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda8f0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1151:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.824589:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda8f13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x84a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a96 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.824608:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0900/0xfc4b8e114eda8f1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.824611:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281233728:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 90us (113us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.824613:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0900/0xfc4b8e114eda8f1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.824615:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110496 00010000:00010000:1.0:1713279306.824618:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0900/0xfc4b8e114eda8f1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.824619:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+73:8074:x1796503200045632:12345-0@lo:1000:osp_up0-1.0 Request processed in 33us (54us total) trans 4295202702 rc 0/0 00000100:00100000:3.0:1713279306.824623:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98826 00000100:00100000:2.0:1713279306.824638:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c161f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200045632:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1713279306.824644:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31995 rpc_version 31995 00000020:00100000:2.0:1713279306.824652:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.824655:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801313c0a80 x1796503200045760/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000004:00200000:1.0:1713279306.824662:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x84a3:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.824664:0:15485:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:2.0:1713279306.824664:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c0a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200045760:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1713279306.824678:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda8f13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x84a3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a96 expref: 3713 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.824680:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.824685:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0900/0xfc4b8e114eda8f1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a96 expref: 3712 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.824689:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x84a3:0x0].0x0 (ffff880096e84e00) 00010000:00010000:1.0:1713279306.824691:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1713279306.824693:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800926b0900, rc 0) 00000100:00100000:2.0:1713279306.824694:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba280c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.824694:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200045760 00000100:00100000:3.0:1713279306.824696:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200045760 00000100:00100000:3.0:1713279306.824703:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98827 00000100:00100000:3.0:1713279306.824705:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+73:8074:x1796503200045760:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.824709:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11855:x1796503281233856:12345-192.168.203.4@tcp:101:touch.0 Request processed in 190us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.824714:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785223 00000100:00100000:3.0:1713279306.824739:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+74:8074:x1796503200045760:12345-0@lo:1000:osp_up0-1.0 Request processed in 33us (58us total) trans 4295202703 rc 0/0 00000100:00100000:3.0:1713279306.824742:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98827 00000100:00100000:0.0:1713279306.824752:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c0a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200045760:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.824757:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31996 rpc_version 31996 00000020:00100000:0.0:1713279306.824764:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.824766:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880096883b80 x1796503200045888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.824774:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096883b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200045888:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.824787:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.824793:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606c180 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.824793:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200045888 00000100:00100000:3.0:1713279306.824795:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200045888 00000100:00100000:3.0:1713279306.824801:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98828 00000100:00100000:3.0:1713279306.824803:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+74:8074:x1796503200045888:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.824834:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+75:8074:x1796503200045888:12345-0@lo:1000:osp_up0-1.0 Request processed in 30us (46us total) trans 4295202704 rc 0/0 00000100:00100000:3.0:1713279306.824838:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98828 00000100:00100000:0.0:1713279306.824842:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096883b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200045888:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.824845:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31997 rpc_version 31997 00000020:00100000:0.0:1713279306.824851:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.824853:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880096880000 x1796503200046016/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.824859:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096880000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046016:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.824870:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.824875:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237273c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.824875:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200046016 00000100:00100000:3.0:1713279306.824877:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200046016 00000100:00100000:3.0:1713279306.824883:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98829 00000100:00100000:3.0:1713279306.824885:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+75:8074:x1796503200046016:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.824925:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+76:8074:x1796503200046016:12345-0@lo:1000:osp_up0-1.0 Request processed in 39us (54us total) trans 4295202705 rc 0/0 00000100:00100000:3.0:1713279306.824929:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98829 00000100:00100000:0.0:1713279306.824933:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096880000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046016:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.824936:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31998 rpc_version 31998 00000020:00100000:0.0:1713279306.824941:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.824944:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880096883100 x1796503200046144/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.824949:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096883100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046144:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.824969:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.824975:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606c180 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.824975:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200046144 00000100:00100000:3.0:1713279306.824977:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200046144 00000100:00100000:3.0:1713279306.824984:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98830 00000100:00100000:3.0:1713279306.824986:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+76:8074:x1796503200046144:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.825017:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+77:8074:x1796503200046144:12345-0@lo:1000:osp_up0-1.0 Request processed in 30us (47us total) trans 4295202706 rc 0/0 00000100:00100000:3.0:1713279306.825023:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98830 00000100:00100000:0.0:1713279306.825025:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096883100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046144:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.825029:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 31999 rpc_version 31999 00000020:00100000:0.0:1713279306.825034:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.825036:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880096881c00 x1796503200046272/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.825042:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096881c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046272:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.825053:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.825058:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237273c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.825058:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200046272 00000100:00100000:3.0:1713279306.825060:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200046272 00000100:00100000:3.0:1713279306.825077:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98831 00000100:00100000:3.0:1713279306.825080:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+77:8074:x1796503200046272:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.825114:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+78:8074:x1796503200046272:12345-0@lo:1000:osp_up0-1.0 Request processed in 33us (60us total) trans 4295202707 rc 0/0 00000100:00100000:3.0:1713279306.825117:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98831 00000100:00100000:0.0:1713279306.825122:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096881c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046272:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.825125:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32000 rpc_version 32000 00000020:00100000:0.0:1713279306.825130:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.825132:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880096880a80 x1796503200046400/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.825138:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096880a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046400:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.825150:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.825155:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606c180 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.825156:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200046400 00000100:00100000:3.0:1713279306.825158:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200046400 00000100:00100000:3.0:1713279306.825164:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98832 00000100:00100000:3.0:1713279306.825166:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+78:8074:x1796503200046400:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.825196:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+79:8074:x1796503200046400:12345-0@lo:1000:osp_up0-1.0 Request processed in 29us (45us total) trans 4295202708 rc 0/0 00000100:00100000:3.0:1713279306.825200:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98832 00000100:00100000:0.0:1713279306.825203:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096880a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046400:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.825207:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32001 rpc_version 32001 00000020:00100000:0.0:1713279306.825212:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.825214:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880096882300 x1796503200046528/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.825219:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096882300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046528:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.825230:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.825235:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237273c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.825237:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200046528 00000100:00100000:3.0:1713279306.825240:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200046528 00000100:00100000:3.0:1713279306.825250:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98833 00000100:00100000:3.0:1713279306.825253:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+79:8074:x1796503200046528:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.825315:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+80:8074:x1796503200046528:12345-0@lo:1000:osp_up0-1.0 Request processed in 59us (81us total) trans 4295202709 rc 0/0 00000100:00100000:3.0:1713279306.825320:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98833 00000100:00100000:1.0:1713279306.825376:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.825408:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.825458:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096882300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046528:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.825462:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32002 rpc_version 32002 00000020:00100000:0.0:1713279306.825469:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.825471:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880121402d80 x1796503200046656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.825491:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281233920 00000100:00100000:3.0:1713279306.825494:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281233920 00000100:00100000:3.0:1713279306.825503:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281234048 00000100:00100000:3.0:1713279306.825504:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281234048 00000100:00100000:3.0:1713279306.825513:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785224 00000100:00100000:3.0:1713279306.825516:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3360:11204:x1796503281233920:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.825522:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.825523:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785225 00000100:00100000:1.0:1713279306.825525:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.825528:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda8f21 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a8f expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.825529:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3725:11876:x1796503281234048:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.825536:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.825543:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda8f28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x84a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175a9d expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.825545:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121402d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046656:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.825562:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.825566:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.825567:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda8f2f lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.825571:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606c180 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.825573:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda8f2f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825577:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda8f2f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.825578:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200046656 00000100:00100000:0.0:1713279306.825580:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200046656 00000100:00100000:1.0:1713279306.825581:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.825583:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8f36 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.825587:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8f36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.825590:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98834 00010000:00010000:3.0:1713279306.825590:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8f36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.825593:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+80:8074:x1796503200046656:12345-0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1713279306.825599:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00000100:00100000:2.0:1713279306.825601:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281234176 00000100:00100000:2.0:1713279306.825604:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281234176 00010000:00010000:3.0:1713279306.825604:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda8f2f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825606:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda8f2f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.825607:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.825610:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda8f2f lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825615:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda8f2f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825618:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092541b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.825619:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda8f2f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825622:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda8f2f lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.825623:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281234432 00000100:00100000:2.0:1713279306.825624:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281234432 00010000:00010000:3.0:1713279306.825627:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:3.0:1713279306.825628:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.825630:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda8f2f lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825633:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda8f2f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.825635:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223063 00000100:00100000:0.0:1713279306.825638:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+81:8074:x1796503200046656:12345-0@lo:1000:osp_up0-1.0 Request processed in 43us (71us total) trans 4295202710 rc 0/0 00010000:00010000:3.0:1713279306.825638:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8f36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.825640:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223064 00000100:00100000:1.0:1713279306.825641:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3641:11906:x1796503281234176:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:3.0:1713279306.825641:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8f36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.825642:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98834 00000100:00100000:2.0:1713279306.825643:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130147050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3727:11736:x1796503281234432:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:3.0:1713279306.825643:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8f36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825646:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092542880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.825647:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8f36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825650:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8f36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825656:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff8801250c1300) 00000100:00100000:0.0:1713279306.825657:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121402d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046656:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.825657:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.825659:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8f36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000004:00080000:0.0:1713279306.825661:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32003 rpc_version 32003 00010000:00010000:3.0:1713279306.825661:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda8f36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000020:00100000:0.0:1713279306.825667:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.825669:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880121401880 x1796503200046784/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1713279306.825671:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130147050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3727:11736:x1796503281234432:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 27us (64us total) trans 0 rc -116/-116 00010000:00010000:3.0:1713279306.825675:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda8f21 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a8f expref: 3361 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.825676:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121401880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046784:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1713279306.825676:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223064 00010000:00010000:3.0:1713279306.825680:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda8f21 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a8f expref: 3361 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.825684:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092540240, rc 0) 00000100:00100000:0.0:1713279306.825688:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.825695:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098cc5780 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.825700:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200046784 00000100:00100000:3.0:1713279306.825700:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3360:11204:x1796503281233920:12345-192.168.203.4@tcp:101:touch.0 Request processed in 182us (327us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.825702:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200046784 00000100:00100000:3.0:1713279306.825704:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785224 00000100:00100000:0.0:1713279306.825711:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98835 00000100:00100000:3.0:1713279306.825711:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281234304 00000100:00100000:3.0:1713279306.825712:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281234304 00000100:00100000:0.0:1713279306.825713:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+81:8074:x1796503200046784:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.825717:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3643:11906:x1796503281234176:12345-192.168.203.4@tcp:35:touch.0 Request processed in 76us (135us total) trans 4295183716 rc 0/0 00000100:00100000:3.0:1713279306.825720:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281234624 00000100:00100000:3.0:1713279306.825721:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281234624 00000100:00100000:1.0:1713279306.825724:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223063 00000100:00100000:3.0:1713279306.825729:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785226 00000100:00100000:3.0:1713279306.825731:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3643:11912:x1796503281234304:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.825736:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.825741:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda8f3d lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175aa4 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.825749:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+82:8074:x1796503200046784:12345-0@lo:1000:osp_up0-1.0 Request processed in 35us (60us total) trans 4295202711 rc 0/0 00000004:00200000:2.0:1713279306.825750:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x84a3:0x0]: returning size 4096 00000100:00100000:0.0:1713279306.825753:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98835 00000100:00100000:1.0:1713279306.825756:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785227 00000100:00100000:1.0:1713279306.825760:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3644:11711:x1796503281234624:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.825762:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda8f4b lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.825767:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.825767:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda8f4b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.825768:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121401880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046784:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.825770:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda8f4b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00080000:0.0:1713279306.825771:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32004 rpc_version 32004 00010000:00010000:3.0:1713279306.825775:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8f59 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000020:00100000:0.0:1713279306.825777:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1713279306.825777:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094fe5b00/0xfc4b8e114eda8f52 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175aab expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.825779:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880121401180 x1796503200046912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1713279306.825779:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8f59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.825781:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda8f28 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x84a3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a9d expref: 3727 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.825782:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8f59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.825785:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121401180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046912:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1713279306.825787:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda8f28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x84a3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a9d expref: 3727 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.825791:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda8f4b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.825792:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2d7a80, rc 0) 00010000:00010000:3.0:1713279306.825794:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda8f4b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825797:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda8f4b lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825800:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda8f4b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825803:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092541440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.825804:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda8f4b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.825806:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.825806:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8f60 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.825806:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3726:11876:x1796503281234048:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 278us (399us total) trans 4295202712 rc 301/301 00000100:00100000:2.0:1713279306.825810:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785225 00010000:00010000:3.0:1713279306.825810:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda8f4b lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.825811:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120671a80 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.825813:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8f60 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.825813:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff8801250c1100) 00010000:00010000:3.0:1713279306.825815:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.825816:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda8f4b lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.825817:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200046912 00000100:00100000:0.0:1713279306.825818:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200046912 00010000:00010000:3.0:1713279306.825819:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda8f4b lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.825820:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8f60 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.825823:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8f59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825826:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8f59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.825828:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98836 00010000:00010000:1.0:1713279306.825828:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda8f67 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.825828:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8f59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.825830:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+82:8074:x1796503200046912:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.825831:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800958d5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.825832:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8f59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.825833:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda8f67 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.825835:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8f59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.825838:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda8f67 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.825838:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff8801250c1000) 00010000:00010000:3.0:1713279306.825839:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.825841:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8f59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825844:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda8f59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.825854:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda8f3d lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175aa4 expref: 3645 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.825855:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8f60 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.825859:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114eda8f3d lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175aa4 expref: 3645 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.825860:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8f60 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.825864:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092540900, rc 0) 00010000:00010000:1.0:1713279306.825865:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8f60 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00000100:00100000:0.0:1713279306.825866:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+83:8074:x1796503200046912:12345-0@lo:1000:osp_up0-1.0 Request processed in 35us (60us total) trans 4295202713 rc 0/0 00000100:00100000:0.0:1713279306.825870:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98836 00010000:00010000:1.0:1713279306.825870:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8f60 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.825874:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.825877:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8f60 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.825879:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3644:11912:x1796503281234304:12345-192.168.203.4@tcp:101:touch.0 Request processed in 146us (355us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.825881:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8f60 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.825882:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785226 00000100:00100000:0.0:1713279306.825885:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121401180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200046912:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1713279306.825887:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88009bf9a000) 00000004:00080000:0.0:1713279306.825889:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32005 rpc_version 32005 00010000:00010000:1.0:1713279306.825890:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.825892:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8f60 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00000020:00100000:0.0:1713279306.825894:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.825896:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880121403800 x1796503200047040/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1713279306.825897:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda8f60 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00000100:00100000:0.0:1713279306.825903:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121403800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200047040:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1713279306.825905:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda8f67 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.825910:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda8f67 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00000100:00100000:0.0:1713279306.825914:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.825914:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda8f67 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00000100:00100000:0.0:1713279306.825918:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120671a80 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.825918:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076d200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.825920:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda8f67 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.825924:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda8f67 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00000100:00100000:2.0:1713279306.825924:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200047040 00000100:00100000:2.0:1713279306.825926:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200047040 00010000:00010000:1.0:1713279306.825929:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88008d729700) 00010000:00010000:1.0:1713279306.825931:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.825933:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda8f67 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.825938:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda8f67 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00000100:00100000:2.0:1713279306.825941:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98837 00000100:00100000:2.0:1713279306.825944:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+83:8074:x1796503200047040:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1713279306.825953:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880094fe5b00/0xfc4b8e114eda8f52 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175aab expref: 3643 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.825960:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094fe5b00/0xfc4b8e114eda8f52 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175aab expref: 3643 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.825968:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fe5b00, rc 0) 00000100:00100000:1.0:1713279306.825990:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3642:11711:x1796503281234624:12345-192.168.203.4@tcp:101:touch.0 Request processed in 229us (428us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.825996:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785227 00000100:00100000:2.0:1713279306.825997:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+84:8074:x1796503200047040:12345-0@lo:1000:osp_up0-1.0 Request processed in 52us (82us total) trans 4295202714 rc 0/0 00000100:00100000:2.0:1713279306.826002:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98837 00000100:00100000:0.0:1713279306.826004:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121403800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200047040:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.826007:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32006 rpc_version 32006 00000020:00100000:0.0:1713279306.826012:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.826015:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880121400a80 x1796503200047168/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.826020:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121400a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200047168:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.826033:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.826038:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120671a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.826042:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200047168 00000100:00100000:2.0:1713279306.826044:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200047168 00000100:00100000:2.0:1713279306.826052:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98838 00000100:00100000:2.0:1713279306.826054:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac44ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+84:8074:x1796503200047168:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.826059:0:15526:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001_UUID:15526:1796503200043840:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.826063:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.826079:0:15526:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 3/0,1 mode: --/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00000100:00100000:2.0:1713279306.826104:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac44ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+85:8074:x1796503200047168:12345-0@lo:1000:osp_up0-1.0 Request processed in 49us (70us total) trans 4295202715 rc 0/0 00000100:00100000:2.0:1713279306.826108:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98838 00000100:00100000:0.0:1713279306.826113:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121400a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200047168:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.826116:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32007 rpc_version 32007 00000020:00100000:0.0:1713279306.826121:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.826123:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880121403b80 x1796503200047296/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.826129:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121403b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200047296:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.826170:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.826181:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120671a80 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.826206:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200047296 00000100:00100000:1.0:1713279306.826209:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200047296 00000100:00100000:2.0:1713279306.826223:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98839 00000100:00100000:2.0:1713279306.826226:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+85:8074:x1796503200047296:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1713279306.826258:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+86:8074:x1796503200047296:12345-0@lo:1000:osp_up0-1.0 Request processed in 31us (87us total) trans 4295202716 rc 0/0 00000100:00100000:2.0:1713279306.826262:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98839 00000100:00100000:0.0:1713279306.826266:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121403b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200047296:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.826270:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32008 rpc_version 32008 00000100:00100000:2.0:1713279306.826271:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281234496 00000100:00100000:2.0:1713279306.826273:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281234496 00000020:00100000:0.0:1713279306.826275:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.826277:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880121400700 x1796503200047424/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:2.0:1713279306.826280:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda7ac9 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175517 expref: 3360 pid: 15483 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.826283:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121400700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200047424:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.826294:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.826297:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196539 00000100:00100000:2.0:1713279306.826300:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3360:1956:x1796503281234496:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.826304:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.826307:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda7ac9 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175517 expref: 3360 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.826312:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda7ac9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175517 expref: 3360 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.826323:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda7ac9 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175517 expref: 3360 pid: 15483 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.826329:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76b7:0x0].0x0 (ffff88012d067100) 00010000:00010000:2.0:1713279306.826331:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 3/0,1 mode: --/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.826335:0:15492:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.826338:0:15492:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.826345:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.826350:0:15526:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.826354:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00000100:00100000:0.0:1713279306.826357:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120671a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.826361:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3359:1956:x1796503281234496:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 59us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.826364:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196539 00000100:00100000:2.0:1713279306.826372:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200047424 00000100:00100000:2.0:1713279306.826373:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200047424 00000100:00100000:2.0:1713279306.826381:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98840 00000100:00100000:2.0:1713279306.826383:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+86:8074:x1796503200047424:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.826407:0:15526:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.826410:0:15526:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00000100:00100000:1.0:1713279306.826433:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.826433:0:15526:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00000100:00100000:2.0:1713279306.826435:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+87:8074:x1796503200047424:12345-0@lo:1000:osp_up0-1.0 Request processed in 51us (140us total) trans 4295202717 rc 0/0 00010000:00010000:3.0:1713279306.826437:0:15526:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d2d58c0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.826439:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98840 00010000:00010000:3.0:1713279306.826439:0:15526:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.826442:0:15526:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT1 00000100:00100000:0.0:1713279306.826446:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121400700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200047424:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.826447:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76b7:0x0].0x0 (ffff88012d067100) 00010000:00010000:3.0:1713279306.826448:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000004:00080000:0.0:1713279306.826449:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32009 rpc_version 32009 00010000:00010000:3.0:1713279306.826450:0:15526:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 2/0,0 mode: --/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.826453:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda8edb lrc: 0/0,0 mode: --/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00000020:00100000:0.0:1713279306.826455:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.826457:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880121401c00 x1796503200047552/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1713279306.826460:0:15526:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda8ec6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.826463:0:15526:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda8ec6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00000100:00100000:0.0:1713279306.826464:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121401c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200047552:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.826466:0:15526:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda8ec6 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.826469:0:15526:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda8ec6 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.826471:0:15526:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68aac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.826472:0:15526:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda8ec6 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.826475:0:15526:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda8ec6 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT1 00000100:00100000:0.0:1713279306.826478:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.826478:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281235136 00010000:00010000:3.0:1713279306.826478:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:3.0:1713279306.826479:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.826481:0:15526:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda8ec6 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00000100:00100000:1.0:1713279306.826482:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281235136 00010000:00010000:3.0:1713279306.826484:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114eda8ec6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.826488:0:15526:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8ed4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.826490:0:15526:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8ed4 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.826493:0:15526:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8ed4 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00000100:00100000:0.0:1713279306.826495:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120671a80 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.826495:0:15526:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.826496:0:15526:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8ed4 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.826499:0:15526:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8ed4 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT1 00000100:00100000:1.0:1713279306.826500:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785228 00010000:00010000:3.0:1713279306.826502:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff88008da65300) 00010000:00010000:3.0:1713279306.826503:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.826504:0:15526:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8ed4 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00000100:00100000:1.0:1713279306.826505:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3726:11736:x1796503281235136:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.826507:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114eda8ed4 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00000100:00100000:2.0:1713279306.826509:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200047552 00000100:00100000:2.0:1713279306.826511:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200047552 00010000:00010000:1.0:1713279306.826512:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.826513:0:15526:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.826517:0:15526:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.826520:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98841 00010000:00010000:1.0:1713279306.826521:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda8f6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7f30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ab9 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.826522:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+87:8074:x1796503200047552:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.826524:0:15526:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.826531:0:15526:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000004:00020000:3.0:1713279306.826532:0:15526:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0001: migrate [0x240000402:0x1:0x0]/0 failed: rc = -16 00000100:00100000:3.0:1713279306.826555:0:15526:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_010:385c4b71-808c-40cf-91de-b076b668d13f+3641:11879:x1796503281212608:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 49228us (49266us total) trans 0 rc -16/-16 00000100:00100000:3.0:1713279306.826559:0:15526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14340 00010000:00010000:1.0:1713279306.826560:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114eda8f75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7f30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.826567:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+88:8074:x1796503200047552:12345-0@lo:1000:osp_up0-1.0 Request processed in 44us (88us total) trans 4295202718 rc 0/0 00010000:00010000:1.0:1713279306.826568:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114eda8f75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.826571:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98841 00000100:00100000:0.0:1713279306.826572:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121401c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200047552:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1713279306.826574:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114eda8f75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.826578:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00200000:1.0:1713279306.826581:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7f30:0x0]: returning size 0 00010000:00010000:3.0:1713279306.826581:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.826585:0:9214:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342ac0 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.826587:0:9214:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.826591:0:9214:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.826601:0:9214:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.826605:0:9214:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713279306.826618:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114eda8f6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7f30:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab9 expref: 3729 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.826622:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.826626:0:9214:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092342ac0/0xfc4b8e114eda83cf lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda83eb expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.826628:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114eda8f75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab9 expref: 3728 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.826634:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f30:0x0].0x0 (ffff88008f43ef00) 00010000:00010000:3.0:1713279306.826635:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.826636:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1713279306.826636:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.826637:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.826638:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce52640, rc 0) 00000100:00100000:2.0:1713279306.826638:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713279306.826643:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200047616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.826659:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.826661:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3728:11736:x1796503281235136:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 155us (228us total) trans 4295202719 rc 0/0 00000100:00100000:1.0:1713279306.826667:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785228 00000100:00100000:2.0:1713279306.826668:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281234688 00000100:00100000:2.0:1713279306.826670:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281234688 00000100:00100000:3.0:1713279306.826673:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.826680:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200047616 00000100:00100000:2.0:1713279306.826681:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200047616 00010000:00010000:2.0:1713279306.826686:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda83eb lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda83cf expref: 88 pid: 15542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.826689:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147257 00000100:00100000:3.0:1713279306.826692:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+3641:1956:x1796503281234688:12345-192.168.203.4@tcp:103:lfs.0 00000100:00100000:2.0:1713279306.826695:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196540 00000100:00100000:2.0:1713279306.826697:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+88:3490:x1796503200047616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.826697:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.826701:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.826704:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda83eb lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda83cf expref: 88 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.826704:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114eda874f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7d86:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917585f expref: 3641 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.826709:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d86:0x0].0x0 (ffff880090a56500) 00010000:00010000:2.0:1713279306.826711:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda83eb lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda83cf expref: 88 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.826712:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.826715:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.826718:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:2.0:1713279306.826720:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.826724:0:15492:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.826724:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+3640:1956:x1796503281234688:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 32us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.826726:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281234752 00010000:00010000:2.0:1713279306.826727:0:15492:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.826728:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281234752 00000100:00100000:3.0:1713279306.826728:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147257 00010000:00010000:2.0:1713279306.826732:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda89ef lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda89e8 expref: 87 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.826739:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.826742:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147258 00000100:00100000:0.0:1713279306.826745:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3728:1957:x1796503281234752:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:0.0:1713279306.826749:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.826751:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.826753:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+87:3490:x1796503200047616:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (80us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.826754:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.826756:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c240/0xfc4b8e114eda8684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x148:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175827 expref: 3728 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.826756:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196540 00010000:00010000:0.0:1713279306.826763:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x0 (ffff880091b34100) 00010000:00010000:0.0:1713279306.826766:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.826774:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.826778:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3727:1957:x1796503281234752:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 33us (64us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.826782:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147258 00000100:00100000:2.0:1713279306.826785:0:15526:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281234880 00000100:00100000:2.0:1713279306.826787:0:15526:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281234880 00000100:00100000:2.0:1713279306.826797:0:15526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14344 00000100:00100000:2.0:1713279306.826800:0:15526:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_010:385c4b71-808c-40cf-91de-b076b668d13f+3727:11854:x1796503281234880:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1713279306.826808:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda8f83 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.826811:0:15526:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.826812:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda8f83 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.826816:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda8f83 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.826818:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda847e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x14f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757a2 expref: 3727 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.826824:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x0 (ffff88012514d900) 00010000:00010000:3.0:1713279306.826824:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8f8a lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.826827:0:15526:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.826827:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8f8a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.826830:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8f8a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.826832:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00010000:00010000:3.0:1713279306.826834:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8f98 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x231:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.826837:0:15526:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda8e1e lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8ded expref: 86 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.826837:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8f98 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.826840:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8f98 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.826841:0:15526:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT0 00010000:00010000:3.0:1713279306.826844:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8f9f lrc: 3/0,1 mode: --/PW res: [0x200000400:0x231:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.826847:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8f9f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.826851:0:15526:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda8e1e lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8ded expref: 86 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.826851:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8f9f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.826858:0:15526:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00010000:00010000:3.0:1713279306.826864:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x862e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.826870:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda879c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x862e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175874 expref: 3711 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.826873:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.826881:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.826885:0:6942:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda879c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x862e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175874 expref: 3711 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.826891:0:6942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda879c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x862e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175874 expref: 3711 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.826892:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281234944 00000100:00100000:0.0:1713279306.826893:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.826894:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281234944 00000100:00100000:3.0:1713279306.826897:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200047744:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.826903:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223065 00000100:00100000:2.0:1713279306.826906:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11945:x1796503281234944:12345-192.168.203.4@tcp:33:lfs.0 00000100:00100000:0.0:1713279306.826907:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.826915:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0840 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.826919:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281235008 00000100:00100000:1.0:1713279306.826923:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281235008 00000100:00100000:3.0:1713279306.826930:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200047616:0@lo:103:ldlm_bl.0 00000004:00200000:2.0:1713279306.826940:0:15478:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7f51:0x0]: returning size 4096 00000004:00200000:2.0:1713279306.826942:0:15478:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1713279306.826944:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281235200 00000100:00100000:1.0:1713279306.826947:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281235200 00000100:00100000:0.0:1713279306.826948:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785229 00000100:00100000:0.0:1713279306.826952:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11855:x1796503281235008:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.826957:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785230 00000100:00100000:1.0:1713279306.826962:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3727:11876:x1796503281235200:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:2.0:1713279306.826962:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11945:x1796503281234944:12345-192.168.203.4@tcp:33:lfs.0 Request processed in 55us (80us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.826966:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223065 00010000:00010000:1.0:1713279306.826969:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.826976:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce51680/0xfc4b8e114eda8fad lrc: 2/0,0 mode: --/CR res: [0x200000400:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ac0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.826996:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda8fb4 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.827003:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda8fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.827010:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda8fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.827022:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:1.0:1713279306.827026:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x24c:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.827028:0:15749:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:0.0:1713279306.827029:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baba80/0xfc4b8e114eda8fbb lrc: 2/0,0 mode: --/CR res: [0x200000400:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ab2 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827044:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce51680/0xfc4b8e114eda8fad lrc: 0/0,0 mode: --/CR res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ac0 expref: 3729 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.827046:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda8fc2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.827051:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda8fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713279306.827055:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda8fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.827058:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda8fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ac0 expref: 3728 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827064:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x0 (ffff880096e84a00) 00010000:00010000:1.0:1713279306.827066:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00000004:00200000:0.0:1713279306.827080:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x24c:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.827082:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:1.0:1713279306.827083:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce533c0, rc 0) 00010000:00010000:0.0:1713279306.827093:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baba80/0xfc4b8e114eda8fbb lrc: 0/0,0 mode: --/CR res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab2 expref: 3714 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.827099:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda8fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab2 expref: 3713 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.827103:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x0 (ffff880096e84a00) 00000100:00100000:1.0:1713279306.827103:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3728:11876:x1796503281235200:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 139us (195us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.827105:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713279306.827107:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba9f80, rc 0) 00000100:00100000:1.0:1713279306.827108:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785230 00000100:00100000:0.0:1713279306.827120:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11855:x1796503281235008:12345-192.168.203.4@tcp:101:touch.0 Request processed in 168us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.827124:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785229 00000100:00100000:0.0:1713279306.827146:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.827174:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281235328 00000100:00100000:0.0:1713279306.827177:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.827177:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281235328 00000100:00100000:2.0:1713279306.827186:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281235456 00000100:00100000:2.0:1713279306.827187:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281235456 00000100:00100000:1.0:1713279306.827193:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785231 00000100:00100000:1.0:1713279306.827199:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11204:x1796503281235328:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.827199:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785232 00000100:00100000:2.0:1713279306.827202:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3728:11711:x1796503281235456:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.827206:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.827207:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.827213:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda8fd0 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ace expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827214:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda8fc9 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ac7 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827240:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda8fd7 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.827246:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda8fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827246:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8fde lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.827251:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8fde lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.827252:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda8fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827257:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8fde lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.827260:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8fe5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827263:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8fec lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.827266:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827267:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8fec lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.827270:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8fec lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.827272:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000004:00200000:2.0:1713279306.827278:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:2.0:1713279306.827282:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8fde lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.827285:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8fde lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.827287:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda8fd7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827288:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8fde lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.827291:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8fde lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.827292:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda8fd7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827294:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ed8c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.827296:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda8fd7 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827296:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8fde lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.827298:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8fde lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713279306.827299:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.827301:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda8fd7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827302:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88008da65700) 00010000:00010000:2.0:1713279306.827304:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.827305:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8dd40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.827306:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8fde lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.827307:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda8fd7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:3.0:1713279306.827308:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281235648 00010000:00010000:2.0:1713279306.827309:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ed8c0/0xfc4b8e114eda8fde lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.827312:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda8fd7 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00000100:00100000:3.0:1713279306.827312:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281235648 00010000:00010000:2.0:1713279306.827314:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8fec lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.827317:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8fec lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.827318:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:2.0:1713279306.827320:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8fec lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.827321:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.827322:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ecd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.827323:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda8fd7 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827324:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8fec lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.827324:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785233 00010000:00010000:2.0:1713279306.827326:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8fec lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.827327:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:11950:x1796503281235648:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.827328:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114eda8fd7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827329:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880090371e00) 00010000:00010000:2.0:1713279306.827331:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.827332:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8fec lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.827332:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.827335:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827335:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecd80/0xfc4b8e114eda8fec lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.827338:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda8ff3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ad5 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827339:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8fe5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.827344:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827347:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda8fd0 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ace expref: 3729 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827348:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8cb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.827351:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827351:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec900/0xfc4b8e114eda8fd0 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ace expref: 3729 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827356:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8fe5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827359:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ec900, rc 0) 00010000:00010000:1.0:1713279306.827361:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff88012cfc6500) 00010000:00010000:1.0:1713279306.827363:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.827365:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8fe5 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.827369:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133317840/0xfc4b8e114eda8ffa lrc: 3/0,1 mode: --/CW res: [0x200000403:0x8439:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.827370:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114eda8fe5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.827374:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3728:11711:x1796503281235456:12345-192.168.203.4@tcp:101:touch.0 Request processed in 171us (197us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.827376:0:15752:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114eda83a5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917576a expref: 3716 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.827378:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785232 00010000:00010000:3.0:1713279306.827380:0:15752:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114eda8606 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175804 expref: 3728 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.827384:0:15752:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133317840/0xfc4b8e114eda8ffa lrc: 5/0,1 mode: --/CW res: [0x200000403:0x8439:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.827388:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda8fc9 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ac7 expref: 3716 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.827393:0:15752:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114eda8606 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175804 expref: 3727 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827395:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda8fc9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ac7 expref: 3716 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.827399:0:15752:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114eda8606 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175804 expref: 3727 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.827402:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f3f3c0, rc 0) 00000100:00100000:3.0:1713279306.827404:0:15752:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000_UUID:15752:1796503200047808:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.827438:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:11204:x1796503281235328:12345-192.168.203.4@tcp:101:touch.0 Request processed in 239us (290us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.827443:0:15752:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114eda83a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917576a expref: 3715 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.827444:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785231 00010000:00010000:3.0:1713279306.827448:0:15752:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114eda83a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917576a expref: 3715 pid: 15473 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.827452:0:15752:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000_UUID:15752:1796503200047872:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.827457:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.827461:0:15752:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.827474:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.827483:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281235520 00000100:00100000:1.0:1713279306.827486:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281235520 00000100:00100000:1.0:1713279306.827500:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281235712 00000100:00100000:1.0:1713279306.827502:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281235712 00000100:00100000:2.0:1713279306.827503:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110497 00000100:00100000:2.0:1713279306.827507:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+85:1956:x1796503281235520:12345-192.168.203.4@tcp:16:kworker.0 00000100:00100000:3.0:1713279306.827510:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110498 00000100:00100000:3.0:1713279306.827513:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+85:1956:x1796503281235712:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:3.0:1713279306.827526:0:15783:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880133315b00/0xfc4b8e114eda9001 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1110:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.827533:0:15783:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009681cfc0/0xfc4b8e114ed9dfe9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1110:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a4c expref: 85 pid: 15538 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713279306.827537:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+85:1956:x1796503281235520:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 29us (80us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.827539:0:15783:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f0873c0/0xfc4b8e114ed9e855 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1110:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d08 expref: 83 pid: 15504 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713279306.827540:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110497 00010000:00010000:3.0:1713279306.827546:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.827547:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.827548:0:15783:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133315b00/0xfc4b8e114eda9001 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1110:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.827557:0:15783:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f0873c0/0xfc4b8e114ed9e855 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1110:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d08 expref: 83 pid: 15504 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713279306.827562:0:15783:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f0873c0/0xfc4b8e114ed9e855 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1110:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d08 expref: 83 pid: 15504 timeout: 509 lvb_type: 1 00000100:00100000:3.0:1713279306.827568:0:15783:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0000_UUID:15783:1796503200047936:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.827584:0:15783:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009681cfc0/0xfc4b8e114ed9dfe9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1110:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a4c expref: 84 pid: 15538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713279306.827589:0:15783:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009681cfc0/0xfc4b8e114ed9dfe9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1110:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a4c expref: 84 pid: 15538 timeout: 509 lvb_type: 1 00000100:00100000:3.0:1713279306.827594:0:15783:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0000_UUID:15783:1796503200048000:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.827599:0:15783:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0a80 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.827611:0:6942:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff88007fd8dc00 x1796503200047744) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda879c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x862e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175874 expref: 3714 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.827617:0:6942:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda879c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x862e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175874 expref: 3714 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.827625:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ef40/0xfc4b8e114eda879c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x862e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175874 expref: 3714 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.827630:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200047744:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.827637:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x862e:0x0].0x0 (ffff88009213a500) 00010000:00010000:3.0:1713279306.827640:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827643:0:6942:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827646:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827651:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827655:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827657:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.827739:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00010000:3.0:1713279306.827752:0:6942:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091bea300 reply state ffff8801234f0000 transno 4295202720 ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827758:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827761:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x862e:0x0].0x0 (ffff88009213a500) 00010000:00010000:3.0:1713279306.827762:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1713279306.827764:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281235840 00000100:00100000:3.0:1713279306.827764:0:6942:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713279306.827766:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281235840 00010000:00010000:3.0:1713279306.827766:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8f98 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827770:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8f98 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.827773:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.827773:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8f98 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827776:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8f98 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827778:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205440 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.827780:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281235968 00010000:00010000:3.0:1713279306.827780:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8f98 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.827781:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281235968 00010000:00010000:3.0:1713279306.827783:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8f98 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827786:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x0 (ffff8801250c1a00) 00010000:00010000:3.0:1713279306.827787:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.827788:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785234 00010000:00010000:3.0:1713279306.827788:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8f98 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.827791:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:11965:x1796503281235840:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.827791:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114eda8f98 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.827796:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:3.0:1713279306.827797:0:6942:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091bea300 reply state ffff8801234f0000 transno 4295202720 ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8f9f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827800:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8f9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.827801:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda9008 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175adc expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.827804:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x3931 (ffff8801250c1d00) 00010000:00010000:3.0:1713279306.827806:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.827807:0:6942:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1713279306.827810:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785235 00010000:00010000:3.0:1713279306.827810:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda8f83 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00000100:00100000:1.0:1713279306.827815:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3640:11912:x1796503281235968:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.827815:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda8f83 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827819:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda8f83 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827824:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda8f83 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.827826:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.827828:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122206400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.827829:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda900f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.827830:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda8f83 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.827833:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda9016 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ae3 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.827834:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda900f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.827834:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda8f83 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.827838:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda900f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.827840:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x0 (ffff8801250c1c00) 00000004:00200000:2.0:1713279306.827842:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7ff8:0x0]: returning size 13836 00010000:00010000:3.0:1713279306.827842:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.827844:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda8f83 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.827849:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda8f83 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00000004:00010000:3.0:1713279306.827858:0:6942:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091bea300 reply state ffff8801234f0000 transno 4295202720 ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8f8a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.827865:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114eda9024 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.827865:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8f8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.827869:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee880/0xfc4b8e114eda9008 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175adc expref: 3718 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827870:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114eda9024 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.827874:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114eda9024 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.827874:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x3931 (ffff8801250c1b00) 00010000:00010000:2.0:1713279306.827876:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963e0240/0xfc4b8e114eda900f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7ff8:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175adc expref: 3717 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.827876:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.827877:0:6942:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:1.0:1713279306.827879:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda902b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.827880:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ff8:0x0].0x0 (ffff880089dc3f00) 00010000:00010000:2.0:1713279306.827881:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1713279306.827882:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda902b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.827882:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.827883:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800963e0240, rc 0) 00010000:00010000:1.0:1713279306.827886:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda902b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.827887:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6942 initiator: MDT0 00000004:00200000:1.0:1713279306.827892:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:3.0:1713279306.827892:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.827897:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:11965:x1796503281235840:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 105us (158us total) trans 4295202721 rc 0/0 00010000:00010000:3.0:1713279306.827897:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.827898:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114eda9024 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.827899:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.827900:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785234 00010000:00010000:1.0:1713279306.827901:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114eda9024 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.827904:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114eda9024 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.827904:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.827907:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114eda9024 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.827910:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.827910:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.827912:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114eda9024 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.827912:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.827915:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114eda9024 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.827915:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda89ef lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda89e8 expref: 86 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827918:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88012cfc6800) 00010000:00010000:1.0:1713279306.827919:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.827920:0:6942:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda89ef lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda89e8 expref: 86 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827921:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114eda9024 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.827923:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114eda9024 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.827924:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda89ef lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda89e8 expref: 86 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827928:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda902b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.827928:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda8e1e lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8ded expref: 86 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827931:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda902b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.827934:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda902b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.827936:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.827937:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda902b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.827940:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda902b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.827942:0:6942:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda89ef lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda89e8 expref: 86 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827946:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88012cfc6c00) 00010000:00010000:1.0:1713279306.827947:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.827948:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda902b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.827948:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200048064:0@lo:105: 00010000:00010000:1.0:1713279306.827951:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114eda902b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.827963:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda9016 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ae3 expref: 3641 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.827963:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.827967:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda9016 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ae3 expref: 3641 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.827972:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801245b6400, rc 0) 00000100:00100000:3.0:1713279306.827972:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.827975:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200048064 00000100:00100000:2.0:1713279306.827977:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200048064 00000100:00100000:2.0:1713279306.827985:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33439 00000100:00100000:1.0:1713279306.827988:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3640:11912:x1796503281235968:12345-192.168.203.4@tcp:101:touch.0 Request processed in 174us (215us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.827988:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6942:x1796503200048064:12345-0@lo:105: 00000100:00100000:1.0:1713279306.827992:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785235 00010000:00010000:2.0:1713279306.827992:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.827996:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.828000:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.828004:0:9213:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.828008:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.828012:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.828015:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.828023:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88008d4b8240) 00010000:00010000:0.0:1713279306.828030:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.828035:0:15525:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.828038:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6942:x1796503200048064:12345-0@lo:105: Request processed in 50us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.828041:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33439 00000100:00100000:3.0:1713279306.828042:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:6942:1796503200048064:0@lo:105: 00000004:00080000:0.0:1713279306.828045:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1713279306.828049:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.828052:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092342d00/0xfc4b8e114eda88bb lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.828091:0:6942:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:10814:x1796503281222016:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 28244us (28286us total) trans 4295202720 rc 0/0 00000100:00100000:3.0:1713279306.828096:0:6942:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14341 00000100:00100000:2.0:1713279306.828185:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.828186:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda9032 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.828192:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda9032 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.828196:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda9032 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.828201:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.828202:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114eda9039 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x260:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.828205:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114eda9039 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.828208:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114eda9039 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.828213:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda9040 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.828215:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.828216:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda9040 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.828219:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda9040 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00000100:00100000:1.0:1713279306.828225:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281236032 00000100:00100000:2.0:1713279306.828225:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281236096 00010000:00010000:0.0:1713279306.828227:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9047 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25b:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.828227:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281236032 00000100:00100000:2.0:1713279306.828227:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281236096 00010000:00010000:0.0:1713279306.828230:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.828233:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00000100:00100000:1.0:1713279306.828237:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281236224 00000100:00100000:1.0:1713279306.828238:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281236224 00000100:00100000:2.0:1713279306.828241:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785236 00000100:00100000:2.0:1713279306.828244:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3641:11876:x1796503281236032:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.828245:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7ad7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00000100:00100000:3.0:1713279306.828245:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785237 00000100:00100000:1.0:1713279306.828249:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785238 00010000:00010000:2.0:1713279306.828249:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.828249:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3359:11855:x1796503281236096:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.828250:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda88d7 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x7ad7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758c8 expref: 3359 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.828252:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3641:11711:x1796503281236224:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.828254:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 4/0,1 mode: --/EX res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.828255:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda9055 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175aea expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.828255:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.828257:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.828260:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114eda905c lrc: 2/0,0 mode: --/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175af1 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.828262:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda9063 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175af8 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.828265:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda88d7 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7ad7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758c8 expref: 3360 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.828270:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda88d7 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7ad7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758c8 expref: 3360 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.828270:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda906a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.828275:0:9221:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8db5 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8dae expref: 88 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.828276:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afd180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001_UUID:15525:1796503200048128:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.828276:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.828282:0:9221:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda906a lrc: 4/1,0 mode: --/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.828286:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245dd40/0xfc4b8e114eda9078 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.828287:0:15753:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.828290:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008245dd40/0xfc4b8e114eda9078 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00000100:00100000:0.0:1713279306.828292:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120671a80 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.828294:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008245dd40/0xfc4b8e114eda9078 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.828296:0:15753:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.828299:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda907f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.828301:0:9221:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8db5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda8dae expref: 88 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.828302:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda907f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.828305:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda907f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00000100:00100000:2.0:1713279306.828307:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9221:1796503200048192:0@lo:104: 00010000:00010000:1.0:1713279306.828315:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245dd40/0xfc4b8e114eda9078 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.828319:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245dd40/0xfc4b8e114eda9078 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00000100:00100000:2.0:1713279306.828320:0:9221:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.828322:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008245dd40/0xfc4b8e114eda9078 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.828324:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008245dd40/0xfc4b8e114eda9078 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.828327:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008245dd40 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.828327:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012edd90c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.828328:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245dd40/0xfc4b8e114eda9078 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.828330:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200048192 00010000:00010000:1.0:1713279306.828334:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245dd40/0xfc4b8e114eda9078 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.828334:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200048192 00010000:00010000:1.0:1713279306.828338:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88008d729f00) 00010000:00010000:1.0:1713279306.828339:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.828340:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008245dd40/0xfc4b8e114eda9078 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.828343:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008245dd40/0xfc4b8e114eda9078 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.828347:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda907f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.828349:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33440 00010000:00010000:1.0:1713279306.828350:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda907f lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.828352:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda907f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.828354:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:9221:x1796503200048192:12345-0@lo:104: 00010000:00010000:1.0:1713279306.828355:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008245cfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.828356:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda907f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.828359:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda907f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.828360:0:9213:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880092455d40/0xfc4b8e114eda8dae lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda8db5 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.828362:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff88008c124700) 00010000:00010000:1.0:1713279306.828363:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.828365:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda907f lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.828367:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114eda907f lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.828378:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda9063 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175af8 expref: 3643 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.828382:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ed00/0xfc4b8e114eda9063 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175af8 expref: 3643 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.828387:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009181ed00, rc 0) 00010000:00010000:3.0:1713279306.828389:0:9213:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1713279306.828394:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:9221:x1796503200048192:12345-0@lo:104: Request processed in 40us (72us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.828396:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9221:1796503200048192:0@lo:104: 00000100:00100000:3.0:1713279306.828399:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33440 00010000:00010000:2.0:1713279306.828403:0:9221:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda906a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.828407:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3642:11711:x1796503281236224:12345-192.168.203.4@tcp:101:touch.0 Request processed in 154us (192us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.828433:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785238 00010000:00010000:3.0:1713279306.828435:0:6919:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.828440:0:6919:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880092455d40/0xfc4b8e114eda8dae lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda8db5 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.828447:0:6919:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092455d40 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.828450:0:6919:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880092455d40/0xfc4b8e114eda8dae lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda8db5 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.828456:0:6919:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880092455d40/0xfc4b8e114eda8dae lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda8db5 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.828471:0:6919:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880092455d40/0xfc4b8e114eda8dae lrc: 2/0,0 mode: --/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda8db5 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.828478:0:6919:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.828490:0:6919:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880092455d40/0xfc4b8e114eda8dae lrc: 1/0,0 mode: --/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda8db5 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.828495:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200048256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.828496:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880092455d40/0xfc4b8e114eda8dae lrc: 0/0,0 mode: --/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda8db5 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.828509:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.828510:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279306.828512:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.828512:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279306.828522:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200048256 00000100:00100000:0.0:1713279306.828525:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200048256 00010000:00010000:0.0:1713279306.828532:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8db5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfc4b8e114eda8dae expref: 89 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.828545:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196541 00000100:00100000:0.0:1713279306.828548:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+89:3492:x1796503200048256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.828552:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.828624:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.828642:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281236416 00000100:00100000:1.0:1713279306.828646:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281236416 00000100:00100000:1.0:1713279306.828663:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785239 00000100:00100000:1.0:1713279306.828667:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3361:11204:x1796503281236416:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.828675:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.828682:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114eda9086 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175aff expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.828723:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114eda908d lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.828729:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114eda908d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828735:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114eda908d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828747:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda9094 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.828752:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda9094 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828756:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda9094 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000004:00200000:1.0:1713279306.828767:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:1.0:1713279306.828773:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114eda908d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828778:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114eda908d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828782:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114eda908d lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828786:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114eda908d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828790:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008245c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.828792:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114eda908d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828796:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114eda908d lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828802:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:1.0:1713279306.828803:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.828805:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114eda908d lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828813:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114eda908d lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828819:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda9094 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828823:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda9094 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828828:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda9094 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828831:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a7180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.828833:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda9094 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828837:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda9094 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828842:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88008c124600) 00010000:00010000:1.0:1713279306.828843:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.828845:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda9094 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828849:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a7180/0xfc4b8e114eda9094 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.828865:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114eda9086 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175aff expref: 3362 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.828870:0:15752:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000_UUID:15752:1796503200047808:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.828871:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114eda9086 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175aff expref: 3362 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.828881:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008245f840, rc 0) 00000100:00100000:1.0:1713279306.828909:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3361:11204:x1796503281236416:12345-192.168.203.4@tcp:101:touch.0 Request processed in 241us (284us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.828915:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785239 00000001:00080000:3.0:1713279306.829059:0:8061:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4295183716 is committed 00000020:00080000:3.0:1713279306.829110:0:8061:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 17683 batchid updated 00000020:00080000:0.0:1713279306.829122:0:8082:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17683 00000004:00080000:0.0:1713279306.829141:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880120671e40 with version 32010 00000020:00080000:0.0:1713279306.829145:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17678 cancel update log [0x200000401:0xf8:0x0].2146: rc = 0 00010000:00010000:1.0:1713279306.829146:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688fc0/0xfc4b8e114eda8db5 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfc4b8e114eda8dae expref: 89 pid: 15494 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.829151:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32010 rpc_version 32010 00010000:00010000:1.0:1713279306.829152:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x13a:0x0].0x0 (ffff880123701d00) 00010000:00010000:1.0:1713279306.829154:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda906a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.829158:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda906a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.829161:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda906a lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9221 initiator: MDT1 00000020:00100000:2.0:1713279306.829161:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1713279306.829164:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.829164:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801313c3800 x1796503200048384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1713279306.829168:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.829170:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.829173:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200048384:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1713279306.829180:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.829186:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.829190:0:15753:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.829192:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012edd90c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.829196:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:1.0:1713279306.829198:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+88:3492:x1796503200048256:12345-0@lo:103:ldlm_bl.0 Request processed in 649us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.829200:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200048384 00000100:00100000:1.0:1713279306.829202:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196541 00000100:00100000:2.0:1713279306.829202:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200048384 00000100:00100000:2.0:1713279306.829212:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98842 00000100:00100000:2.0:1713279306.829214:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+87:8074:x1796503200048384:12345-0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1713279306.829217:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17678 cancel update log [0x240000400:0x1c0:0x0].1538: rc = 0 00000004:00200000:3.0:1713279306.829219:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x13a:0x0]: returning size 4096 00000004:00200000:3.0:1713279306.829222:0:15753:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:1.0:1713279306.829228:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200048256:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1713279306.829231:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880120671c00 with version 32011 00000020:00080000:0.0:1713279306.829232:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17679 cancel update log [0x200000401:0xf8:0x0].2147: rc = 0 00000020:00080000:0.0:1713279306.829241:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17679 cancel update log [0x240000400:0x1c0:0x0].1539: rc = 0 00010000:00010000:3.0:1713279306.829241:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114eda905c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175af1 expref: 3361 pid: 15753 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.829252:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880092078540 with version 32012 00010000:00010000:3.0:1713279306.829252:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175af1 expref: 3360 pid: 15753 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1713279306.829253:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17680 cancel update log [0x200000401:0xf8:0x0].2148: rc = 0 00000100:00100000:2.0:1713279306.829254:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+88:8074:x1796503200048384:12345-0@lo:1000:osp_up0-1.0 Request processed in 38us (66us total) trans 4295202722 rc 0/0 00010000:00010000:3.0:1713279306.829258:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x13a:0x0].0x0 (ffff880123701d00) 00000100:00100000:2.0:1713279306.829259:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98842 00010000:00010000:3.0:1713279306.829261:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713279306.829263:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800978861c0, rc 0) 00000100:00100000:2.0:1713279306.829277:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200048384:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1713279306.829281:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32011 rpc_version 32011 00000020:00100000:2.0:1713279306.829287:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.829287:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3360:11855:x1796503281236096:12345-192.168.203.4@tcp:101:touch.0 Request processed in 1037us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.829290:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88007f02ce00 x1796503200048512/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.829296:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785237 00000100:00100000:2.0:1713279306.829297:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200048512:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1713279306.829308:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1713279306.829310:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17680 cancel update log [0x240000400:0x1c0:0x0].1540: rc = 0 00000100:00100000:2.0:1713279306.829313:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c2fb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.829318:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200048512 00000100:00100000:2.0:1713279306.829319:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200048512 00000004:00080000:0.0:1713279306.829321:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009606c000 with version 32013 00000020:00080000:0.0:1713279306.829322:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17681 cancel update log [0x200000401:0xf8:0x0].2149: rc = 0 00000100:00100000:2.0:1713279306.829328:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98843 00000020:00080000:0.0:1713279306.829329:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17681 cancel update log [0x240000400:0x1c0:0x0].1541: rc = 0 00000100:00100000:2.0:1713279306.829330:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+88:8074:x1796503200048512:12345-0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279306.829337:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8801237273c0 with version 32014 00000020:00080000:0.0:1713279306.829338:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17682 cancel update log [0x200000401:0xf8:0x0].2150: rc = 0 00000020:00080000:0.0:1713279306.829344:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17682 cancel update log [0x240000400:0x1c0:0x0].1543: rc = 0 00000004:00080000:0.0:1713279306.829352:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800917f2780 with version 32015 00000020:00080000:0.0:1713279306.829353:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17683 cancel update log [0x200000401:0xf8:0x0].2151: rc = 0 00000100:00100000:3.0:1713279306.829353:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000020:00080000:0.0:1713279306.829359:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17683 cancel update log [0x240000400:0x1c0:0x0].1544: rc = 0 00000020:00080000:0.0:1713279306.829364:0:8082:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17683 00000100:00100000:2.0:1713279306.829364:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+89:8074:x1796503200048512:12345-0@lo:1000:osp_up0-1.0 Request processed in 32us (54us total) trans 4295202723 rc 0/0 00000100:00100000:2.0:1713279306.829367:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98843 00000100:00100000:1.0:1713279306.829369:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281236288 00000100:00100000:1.0:1713279306.829373:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281236288 00000100:00100000:2.0:1713279306.829381:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200048512:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1713279306.829384:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114eda8606 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175804 expref: 3728 pid: 15753 timeout: 509 lvb_type: 0 00000004:00080000:2.0:1713279306.829385:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32012 rpc_version 32012 00000020:00100000:2.0:1713279306.829390:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.829392:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.829393:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88007f02f480 x1796503200048640/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1713279306.829400:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196542 00000100:00100000:2.0:1713279306.829400:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200048640:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.829405:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3728:1957:x1796503281236288:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.829408:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281236864 00000100:00100000:2.0:1713279306.829410:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.829427:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.829429:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281236864 00010000:00010000:1.0:1713279306.829432:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114eda8606 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175804 expref: 3729 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.829432:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c2fb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.829438:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200048640 00000100:00100000:2.0:1713279306.829440:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200048640 00010000:00010000:1.0:1713279306.829441:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114eda8606 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175804 expref: 3729 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.829448:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785240 00000100:00100000:2.0:1713279306.829451:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98844 00010000:00010000:1.0:1713279306.829452:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114eda8606 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175804 expref: 3729 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.829453:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+89:8074:x1796503200048640:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.829453:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3729:11711:x1796503281236864:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.829461:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8439:0x0].0x0 (ffff8800938abb00) 00010000:00010000:3.0:1713279306.829461:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.829464:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880133317840/0xfc4b8e114eda8ffa lrc: 3/0,1 mode: --/CW res: [0x200000403:0x8439:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.829469:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda909b lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b06 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.829470:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880133317840/0xfc4b8e114eda8ffa lrc: 3/0,1 mode: --/CW res: [0x200000403:0x8439:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.829474:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.829490:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+90:8074:x1796503200048640:12345-0@lo:1000:osp_up0-1.0 Request processed in 35us (79us total) trans 4295202724 rc 0/0 00000100:00100000:2.0:1713279306.829493:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98844 00000100:00100000:1.0:1713279306.829494:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3729:1957:x1796503281236288:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 88us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.829500:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196542 00000100:00100000:2.0:1713279306.829508:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200048640:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1713279306.829511:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32013 rpc_version 32013 00000020:00100000:2.0:1713279306.829517:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.829519:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880082549c00 x1796503200048768/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1713279306.829521:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095249d40/0xfc4b8e114eda90a2 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.829526:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200048768:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.829527:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095249d40/0xfc4b8e114eda90a2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.829531:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095249d40/0xfc4b8e114eda90a2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.829536:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.829537:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009524b180/0xfc4b8e114eda90a9 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.829541:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009524b180/0xfc4b8e114eda90a9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.829542:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c2fb3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.829544:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009524b180/0xfc4b8e114eda90a9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000100:00100000:0.0:1713279306.829546:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200048768 00010000:00010000:2.0:1713279306.829548:0:9221:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda906a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713279306.829549:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200048768 00010000:00010000:2.0:1713279306.829552:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda906a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000004:00200000:3.0:1713279306.829554:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:3.0:1713279306.829558:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095249d40/0xfc4b8e114eda90a2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000100:00100000:0.0:1713279306.829560:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98845 00000100:00100000:0.0:1713279306.829563:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+90:8074:x1796503200048768:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.829563:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095249d40/0xfc4b8e114eda90a2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00000004:00200000:2.0:1713279306.829564:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x13a:0x0]: returning size 4096 00000004:00200000:2.0:1713279306.829566:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:3.0:1713279306.829566:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095249d40/0xfc4b8e114eda90a2 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.829569:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095249d40/0xfc4b8e114eda90a2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.829572:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095249d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.829573:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095249d40/0xfc4b8e114eda90a2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.829576:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095249d40/0xfc4b8e114eda90a2 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.829578:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda9055 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175aea expref: 3640 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.829580:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880096e84c00) 00010000:00010000:3.0:1713279306.829581:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.829583:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095249d40/0xfc4b8e114eda90a2 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.829585:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda906a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175aea expref: 3639 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.829586:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095249d40/0xfc4b8e114eda90a2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.829589:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x13a:0x0].0x0 (ffff880123701d00) 00010000:00010000:2.0:1713279306.829591:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713279306.829591:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009524b180/0xfc4b8e114eda90a9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.829593:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f2b180, rc 0) 00010000:00010000:3.0:1713279306.829594:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009524b180/0xfc4b8e114eda90a9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.829596:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009524b180/0xfc4b8e114eda90a9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.829599:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009524b180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.829602:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009524b180/0xfc4b8e114eda90a9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.829607:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3639:11876:x1796503281236032:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1362us (1421us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.829607:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009524b180/0xfc4b8e114eda90a9 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00000100:00100000:0.0:1713279306.829608:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+91:8074:x1796503200048768:12345-0@lo:1000:osp_up0-1.0 Request processed in 44us (70us total) trans 4295202725 rc 0/0 00000100:00100000:2.0:1713279306.829611:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785236 00000100:00100000:0.0:1713279306.829612:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98845 00010000:00010000:3.0:1713279306.829613:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880096e84700) 00010000:00010000:3.0:1713279306.829615:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.829617:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009524b180/0xfc4b8e114eda90a9 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.829621:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009524b180/0xfc4b8e114eda90a9 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000100:00100000:1.0:1713279306.829624:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200048768:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1713279306.829630:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32014 rpc_version 32014 00000020:00100000:1.0:1713279306.829639:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1713279306.829643:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda909b lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b06 expref: 3728 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.829644:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008c160e00 x1796503200048896/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1713279306.829650:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097887cc0/0xfc4b8e114eda909b lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b06 expref: 3728 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.829656:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200048896:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.829657:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097887cc0, rc 0) 00000100:00100000:3.0:1713279306.829679:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3727:11711:x1796503281236864:12345-192.168.203.4@tcp:101:touch.0 Request processed in 225us (286us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.829680:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.829683:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785240 00000100:00100000:1.0:1713279306.829701:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.829714:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200048896 00000100:00100000:0.0:1713279306.829717:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200048896 00000100:00100000:0.0:1713279306.829725:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98846 00000100:00100000:0.0:1713279306.829728:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+91:8074:x1796503200048896:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.829729:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.829731:0:15752:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000_UUID:15752:1796503200047872:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.829739:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.829740:0:15752:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880133317840/0xfc4b8e114eda8ffa lrc: 3/0,1 mode: --/CW res: [0x200000403:0x8439:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.829746:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281236480 00000100:00100000:1.0:1713279306.829750:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281236480 00000100:00100000:2.0:1713279306.829752:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281236544 00000100:00100000:2.0:1713279306.829753:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281236544 00000100:00100000:3.0:1713279306.829763:0:15783:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0000_UUID:15783:1796503200047936:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.829764:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114eda83a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917576a expref: 3717 pid: 15473 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.829764:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110499 00000100:00100000:2.0:1713279306.829766:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281236544:12345-192.168.203.4@tcp:16:kworker.0 00000100:00100000:0.0:1713279306.829767:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+92:8074:x1796503200048896:12345-0@lo:1000:osp_up0-1.0 Request processed in 39us (87us total) trans 4295202726 rc 0/0 00000100:00100000:0.0:1713279306.829771:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98846 00000100:00100000:3.0:1713279306.829775:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.829779:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281236608 00000100:00100000:1.0:1713279306.829781:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281236608 00010000:00010000:1.0:1713279306.829790:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f0873c0/0xfc4b8e114ed9e855 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1110:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d08 expref: 84 pid: 15504 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.829790:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281236544:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 23us (50us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.829790:0:15783:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0000_UUID:15783:1796503200048000:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.829794:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110499 00010000:00010000:3.0:1713279306.829799:0:15783:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880133315b00/0xfc4b8e114eda9001 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1110:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.829804:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196543 00000100:00100000:2.0:1713279306.829807:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:1957:x1796503281236480:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.829808:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196544 00010000:00010000:2.0:1713279306.829811:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.829813:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+84:1957:x1796503281236608:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.829814:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114eda83a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917576a expref: 3717 pid: 15473 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.829819:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114eda83a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917576a expref: 3717 pid: 15473 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.829820:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.829821:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.829826:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114eda83a5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8439:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917576a expref: 3717 pid: 15473 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.829826:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281236672 00000100:00100000:3.0:1713279306.829828:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281236672 00010000:00010000:1.0:1713279306.829831:0:6915:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f0873c0/0xfc4b8e114ed9e855 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1110:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d08 expref: 84 pid: 15504 timeout: 509 lvb_type: 1 00010000:00010000:2.0:1713279306.829835:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8439:0x0].0x0 (ffff8800938abb00) 00010000:00010000:3.0:1713279306.829835:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009681cfc0/0xfc4b8e114ed9dfe9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1110:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a4c expref: 85 pid: 15538 timeout: 509 lvb_type: 1 00010000:00010000:2.0:1713279306.829837:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880133317840/0xfc4b8e114eda8ffa lrc: 3/0,1 mode: --/CW res: [0x200000403:0x8439:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.829840:0:6915:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f0873c0/0xfc4b8e114ed9e855 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1110:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d08 expref: 84 pid: 15504 timeout: 509 lvb_type: 1 00010000:00010000:2.0:1713279306.829841:0:15492:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133317840/0xfc4b8e114eda8ffa lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x8439:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.829844:0:15492:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133317840/0xfc4b8e114eda8ffa lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x8439:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.829844:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196545 00000100:00100000:3.0:1713279306.829847:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+85:1956:x1796503281236672:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.829849:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.829851:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.829857:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f0873c0/0xfc4b8e114ed9e855 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1110:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d08 expref: 84 pid: 15504 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.829857:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:1957:x1796503281236480:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 49us (128us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.829859:0:15496:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009681cfc0/0xfc4b8e114ed9dfe9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1110:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a4c expref: 85 pid: 15538 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.829860:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196543 00010000:00010000:2.0:1713279306.829867:0:15752:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880133317840/0xfc4b8e114eda8ffa lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x8439:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.829867:0:15496:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009681cfc0/0xfc4b8e114ed9dfe9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1110:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a4c expref: 85 pid: 15538 timeout: 509 lvb_type: 1 00010000:00010000:2.0:1713279306.829870:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133317840/0xfc4b8e114eda8ffa lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x8439:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.829875:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:2.0:1713279306.829876:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8439:0x0]: returning size 45312 00010000:00010000:3.0:1713279306.829882:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009681cfc0/0xfc4b8e114ed9dfe9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1110:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a4c expref: 85 pid: 15538 timeout: 509 lvb_type: 1 00000100:00100000:1.0:1713279306.829892:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+83:1957:x1796503281236608:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 77us (115us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.829892:0:15496:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.829893:0:15496:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713279306.829896:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196544 00010000:00010000:3.0:1713279306.829896:0:15496:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133315b00/0xfc4b8e114eda9001 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1110:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.829902:0:15496:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133315b00/0xfc4b8e114eda9001 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1110:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.829905:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114eda8ff3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ad5 expref: 3717 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.829912:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133317840/0xfc4b8e114eda8ffa lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x8439:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ad5 expref: 3716 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.829916:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8439:0x0].0x0 (ffff8800938abb00) 00010000:00010000:2.0:1713279306.829917:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1713279306.829919:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133317840, rc 0) 00010000:00010000:3.0:1713279306.829921:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.829922:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200048896:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1713279306.829929:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32015 rpc_version 32015 00000100:00100000:2.0:1713279306.829930:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:11950:x1796503281235648:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 2602us (2632us total) trans 4295202727 rc 0/0 00000100:00100000:2.0:1713279306.829933:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785233 00000020:00100000:1.0:1713279306.829938:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.829938:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+84:1956:x1796503281236672:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 89us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.829943:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008c161c00 x1796503200049024/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.829943:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196545 00010000:00010000:3.0:1713279306.829954:0:15783:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880133315b00/0xfc4b8e114eda9001 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1110:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.829955:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c161c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200049024:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.829959:0:15783:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133315b00/0xfc4b8e114eda9001 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1110:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.829966:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.829966:0:15783:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880133315b00/0xfc4b8e114eda9001 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1110:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.829968:0:15525:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880090afd180 x1796503200048128) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda88d7 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7ad7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758c8 expref: 3359 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.829970:0:15783:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880133315b00/0xfc4b8e114eda9001 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1110:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.829973:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281236736 00010000:00010000:3.0:1713279306.829974:0:15783:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880133315b00/0xfc4b8e114eda9001 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1110:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.829975:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.829975:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281236736 00010000:00010000:0.0:1713279306.829976:0:15525:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda88d7 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7ad7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758c8 expref: 3359 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.829977:0:15783:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133315b00 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:3.0:1713279306.829979:0:15783:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880133315b00/0xfc4b8e114eda9001 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1110:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.829982:0:15783:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880133315b00/0xfc4b8e114eda9001 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1110:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.829984:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda88d7 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x7ad7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758c8 expref: 3360 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.829984:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.829985:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785241 00000100:00100000:2.0:1713279306.829987:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3360:10814:x1796503281236736:12345-192.168.203.4@tcp:34:lfs.0 00000100:00100000:0.0:1713279306.829991:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afd180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001_UUID:15525:1796503200048128:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.829992:0:15783:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880133315b00/0xfc4b8e114eda9001 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1110:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.829996:0:15783:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133315b00/0xfc4b8e114eda9001 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1110:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.829997:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ad7:0x0].0x0 (ffff880094168d00) 00010000:00010000:0.0:1713279306.830000:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.830004:0:15525:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.830004:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda90b7 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x134:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.830007:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.830009:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda90b7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.830013:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.830013:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda90b7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.830016:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281235712:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 2502us (2541us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.830017:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.830018:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda90be lrc: 3/1,0 mode: --/PR res: [0x240000401:0x134:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.830019:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00000100:00100000:3.0:1713279306.830019:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110498 00010000:00010000:2.0:1713279306.830022:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda90be lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.830024:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda90be lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.830048:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda90c5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7642:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.830051:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda90c5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7642:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.830057:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda90c5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7642:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000004:00010000:2.0:1713279306.830086:0:15752:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda90c5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7642:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.830091:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda90b7 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.830094:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda90b7 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.830097:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda90b7 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.830100:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda90b7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.830102:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f28000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.830104:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda90b7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.830107:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda90b7 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.830111:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x0 (ffff880131200300) 00010000:00010000:2.0:1713279306.830112:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.830113:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda90b7 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.830116:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114eda90b7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000004:00010000:0.0:1713279306.830120:0:15525:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012c3fe680 reply state ffff8801234e4000 transno 4295183717 ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.830122:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda90be lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.830126:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda90be lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.830127:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.830129:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda90be lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.830130:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ad7:0x0].0x0 (ffff880094168d00) 00010000:00010000:2.0:1713279306.830131:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f286c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.830132:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.830132:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda90be lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.830133:0:15525:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.830135:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda90be lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.830136:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda9040 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.830138:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x3631 (ffff8800954bed00) 00010000:00010000:0.0:1713279306.830139:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda9040 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.830139:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.830140:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda90be lrc: 2/0,0 mode: --/PR res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.830142:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda9040 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.830143:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f286c0/0xfc4b8e114eda90be lrc: 0/0,0 mode: --/PR res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.830147:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda90c5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7642:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.830148:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda9040 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.830150:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda90c5 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x7642:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.830151:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.830152:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda9040 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.830153:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda90c5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7642:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.830155:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda9040 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.830155:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f29b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.830156:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda90c5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7642:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.830159:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880130675000) 00010000:00010000:0.0:1713279306.830160:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.830161:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda9040 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.830162:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda90c5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x7642:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.830164:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda9040 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.830165:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7642:0x0].0x0 (ffff88012fbfe100) 00010000:00010000:2.0:1713279306.830166:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.830167:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda90c5 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x7642:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.830170:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114eda90c5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7642:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000004:00010000:0.0:1713279306.830171:0:15525:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012c3fe680 reply state ffff8801234e4000 transno 4295183717 ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.830174:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9047 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.830178:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3431 (ffff880130675600) 00010000:00010000:0.0:1713279306.830179:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.830180:0:15525:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1713279306.830181:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda9032 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.830184:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda9032 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.830189:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda9032 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.830190:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3360:10814:x1796503281236736:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 202us (224us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.830192:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda9032 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.830194:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9680 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.830194:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785241 00010000:00010000:0.0:1713279306.830195:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda9032 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.830198:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda9032 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.830201:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880130675700) 00010000:00010000:0.0:1713279306.830202:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.830203:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda9032 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.830206:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda9032 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00000004:00010000:0.0:1713279306.830210:0:15525:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012c3fe680 reply state ffff8801234e4000 transno 4295183717 ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114eda9039 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.830214:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114eda9039 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.830216:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x3431 (ffff880130675500) 00010000:00010000:0.0:1713279306.830217:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.830218:0:15525:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:0.0:1713279306.830221:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.830227:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.830231:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.830238:0:15525:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1713279306.830244:0:15544:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713279306.830248:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.830251:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d4b8240 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:2.0:1713279306.830253:0:15544:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.830257:0:15544:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.830261:0:15525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3360:11374:x1796503281224256:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 26720us (26748us total) trans 4295183717 rc 0/0 00000100:00100000:0.0:1713279306.830265:0:15525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14342 00010000:00010000:2.0:1713279306.830267:0:15544:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.830270:0:15544:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1713279306.830276:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200049024 00000100:00100000:0.0:1713279306.830278:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200049024 00010000:00010000:2.0:1713279306.830278:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.830282:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda89e8 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda89ef expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.830286:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98847 00010000:00010000:2.0:1713279306.830287:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279306.830288:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+92:8074:x1796503200049024:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1713279306.830288:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.830289:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279306.830291:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200049088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.830315:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.830328:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200049088 00000100:00100000:3.0:1713279306.830331:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200049088 00010000:00010000:3.0:1713279306.830339:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda89ef lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda89e8 expref: 93 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.830349:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196546 00000100:00100000:3.0:1713279306.830351:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+93:3493:x1796503200049088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.830356:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.830358:0:15496:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda89ef lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda89e8 expref: 93 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.830365:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091cbc000/0xfc4b8e114eda89ef lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda89e8 expref: 93 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.830371:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:3.0:1713279306.830374:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda8e1e lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8ded expref: 92 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.830381:0:15496:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda8e1e lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda8ded expref: 92 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.830385:0:15496:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda8e1e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda8ded expref: 93 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.830389:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00000100:00100000:2.0:1713279306.830393:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.830397:0:15496:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda8e1e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8ded expref: 93 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.830402:0:15496:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000_UUID:15496:1796503200049152:0@lo:105: 00000100:00100000:0.0:1713279306.830409:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+93:8074:x1796503200049024:12345-0@lo:1000:osp_up0-1.0 Request processed in 119us (434us total) trans 4295202728 rc 0/0 00000100:00100000:2.0:1713279306.830409:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.830430:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98847 00000100:00100000:2.0:1713279306.830430:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281237120 00000100:00100000:3.0:1713279306.830431:0:15496:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.830432:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281237120 00000100:00100000:1.0:1713279306.830438:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c161c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200049024:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.830438:0:15496:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.830442:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223066 00000100:00100000:2.0:1713279306.830445:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:11945:x1796503281237120:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.830446:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200049152 00000100:00100000:3.0:1713279306.830448:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200049152 00000100:00100000:3.0:1713279306.830462:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33441 00000100:00100000:3.0:1713279306.830464:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15496:x1796503200049152:12345-0@lo:105: 00010000:00010000:3.0:1713279306.830469:0:6913:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.830474:0:6913:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.830478:0:6913:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.830484:0:6913:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.830487:0:6913:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.830491:0:6913:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.830493:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:11945:x1796503281237120:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 46us (83us total) trans 4295202729 rc 0/0 00010000:00010000:3.0:1713279306.830494:0:6913:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.830496:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223066 00000100:00100000:1.0:1713279306.830501:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.830502:0:6913:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880091baaf40) 00010000:00010000:0.0:1713279306.830509:0:15502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.830514:0:15502:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.830514:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281237376 00000100:00100000:3.0:1713279306.830515:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15496:x1796503200049152:12345-0@lo:105: Request processed in 50us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.830516:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281237376 00000100:00100000:3.0:1713279306.830518:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33441 00000004:00080000:0.0:1713279306.830522:0:15502:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1713279306.830524:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785242 00000100:00100000:2.0:1713279306.830526:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3360:11855:x1796503281237376:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.830539:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281236928 00000100:00100000:3.0:1713279306.830540:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281236928 00000100:00100000:1.0:1713279306.830544:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.830552:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.830552:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110500 00000100:00100000:3.0:1713279306.830554:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+89:1954:x1796503281236928:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:2.0:1713279306.830557:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda90cc lrc: 2/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b1b expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.830567:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afd180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200049216:0@lo:1000:mdt_io00_004.0 00010000:00010000:2.0:1713279306.830571:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda90d3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:1.0:1713279306.830572:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.830576:0:15753:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114eda8dc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda8dbc expref: 87 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.830581:0:15753:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda90d3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.830584:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.830589:0:15753:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114eda8dc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda8dbc expref: 87 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.830590:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120671a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.830595:0:15753:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549500 pname:cluuid:pid:xid:nid:opc:job mdt00_035:lustre-MDT0001_UUID:15753:1796503200049280:0@lo:104: 00000100:00100000:1.0:1713279306.830601:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200049216 00000100:00100000:1.0:1713279306.830605:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200049216 00000100:00100000:0.0:1713279306.830607:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281237568 00000100:00100000:2.0:1713279306.830608:0:15753:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1713279306.830608:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb size from disk: 13836 -> 13836 00000100:00100000:0.0:1713279306.830609:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281237568 00002000:00010000:3.0:1713279306.830610:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb mtime from disk: 1713279304 -> 1713279304 00002000:00010000:3.0:1713279306.830611:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb atime from disk: 1713279298 -> 1713279298 00002000:00010000:3.0:1713279306.830613:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb ctime from disk: 1713279304 -> 1713279304 00002000:00010000:3.0:1713279306.830614:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1713279306.830615:0:15753:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c2fb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.830626:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281237632 00000100:00100000:2.0:1713279306.830628:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281237632 00000100:00100000:3.0:1713279306.830629:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+90:1954:x1796503281236928:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 73us (235us total) trans 4295010125 rc 0/0 00000100:00100000:1.0:1713279306.830630:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98848 00000100:00100000:3.0:1713279306.830633:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110500 00000100:00100000:1.0:1713279306.830635:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+93:15502:x1796503200049216:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713279306.830637:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785243 00000100:00100000:2.0:1713279306.830640:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3639:11876:x1796503281237568:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:0.0:1713279306.830641:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785244 00000100:00100000:3.0:1713279306.830643:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200049280 00000100:00100000:0.0:1713279306.830644:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3362:11940:x1796503281237632:12345-192.168.203.4@tcp:101:mkdir.0 00000100:00100000:3.0:1713279306.830644:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200049280 00010000:00010000:2.0:1713279306.830645:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.830649:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688b40/0xfc4b8e114eda90da lrc: 2/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b29 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.830650:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.830653:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33442 00000100:00100000:3.0:1713279306.830655:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:15753:x1796503200049280:12345-0@lo:104: 00010000:00010000:0.0:1713279306.830656:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114eda90e1 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b30 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.830659:0:6913:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fca9b00/0xfc4b8e114eda8dbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda8dc3 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.830661:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda90e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713279306.830665:0:9221:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda90e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.830669:0:9221:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda90e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713279306.830674:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda90ef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.830677:0:6913:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1713279306.830678:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda90ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ff:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.830680:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:15753:x1796503200049280:12345-0@lo:104: Request processed in 24us (72us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.830682:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda90ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ff:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00000100:00100000:1.0:1713279306.830682:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+93:15502:x1796503200049216:12345-0@lo:1000:mdt_io00_004.0 Request processed in 45us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.830683:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33442 00000100:00100000:2.0:1713279306.830686:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.830688:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98848 00010000:00010000:3.0:1713279306.830689:0:6918:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.830691:0:6918:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fca9b00/0xfc4b8e114eda8dbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda8dc3 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713279306.830695:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x1ff:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.830695:0:6918:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fca9b00 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.830697:0:6918:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fca9b00/0xfc4b8e114eda8dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda8dc3 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.830701:0:6918:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fca9b00/0xfc4b8e114eda8dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda8dc3 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.830708:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afd180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200049216:0@lo:1000:mdt_io00_004.0 00010000:00010000:3.0:1713279306.830710:0:6918:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fca9b00/0xfc4b8e114eda8dbc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda8dc3 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.830713:0:6918:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713279306.830720:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.830720:0:6918:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fca9b00/0xfc4b8e114eda8dbc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda8dc3 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.830727:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fca9b00/0xfc4b8e114eda8dbc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda8dc3 expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.830729:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.830734:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.830735:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.830736:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279306.830740:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122e6d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200049408:0@lo:1000:mdt_io00_004.0 00000100:00100000:3.0:1713279306.830741:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200049344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.830747:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00200000:0.0:1713279306.830750:0:15749:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:3.0:1713279306.830754:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.830760:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.830765:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114eda90e1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b30 expref: 3364 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.830769:0:15496:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000_UUID:15496:1796503200049152:0@lo:105: 00010000:00010000:0.0:1713279306.830772:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda90ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ff:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b30 expref: 3363 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.830775:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.830776:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x1ff:0x0].0x0 (ffff88007f009300) 00010000:00010000:0.0:1713279306.830778:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713279306.830779:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ad686c0, rc 0) 00000100:00100000:3.0:1713279306.830786:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+92:3493:x1796503200049088:12345-0@lo:103:ldlm_bl.0 Request processed in 433us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.830789:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.830789:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196546 00000100:00100000:0.0:1713279306.830794:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3363:11940:x1796503281237632:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 149us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.830795:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200049344 00000100:00100000:3.0:1713279306.830796:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200049344 00000100:00100000:1.0:1713279306.830797:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.830800:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785244 00010000:00010000:3.0:1713279306.830802:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114eda8dc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfc4b8e114eda8dbc expref: 88 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.830804:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0900 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.830807:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281237184 00000100:00100000:0.0:1713279306.830809:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281237184 00000100:00100000:3.0:1713279306.830809:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196547 00000100:00100000:3.0:1713279306.830811:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+88:3490:x1796503200049344:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.830815:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.830816:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.830817:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200049088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.830825:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281237312 00000100:00100000:0.0:1713279306.830827:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281237312 00000100:00100000:2.0:1713279306.830829:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281237504 00000100:00100000:1.0:1713279306.830830:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200049408 00000100:00100000:1.0:1713279306.830831:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200049408 00000100:00100000:2.0:1713279306.830831:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281237504 00000100:00100000:3.0:1713279306.830834:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281237824 00000100:00100000:0.0:1713279306.830836:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281237760 00000100:00100000:3.0:1713279306.830836:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281237824 00000100:00100000:0.0:1713279306.830838:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281237760 00000100:00100000:2.0:1713279306.830840:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281238016 00000100:00100000:2.0:1713279306.830841:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281238016 00000100:00100000:1.0:1713279306.830843:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785245 00000100:00100000:3.0:1713279306.830843:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110501 00000100:00100000:1.0:1713279306.830846:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:11204:x1796503281237184:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.830846:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281237824:12345-192.168.203.4@tcp:16:kworker.0 00000100:00100000:0.0:1713279306.830847:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785246 00000100:00100000:0.0:1713279306.830850:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3642:11912:x1796503281237312:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.830851:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785247 00010000:00010000:1.0:1713279306.830853:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.830853:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:11961:x1796503281237504:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.830855:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.830859:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda90f6 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b0d expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.830859:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.830860:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114eda90fd lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b14 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.830864:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093aba1c0/0xfc4b8e114eda9104 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b22 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.830866:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281237824:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 19us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.830870:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110501 00010000:00010000:0.0:1713279306.830879:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda910b lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.830880:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda9112 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:3.0:1713279306.830881:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785248 00010000:00010000:0.0:1713279306.830883:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda910b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.830883:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3643:11711:x1796503281237760:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.830885:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda9112 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.830887:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda910b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.830888:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.830889:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda9112 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.830892:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda9119 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.830894:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda9127 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.830894:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9120 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b37 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.830895:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c04480/0xfc4b8e114eda912e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.830896:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda9119 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.830899:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda9119 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.830900:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda9127 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.830901:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c04480/0xfc4b8e114eda912e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.830904:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda9127 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.830905:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c04480/0xfc4b8e114eda912e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.830908:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda910b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.830911:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda910b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.830912:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda9135 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.830914:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda910b lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.830915:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda9135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.830915:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda913c lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.830917:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda910b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.830917:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda9112 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.830918:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda9135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.830920:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023e880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.830920:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda9112 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.830920:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda913c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.830921:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda910b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.830923:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda9112 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.830924:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda910b lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.830924:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda913c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.830926:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda9112 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.830926:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda9143 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x75f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.830928:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff8801250c1e00) 00010000:00010000:1.0:1713279306.830928:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a4b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.830929:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.830930:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda910b lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.830930:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda9112 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.830930:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda9143 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x75f8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.830932:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda914a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.830933:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda910b lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.830933:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda9112 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.830933:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda9143 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x75f8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.830937:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:3.0:1713279306.830937:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda914a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.830938:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda9119 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.830938:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.830938:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c04480/0xfc4b8e114eda912e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.830940:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda9119 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.830940:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda9112 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.830940:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c04480/0xfc4b8e114eda912e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.830942:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda914a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.830943:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda9119 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.830943:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114eda9112 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.830943:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c04480/0xfc4b8e114eda912e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.830946:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023dd40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.830946:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c04480/0xfc4b8e114eda912e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.830947:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda9127 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.830948:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda9119 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.830949:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c04480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.830950:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda9119 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.830950:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c04480/0xfc4b8e114eda912e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.830951:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda9127 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.830953:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda9127 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.830953:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c04480/0xfc4b8e114eda912e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.830954:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff8801250c1200) 00010000:00010000:0.0:1713279306.830955:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.830956:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda9119 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.830956:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a5f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.830957:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda9127 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.830957:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:2.0:1713279306.830958:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.830959:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023dd40/0xfc4b8e114eda9119 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.830960:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda9127 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.830960:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c04480/0xfc4b8e114eda912e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.830960:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda913c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.830963:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff88008e8c9200) 00010000:00010000:2.0:1713279306.830963:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c04480/0xfc4b8e114eda912e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.830964:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.830965:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda9127 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.830966:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda913c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.830967:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda9135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.830968:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a5f80/0xfc4b8e114eda9127 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.830970:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114eda90fd lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b14 expref: 3644 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.830970:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda9135 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.830971:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda913c lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.830974:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114eda90fd lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b14 expref: 3644 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.830974:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda9135 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.830976:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf7cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.830976:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda913c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.830977:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda9135 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.830978:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda90f6 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b0d expref: 3720 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.830979:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023c000, rc 0) 00010000:00010000:2.0:1713279306.830980:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda9135 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.830980:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134927180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.830983:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4d80/0xfc4b8e114eda90f6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b0d expref: 3720 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.830983:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3631 (ffff88011eea5000) 00010000:00010000:3.0:1713279306.830983:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda913c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.830984:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.830985:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda9135 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.830986:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4a4d80, rc 0) 00010000:00010000:2.0:1713279306.830988:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114eda9135 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.830988:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda913c lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00000100:00100000:0.0:1713279306.830990:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3643:11912:x1796503281237312:12345-192.168.203.4@tcp:101:touch.0 Request processed in 139us (270us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.830993:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785246 00010000:00010000:3.0:1713279306.830995:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880096e84500) 00010000:00010000:3.0:1713279306.830996:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.830998:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda913c lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.830999:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093aba1c0/0xfc4b8e114eda9104 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b22 expref: 3720 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.831001:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785249 00000100:00100000:1.0:1713279306.831001:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11204:x1796503281237184:12345-192.168.203.4@tcp:101:touch.0 Request processed in 153us (314us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.831001:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda913c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00000100:00100000:0.0:1713279306.831003:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3363:10814:x1796503281238016:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.831005:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785245 00010000:00010000:2.0:1713279306.831005:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda9143 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x75f8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b22 expref: 3719 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.831006:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda914a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.831008:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.831008:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x75f8:0x0].0x0 (ffff880082706900) 00010000:00010000:2.0:1713279306.831009:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713279306.831009:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda914a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.831010:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf5d40, rc 0) 00010000:00010000:0.0:1713279306.831012:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda9151 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x7642:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b3e expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.831012:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda914a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.831014:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134926f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.831016:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda914a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.831019:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda914a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00000100:00100000:2.0:1713279306.831022:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:11961:x1796503281237504:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 168us (292us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.831025:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880096e84800) 00000100:00100000:1.0:1713279306.831026:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98849 00000100:00100000:2.0:1713279306.831026:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785247 00010000:00010000:3.0:1713279306.831026:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.831027:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda914a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00000100:00100000:1.0:1713279306.831028:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+92:15502:x1796503200049408:12345-0@lo:1000:mdt_io00_004.0 00010000:00010000:3.0:1713279306.831030:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda914a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.831038:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda9158 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x7642:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.831043:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda9158 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7642:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.831043:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9120 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b37 expref: 3642 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.831047:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda9158 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7642:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.831047:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9120 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b37 expref: 3642 pid: 15471 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713279306.831051:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7642:0x0]: returning size 0 00010000:00010000:3.0:1713279306.831053:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009524a640, rc 0) 00000100:00100000:2.0:1713279306.831057:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.831084:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3641:11711:x1796503281237760:12345-192.168.203.4@tcp:101:touch.0 Request processed in 182us (319us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.831089:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785248 00010000:00010000:0.0:1713279306.831093:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114eda9151 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x7642:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b3e expref: 3366 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.831098:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.831101:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda9158 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x7642:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b3e expref: 3365 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.831104:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7642:0x0].0x0 (ffff88012fbfe100) 00000100:00100000:3.0:1713279306.831105:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281238208 00010000:00010000:0.0:1713279306.831106:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1713279306.831107:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023c480, rc 0) 00000100:00100000:3.0:1713279306.831107:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281238208 00000100:00100000:3.0:1713279306.831117:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785250 00000100:00100000:1.0:1713279306.831120:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+92:15502:x1796503200049408:12345-0@lo:1000:mdt_io00_004.0 Request processed in 90us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.831120:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3366:11374:x1796503281238208:12345-192.168.203.4@tcp:34:lfs.0 00000100:00100000:0.0:1713279306.831122:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3366:10814:x1796503281238016:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 118us (333us total) trans 4295183718 rc 0/0 00000100:00100000:1.0:1713279306.831124:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98849 00000100:00100000:0.0:1713279306.831126:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785249 00000100:00100000:1.0:1713279306.831135:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281238144 00000100:00100000:1.0:1713279306.831137:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281238144 00010000:00010000:3.0:1713279306.831138:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9166 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1713279306.831140:0:15525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281238080 00000100:00100000:0.0:1713279306.831142:0:15525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281238080 00010000:00010000:3.0:1713279306.831143:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9166 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00000100:00100000:1.0:1713279306.831146:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110502 00010000:00010000:3.0:1713279306.831147:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9166 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00000100:00100000:1.0:1713279306.831149:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+83:1955:x1796503281238144:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:3.0:1713279306.831153:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda916d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.831156:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda916d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.831159:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda916d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.831180:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9174 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.831183:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9174 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.831186:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9174 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00000004:00010000:3.0:1713279306.831200:0:15474:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9174 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00000100:00100000:0.0:1713279306.831202:0:15525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14345 00010000:00010000:3.0:1713279306.831205:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9166 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00000100:00100000:0.0:1713279306.831206:0:15525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:385c4b71-808c-40cf-91de-b076b668d13f+3727:11736:x1796503281238080:12345-192.168.203.4@tcp:36:lfs.0 00002000:00010000:1.0:1713279306.831206:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x113c:0x0] updating lvb size from disk: 45312 -> 45312 00002000:00010000:1.0:1713279306.831208:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x113c:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00010000:00010000:3.0:1713279306.831208:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9166 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00002000:00010000:1.0:1713279306.831209:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x113c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1713279306.831210:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x113c:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00010000:00010000:3.0:1713279306.831211:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9166 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00002000:00010000:1.0:1713279306.831212:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x113c:0x0] updating lvb blocks from disk: 64 -> 64 00010000:00010000:3.0:1713279306.831213:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9166 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.831216:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801349258c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.831218:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9166 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.831219:0:15525:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.831221:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9166 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.831225:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880096e84900) 00000100:00100000:1.0:1713279306.831226:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+84:1955:x1796503281238144:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 76us (169us total) trans 4295010181 rc 0/0 00010000:00010000:3.0:1713279306.831226:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.831227:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114eda35a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917433c expref: 3727 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.831228:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9166 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000100:00100000:1.0:1713279306.831230:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110502 00010000:00010000:3.0:1713279306.831231:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9166 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.831233:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f30:0x0].0x0 (ffff88008f43ef00) 00010000:00010000:0.0:1713279306.831235:0:15525:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.831237:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda916d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.831239:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.831239:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda916d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.831242:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda916d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.831243:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00000100:00100000:1.0:1713279306.831244:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122e6d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200049408:0@lo:1000:mdt_io00_004.0 00010000:00010000:3.0:1713279306.831245:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed0ba80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.831246:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.831246:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda916d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.831249:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda916d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.831252:0:15525:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15526 initiator: MDT0 00010000:00010000:3.0:1713279306.831252:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3331 (ffff880131200900) 00010000:00010000:3.0:1713279306.831253:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.831254:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda916d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.831256:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.831259:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda916d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.831264:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9174 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.831267:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9174 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.831270:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9174 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.831273:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed098c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.831274:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9174 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.831276:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9174 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.831279:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ad1:0x0].0x0 (ffff880082706a00) 00010000:00010000:3.0:1713279306.831280:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.831282:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9174 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.831284:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9174 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000100:00100000:3.0:1713279306.831304:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3365:11374:x1796503281238208:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 183us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.831308:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785250 00000100:00100000:1.0:1713279306.831313:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122e6d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200049472:0@lo:1000:mdt_io00_004.0 00000100:00100000:1.0:1713279306.831327:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.831333:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0900 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.831337:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200049472 00000100:00100000:0.0:1713279306.831340:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200049472 00000100:00100000:0.0:1713279306.831350:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98850 00000100:00100000:0.0:1713279306.831352:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+92:15502:x1796503200049472:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:3.0:1713279306.831383:0:15753:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549500 pname:cluuid:pid:xid:nid:opc:job mdt00_035:lustre-MDT0001_UUID:15753:1796503200049280:0@lo:104: 00000100:00100000:0.0:1713279306.831386:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+92:15502:x1796503200049472:12345-0@lo:1000:mdt_io00_004.0 Request processed in 33us (58us total) trans 0 rc -2/-2 00000100:00100000:0.0:1713279306.831390:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98850 00010000:00010000:3.0:1713279306.831390:0:15753:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda90d3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:1.0:1713279306.831392:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122e6d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200049472:0@lo:1000:mdt_io00_004.0 00010000:00010000:1.0:1713279306.831437:0:15502:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.831445:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.831449:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.831455:0:15502:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000004:00020000:1.0:1713279306.831457:0:15502:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0001: migrate [0x240000402:0x7234:0x0]/10 failed: rc = -114 00010000:00010000:3.0:1713279306.831461:0:8071:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.831464:0:8071:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.831467:0:8071:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baaf40 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.831470:0:8071:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.831474:0:8071:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.831477:0:15502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3364:9807:x1796503281232128:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 11550us (11714us total) trans 0 rc -114/-114 00000100:00100000:1.0:1713279306.831481:0:15502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14343 00010000:00010000:3.0:1713279306.831484:0:8071:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.831488:0:8071:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.831495:0:8071:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.831499:0:8071:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091baaf40/0xfc4b8e114eda8ded lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda8e1e expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.831505:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.831506:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.831507:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279306.831511:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713279306.831516:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200049536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.831532:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.831546:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200049536 00000100:00100000:1.0:1713279306.831548:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200049536 00010000:00010000:1.0:1713279306.831555:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda8e1e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda8ded expref: 92 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.831564:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196548 00000100:00100000:1.0:1713279306.831567:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b25ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+92:3490:x1796503200049536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.831571:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.831574:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda8e1e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda8ded expref: 92 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.831581:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114eda8e1e lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda8ded expref: 92 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.831587:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.831590:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.831594:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290400000020 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.831597:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290400000020 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.831600:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.831607:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.831613:0:15526:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.831618:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15526 initiator: MDT0 00000100:00100000:1.0:1713279306.831621:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b25ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+91:3490:x1796503200049536:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.831624:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196548 00000100:00100000:3.0:1713279306.831629:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200049536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.831644:0:15526:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be59f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0000-mdtlov_UUID:15526:1796503200049600:0@lo:1000:mdt_io00_010.0 00000100:00100000:2.0:1713279306.831658:0:15526:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.831664:0:15526:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c2fbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.831679:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200049600 00000100:00100000:0.0:1713279306.831682:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200049600 00000100:00100000:2.0:1713279306.831687:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.831692:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98851 00000100:00100000:0.0:1713279306.831694:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+89:15526:x1796503200049600:12345-0@lo:1000:mdt_io00_010.0 00000100:00100000:3.0:1713279306.831702:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281238272 00000100:00100000:3.0:1713279306.831705:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281238272 00000100:00100000:3.0:1713279306.831722:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785251 00000100:00100000:3.0:1713279306.831727:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:11940:x1796503281238272:12345-192.168.203.4@tcp:101:mkdir.0 00000100:00100000:0.0:1713279306.831733:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+89:15526:x1796503200049600:12345-0@lo:1000:mdt_io00_010.0 Request processed in 38us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.831738:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98851 00010000:00010000:3.0:1713279306.831738:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000001:00080000:2.0:1713279306.831739:0:8061:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4295183718 is committed 00000100:00100000:1.0:1713279306.831741:0:15526:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4295183714 gen 2 00000004:00080000:1.0:1713279306.831745:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183574 committed transno 4295183714 00010000:00010000:3.0:1713279306.831746:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9182 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x119:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b45 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000020:00080000:1.0:1713279306.831747:0:15526:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880129a98c00 refcount 2 committed 0 result 0 batchid 16407 00000020:00080000:1.0:1713279306.831750:0:15526:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880095863b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008c213180 00000020:00080000:1.0:1713279306.831751:0:15526:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].674 00000020:00080000:1.0:1713279306.831753:0:15526:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007f389800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d51d400 00000020:00080000:1.0:1713279306.831754:0:15526:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].189 00000020:00080000:0.0:1713279306.831764:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 16407 committed batchid 16406 00000004:00080000:1.0:1713279306.831767:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183576 committed transno 4295183714 00000020:00080000:1.0:1713279306.831769:0:15526:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800a42d89c0 refcount 2 committed 0 result 0 batchid 16408 00000020:00080000:1.0:1713279306.831770:0:15526:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880130675c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800a42d8180 00000020:00080000:1.0:1713279306.831772:0:15526:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].675 00000020:00080000:1.0:1713279306.831773:0:15526:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880130675f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008e5bb200 00000020:00080000:1.0:1713279306.831774:0:15526:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].190 00000020:00080000:0.0:1713279306.831778:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 16408 committed batchid 16406 00000020:00080000:0.0:1713279306.831782:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16406 00000004:00080000:1.0:1713279306.831782:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183581 committed transno 4295183714 00010000:00010000:3.0:1713279306.831783:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114eda8dc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfc4b8e114eda8dbc expref: 88 pid: 15494 timeout: 0 lvb_type: 0 00000020:00080000:1.0:1713279306.831785:0:15526:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800968dda80 refcount 2 committed 0 result 0 batchid 16409 00000020:00080000:1.0:1713279306.831787:0:15526:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800908e1b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800968ddc00 00000020:00080000:1.0:1713279306.831788:0:15526:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].676 00000020:00080000:1.0:1713279306.831790:0:15526:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800908e1e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8801307a5200 00000020:00080000:1.0:1713279306.831791:0:15526:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].191 00010000:00010000:3.0:1713279306.831792:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880123701600) 00010000:00010000:3.0:1713279306.831795:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda90d3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000020:00080000:0.0:1713279306.831797:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 16409 committed batchid 16406 00000020:00080000:0.0:1713279306.831801:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16406 00000004:00080000:1.0:1713279306.831801:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183584 committed transno 4295183714 00010000:00010000:3.0:1713279306.831801:0:15496:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda90d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15753 initiator: MDT1 00000020:00080000:1.0:1713279306.831803:0:15526:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880129a98780 refcount 2 committed 0 result 0 batchid 16410 00000020:00080000:1.0:1713279306.831804:0:15526:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008ea88b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88012ffbb900 00000020:00080000:1.0:1713279306.831805:0:15526:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].677 00010000:00010000:3.0:1713279306.831806:0:15496:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda90d3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15753 initiator: MDT1 00000020:00080000:1.0:1713279306.831807:0:15526:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131eda200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8801302ee400 00000020:00080000:1.0:1713279306.831808:0:15526:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].192 00010000:00010000:3.0:1713279306.831812:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda90e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000020:00080000:0.0:1713279306.831814:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 16410 committed batchid 16406 00010000:00010000:3.0:1713279306.831817:0:15496:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda90e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9221 initiator: MDT1 00000020:00080000:0.0:1713279306.831818:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16406 00000004:00080000:1.0:1713279306.831818:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183601 committed transno 4295183714 00000020:00080000:1.0:1713279306.831819:0:15526:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008e45f3c0 refcount 2 committed 0 result 0 batchid 16411 00000020:00080000:1.0:1713279306.831821:0:15526:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880123701000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008e45fa80 00010000:00010000:3.0:1713279306.831821:0:15496:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda90e8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9221 initiator: MDT1 00000020:00080000:1.0:1713279306.831823:0:15526:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].678 00000020:00080000:1.0:1713279306.831824:0:15526:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880123701700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880094f5a200 00000020:00080000:1.0:1713279306.831825:0:15526:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].193 00000020:00080000:0.0:1713279306.831831:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 16411 committed batchid 16406 00000004:00080000:1.0:1713279306.831835:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183656 committed transno 4295183714 00000020:00080000:0.0:1713279306.831836:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16406 00010000:00010000:3.0:1713279306.831836:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.831838:0:9221:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda90e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.831842:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda90e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000004:00080000:1.0:1713279306.831844:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183658 committed transno 4295183714 00000004:00080000:1.0:1713279306.831851:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183659 committed transno 4295183714 00000004:00200000:2.0:1713279306.831856:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x233:0x0]: returning size 4096 00000100:00100000:3.0:1713279306.831856:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+87:3490:x1796503200049344:12345-0@lo:103:ldlm_bl.0 Request processed in 1043us (1101us total) trans 0 rc 0/0 00000004:00080000:1.0:1713279306.831858:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183660 committed transno 4295183714 00000004:00200000:2.0:1713279306.831858:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00080000:1.0:1713279306.831865:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183661 committed transno 4295183714 00000100:00100000:3.0:1713279306.831865:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196547 00010000:00010000:2.0:1713279306.831869:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688b40/0xfc4b8e114eda90da lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b29 expref: 3641 pid: 9221 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713279306.831875:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183662 committed transno 4295183714 00010000:00010000:2.0:1713279306.831876:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda90e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b29 expref: 3640 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.831880:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880123701600) 00010000:00010000:2.0:1713279306.831881:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00000004:00080000:1.0:1713279306.831883:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183663 committed transno 4295183714 00010000:00010000:2.0:1713279306.831883:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68ad00, rc 0) 00000004:00080000:1.0:1713279306.831891:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183664 committed transno 4295183714 00000100:00100000:2.0:1713279306.831897:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3640:11876:x1796503281237568:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1257us (1353us total) trans 0 rc 0/0 00000004:00080000:1.0:1713279306.831899:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183665 committed transno 4295183714 00000100:00100000:2.0:1713279306.831901:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785243 00000004:00080000:1.0:1713279306.831906:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183666 committed transno 4295183714 00000004:00080000:1.0:1713279306.831915:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183667 committed transno 4295183714 00000004:00080000:1.0:1713279306.831923:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183668 committed transno 4295183714 00000004:00080000:1.0:1713279306.831930:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183669 committed transno 4295183714 00000004:00080000:1.0:1713279306.831939:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183670 committed transno 4295183714 00000004:00080000:1.0:1713279306.831948:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183671 committed transno 4295183714 00000100:00100000:2.0:1713279306.831952:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00080000:1.0:1713279306.831957:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183672 committed transno 4295183714 00000100:00100000:0.0:1713279306.831962:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281238336 00000100:00100000:0.0:1713279306.831965:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281238336 00000004:00080000:1.0:1713279306.831965:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183673 committed transno 4295183714 00000004:00080000:1.0:1713279306.831972:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183674 committed transno 4295183714 00000100:00100000:0.0:1713279306.831976:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110503 00000100:00100000:0.0:1713279306.831979:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281238336:12345-192.168.203.4@tcp:16:kworker.0 00000004:00080000:1.0:1713279306.831980:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183675 committed transno 4295183714 00000004:00080000:1.0:1713279306.831988:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183677 committed transno 4295183714 00000004:00080000:1.0:1713279306.831994:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183678 committed transno 4295183714 00000004:00080000:1.0:1713279306.832001:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183679 committed transno 4295183714 00000100:00100000:0.0:1713279306.832004:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281238336:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 24us (52us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.832007:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110503 00000004:00080000:1.0:1713279306.832009:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183680 committed transno 4295183714 00000004:00080000:1.0:1713279306.832016:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183681 committed transno 4295183714 00000004:00080000:1.0:1713279306.832022:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183682 committed transno 4295183714 00000004:00080000:1.0:1713279306.832029:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183683 committed transno 4295183714 00000004:00080000:1.0:1713279306.832035:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183684 committed transno 4295183714 00000004:00080000:1.0:1713279306.832042:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183685 committed transno 4295183714 00000004:00080000:1.0:1713279306.832049:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183686 committed transno 4295183714 00000004:00080000:1.0:1713279306.832055:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183687 committed transno 4295183714 00000004:00080000:1.0:1713279306.832078:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183689 committed transno 4295183714 00000004:00080000:1.0:1713279306.832086:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183690 committed transno 4295183714 00000004:00080000:1.0:1713279306.832094:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183691 committed transno 4295183714 00000004:00080000:1.0:1713279306.832101:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183714 committed transno 4295183714 00000100:00100000:1.0:1713279306.832118:0:15526:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be59f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0000-mdtlov_UUID:15526:1796503200049600:0@lo:1000:mdt_io00_010.0 00000100:00100000:3.0:1713279306.832120:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200049344:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1713279306.832133:0:15526:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x7d86:0x0] 00000100:00100000:1.0:1713279306.832145:0:15526:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0000-mdtlov_UUID:15526:1796503200049664:0@lo:1000:mdt_io00_010.0 00010000:00010000:3.0:1713279306.832146:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9189 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x119:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.832151:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.832155:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.832160:0:15526:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.832160:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.832168:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00200000:3.0:1713279306.832168:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x119:0x0]: returning size 4096 00000004:00200000:3.0:1713279306.832170:0:15480:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 4 MDT count 2 00000100:00100000:1.0:1713279306.832174:0:15526:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0180 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.832178:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200049664 00000100:00100000:2.0:1713279306.832178:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.832180:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200049664 00010000:00010000:3.0:1713279306.832182:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9182 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b45 expref: 3720 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.832183:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114eda9039 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.832185:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281238784 00000100:00100000:2.0:1713279306.832187:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281238784 00010000:00010000:1.0:1713279306.832188:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114eda9039 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00010000:00010000:3.0:1713279306.832188:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b45 expref: 3719 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.832190:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98852 00010000:00010000:1.0:1713279306.832191:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114eda9039 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:3.0:1713279306.832192:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x119:0x0].0x0 (ffff88009228ea00) 00000100:00100000:0.0:1713279306.832193:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+87:15526:x1796503200049664:12345-0@lo:1000:mdt_io00_010.0 00010000:00010000:3.0:1713279306.832193:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1713279306.832194:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baa400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.832195:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114eda9039 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:3.0:1713279306.832195:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d4b3180, rc 0) 00000100:00100000:2.0:1713279306.832197:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223067 00010000:00010000:1.0:1713279306.832198:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114eda9039 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.832200:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11965:x1796503281238784:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:1.0:1713279306.832203:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x3431 (ffff880130675500) 00010000:00010000:1.0:1713279306.832205:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.832206:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114eda9039 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.832209:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114eda9039 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00000100:00100000:3.0:1713279306.832211:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11940:x1796503281238272:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 484us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.832215:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785251 00010000:00010000:1.0:1713279306.832219:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9047 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00000100:00100000:3.0:1713279306.832221:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281238464 00010000:00010000:1.0:1713279306.832222:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9047 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00000100:00100000:0.0:1713279306.832223:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+87:15526:x1796503200049664:12345-0@lo:1000:mdt_io00_010.0 Request processed in 30us (63us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.832223:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281238464 00010000:00010000:1.0:1713279306.832225:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9047 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00000100:00100000:0.0:1713279306.832227:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98852 00010000:00010000:1.0:1713279306.832227:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.832229:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9047 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00000100:00100000:3.0:1713279306.832231:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785252 00010000:00010000:1.0:1713279306.832232:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9047 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT1 00000100:00100000:3.0:1713279306.832234:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3727:11711:x1796503281238464:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.832235:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281238592 00010000:00010000:1.0:1713279306.832235:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3431 (ffff880130675600) 00000100:00100000:0.0:1713279306.832237:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281238592 00010000:00010000:1.0:1713279306.832237:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.832238:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9047 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:3.0:1713279306.832239:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.832240:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9047 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00000100:00100000:0.0:1713279306.832244:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110504 00000100:00100000:2.0:1713279306.832245:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11965:x1796503281238784:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 44us (65us total) trans 4295202730 rc 0/0 00010000:00010000:3.0:1713279306.832245:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda9190 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b4c expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.832246:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00000100:00100000:0.0:1713279306.832247:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+84:1954:x1796503281238592:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:1.0:1713279306.832248:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.832250:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223067 00010000:00010000:1.0:1713279306.832251:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.832253:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091bab600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.832255:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.832258:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT1 00002000:00010000:0.0:1713279306.832261:0:11415:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x105e:0x0] initial LVB size: 0, mtime: 0x661e9148, atime: 0x661e9148, ctime: 0x661e9148, blocks: 0x0 00010000:00010000:1.0:1713279306.832261:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ad7:0x0].0x0 (ffff880094168d00) 00010000:00010000:1.0:1713279306.832262:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1713279306.832264:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.832265:0:11415:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009023db00/0xfc4b8e114eda9197 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x105e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.832266:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114eda904e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7ad7:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.832268:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.832270:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.832271:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.832273:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009023db00/0xfc4b8e114eda9197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x105e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.832275:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281238656 00010000:00010000:3.0:1713279306.832276:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda919e lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:2.0:1713279306.832277:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281238656 00010000:00010000:0.0:1713279306.832278:0:11415:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009023db00/0xfc4b8e114eda9197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x105e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.832281:0:15526:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0000-mdtlov_UUID:15526:1796503200049664:0@lo:1000:mdt_io00_010.0 00010000:00010000:3.0:1713279306.832281:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda919e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.832283:0:11415:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009023db00/0xfc4b8e114eda9197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x105e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.832285:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda919e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000100:00100000:2.0:1713279306.832286:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785253 00010000:00010000:0.0:1713279306.832287:0:11415:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009023db00/0xfc4b8e114eda9197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x105e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.832288:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3361:11204:x1796503281238656:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.832289:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda91a5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.832291:0:11415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009023db00/0xfc4b8e114eda9197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.832293:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.832293:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda91a5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.832295:0:11415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023db00 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:3.0:1713279306.832296:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda91a5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.832297:0:11415:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009023db00/0xfc4b8e114eda9197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.832298:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda91ac lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b53 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.832303:0:11415:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009023db00/0xfc4b8e114eda9197 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x105e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713279306.832303:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:3.0:1713279306.832308:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda919e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.832310:0:11415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009023db00/0xfc4b8e114eda9197 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x105e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.832311:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda919e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.832313:0:11415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009023db00/0xfc4b8e114eda9197 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x105e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.832313:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda919e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.832317:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda919e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.832322:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe16880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.832323:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda919e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.832327:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda919e lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.832330:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880097910a00) 00010000:00010000:2.0:1713279306.832331:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda91b3 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.832332:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.832333:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+84:1954:x1796503281238592:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 85us (173us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.832333:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda919e lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:0.0:1713279306.832336:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110504 00010000:00010000:2.0:1713279306.832336:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda91b3 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.832336:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114eda919e lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.832340:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda91b3 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.832341:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda91a5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.832344:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda91a5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.832345:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114eda91ba lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.832347:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda91a5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.832348:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114eda91ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.832349:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe15f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.832350:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda91a5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.832351:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114eda91ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.832353:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda91a5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.832356:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880097910c00) 00010000:00010000:3.0:1713279306.832357:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.832359:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00200000:2.0:1713279306.832359:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:3.0:1713279306.832359:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda91a5 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.832362:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15f80/0xfc4b8e114eda91a5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.832363:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda91b3 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832366:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda91b3 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832369:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda91b3 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.832371:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.832372:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda91b3 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.832373:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda9190 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b4c expref: 3728 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.832375:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf4fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.832376:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda91b3 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832379:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda91b3 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.832379:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda9190 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b4c expref: 3728 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.832383:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:3.0:1713279306.832384:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe17cc0, rc 0) 00010000:00010000:2.0:1713279306.832385:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.832386:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda91b3 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832389:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda91b3 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.832392:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281238912 00010000:00010000:2.0:1713279306.832394:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114eda91ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.832394:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281238912 00000100:00100000:0.0:1713279306.832395:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.832396:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114eda91ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832399:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114eda91ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832402:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf4000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.832404:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114eda91ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.832404:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281239168 00000100:00100000:3.0:1713279306.832405:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281239168 00010000:00010000:2.0:1713279306.832406:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114eda91ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832409:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88011eea5800) 00010000:00010000:2.0:1713279306.832410:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.832427:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114eda91ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.832427:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785254 00010000:00010000:2.0:1713279306.832430:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114eda91ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.832430:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3363:11374:x1796503281238912:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:0.0:1713279306.832431:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785255 00000100:00100000:0.0:1713279306.832434:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:9807:x1796503281239168:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.832435:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.832440:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.832440:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda91c1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b5a expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.832443:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda91ac lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b53 expref: 3363 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.832446:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda91c8 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b61 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.832450:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda91ac lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b53 expref: 3364 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.832455:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf5680, rc 0) 00010000:00010000:3.0:1713279306.832464:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda91cf lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7ad1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00000100:00100000:2.0:1713279306.832466:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3363:11204:x1796503281238656:12345-192.168.203.4@tcp:101:touch.0 Request processed in 177us (197us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.832467:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda91d6 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.832468:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda91cf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7ad1:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00000100:00100000:2.0:1713279306.832469:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785253 00010000:00010000:0.0:1713279306.832472:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda91d6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.832472:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda91cf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7ad1:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.832478:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda91d6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000004:00200000:3.0:1713279306.832479:0:15471:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7ad1:0x0]: returning size 0 00010000:00010000:0.0:1713279306.832486:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda91e4 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.832489:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda91e4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.832492:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda91e4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.832503:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda91d6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.832506:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda91d6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.832508:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda91c1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b5a expref: 3364 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.832509:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda91d6 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.832512:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda91d6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.832514:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.832514:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda91cf lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7ad1:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b5a expref: 3363 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.832516:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda91d6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.832518:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ad1:0x0].0x0 (ffff880082706a00) 00010000:00010000:0.0:1713279306.832519:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda91d6 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.832519:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1713279306.832521:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe16f40, rc 0) 00010000:00010000:0.0:1713279306.832522:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x20a:0x0].0x0 (ffff8801250c1400) 00010000:00010000:0.0:1713279306.832523:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.832525:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda91d6 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.832528:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda91d6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.832533:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda91e4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.832536:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda91e4 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.832536:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3363:11374:x1796503281238912:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 106us (164us total) trans 4295183719 rc 0/0 00010000:00010000:0.0:1713279306.832539:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda91e4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.832540:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785254 00010000:00010000:0.0:1713279306.832542:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c53ba80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.832554:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3727:11711:x1796503281238464:12345-192.168.203.4@tcp:101:touch.0 Request processed in 320us (389us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.832558:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785252 00010000:00010000:3.0:1713279306.832564:0:15753:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda90d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.832568:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda90d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000004:00200000:3.0:1713279306.832579:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x233:0x0]: returning size 4096 00000004:00200000:3.0:1713279306.832581:0:15753:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:3.0:1713279306.832590:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda90cc lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b1b expref: 3363 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.832596:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda90d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b1b expref: 3362 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.832600:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880123701600) 00010000:00010000:3.0:1713279306.832602:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713279306.832603:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e689f80, rc 0) 00010000:00010000:0.0:1713279306.832610:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda91e4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.832613:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3362:11855:x1796503281237376:12345-192.168.203.4@tcp:101:touch.0 Request processed in 2086us (2113us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.832615:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda91e4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.832616:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785242 00010000:00010000:0.0:1713279306.832619:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x20a:0x0].0x3031 (ffff8801250c1f00) 00000100:00100000:2.0:1713279306.832619:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.832621:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.832622:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda91e4 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.832623:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281239296 00010000:00010000:0.0:1713279306.832625:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53ba80/0xfc4b8e114eda91e4 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.832625:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281239296 00000100:00100000:3.0:1713279306.832636:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785256 00000100:00100000:3.0:1713279306.832638:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3640:11912:x1796503281239296:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.832641:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda91c8 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b61 expref: 3721 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.832641:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.832643:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.832645:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda91c8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b61 expref: 3721 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.832647:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda91eb lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b68 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.832651:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023c6c0, rc 0) 00000100:00100000:1.0:1713279306.832654:0:15526:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0000-mdtlov_UUID:15526:1796503200049728:0@lo:403:mdt_io00_010.0 00000100:00100000:0.0:1713279306.832664:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:9807:x1796503281239168:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 229us (269us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.832668:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785255 00000100:00100000:1.0:1713279306.832672:0:15526:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.832675:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281239360 00000100:00100000:0.0:1713279306.832676:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281239360 00010000:00010000:3.0:1713279306.832677:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda91f2 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1713279306.832678:0:15526:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d00c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.832682:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda91f2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00000100:00100000:0.0:1713279306.832685:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785257 00000100:00100000:1.0:1713279306.832686:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281239040 00010000:00010000:3.0:1713279306.832687:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda91f2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00000100:00100000:0.0:1713279306.832688:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3727:11876:x1796503281239360:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.832688:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281239040 00010000:00010000:0.0:1713279306.832692:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.832695:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda91f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.832697:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda9200 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b6f expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.832698:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223068 00010000:00010000:3.0:1713279306.832700:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda91f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00000100:00100000:1.0:1713279306.832701:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11950:x1796503281239040:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:3.0:1713279306.832708:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda91f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.832713:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539d40/0xfc4b8e114eda9207 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.832718:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539d40/0xfc4b8e114eda9207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00000004:00200000:3.0:1713279306.832720:0:15474:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:0.0:1713279306.832722:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539d40/0xfc4b8e114eda9207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.832728:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda91f2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.832733:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda91f2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.832738:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda91f2 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.832743:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda91f2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.832747:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe16d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.832750:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda91f2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00000100:00100000:1.0:1713279306.832752:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:11950:x1796503281239040:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 50us (392us total) trans 4295202731 rc 0/0 00010000:00010000:3.0:1713279306.832754:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda91f2 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00000100:00100000:1.0:1713279306.832756:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223068 00010000:00010000:3.0:1713279306.832761:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880097910900) 00010000:00010000:3.0:1713279306.832763:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.832765:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200049728 00010000:00010000:3.0:1713279306.832765:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda91f2 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000100:00100000:1.0:1713279306.832767:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200049728 00010000:00010000:3.0:1713279306.832770:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda91f2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000100:00100000:1.0:1713279306.832776:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98853 00000100:00100000:1.0:1713279306.832778:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+87:15526:x1796503200049728:12345-0@lo:403:mdt_io00_010.0 00010000:00010000:3.0:1713279306.832778:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda91f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.832784:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda91f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.832787:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda91f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.832789:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe14900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.832791:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda91f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.832793:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda91f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00000100:00100000:2.0:1713279306.832794:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.832797:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880097910400) 00010000:00010000:3.0:1713279306.832798:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.832799:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda91f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000100:00100000:2.0:1713279306.832801:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281239488 00010000:00010000:3.0:1713279306.832802:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda91f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000100:00100000:2.0:1713279306.832803:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281239488 00000004:00200000:0.0:1713279306.832806:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x84a3:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.832808:0:15482:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:2.0:1713279306.832813:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785258 00000004:00010000:0.0:1713279306.832815:0:15482:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539d40/0xfc4b8e114eda9207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.832816:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3642:11952:x1796503281239488:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.832817:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda91eb lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b68 expref: 3642 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.832821:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.832821:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114eda91eb lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b68 expref: 3642 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.832825:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda9200 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b6f expref: 3729 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.832826:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114eda920e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b76 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.832826:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe161c0, rc 0) 00000100:00100000:3.0:1713279306.832840:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3642:11912:x1796503281239296:12345-192.168.203.4@tcp:101:touch.0 Request processed in 201us (221us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.832844:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785256 00010000:00010000:2.0:1713279306.832853:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9215 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.832858:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9215 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832862:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9215 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832867:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda921c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.832871:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda921c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832874:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda921c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.832875:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.832882:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9223 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.832885:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9223 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832888:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9223 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.832893:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539d40/0xfc4b8e114eda9207 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b6f expref: 3728 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.832893:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9215 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832896:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9215 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.832897:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x84a3:0x0].0x0 (ffff880096e84e00) 00010000:00010000:0.0:1713279306.832899:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713279306.832899:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9215 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.832900:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539d40, rc 0) 00010000:00010000:2.0:1713279306.832902:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9215 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832904:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf6ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.832906:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9215 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832908:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9215 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.832913:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3728:11876:x1796503281239360:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 224us (271us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.832914:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00000100:00100000:0.0:1713279306.832916:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785257 00010000:00010000:2.0:1713279306.832916:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.832917:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9215 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832920:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9215 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832925:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda921c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.832927:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281239552 00010000:00010000:2.0:1713279306.832927:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda921c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.832929:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281239552 00010000:00010000:2.0:1713279306.832930:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda921c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832932:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.832934:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda921c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.832937:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110505 00010000:00010000:2.0:1713279306.832937:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda921c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.832940:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281239552:12345-192.168.203.4@tcp:16:kworker.0 00010000:00010000:2.0:1713279306.832940:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3831 (ffff88011eea5d00) 00010000:00010000:2.0:1713279306.832941:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.832942:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda921c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.832942:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.832945:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda921c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.832955:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114eda920e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b76 expref: 3642 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.832960:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281239552:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 19us (85us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.832961:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9223 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b76 expref: 3641 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.832963:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110505 00010000:00010000:2.0:1713279306.832964:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84ee:0x0].0x0 (ffff88008acd3000) 00010000:00010000:2.0:1713279306.832965:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1713279306.832967:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf5b00, rc 0) 00000100:00100000:0.0:1713279306.832971:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281239744 00000100:00100000:0.0:1713279306.832973:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281239744 00000100:00100000:2.0:1713279306.832979:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3641:11952:x1796503281239488:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 161us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.832982:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785258 00000100:00100000:0.0:1713279306.832987:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785259 00000100:00100000:0.0:1713279306.832990:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3362:11961:x1796503281239744:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.832994:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.833000:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114eda922a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x75f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b7d expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.833014:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.833022:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281239616 00000100:00100000:3.0:1713279306.833024:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281239616 00000004:00200000:0.0:1713279306.833029:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x75f8:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.833036:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114eda922a lrc: 1/0,0 mode: --/CW res: [0x240000402:0x75f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b7d expref: 3363 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.833036:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147259 00000100:00100000:3.0:1713279306.833039:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:1956:x1796503281239616:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.833041:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114eda922a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x75f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b7d expref: 3363 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.833043:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.833047:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ec240, rc 0) 00010000:00010000:3.0:1713279306.833050:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda9143 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x75f8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b22 expref: 3721 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.833056:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x75f8:0x0].0x0 (ffff880082706900) 00010000:00010000:3.0:1713279306.833058:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.833061:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3362:11961:x1796503281239744:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 71us (121us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.833065:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785259 00000100:00100000:3.0:1713279306.833083:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:1956:x1796503281239616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 42us (69us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.833087:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147259 00000100:00100000:1.0:1713279306.833902:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+87:15526:x1796503200049728:12345-0@lo:403:mdt_io00_010.0 Request processed in 1122us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.833906:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98853 00000100:00100000:0.0:1713279306.833921:0:15526:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0000-mdtlov_UUID:15526:1796503200049728:0@lo:403:mdt_io00_010.0 00000100:00100000:2.0:1713279306.834043:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.834054:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.834055:0:15502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281239872 00000100:00100000:1.0:1713279306.834057:0:15502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281239872 00000100:00100000:2.0:1713279306.834066:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.834080:0:15502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14346 00000100:00100000:1.0:1713279306.834083:0:15502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3362:10814:x1796503281239872:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:1.0:1713279306.834106:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15502 initiator: MDT0 00010000:00010000:1.0:1713279306.834112:0:15502:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.834117:0:15502:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279306.834124:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097bad880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200049792:0@lo:101:mdt_io00_004.0 00000100:00100000:1.0:1713279306.834136:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.834142:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0000 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.834147:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200049792 00000100:00100000:2.0:1713279306.834149:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200049792 00000100:00100000:2.0:1713279306.834165:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98854 00000100:00100000:2.0:1713279306.834168:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+91:15502:x1796503200049792:12345-0@lo:101:mdt_io00_004.0 00010000:00010000:2.0:1713279306.834173:0:15580:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.834179:0:15580:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda9238 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda9231 expref: -99 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.834187:0:15580:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.834190:0:15580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda9238 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda9231 expref: 92 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.834196:0:15580:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.834202:0:15580:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda9238 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9231 expref: 92 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.834205:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:2.0:1713279306.834207:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.834208:0:15580:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.834211:0:15580:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e35f80, rc 0) 00000100:00100000:2.0:1713279306.834226:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+92:15502:x1796503200049792:12345-0@lo:101:mdt_io00_004.0 Request processed in 58us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.834229:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98854 00000100:00100000:1.0:1713279306.834233:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097bad880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200049792:0@lo:101:mdt_io00_004.0 00010000:00010000:1.0:1713279306.834239:0:15502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.834244:0:15502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.834454:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda923f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.834460:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda923f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.834464:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda923f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.834469:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda9246 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x14f:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.834473:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda9246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.834476:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda9246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.834481:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda924d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x148:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.834486:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda924d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.834489:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda924d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.834494:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda9254 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x148:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.834497:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda9254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.834500:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda9254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.834513:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x843e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.834518:0:15526:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114eda8d61 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x843e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a18 expref: 3727 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.834522:0:15526:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 4/0,1 mode: --/EX res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.834532:0:15526:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114eda8d61 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x843e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a18 expref: 3727 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.834538:0:15526:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114eda8d61 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x843e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a18 expref: 3727 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.834544:0:15526:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0000_UUID:15526:1796503200049856:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.834562:0:15526:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540e40 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.834570:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281239936 00000100:00100000:0.0:1713279306.834573:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281239936 00000100:00100000:0.0:1713279306.834582:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281240000 00000100:00100000:0.0:1713279306.834583:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281240000 00000100:00100000:2.0:1713279306.834592:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785260 00000100:00100000:2.0:1713279306.834595:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3364:11374:x1796503281239936:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:0.0:1713279306.834598:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785261 00000100:00100000:0.0:1713279306.834601:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3364:11940:x1796503281240000:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:2.0:1713279306.834603:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.834606:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.834608:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda9262 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b84 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.834612:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda9269 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x135:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b8b expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.834623:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda9262 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b84 expref: 3366 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.834629:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b3cc0/0xfc4b8e114eda9262 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7ad1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b84 expref: 3366 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.834636:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ad1:0x0].0x0 (ffff880082706a00) 00010000:00010000:2.0:1713279306.834637:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1713279306.834639:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800926b3cc0, rc 0) 00010000:00010000:0.0:1713279306.834642:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda9270 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x135:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.834646:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda9270 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.834651:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda9270 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.834652:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3366:11374:x1796503281239936:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 57us (598us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.834654:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda9270 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.834656:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785260 00010000:00010000:0.0:1713279306.834657:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda9270 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.834659:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda9270 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.834662:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ef180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.834664:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda9270 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.834666:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda9270 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.834718:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x135:0x0].0x0 (ffff88008c2e7e00) 00010000:00010000:0.0:1713279306.834720:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713279306.834722:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda9270 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.834725:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114eda9270 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x135:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.834736:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.834741:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda9269 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x135:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b8b expref: 3365 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.834745:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114eda9269 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x135:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b8b expref: 3365 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.834752:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ecb40, rc 0) 00000100:00100000:1.0:1713279306.834765:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281240704 00000100:00100000:0.0:1713279306.834767:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3364:11940:x1796503281240000:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 166us (700us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.834768:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281240704 00000100:00100000:0.0:1713279306.834771:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785261 00000100:00100000:1.0:1713279306.834782:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223069 00000100:00100000:1.0:1713279306.834784:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130146c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3728:11876:x1796503281240704:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:0.0:1713279306.834951:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.834962:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281240768 00000100:00100000:2.0:1713279306.834964:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281240768 00000100:00100000:2.0:1713279306.834975:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110506 00000100:00100000:2.0:1713279306.834978:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281240768:12345-192.168.203.4@tcp:16:kworker.0 00000100:00100000:2.0:1713279306.835002:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281240768:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 24us (52us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.835006:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110506 00010000:00010000:2.0:1713279306.835337:0:15526:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880090afea00 x1796503200049856) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114eda8d61 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x843e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a18 expref: 3729 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.835344:0:15526:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114eda8d61 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x843e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a18 expref: 3729 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.835352:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114eda8d61 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x843e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a18 expref: 3729 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.835358:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.835358:0:15526:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0000_UUID:15526:1796503200049856:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.835364:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x843e:0x0].0x0 (ffff88008e4c8b00) 00010000:00010000:2.0:1713279306.835366:0:15526:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT0 00000100:00100000:3.0:1713279306.835366:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.835370:0:15526:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15526 initiator: MDT0 00000100:00100000:0.0:1713279306.835374:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.835376:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15526 initiator: MDT0 00000100:00100000:0.0:1713279306.835382:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281240128 00010000:00010000:2.0:1713279306.835382:0:15526:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00000100:00100000:1.0:1713279306.835383:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281240256 00000100:00100000:0.0:1713279306.835384:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281240128 00010000:00010000:2.0:1713279306.835386:0:15526:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00000100:00100000:1.0:1713279306.835387:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281240256 00010000:00010000:2.0:1713279306.835389:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00000100:00100000:0.0:1713279306.835395:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785262 00000100:00100000:0.0:1713279306.835398:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11204:x1796503281240128:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.835400:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.835402:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785263 00010000:00010000:0.0:1713279306.835405:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.835405:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3641:11711:x1796503281240256:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.835410:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114eda9277 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b92 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.835410:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.835426:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.835430:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda927e lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175b99 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.835434:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281240384 00000100:00100000:3.0:1713279306.835436:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281240384 00010000:00010000:0.0:1713279306.835448:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda9285 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.835448:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785264 00000100:00100000:3.0:1713279306.835451:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3364:11855:x1796503281240384:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.835453:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda9285 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835454:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda928c lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.835457:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda9285 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835458:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda928c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.835459:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.835460:0:15753:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1713279306.835462:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9293 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835462:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda928c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.835466:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9293 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835467:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda929a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.835468:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114eda90d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b1b expref: 3364 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.835469:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9293 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835471:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda929a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.835474:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda929a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.835478:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880123701600) 00010000:00010000:3.0:1713279306.835480:0:15753:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.835481:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda9285 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.835484:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda9285 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835485:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda928c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.835485:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda92a1 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ba0 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.835487:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda9285 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835488:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda928c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.835490:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda9285 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835491:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda928c lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.835493:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ecfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.835494:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda9285 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835494:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda928c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.835497:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.835498:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda928c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.835500:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda9285 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00000004:00010000:2.0:1713279306.835502:0:15526:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008c161500 reply state ffff88012b12e000 transno 4295202732 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.835504:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:1.0:1713279306.835504:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda928c lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.835505:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.835505:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda92a8 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.835507:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda9285 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835508:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880130675100) 00010000:00010000:2.0:1713279306.835508:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.835509:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda9285 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835509:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.835510:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda92a8 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.835511:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda928c lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.835511:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x843e:0x0].0x0 (ffff88008e4c8b00) 00010000:00010000:1.0:1713279306.835513:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda928c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.835513:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1713279306.835514:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9293 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.835514:0:15526:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.835514:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda92a8 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.835516:0:15526:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda924d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.835517:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9293 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835518:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda929a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.835519:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda92af lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:0.0:1713279306.835520:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9293 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.835520:0:15526:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda924d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.835521:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda929a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.835523:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ed680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.835523:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda929a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.835523:0:15526:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda924d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT0 00010000:00010000:3.0:1713279306.835523:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda92af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.835524:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9293 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835526:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925433c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.835526:0:15526:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda924d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT0 00010000:00010000:3.0:1713279306.835526:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda92af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:0.0:1713279306.835527:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9293 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835527:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda929a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.835528:0:15526:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ed200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.835530:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff8800940a8800) 00010000:00010000:1.0:1713279306.835530:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda929a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.835531:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.835531:0:15526:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda924d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.835532:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9293 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835533:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880130675800) 00010000:00010000:2.0:1713279306.835534:0:15526:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda924d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.835535:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9293 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.835535:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.835536:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda929a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.835538:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x0 (ffff880091b34100) 00010000:00010000:1.0:1713279306.835539:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda929a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.835539:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.835540:0:15526:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda924d lrc: 3/0,0 mode: --/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.835543:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda924d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.835546:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114eda9277 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b92 expref: 3721 pid: 15482 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.835548:0:15526:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008c161500 reply state ffff88012b12e000 transno 4295202732 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda9254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.835550:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114eda9277 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b92 expref: 3721 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.835551:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda927e lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b99 expref: 3642 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.835551:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda9254 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.835554:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x38 (ffff880092ae7500) 00010000:00010000:0.0:1713279306.835555:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ecd80, rc 0) 00010000:00010000:2.0:1713279306.835555:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.835556:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda927e lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b99 expref: 3642 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.835556:0:15526:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:2.0:1713279306.835558:0:15526:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda923f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.835561:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925421c0, rc 0) 00010000:00010000:2.0:1713279306.835561:0:15526:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda923f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT0 00010000:00010000:3.0:1713279306.835562:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda92b6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7d29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.835563:0:15526:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda923f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.835566:0:15526:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda923f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT0 00010000:00010000:3.0:1713279306.835569:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda92b6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7d29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.835571:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11204:x1796503281240128:12345-192.168.203.4@tcp:101:touch.0 Request processed in 171us (213us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.835571:0:15526:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.835572:0:15526:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda923f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT0 00000100:00100000:0.0:1713279306.835574:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785262 00010000:00010000:3.0:1713279306.835574:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda92b6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7d29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.835575:0:15526:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda923f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT0 00000100:00100000:1.0:1713279306.835576:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3641:11711:x1796503281240256:12345-192.168.203.4@tcp:101:touch.0 Request processed in 169us (200us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.835578:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x0 (ffff880091b35d00) 00000100:00100000:1.0:1713279306.835579:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785263 00010000:00010000:2.0:1713279306.835579:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.835580:0:15526:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda923f lrc: 3/0,0 mode: --/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT0 00000004:00200000:3.0:1713279306.835580:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7d29:0x0]: returning size 0 00010000:00010000:2.0:1713279306.835583:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda923f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT0 00000004:00010000:2.0:1713279306.835588:0:15526:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008c161500 reply state ffff88012b12e000 transno 4295202732 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda9246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.835591:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda9246 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.835594:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x38 (ffff880092ae7700) 00010000:00010000:2.0:1713279306.835595:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.835596:0:15526:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000004:00080000:2.0:1713279306.835598:0:15526:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x7d86:0x0] 00010000:00010000:2.0:1713279306.835601:0:15526:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 15526 initiator: MDT0 00000100:00100000:0.0:1713279306.835603:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.835604:0:15526:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.835607:0:15526:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15526 initiator: MDT0 00010000:00010000:3.0:1713279306.835610:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda92a8 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:1.0:1713279306.835612:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281240512 00010000:00010000:2.0:1713279306.835612:0:15526:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ef180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.835613:0:15526:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15526 initiator: MDT0 00000100:00100000:1.0:1713279306.835614:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281240512 00010000:00010000:2.0:1713279306.835616:0:15526:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 15526 initiator: MDT0 00010000:00010000:3.0:1713279306.835617:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda92a8 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.835619:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:2.0:1713279306.835620:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.835622:0:15526:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.835622:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda92a8 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00000100:00100000:1.0:1713279306.835625:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785265 00010000:00010000:2.0:1713279306.835625:0:15526:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290400000020 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.835627:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3366:11937:x1796503281240512:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.835627:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda92a8 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.835628:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.835631:0:15526:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda9238 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9231 expref: 91 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.835632:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.835632:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe14fc0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.835634:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.835634:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda92a8 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.835638:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114eda92c4 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ba7 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.835639:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda92a8 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:2.0:1713279306.835640:0:15526:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.835643:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.835643:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef180/0xfc4b8e114eda8f91 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15526 initiator: MDT0 00010000:00010000:3.0:1713279306.835646:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880123701600) 00010000:00010000:0.0:1713279306.835647:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.835648:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.835651:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda92a8 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.835656:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda92a8 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.835663:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda92af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.835665:0:15526:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_010:385c4b71-808c-40cf-91de-b076b668d13f+3730:11854:x1796503281234880:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 8864us (8892us total) trans 4295202732 rc 0/0 00010000:00010000:3.0:1713279306.835667:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda92af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.835669:0:15526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14344 00010000:00010000:3.0:1713279306.835670:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda92af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.835671:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda92cb lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.835675:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe15b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.835677:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda92af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:1.0:1713279306.835678:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda92cb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.835680:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281241152 00010000:00010000:3.0:1713279306.835680:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda92af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.835682:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281241152 00010000:00010000:1.0:1713279306.835683:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda92cb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.835683:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3031 (ffff880096e84200) 00010000:00010000:3.0:1713279306.835685:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.835686:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda92af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.835689:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda92af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.835691:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110507 00010000:00010000:1.0:1713279306.835692:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda92d2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.835693:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+90:1956:x1796503281241152:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:1.0:1713279306.835697:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda92d2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.835702:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda92d2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.835706:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda92a1 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ba0 expref: 3368 pid: 15753 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713279306.835709:0:11415:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000400:0x104c:0x0] initial LVB size: 0, mtime: 0x661e9145, atime: 0x661e9145, ctime: 0x661e9145, blocks: 0x0 00010000:00010000:2.0:1713279306.835712:0:11415:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800926b0240/0xfc4b8e114eda92d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x104c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.835712:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda92b6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7d29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ba0 expref: 3367 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.835715:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d29:0x0].0x0 (ffff88009e797300) 00010000:00010000:2.0:1713279306.835717:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.835717:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713279306.835718:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe146c0, rc 0) 00010000:00010000:2.0:1713279306.835719:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.835721:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800926b0240/0xfc4b8e114eda92d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x104c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713279306.835723:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7884:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.835726:0:11415:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800926b0240/0xfc4b8e114eda92d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x104c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.835730:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda92cb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.835731:0:11415:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800926b0240/0xfc4b8e114eda92d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x104c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.835732:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3367:11855:x1796503281240384:12345-192.168.203.4@tcp:101:touch.0 Request processed in 281us (306us total) trans 4295183720 rc 0/0 00010000:00010000:1.0:1713279306.835734:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda92cb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.835735:0:11415:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800926b0240/0xfc4b8e114eda92d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x104c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.835737:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785264 00010000:00010000:1.0:1713279306.835738:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda92cb lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.835739:0:11415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800926b0240/0xfc4b8e114eda92d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x104c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.835742:0:11415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b0240 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:1.0:1713279306.835743:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda92cb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.835744:0:11415:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800926b0240/0xfc4b8e114eda92d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x104c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.835745:0:15753:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281240640 00010000:00010000:1.0:1713279306.835747:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093691440 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.835747:0:15753:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281240640 00010000:00010000:1.0:1713279306.835750:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda92cb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.835750:0:11415:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800926b0240/0xfc4b8e114eda92d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x104c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.835754:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda92cb lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.835756:0:11415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800926b0240/0xfc4b8e114eda92d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x104c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.835760:0:11415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800926b0240/0xfc4b8e114eda92d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x104c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.835760:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785266 00010000:00010000:1.0:1713279306.835761:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:1.0:1713279306.835763:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.835763:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3367:9807:x1796503281240640:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.835765:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda92cb lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.835768:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.835770:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114eda92cb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.835774:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda92e0 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x234:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175bae expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.835778:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+90:1956:x1796503281241152:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 83us (378us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.835781:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda92d2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.835782:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110507 00010000:00010000:1.0:1713279306.835786:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda92d2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.835791:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda92d2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.835791:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281240960 00010000:00010000:3.0:1713279306.835792:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda92e7 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x234:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00000100:00100000:2.0:1713279306.835793:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281240960 00010000:00010000:1.0:1713279306.835795:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008be61680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.835796:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda92d2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.835797:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda92e7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.835798:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda92ee lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.835799:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda92d2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.835801:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda92e7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.835803:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda92ee lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.835803:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x37 (ffff880130675e00) 00000100:00100000:2.0:1713279306.835803:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147260 00010000:00010000:1.0:1713279306.835804:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.835805:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3641:1955:x1796503281240960:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.835806:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda92d2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.835806:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda92f5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.835807:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda92ee lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.835809:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114eda92d2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.835809:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda92f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.835810:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.835812:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda92fc lrc: 3/0,1 mode: --/PW res: [0x200000400:0x235:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.835813:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda92f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.835815:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda92fc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.835815:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9223 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x84ee:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b76 expref: 3641 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.835819:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda92fc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.835820:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84ee:0x0].0x0 (ffff88008acd3000) 00010000:00010000:1.0:1713279306.835822:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114eda92c4 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ba7 expref: 3368 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.835822:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.835827:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114eda92c4 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ba7 expref: 3368 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.835829:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3640:1955:x1796503281240960:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 23us (465us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.835830:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.835831:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093693a80, rc 0) 00000100:00100000:2.0:1713279306.835833:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147260 00010000:00010000:0.0:1713279306.835835:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114ed9e48f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172bf7 expref: 3729 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.835840:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114ed9e997 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d6a expref: 3719 pid: 15488 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713279306.835840:0:15471:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x74de:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.835844:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542640/0xfc4b8e114eda39a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917448c expref: 3719 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.835845:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3367:11937:x1796503281240512:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 216us (241us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.835848:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114eda8f75 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7f30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab9 expref: 3729 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.835849:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785265 00010000:00010000:0.0:1713279306.835851:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 7/0,1 mode: --/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.835859:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda92e7 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.835861:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114eda8f75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab9 expref: 3729 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.835864:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda92e7 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.835866:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114eda8f75 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7f30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab9 expref: 3729 pid: 15749 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.835869:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda92e7 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00000100:00100000:0.0:1713279306.835872:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200049920:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.835877:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda92e7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.835882:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe14480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.835884:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda92e7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.835889:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda92e7 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.835890:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092542640/0xfc4b8e114eda39a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917448c expref: 3719 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.835894:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542640/0xfc4b8e114eda39a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917448c expref: 3719 pid: 15479 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.835896:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x234:0x0].0x0 (ffff880096e84100) 00010000:00010000:3.0:1713279306.835898:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.835899:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121535180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200049984:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.835900:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda92e7 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.835905:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda92e7 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.835908:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114ed9e997 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d6a expref: 3719 pid: 15488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.835912:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114ed9e997 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d6a expref: 3719 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.835914:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda92f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00000100:00100000:0.0:1713279306.835916:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200050048:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.835919:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda92f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.835924:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda92f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.835925:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114ed9e48f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172bf7 expref: 3729 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.835928:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fca86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.835929:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114ed9e48f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172bf7 expref: 3729 pid: 9221 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.835930:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda92f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00000100:00100000:0.0:1713279306.835933:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121536d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200050112:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.835934:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda92f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00000100:00100000:0.0:1713279306.835939:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540f00 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.835941:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x234:0x0].0x3031 (ffff880096e84f00) 00010000:00010000:3.0:1713279306.835942:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.835944:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda92f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.835947:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda92f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.835963:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda92e0 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x234:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bae expref: 3367 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.835967:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda92e0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x234:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bae expref: 3367 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.835973:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe17a80, rc 0) 00000100:00100000:0.0:1713279306.835981:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.835985:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3366:9807:x1796503281240640:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 221us (350us total) trans 4295183721 rc 301/301 00000100:00100000:3.0:1713279306.835989:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785266 00000100:00100000:1.0:1713279306.835992:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281240896 00000100:00100000:1.0:1713279306.835994:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281240896 00000100:00100000:3.0:1713279306.836003:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785267 00000100:00100000:3.0:1713279306.836006:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3640:11912:x1796503281240896:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.836011:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.836017:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda9311 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175bb5 expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.836036:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda9318 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.836040:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda9318 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.836044:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda9318 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.836049:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda931f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00000100:00100000:0.0:1713279306.836050:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.836052:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda931f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.836055:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda931f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.836060:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281241216 00000100:00100000:2.0:1713279306.836062:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281241216 00010000:00010000:3.0:1713279306.836065:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda9318 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.836082:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.836083:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda9318 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.836085:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110508 00010000:00010000:3.0:1713279306.836086:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda9318 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.836088:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281241216:12345-192.168.203.4@tcp:16:kworker.0 00010000:00010000:3.0:1713279306.836089:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda9318 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.836092:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.836093:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda9318 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00000100:00100000:1.0:1713279306.836096:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281241088 00010000:00010000:3.0:1713279306.836096:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda9318 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00000100:00100000:1.0:1713279306.836099:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281241088 00010000:00010000:3.0:1713279306.836100:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88008c2e7f00) 00010000:00010000:3.0:1713279306.836102:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.836105:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda9318 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.836110:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114eda9318 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.836111:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281241216:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 22us (62us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.836114:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110508 00010000:00010000:3.0:1713279306.836117:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda931f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.836121:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.836123:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda931f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.836128:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda931f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.836131:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.836134:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda931f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.836139:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda931f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT1 00010000:00010000:3.0:1713279306.836145:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88008e59ca00) 00010000:00010000:3.0:1713279306.836147:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.836149:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda931f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00000100:00100000:0.0:1713279306.836150:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.836153:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114eda931f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT1 00000100:00100000:2.0:1713279306.836159:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281241344 00000100:00100000:2.0:1713279306.836161:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281241344 00000100:00100000:2.0:1713279306.836169:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281241472 00000100:00100000:2.0:1713279306.836170:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281241472 00010000:00010000:3.0:1713279306.836172:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda9311 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bb5 expref: 3641 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.836176:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785268 00000100:00100000:2.0:1713279306.836179:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11967:x1796503281241344:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.836180:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114eda9311 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bb5 expref: 3641 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.836185:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.836189:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba8240, rc 0) 00010000:00010000:2.0:1713279306.836190:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9326 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175bc3 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.836212:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3640:11912:x1796503281240896:12345-192.168.203.4@tcp:101:touch.0 Request processed in 203us (229us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.836218:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785267 00010000:00010000:2.0:1713279306.836222:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda932d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836228:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda932d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00000100:00100000:3.0:1713279306.836231:0:15753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785269 00010000:00010000:2.0:1713279306.836232:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda932d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00000100:00100000:3.0:1713279306.836235:0:15753:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3730:11956:x1796503281241472:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.836238:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda9334 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836241:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda9334 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.836244:0:15753:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.836245:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda9334 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.836252:0:15753:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda933b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175bca expref: -99 pid: 15753 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713279306.836274:0:15471:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7e3b:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.836278:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda932d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836281:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda932d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836284:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda932d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00000100:00100000:0.0:1713279306.836287:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.836287:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda932d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836289:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b0480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.836291:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda932d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836294:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda932d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.836295:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda9342 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.836298:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:2.0:1713279306.836299:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.836301:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda932d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.836301:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda9342 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.836303:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0480/0xfc4b8e114eda932d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.836305:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda9342 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.836308:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda9334 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.836311:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114eda9349 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.836313:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda9334 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836315:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda9334 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.836315:0:15753:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114eda9349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.836318:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf6400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.836318:0:15753:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114eda9349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.836319:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda9334 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836322:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda9334 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836325:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3831 (ffff880136671000) 00010000:00010000:2.0:1713279306.836326:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.836327:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda9334 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836329:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda9334 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.836337:0:15753:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda9350 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.836340:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9326 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bc3 expref: 3721 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.836343:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda9350 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.836344:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9326 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bc3 expref: 3721 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.836346:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda9350 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.836347:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800926b1b00, rc 0) 00010000:00010000:3.0:1713279306.836349:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda9350 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.836351:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.836353:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda9350 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.836356:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda9350 lrc: 4/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.836359:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7abd:0x0].0x0 (ffff88008c2e7d00) 00010000:00010000:3.0:1713279306.836361:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda9350 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.836364:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba86c0/0xfc4b8e114eda9350 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.836369:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11967:x1796503281241344:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 189us (248us total) trans 0 rc 301/301 00000004:00200000:3.0:1713279306.836370:0:15753:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7abd:0x0]: returning size 42048 00000100:00100000:2.0:1713279306.836373:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785268 00000100:00100000:2.0:1713279306.836379:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281241664 00000100:00100000:2.0:1713279306.836381:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281241664 00010000:00010000:3.0:1713279306.836392:0:15753:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda9342 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15753 initiator: MDT0 00000100:00100000:2.0:1713279306.836393:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785270 00000100:00100000:2.0:1713279306.836395:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3733:11711:x1796503281241664:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.836395:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda9342 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.836398:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda9342 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.836401:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.836401:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda9342 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.836404:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baa640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.836405:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda9342 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.836406:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda935e lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175bd1 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.836408:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda9342 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.836430:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.836432:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.836433:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda9342 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.836436:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114eda9342 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.836440:0:15753:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114eda9349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.836443:0:15753:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114eda9349 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.836446:0:15753:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114eda9349 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.836448:0:15753:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091bab840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.836450:0:15753:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114eda9349 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.836452:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9365 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.836452:0:15753:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114eda9349 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15753 initiator: MDT0 00010000:00010000:3.0:1713279306.836455:0:15753:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x33 (ffff88008d11ee00) 00010000:00010000:3.0:1713279306.836456:0:15753:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.836457:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9365 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.836458:0:15753:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114eda9349 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.836461:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9365 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.836461:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114eda9349 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15753 initiator: MDT0 00010000:00010000:2.0:1713279306.836467:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114eda936c lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836470:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114eda936c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836473:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114eda936c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00000100:00100000:1.0:1713279306.836475:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130146c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3734:11876:x1796503281240704:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1689us (1738us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.836476:0:15753:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda933b lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bca expref: 3734 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.836480:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223069 00000004:00200000:2.0:1713279306.836480:0:15471:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00010000:00010000:3.0:1713279306.836480:0:15753:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114eda933b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bca expref: 3734 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.836484:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9365 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.836484:0:15753:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baa1c0, rc 0) 00010000:00010000:2.0:1713279306.836487:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9365 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836490:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9365 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836493:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9365 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836496:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f192ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.836497:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9365 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836500:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9365 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836504:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880136671a00) 00010000:00010000:2.0:1713279306.836505:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.836506:0:15753:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_035:385c4b71-808c-40cf-91de-b076b668d13f+3732:11956:x1796503281241472:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 270us (354us total) trans 4295202733 rc 301/301 00010000:00010000:2.0:1713279306.836507:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9365 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836509:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9365 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00000100:00100000:1.0:1713279306.836510:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785271 00000100:00100000:1.0:1713279306.836513:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3732:11952:x1796503281241088:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:3.0:1713279306.836513:0:15753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785269 00010000:00010000:2.0:1713279306.836514:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114eda936c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836516:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114eda936c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.836519:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.836519:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114eda936c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836522:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a064480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.836523:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114eda936c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.836525:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda9373 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x84ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175bbc expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.836526:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114eda936c lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836531:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff880136671300) 00010000:00010000:2.0:1713279306.836532:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.836534:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114eda936c lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836537:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114eda936c lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.836548:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda935e lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bd1 expref: 3732 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.836552:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda935e lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bd1 expref: 3732 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.836557:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf46c0, rc 0) 00000100:00100000:2.0:1713279306.836572:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3731:11711:x1796503281241664:12345-192.168.203.4@tcp:101:touch.0 Request processed in 175us (285us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.836576:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785270 00000004:00200000:1.0:1713279306.836583:0:15474:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x84ee:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.836597:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda9373 lrc: 1/0,0 mode: --/CW res: [0x200000403:0x84ee:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bbc expref: 3730 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.836605:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be63600/0xfc4b8e114eda9373 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x84ee:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bbc expref: 3730 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.836611:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008be63600, rc 0) 00000100:00100000:1.0:1713279306.836628:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3729:11952:x1796503281241088:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 114us (560us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.836632:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785271 00000100:00100000:0.0:1713279306.836747:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.836756:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281241728 00000100:00100000:1.0:1713279306.836759:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281241728 00000100:00100000:1.0:1713279306.836768:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785272 00000100:00100000:1.0:1713279306.836770:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3366:11204:x1796503281241728:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.836776:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.836781:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c480/0xfc4b8e114eda937a lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175bd8 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.836813:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114eda9381 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.836818:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114eda9381 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836822:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114eda9381 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836827:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114eda9388 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.836831:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114eda9388 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836834:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114eda9388 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:1.0:1713279306.836842:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:1.0:1713279306.836846:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114eda9381 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836849:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114eda9381 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836852:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114eda9381 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836857:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114eda9381 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836860:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012154fa80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.836862:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114eda9381 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836864:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114eda9381 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836868:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:1.0:1713279306.836869:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.836871:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114eda9381 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836874:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114eda9381 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836878:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114eda9388 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836880:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114eda9388 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836883:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114eda9388 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836886:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c366880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.836887:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114eda9388 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836890:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114eda9388 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836896:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880130675300) 00010000:00010000:1.0:1713279306.836897:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.836898:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114eda9388 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836901:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114eda9388 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.836912:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c480/0xfc4b8e114eda937a lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bd8 expref: 3367 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.836916:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c480/0xfc4b8e114eda937a lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bd8 expref: 3367 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.836920:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f3c480, rc 0) 00000100:00100000:1.0:1713279306.836943:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3366:11204:x1796503281241728:12345-192.168.203.4@tcp:101:touch.0 Request processed in 172us (197us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.836947:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785272 00000100:00100000:2.0:1713279306.837040:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.837050:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281241856 00000100:00100000:1.0:1713279306.837052:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281241856 00000100:00100000:1.0:1713279306.837060:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785273 00000100:00100000:1.0:1713279306.837062:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3366:11855:x1796503281241856:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:1.0:1713279306.837084:0:15480:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.837091:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda92b6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7d29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ba0 expref: 3366 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.837096:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d29:0x0].0x0 (ffff88009e797300) 00010000:00010000:1.0:1713279306.837098:0:15480:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.837131:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda938f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7d29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.837135:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda938f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.837139:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda938f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00010000:1.0:1713279306.837168:0:15480:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880097a18e00 reply state ffff8800895e1000 transno 4295183722 ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda938f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.837172:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda938f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7d29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.837175:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d29:0x0].0x0 (ffff88009e797300) 00010000:00010000:1.0:1713279306.837177:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.837178:0:15480:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713279306.837208:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3367:11855:x1796503281241856:12345-192.168.203.4@tcp:36:touch.0 Request processed in 144us (167us total) trans 4295183722 rc 0/0 00000100:00100000:1.0:1713279306.837211:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785273 00010000:00010000:0.0:1713279306.837307:0:15525:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880082549f80 x1796503200049920) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114eda8f75 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7f30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab9 expref: 3728 pid: 15749 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.837314:0:15525:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114eda8f75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab9 expref: 3728 pid: 15749 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.837322:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114eda8f75 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7f30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab9 expref: 3728 pid: 15749 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.837328:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200049920:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.837585:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121535180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200049984:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.837808:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.837843:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281241984 00000100:00100000:1.0:1713279306.837847:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281241984 00000100:00100000:1.0:1713279306.837872:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785274 00000100:00100000:1.0:1713279306.837877:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11957:x1796503281241984:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.837884:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.837891:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3a80/0xfc4b8e114eda9396 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175bdf expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.837932:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b58c0/0xfc4b8e114eda939d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.837944:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b58c0/0xfc4b8e114eda939d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.837951:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b58c0/0xfc4b8e114eda939d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000004:00200000:1.0:1713279306.837957:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7fe9:0x0]: returning size 46934 00010000:00010000:1.0:1713279306.837998:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3a80/0xfc4b8e114eda9396 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bdf expref: 3723 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.838008:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b58c0/0xfc4b8e114eda939d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bdf expref: 3722 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.838014:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:1.0:1713279306.838016:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1713279306.838018:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801245b58c0, rc 0) 00000100:00100000:1.0:1713279306.838041:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:11957:x1796503281241984:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 163us (232us total) trans 4295202734 rc 0/0 00000100:00100000:1.0:1713279306.838047:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785274 00000100:00100000:0.0:1713279306.838426:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.838451:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.838462:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281242048 00000100:00100000:1.0:1713279306.838466:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281242048 00000100:00100000:2.0:1713279306.838466:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200050048:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.838472:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.838482:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281242112 00000100:00100000:1.0:1713279306.838483:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785275 00000100:00100000:2.0:1713279306.838485:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281242112 00000100:00100000:1.0:1713279306.838486:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3728:11854:x1796503281242048:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:2.0:1713279306.838493:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542640/0xfc4b8e114eda39a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917448c expref: 3722 pid: 15479 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.838502:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281242176 00000100:00100000:2.0:1713279306.838503:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281242176 00010000:00010000:1.0:1713279306.838508:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda93ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x148:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.838508:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114ed9e997 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d6a expref: 3723 pid: 15488 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.838511:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196549 00010000:00010000:1.0:1713279306.838515:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda93ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.838517:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:1957:x1796503281242112:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.838521:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196550 00000100:00100000:2.0:1713279306.838524:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:1957:x1796503281242176:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.838525:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda93ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.838525:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.838529:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.838529:0:15496:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092542640/0xfc4b8e114eda39a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917448c expref: 3723 pid: 15479 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.838531:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114ed9e997 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d6a expref: 3723 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.838534:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b7180/0xfc4b8e114eda93b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x148:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.838537:0:15496:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092542640/0xfc4b8e114eda39a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917448c expref: 3723 pid: 15479 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.838540:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b7180/0xfc4b8e114eda93b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.838543:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114ed9e997 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d6a expref: 3723 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.838545:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b7180/0xfc4b8e114eda93b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.838555:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542640/0xfc4b8e114eda39a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917448c expref: 3723 pid: 15479 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.838557:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114ed9e997 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d6a expref: 3723 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.838562:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f30:0x0].0x0 (ffff88008f43ef00) 00010000:00010000:3.0:1713279306.838565:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.838569:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.838572:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.838573:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda93b9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x854f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.838575:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f30:0x0].0x0 (ffff88008f43ef00) 00010000:00010000:3.0:1713279306.838575:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.838577:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.838578:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda93b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x854f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838581:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda93b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x854f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.838581:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.838583:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.838586:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.838598:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:1957:x1796503281242176:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 73us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.838599:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:1957:x1796503281242112:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 82us (146us total) trans 0 rc 0/0 00000004:00010000:1.0:1713279306.838600:0:15480:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda93b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x854f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000100:00100000:2.0:1713279306.838602:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196550 00000100:00100000:3.0:1713279306.838604:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196549 00010000:00010000:1.0:1713279306.838607:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda93ab lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838612:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda93ab lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838616:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda93ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838621:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda93ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838626:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b61c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.838628:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda93ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838633:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda93ab lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838640:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x0 (ffff880091b34100) 00010000:00010000:1.0:1713279306.838643:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.838645:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda93ab lrc: 3/0,0 mode: --/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838650:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114eda93ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838658:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b7180/0xfc4b8e114eda93b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838663:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b7180/0xfc4b8e114eda93b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838667:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b7180/0xfc4b8e114eda93b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838672:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b7180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.838674:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b7180/0xfc4b8e114eda93b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838679:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b7180/0xfc4b8e114eda93b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838685:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x34 (ffff880130675900) 00010000:00010000:1.0:1713279306.838688:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.838690:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b7180/0xfc4b8e114eda93b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838695:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b7180/0xfc4b8e114eda93b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838704:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda93b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x854f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838708:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda93b9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x854f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838711:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda93b9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x854f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838713:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096a2d680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.838715:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda93b9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x854f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838717:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda93b9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x854f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838721:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x854f:0x0].0x0 (ffff88008dba4d00) 00010000:00010000:1.0:1713279306.838722:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.838724:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda93b9 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x854f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.838726:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096a2d680/0xfc4b8e114eda93b9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x854f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.838749:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3728:11854:x1796503281242048:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 261us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.838753:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785275 00000100:00100000:0.0:1713279306.839156:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.839182:0:15526:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281242304 00000100:00100000:0.0:1713279306.839183:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.839185:0:15526:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281242304 00000100:00100000:0.0:1713279306.839192:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.839196:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281242368 00000100:00100000:3.0:1713279306.839200:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281242368 00000100:00100000:2.0:1713279306.839202:0:15526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14347 00000100:00100000:2.0:1713279306.839205:0:15526:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3367:11374:x1796503281242304:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:0.0:1713279306.839208:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.839208:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114ed9e48f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172bf7 expref: 3728 pid: 9221 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.839217:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.839219:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196551 00000100:00100000:3.0:1713279306.839222:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+3728:1956:x1796503281242368:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.839226:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.839226:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281242560 00010000:00010000:3.0:1713279306.839227:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.839228:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 15526 initiator: MDT0 00010000:00010000:3.0:1713279306.839229:0:15496:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114ed9e48f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172bf7 expref: 3728 pid: 9221 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.839230:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281242560 00010000:00010000:2.0:1713279306.839232:0:15526:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.839235:0:15496:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114ed9e48f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172bf7 expref: 3728 pid: 9221 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.839236:0:15526:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 15526 initiator: MDT1 00000100:00100000:0.0:1713279306.839240:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.839242:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f30:0x0].0x0 (ffff88008f43ef00) 00000100:00100000:2.0:1713279306.839243:0:15526:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001-mdtlov_UUID:15526:1796503200050176:0@lo:101:mdt_io00_010.0 00010000:00010000:3.0:1713279306.839245:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.839246:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223070 00010000:00010000:3.0:1713279306.839249:0:15496:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.839250:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3640:11876:x1796503281242560:12345-192.168.203.4@tcp:37:lfs.0 00010000:00010000:3.0:1713279306.839252:0:15496:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.839257:0:15526:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.839259:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.839264:0:15526:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c2fbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.839273:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281242496 00000100:00100000:3.0:1713279306.839273:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+3728:1956:x1796503281242368:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 50us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.839275:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281242496 00000100:00100000:3.0:1713279306.839277:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196551 00000100:00100000:2.0:1713279306.839283:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110509 00000100:00100000:2.0:1713279306.839286:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281242496:12345-192.168.203.4@tcp:16:kworker.0 00010000:00010000:3.0:1713279306.839294:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114ed9e48f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172bf7 expref: 3727 pid: 9221 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.839300:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121536d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200050112:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.839308:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281242496:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 21us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.839311:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110509 00010000:00010000:3.0:1713279306.839312:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f30:0x0].0x0 (ffff88008f43ef00) 00010000:00010000:3.0:1713279306.839315:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.839318:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.839320:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281242432 00000100:00100000:2.0:1713279306.839321:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281242432 00010000:00010000:3.0:1713279306.839321:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.839327:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281242624 00000100:00100000:2.0:1713279306.839329:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281242624 00000100:00100000:2.0:1713279306.839333:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281242688 00000100:00100000:2.0:1713279306.839334:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281242688 00000100:00100000:2.0:1713279306.839339:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785276 00000100:00100000:2.0:1713279306.839342:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:9807:x1796503281242432:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.839347:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.839353:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda93c7 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175be6 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.839365:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.839369:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.839370:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda93ce lrc: 3/1,0 mode: --/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.839372:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.839374:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda93ce lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.839375:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.839377:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.839378:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda93ce lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.839380:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.839384:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f30:0x0].0x0 (ffff88008f43ef00) 00010000:00010000:3.0:1713279306.839386:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1713279306.839387:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00000004:00200000:2.0:1713279306.839389:0:15474:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x74de:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.839390:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda9303 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7f30:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00000004:00200000:2.0:1713279306.839391:0:15474:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1713279306.839395:0:15474:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda93ce lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.839395:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda92ee lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.839399:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda92ee lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.839402:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801251d5b00/0xfc4b8e114eda93c7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175be6 expref: 3371 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.839402:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda92ee lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.839404:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda92ee lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.839407:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.839408:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda92ee lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.839426:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda92ee lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.839427:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda93ce lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175be6 expref: 3370 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.839431:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74de:0x0].0x0 (ffff880136671500) 00010000:00010000:2.0:1713279306.839433:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713279306.839433:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff88012fbfee00) 00010000:00010000:2.0:1713279306.839434:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023ed00, rc 0) 00010000:00010000:3.0:1713279306.839434:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.839436:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda92ee lrc: 3/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.839438:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda92ee lrc: 0/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.839445:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3370:9807:x1796503281242432:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 102us (253us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.839445:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda92fc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.839448:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda92fc lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.839449:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785276 00010000:00010000:3.0:1713279306.839451:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda92fc lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.839453:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298eef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.839454:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda92fc lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.839456:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785277 00010000:00010000:3.0:1713279306.839457:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda92fc lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.839459:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3641:11711:x1796503281242624:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.839460:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x3431 (ffff88012fbfe500) 00010000:00010000:3.0:1713279306.839461:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.839462:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda92fc lrc: 2/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.839463:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.839465:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda92fc lrc: 0/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.839469:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda93d5 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175bed expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.839471:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.839475:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.839478:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.839480:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.839481:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.839483:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda93dc lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.839484:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.839487:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:2.0:1713279306.839488:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda93dc lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.839488:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.839491:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda93dc lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.839491:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda9238 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9231 expref: 91 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.839495:0:15525:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda9238 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114eda9231 expref: 91 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.839496:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134971f80/0xfc4b8e114eda93e3 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.839499:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134971f80/0xfc4b8e114eda93e3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.839499:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda9238 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114eda9231 expref: 91 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.839502:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134971f80/0xfc4b8e114eda93e3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.839510:0:15525:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda9238 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9231 expref: 91 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.839513:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda93dc lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00000100:00100000:3.0:1713279306.839515:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095a69500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200050240:0@lo:105: 00010000:00010000:2.0:1713279306.839516:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda93dc lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.839519:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda93dc lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.839522:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda93dc lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.839527:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d2d7a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.839529:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda93dc lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.839532:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda93dc lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00000100:00100000:3.0:1713279306.839532:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.839536:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880136671e00) 00010000:00010000:2.0:1713279306.839537:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.839538:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda93dc lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000100:00100000:3.0:1713279306.839540:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0f00 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.839541:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda93dc lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000100:00100000:0.0:1713279306.839545:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200050240 00010000:00010000:2.0:1713279306.839545:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134971f80/0xfc4b8e114eda93e3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00000100:00100000:0.0:1713279306.839548:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200050240 00010000:00010000:2.0:1713279306.839548:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134971f80/0xfc4b8e114eda93e3 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.839551:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134971f80/0xfc4b8e114eda93e3 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.839554:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134971f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.839555:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134971f80/0xfc4b8e114eda93e3 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.839558:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134971f80/0xfc4b8e114eda93e3 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.839560:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x32 (ffff880136671600) 00010000:00010000:2.0:1713279306.839562:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.839563:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134971f80/0xfc4b8e114eda93e3 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000100:00100000:0.0:1713279306.839564:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33443 00010000:00010000:2.0:1713279306.839566:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134971f80/0xfc4b8e114eda93e3 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000100:00100000:0.0:1713279306.839568:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15525:x1796503200050240:12345-0@lo:105: 00010000:00010000:0.0:1713279306.839574:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.839575:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda93d5 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bed expref: 3642 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.839579:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114eda93d5 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bed expref: 3642 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.839580:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.839584:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023eac0, rc 0) 00010000:00010000:0.0:1713279306.839585:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.839589:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.839592:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.839595:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3641:11711:x1796503281242624:12345-192.168.203.4@tcp:101:touch.0 Request processed in 135us (368us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.839596:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.839598:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785277 00010000:00010000:0.0:1713279306.839605:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88008f4a5b00) 00000100:00100000:2.0:1713279306.839605:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785278 00000100:00100000:2.0:1713279306.839607:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:11855:x1796503281242688:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.839611:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.839615:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda93ea lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7d29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175bf4 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.839626:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda93ea lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7d29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bf4 expref: 3370 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.839630:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15525:x1796503200050240:12345-0@lo:105: Request processed in 62us (98us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.839632:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d866d00/0xfc4b8e114eda93ea lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7d29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bf4 expref: 3370 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.839634:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33443 00010000:00010000:2.0:1713279306.839638:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d29:0x0].0x0 (ffff88009e797300) 00010000:00010000:2.0:1713279306.839639:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1713279306.839641:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d866d00, rc 0) 00010000:00010000:0.0:1713279306.839646:0:15502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.839647:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095a69500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200050240:0@lo:105: 00000100:00100000:2.0:1713279306.839649:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3370:11855:x1796503281242688:12345-192.168.203.4@tcp:101:touch.0 Request processed in 41us (408us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.839650:0:15502:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.839652:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785278 00010000:00010000:3.0:1713279306.839656:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15525 initiator: MDT0 00000004:00080000:0.0:1713279306.839659:0:15502:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1713279306.839660:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114eda917b lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.839662:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200050176 00000100:00100000:2.0:1713279306.839664:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200050176 00000004:00020000:3.0:1713279306.839665:0:15525:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200000402:0x7f51:0x0]/14 failed: rc = -114 00000100:00100000:2.0:1713279306.839674:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98855 00000100:00100000:2.0:1713279306.839676:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+92:15526:x1796503200050176:12345-0@lo:101:mdt_io00_010.0 00000100:00100000:0.0:1713279306.839680:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd2a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200050304:0@lo:1000:mdt_io00_004.0 00010000:00010000:2.0:1713279306.839680:0:15580:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.839685:0:15580:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda93f1 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda93c0 expref: -99 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.839686:0:15525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:385c4b71-808c-40cf-91de-b076b668d13f+3726:11736:x1796503281238080:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 8478us (8869us total) trans 0 rc -114/-114 00000100:00100000:3.0:1713279306.839690:0:15525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14345 00010000:00010000:2.0:1713279306.839693:0:15580:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda9238 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9231 expref: 93 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.839695:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.839697:0:15580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda93f1 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda93c0 expref: 93 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.839702:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540e40 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.839703:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200050304 00000100:00100000:3.0:1713279306.839705:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200050304 00010000:00010000:2.0:1713279306.839706:0:15580:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda9238 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda9231 expref: 93 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.839711:0:15580:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1a680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000_UUID:15580:1796503200050368:0@lo:104: 00000100:00100000:3.0:1713279306.839715:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98856 00000100:00100000:3.0:1713279306.839718:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+94:15502:x1796503200050304:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713279306.839725:0:15580:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.839733:0:15580:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c2fb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.839739:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200050368 00000100:00100000:1.0:1713279306.839743:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200050368 00000100:00100000:3.0:1713279306.839749:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+94:15502:x1796503200050304:12345-0@lo:1000:mdt_io00_004.0 Request processed in 30us (53us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.839753:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98856 00000100:00100000:0.0:1713279306.839763:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd2a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200050304:0@lo:1000:mdt_io00_004.0 00000100:00100000:3.0:1713279306.839765:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33444 00000100:00100000:3.0:1713279306.839767:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15580:x1796503200050368:12345-0@lo:104: 00010000:00010000:3.0:1713279306.839772:0:6913:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.839777:0:15502:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000403:0x863c:0x0] 00010000:00010000:3.0:1713279306.839796:0:6913:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1713279306.839800:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15580:x1796503200050368:12345-0@lo:104: Request processed in 32us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.839802:0:15580:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1a680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000_UUID:15580:1796503200050368:0@lo:104: 00000100:00100000:3.0:1713279306.839805:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33444 00010000:00010000:2.0:1713279306.839810:0:15580:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda93f1 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda93c0 expref: 93 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.839816:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713279306.839817:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:2.0:1713279306.839818:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.839820:0:15580:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda93f1 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda93c0 expref: 93 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.839820:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.839823:0:15580:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800926b21c0, rc 0) 00010000:00010000:3.0:1713279306.839824:0:9214:0:(ldlm_lockd.c:1968:ldlm_handle_bl_callback()) Lock ffff88008f4a5b00 is referenced, will be cancelled later 00010000:00010000:3.0:1713279306.839825:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.839830:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.839830:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.839831:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279306.839837:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+93:15526:x1796503200050176:12345-0@lo:101:mdt_io00_010.0 Request processed in 160us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.839840:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98855 00000100:00100000:0.0:1713279306.839844:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd2a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200050432:0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713279306.839853:0:15526:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001-mdtlov_UUID:15526:1796503200050176:0@lo:101:mdt_io00_010.0 00010000:00010000:2.0:1713279306.839859:0:15526:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.839860:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.839863:0:15526:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.839867:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540e40 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.839869:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200050432 00000100:00100000:3.0:1713279306.839871:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200050432 00000100:00100000:3.0:1713279306.839882:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98857 00000100:00100000:3.0:1713279306.839884:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+93:15502:x1796503200050432:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:1.0:1713279306.839902:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.839914:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281242816 00000100:00100000:3.0:1713279306.839914:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+93:15502:x1796503200050432:12345-0@lo:1000:mdt_io00_004.0 Request processed in 29us (54us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.839915:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281242816 00000100:00100000:3.0:1713279306.839918:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98857 00000100:00100000:1.0:1713279306.839921:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.839922:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd2a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200050432:0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713279306.839933:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281242944 00000100:00100000:2.0:1713279306.839934:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281242944 00000100:00100000:2.0:1713279306.839940:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785279 00000100:00100000:2.0:1713279306.839942:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3726:11854:x1796503281242816:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.839947:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.839947:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.839951:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008957c900/0xfc4b8e114eda93f8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x854f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175bfb expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.839958:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281243072 00000100:00100000:1.0:1713279306.839961:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281243072 00000100:00100000:1.0:1713279306.839978:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785280 00010000:00010000:2.0:1713279306.839979:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda93ff lrc: 3/0,1 mode: --/PW res: [0x200000403:0x854f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.839983:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3370:11954:x1796503281243072:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.839984:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda93ff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x854f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.839988:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda93ff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x854f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.839990:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:2.0:1713279306.839992:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x854f:0x0]: returning size 0 00010000:00010000:1.0:1713279306.839998:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda9406 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c09 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.840017:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008957c900/0xfc4b8e114eda93f8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x854f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bfb expref: 3729 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.840023:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda93ff lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x854f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bfb expref: 3728 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.840027:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x854f:0x0].0x0 (ffff88008dba4d00) 00010000:00010000:2.0:1713279306.840028:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1713279306.840030:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091805440, rc 0) 00010000:00010000:1.0:1713279306.840035:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda9414 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.840040:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda9414 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840044:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda9414 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00000100:00100000:2.0:1713279306.840044:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3728:11854:x1796503281242816:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 100us (143us total) trans 4295202735 rc 0/0 00000100:00100000:2.0:1713279306.840047:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785279 00010000:00010000:1.0:1713279306.840050:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114eda941b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.840053:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114eda941b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840056:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114eda941b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00000100:00100000:2.0:1713279306.840080:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785281 00000100:00100000:2.0:1713279306.840083:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11204:x1796503281242944:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.840088:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.840089:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda9422 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.840093:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda9429 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c02 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.840094:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda9422 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840097:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda9422 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00000004:00200000:1.0:1713279306.840101:0:15471:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x758f:0x0]: returning size 21016 00010000:00010000:2.0:1713279306.840111:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9437 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.840118:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9437 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.840122:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda9414 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.840123:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9437 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.840125:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda9414 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840128:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda9414 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.840128:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda943e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.840131:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda9414 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.840131:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda943e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.840134:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a0d8480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.840134:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda943e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.840135:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda9414 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840138:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda9414 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840142:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:1.0:1713279306.840143:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.840145:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda9414 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.840146:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9437 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.840149:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9437 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.840150:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0d8480/0xfc4b8e114eda9414 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.840152:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9437 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.840155:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114eda941b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.840155:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9437 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.840157:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.840158:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114eda941b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.840159:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9437 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.840161:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114eda941b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.840162:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9437 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.840163:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a0daac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.840165:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114eda941b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840167:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114eda941b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.840168:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:2.0:1713279306.840169:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.840170:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3431 (ffff880130675200) 00010000:00010000:1.0:1713279306.840171:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.840171:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9437 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.840173:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114eda941b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.840174:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9437 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.840175:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114eda941b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.840178:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda943e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.840181:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda943e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.840184:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda943e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.840186:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bc900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.840188:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda943e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.840191:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114eda9406 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c09 expref: 3373 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.840191:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda943e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.840194:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff8800954bed00) 00010000:00010000:2.0:1713279306.840195:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.840196:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda9422 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c09 expref: 3372 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.840196:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda943e lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.840199:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda943e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.840203:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x758f:0x0].0x0 (ffff8800908e1600) 00010000:00010000:1.0:1713279306.840204:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.840205:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b25440, rc 0) 00010000:00010000:2.0:1713279306.840208:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda9429 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c02 expref: 3721 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.840213:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bdb00/0xfc4b8e114eda9429 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c02 expref: 3721 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.840217:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bdb00, rc 0) 00000100:00100000:1.0:1713279306.840230:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3372:11954:x1796503281243072:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 247us (283us total) trans 4295183723 rc 0/0 00000100:00100000:2.0:1713279306.840230:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11204:x1796503281242944:12345-192.168.203.4@tcp:101:touch.0 Request processed in 145us (309us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.840233:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785281 00000100:00100000:1.0:1713279306.840236:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785280 00000100:00100000:3.0:1713279306.840263:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.840281:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281243200 00000100:00100000:1.0:1713279306.840284:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281243200 00000100:00100000:1.0:1713279306.840295:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785282 00000100:00100000:1.0:1713279306.840298:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3642:11912:x1796503281243200:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.840303:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.840308:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200050496:0@lo:403:mdt_io00_004.0 00010000:00010000:1.0:1713279306.840309:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda9445 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c10 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.840325:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.840331:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.840333:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200050496 00000100:00100000:3.0:1713279306.840336:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200050496 00010000:00010000:1.0:1713279306.840342:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda944c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.840346:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda944c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00000100:00100000:3.0:1713279306.840346:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98858 00000100:00100000:3.0:1713279306.840349:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+93:15502:x1796503200050496:12345-0@lo:403:mdt_io00_004.0 00010000:00010000:1.0:1713279306.840351:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda944c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840356:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda9453 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.840360:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda9453 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840365:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda9453 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00000004:00200000:1.0:1713279306.840373:0:15471:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:1.0:1713279306.840378:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda944c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840381:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda944c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840384:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda944c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840386:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda944c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840389:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a4c86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.840390:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda944c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840393:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda944c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840397:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff8801250c1900) 00010000:00010000:1.0:1713279306.840398:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.840399:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda944c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840402:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4c86c0/0xfc4b8e114eda944c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840407:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda9453 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840431:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda9453 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840434:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda9453 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840437:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938fcfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.840438:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda9453 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840441:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda9453 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840444:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff8801250c1700) 00010000:00010000:1.0:1713279306.840446:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.840447:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda9453 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840450:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114eda9453 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.840469:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda9445 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c10 expref: 3643 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.840475:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a4ca400/0xfc4b8e114eda9445 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c10 expref: 3643 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.840484:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a4ca400, rc 0) 00000100:00100000:1.0:1713279306.840507:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3642:11912:x1796503281243200:12345-192.168.203.4@tcp:101:touch.0 Request processed in 207us (244us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.840513:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785282 00000100:00100000:1.0:1713279306.841201:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.841214:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281243328 00000100:00100000:0.0:1713279306.841219:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281243328 00000100:00100000:0.0:1713279306.841234:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785283 00000100:00100000:0.0:1713279306.841238:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b3cf9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3642:11969:x1796503281243328:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.841245:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.841252:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda945a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c17 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.841291:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda9461 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.841296:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda9461 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.841301:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda9461 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.841307:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda9468 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.841314:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda9468 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.841317:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda9468 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:0.0:1713279306.841346:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x700e:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.841351:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda9461 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.841354:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda9461 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.841357:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda9461 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.841430:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda9461 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.841433:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800923421c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.841435:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda9461 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.841438:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda9461 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.841443:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00000100:00100000:1.0:1713279306.841444:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.841445:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.841446:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda9461 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.841449:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114eda9461 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.841459:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda9468 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.841460:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+93:15502:x1796503200050496:12345-0@lo:403:mdt_io00_004.0 Request processed in 1109us (1133us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.841462:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda9468 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.841465:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda9468 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.841465:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98858 00010000:00010000:0.0:1713279306.841468:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092343840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.841469:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda9468 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.841471:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.841472:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda9468 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.841475:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x38 (ffff88012fbfe400) 00010000:00010000:0.0:1713279306.841476:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.841477:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda9468 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.841479:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114eda9468 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.841486:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.841493:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda945a lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c17 expref: 3643 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.841497:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281243584 00010000:00010000:0.0:1713279306.841498:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda945a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c17 expref: 3643 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.841500:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281243584 00010000:00010000:0.0:1713279306.841502:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea5f180, rc 0) 00000100:00100000:2.0:1713279306.841509:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281243456 00000100:00100000:2.0:1713279306.841513:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281243456 00000100:00100000:1.0:1713279306.841516:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785284 00000100:00100000:0.0:1713279306.841518:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200050496:0@lo:403:mdt_io00_004.0 00000100:00100000:1.0:1713279306.841521:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11974:x1796503281243584:12345-192.168.203.4@tcp:36:mkdir.0 00000100:00100000:2.0:1713279306.841530:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110510 00000100:00100000:2.0:1713279306.841534:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+90:11957:x1796503281243456:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.841540:0:15783:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.841547:0:15783:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda946f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c1e expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.841560:0:15783:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012154d680/0xfc4b8e114eda8b0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->32767) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917597e expref: 82 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.841565:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.841566:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.841568:0:15783:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda946f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [4096->20479] (req 4096->20479) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c1e expref: 91 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.841579:0:15783:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012154d680/0xfc4b8e114eda8b0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->32767) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917597e expref: 82 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.841580:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11974:x1796503281243584:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 58us (92us total) trans 0 rc -17/-17 00000100:00100000:1.0:1713279306.841586:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785284 00010000:00010000:2.0:1713279306.841589:0:15783:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012154d680/0xfc4b8e114eda8b0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->32767) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917597e expref: 82 pid: 15506 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.841595:0:15783:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0001_UUID:15783:1796503200050560:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.841612:0:15783:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c2fb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.841620:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281243392 00000100:00100000:2.0:1713279306.841622:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281243392 00000100:00100000:3.0:1713279306.841630:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.841633:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147261 00000100:00100000:2.0:1713279306.841636:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:1954:x1796503281243392:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.841637:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281243648 00000100:00100000:3.0:1713279306.841640:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281243648 00010000:00010000:2.0:1713279306.841641:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.841647:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b58c0/0xfc4b8e114eda939d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bdf expref: 3720 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.841651:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110511 00010000:00010000:2.0:1713279306.841654:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00000100:00100000:3.0:1713279306.841655:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b42cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281243648:12345-192.168.203.4@tcp:16:kworker.0 00010000:00010000:2.0:1713279306.841656:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.841666:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3719:1954:x1796503281243392:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 29us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.841669:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147261 00000100:00100000:3.0:1713279306.841689:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b42cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281243648:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 34us (60us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.841693:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110511 00000100:00100000:3.0:1713279306.841724:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.841896:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.841911:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281243776 00000100:00100000:3.0:1713279306.841914:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281243776 00000100:00100000:3.0:1713279306.841937:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110512 00000100:00100000:3.0:1713279306.841941:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+84:1957:x1796503281243776:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:2.0:1713279306.841942:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.842015:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092341d40/0xfc4b8e114eda9476 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15502 initiator: MDT0 00010000:00010000:0.0:1713279306.842019:0:15502:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092341d40/0xfc4b8e114eda9476 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.842023:0:15502:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092341d40/0xfc4b8e114eda9476 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15502 initiator: MDT1 00000100:00100000:0.0:1713279306.842031:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200050624:0@lo:101:mdt_io00_004.0 00002000:00010000:3.0:1713279306.842035:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb size from disk: 21016 -> 64588 00002000:00010000:3.0:1713279306.842037:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb mtime from disk: 1713279304 -> 1713279306 00002000:00010000:3.0:1713279306.842039:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:3.0:1713279306.842040:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.842041:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb blocks from disk: 56 -> 128 00000100:00100000:0.0:1713279306.842047:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.842056:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.842056:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+85:1957:x1796503281243776:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 114us (159us total) trans 4295010182 rc 0/0 00000100:00100000:1.0:1713279306.842058:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3641:11876:x1796503281242560:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 2804us (2836us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.842059:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200050624 00000100:00100000:3.0:1713279306.842060:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110512 00000100:00100000:2.0:1713279306.842061:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200050624 00000100:00100000:1.0:1713279306.842063:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223070 00000100:00100000:0.0:1713279306.842065:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281243968 00000100:00100000:2.0:1713279306.842082:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98859 00000100:00100000:2.0:1713279306.842085:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+93:15502:x1796503200050624:12345-0@lo:101:mdt_io00_004.0 00000100:00100000:1.0:1713279306.842090:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281243712 00010000:00010000:2.0:1713279306.842090:0:15580:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.842092:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281243712 00000100:00100000:3.0:1713279306.842096:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.842097:0:15580:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda947d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda9476 expref: -99 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.842106:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda947d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda9476 expref: 94 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.842108:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281243904 00000100:00100000:1.0:1713279306.842110:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281243904 00010000:00010000:2.0:1713279306.842112:0:15580:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda947d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9476 expref: 94 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.842116:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x0 (ffff880091714100) 00000100:00100000:3.0:1713279306.842116:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785285 00010000:00010000:2.0:1713279306.842118:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.842119:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785286 00010000:00010000:2.0:1713279306.842119:0:15580:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bcd80, rc 0) 00000100:00100000:3.0:1713279306.842119:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3728:11854:x1796503281243712:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.842122:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3372:11960:x1796503281243904:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.842125:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.842126:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281243968 00010000:00010000:1.0:1713279306.842128:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.842131:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa880/0xfc4b8e114eda9484 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x854f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c25 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.842134:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda948b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c2c expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.842136:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+94:15502:x1796503200050624:12345-0@lo:101:mdt_io00_004.0 Request processed in 50us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.842139:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98859 00000100:00100000:0.0:1713279306.842142:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223071 00000100:00100000:0.0:1713279306.842146:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3374:9807:x1796503281243968:12345-192.168.203.4@tcp:37:lfs.0 00010000:00010000:3.0:1713279306.842148:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa880/0xfc4b8e114eda9484 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x854f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c25 expref: 3729 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.842153:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda9492 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.842155:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa880/0xfc4b8e114eda9484 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x854f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c25 expref: 3729 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.842158:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda9492 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.842161:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x854f:0x0].0x0 (ffff88008dba4d00) 00010000:00010000:1.0:1713279306.842162:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda9492 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.842163:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713279306.842165:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baa880, rc 0) 00010000:00010000:1.0:1713279306.842167:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda9499 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.842171:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda9499 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.842174:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda9499 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00000100:00100000:3.0:1713279306.842176:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3729:11854:x1796503281243712:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 56us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.842180:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785285 00000100:00100000:2.0:1713279306.842184:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.842188:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281244288 00000100:00100000:3.0:1713279306.842189:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281244288 00010000:00010000:1.0:1713279306.842194:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda9492 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.842197:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda9492 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00000100:00100000:2.0:1713279306.842198:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.842200:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda9492 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.842203:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda9492 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.842206:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4d80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.842206:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785287 00010000:00010000:1.0:1713279306.842207:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda9492 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00000100:00100000:3.0:1713279306.842208:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3375:11204:x1796503281244288:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.842210:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda9492 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00000100:00100000:2.0:1713279306.842213:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281244096 00010000:00010000:3.0:1713279306.842213:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.842214:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:1.0:1713279306.842215:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.842215:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281244096 00010000:00010000:1.0:1713279306.842217:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda9492 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.842219:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114eda94a0 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c33 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.842220:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114eda9492 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.842224:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda9499 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00000100:00100000:2.0:1713279306.842225:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223072 00010000:00010000:1.0:1713279306.842227:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda9499 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00000100:00100000:2.0:1713279306.842228:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3729:11736:x1796503281244096:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:1.0:1713279306.842230:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda9499 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.842232:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.842234:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda9499 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.842236:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda9499 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.842239:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3631 (ffff8801250c1800) 00010000:00010000:1.0:1713279306.842240:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.842242:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda9499 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.842244:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114eda9499 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00000100:00100000:2.0:1713279306.842251:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3729:11736:x1796503281244096:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 23us (52us total) trans 0 rc -116/-116 00000100:00100000:2.0:1713279306.842255:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223072 00010000:00010000:3.0:1713279306.842255:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114eda94a7 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713279306.842256:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda948b lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c2c expref: 3376 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.842260:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114eda948b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c2c expref: 3376 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.842260:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114eda94a7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713279306.842264:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd5f80, rc 0) 00010000:00010000:3.0:1713279306.842264:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114eda94a7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.842269:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114eda94ae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.842275:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114eda94ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.842278:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3375:11960:x1796503281243904:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 156us (182us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.842278:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114eda94ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.842282:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785286 00000100:00100000:2.0:1713279306.842284:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00200000:3.0:1713279306.842287:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00000100:00100000:3.0:1713279306.842298:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281244224 00000100:00100000:3.0:1713279306.842300:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281244224 00000100:00100000:3.0:1713279306.842310:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110513 00000100:00100000:3.0:1713279306.842312:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+85:1956:x1796503281244224:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:1.0:1713279306.842356:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.842362:0:15783:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0001_UUID:15783:1796503200050560:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.842371:0:15783:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda946f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [4096->20479] (req 4096->20479) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c1e expref: 91 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.842372:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1956:x1796503281244224:12345-192.168.203.4@tcp:2:touch.0 Request processed in 59us (88us total) trans 4295010183 rc 0/0 00000100:00100000:3.0:1713279306.842376:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110513 00010000:00010000:2.0:1713279306.842381:0:15783:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bd680, rc 0) 00000100:00100000:3.0:1713279306.842382:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281244352 00000100:00100000:3.0:1713279306.842384:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281244352 00000100:00100000:1.0:1713279306.842392:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.842392:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+91:11957:x1796503281243456:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 858us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.842396:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110510 00000100:00100000:3.0:1713279306.842400:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110514 00000100:00100000:3.0:1713279306.842402:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281244352:12345-192.168.203.4@tcp:16:kworker.0 00000100:00100000:3.0:1713279306.842437:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281244352:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 33us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.842441:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110514 00000100:00100000:1.0:1713279306.842451:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b3cf9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3640:11969:x1796503281243328:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 1210us (1248us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.842455:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114eda94a7 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713279306.842457:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785283 00010000:00010000:3.0:1713279306.842460:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114eda94a7 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.842465:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114eda94a7 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.842471:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114eda94a7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.842476:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.842478:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114eda94a7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.842483:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114eda94a7 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713279306.842484:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281244416 00000100:00100000:2.0:1713279306.842486:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281244416 00010000:00010000:3.0:1713279306.842489:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:3.0:1713279306.842490:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.842492:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012154d680/0xfc4b8e114eda8b0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->32767) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917597e expref: 83 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.842492:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114eda94a7 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.842495:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114eda94a7 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.842500:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114eda94ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713279306.842501:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196552 00010000:00010000:3.0:1713279306.842503:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114eda94ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713279306.842504:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a147b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:385c4b71-808c-40cf-91de-b076b668d13f+83:1956:x1796503281244416:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.842506:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114eda94ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.842508:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.842509:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.842510:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114eda94ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.842513:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114eda94ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.842515:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012154d680/0xfc4b8e114eda8b0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->32767) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917597e expref: 83 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.842519:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88007f2ad800) 00010000:00010000:3.0:1713279306.842520:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.842521:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012154d680/0xfc4b8e114eda8b0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->32767) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917597e expref: 83 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.842521:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114eda94ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713279306.842524:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114eda94ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713279306.842530:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012154d680/0xfc4b8e114eda8b0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->32767) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917597e expref: 83 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.842535:0:15492:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.842536:0:15492:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.842539:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114eda94a0 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c33 expref: 3374 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.842540:0:15492:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda946f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->20479) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c1e expref: 90 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.842544:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114eda94a0 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c33 expref: 3374 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.842548:0:15492:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda946f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->20479) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c1e expref: 90 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.842548:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091babcc0, rc 0) 00000100:00100000:3.0:1713279306.842558:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3373:11204:x1796503281244288:12345-192.168.203.4@tcp:101:touch.0 Request processed in 349us (375us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.842559:0:15492:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda946f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->20479) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c1e expref: 90 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.842562:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785287 00000100:00100000:2.0:1713279306.842564:0:15492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15492:1796503200050688:192.168.203.4@tcp:105: 00000100:00100000:2.0:1713279306.842574:0:15492:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c2fb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.842635:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200050624:0@lo:101:mdt_io00_004.0 00010000:00010000:0.0:1713279306.842642:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092341d40/0xfc4b8e114eda9476 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda947d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.842647:0:15502:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092341d40/0xfc4b8e114eda9476 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda947d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.842654:0:15502:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00000100:00100000:3.0:1713279306.842654:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.842664:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092343a80/0xfc4b8e114eda94b5 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15502 initiator: MDT0 00000100:00100000:2.0:1713279306.842665:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281244480 00010000:00010000:0.0:1713279306.842667:0:15502:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092343a80/0xfc4b8e114eda94b5 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279306.842667:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281244480 00010000:00010000:0.0:1713279306.842671:0:15502:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092343a80/0xfc4b8e114eda94b5 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15502 initiator: MDT1 00000100:00100000:0.0:1713279306.842678:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200050752:0@lo:101:mdt_io00_004.0 00000100:00100000:3.0:1713279306.842680:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.842681:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785288 00000100:00100000:2.0:1713279306.842684:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3729:11711:x1796503281244480:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.842688:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281244608 00010000:00010000:2.0:1713279306.842689:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.842690:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281244608 00000100:00100000:0.0:1713279306.842691:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.842696:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda94bc lrc: 2/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c3a expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.842698:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.842702:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785289 00000100:00100000:3.0:1713279306.842705:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3640:11932:x1796503281244608:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.842710:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.842712:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda94c3 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842717:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda94c3 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.842717:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114eda94ca lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c41 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.842721:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda94c3 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842726:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda94d1 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842732:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda94d1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842735:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda94d1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.842740:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda94d8 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.842745:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda94d8 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.842749:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda94d8 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.842754:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda94df lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3032 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.842757:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda94df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.842760:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda94e6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x822b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.842761:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda94df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.842764:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda94e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x822b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842767:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda94e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x822b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000004:00200000:2.0:1713279306.842772:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x822b:0x0]: returning size 1 00000004:00010000:2.0:1713279306.842778:0:15658:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda94e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x822b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842783:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda94c3 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842786:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda94c3 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842789:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda94c3 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842791:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda94c3 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.842793:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda94ed lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7aed:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.842794:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.842796:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda94c3 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.842799:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda94ed lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7aed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.842801:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda94c3 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.842804:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda94ed lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7aed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.842805:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88008a21ee00) 00010000:00010000:2.0:1713279306.842807:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.842808:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda94c3 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000004:00200000:3.0:1713279306.842810:0:15471:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7aed:0x0]: returning size 0 00010000:00010000:2.0:1713279306.842811:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be400/0xfc4b8e114eda94c3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842815:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda94d1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842819:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda94d1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842821:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda94d1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842824:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bf3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.842825:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda94d1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842828:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda94d1 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842831:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x32 (ffff88008e8c9200) 00010000:00010000:2.0:1713279306.842832:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.842833:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda94d1 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.842836:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda94d1 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.842838:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda94d8 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00000100:00100000:0.0:1713279306.842841:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.842843:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda94d8 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.842848:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda94bc lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c3a expref: 3731 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.842852:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda94d8 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.842855:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc480/0xfc4b8e114eda94e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x822b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c3a expref: 3730 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.842858:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda94d8 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.842859:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x822b:0x0].0x0 (ffff88008c124600) 00010000:00010000:2.0:1713279306.842860:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713279306.842860:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.842861:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bc480, rc 0) 00010000:00010000:3.0:1713279306.842862:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda94d8 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.842865:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda94d8 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00000100:00100000:2.0:1713279306.842870:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281244672 00010000:00010000:3.0:1713279306.842870:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880130675600) 00000100:00100000:2.0:1713279306.842871:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281244672 00010000:00010000:3.0:1713279306.842871:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.842872:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda94d8 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.842875:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114eda94d8 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00000100:00100000:2.0:1713279306.842881:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110515 00010000:00010000:3.0:1713279306.842881:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda94df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00000100:00100000:2.0:1713279306.842884:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281244672:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:3.0:1713279306.842884:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda94df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.842886:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda94df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.842889:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.842890:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda94df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.842895:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda94df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.842899:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3032 (ffff880130675500) 00010000:00010000:3.0:1713279306.842900:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.842901:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda94df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.842903:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114eda94df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.842918:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114eda94ca lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c41 expref: 3643 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.842925:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda94ed lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7aed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c41 expref: 3642 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.842928:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7aed:0x0].0x0 (ffff88008eb9f200) 00010000:00010000:3.0:1713279306.842929:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713279306.842930:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baba80, rc 0) 00000100:00100000:3.0:1713279306.842941:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3642:11932:x1796503281244608:12345-192.168.203.4@tcp:101:touch.0 Request processed in 235us (261us total) trans 4295183724 rc 0/0 00000100:00100000:3.0:1713279306.842945:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785289 00002000:00010000:2.0:1713279306.842951:0:15506:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb size from disk: 42048 -> 42048 00002000:00010000:2.0:1713279306.842952:0:15506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.842954:0:15506:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb atime from disk: 1713279292 -> 1648351934 00002000:00010000:2.0:1713279306.842955:0:15506:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.842956:0:15506:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb blocks from disk: 72 -> 72 00000100:00100000:0.0:1713279306.842964:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.842969:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+84:1957:x1796503281244672:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 83us (129us total) trans 4295010184 rc 0/0 00000100:00100000:2.0:1713279306.842973:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110515 00000100:00100000:3.0:1713279306.842977:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281244800 00000100:00100000:3.0:1713279306.842979:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281244800 00000100:00100000:3.0:1713279306.842990:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785290 00000100:00100000:2.0:1713279306.842992:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3731:11711:x1796503281244480:12345-192.168.203.4@tcp:101:touch.0 Request processed in 307us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.842992:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3731:11955:x1796503281244800:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:2.0:1713279306.842995:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785288 00010000:00010000:3.0:1713279306.843000:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.843003:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200050752 00000100:00100000:2.0:1713279306.843005:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200050752 00010000:00010000:3.0:1713279306.843005:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114eda94fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c48 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.843015:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98860 00000100:00100000:2.0:1713279306.843017:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+94:15502:x1796503200050752:12345-0@lo:101:mdt_io00_004.0 00010000:00010000:2.0:1713279306.843022:0:15580:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.843024:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda9502 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.843027:0:15580:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda9509 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda94b5 expref: -99 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.843029:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda9502 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.843033:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda9502 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.843035:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda9509 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda94b5 expref: 95 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.843038:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda9510 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.843041:0:15580:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda9509 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda94b5 expref: 95 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.843042:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda9510 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.843044:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x3631 (ffff88008c124700) 00010000:00010000:3.0:1713279306.843045:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda9510 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.843046:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.843047:0:15580:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bcb40, rc 0) 00000100:00100000:2.0:1713279306.843081:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+95:15502:x1796503200050752:12345-0@lo:101:mdt_io00_004.0 Request processed in 62us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.843084:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98860 00000100:00100000:0.0:1713279306.843098:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200050752:0@lo:101:mdt_io00_004.0 00010000:00010000:0.0:1713279306.843105:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092343a80/0xfc4b8e114eda94b5 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9509 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713279306.843106:0:15471:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.843110:0:15502:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092343a80/0xfc4b8e114eda94b5 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9509 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.843117:0:15502:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00010000:00010000:0.0:1713279306.843124:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114eda951e lrc: 3/0,1 mode: --/CW res: [0x240000401:0x134:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15502 initiator: MDT0 00010000:00010000:0.0:1713279306.843127:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114eda951e lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.843127:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda9502 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.843131:0:15502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114eda951e lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.843131:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda9502 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.843134:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda9502 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.843137:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda9525 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x134:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15502 initiator: MDT0 00010000:00010000:3.0:1713279306.843137:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda9502 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.843139:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.843140:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda9525 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.843141:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda9502 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.843144:0:15502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda9525 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.843144:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda9502 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.843149:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.843150:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.843152:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda9502 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.843155:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114eda9502 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.843160:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda9510 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.843161:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7642:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15502 initiator: MDT0 00010000:00010000:3.0:1713279306.843163:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda9510 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.843166:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda9510 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.843167:0:15502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda9158 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x7642:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b3e expref: 3373 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.843169:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091bab600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.843170:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda9510 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.843171:0:15502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 4/0,1 mode: --/EX res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.843172:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda9510 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.843176:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff880130675000) 00010000:00010000:3.0:1713279306.843177:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.843178:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda9510 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.843180:0:15502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda9158 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x7642:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b3e expref: 3373 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.843180:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114eda9510 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.843186:0:15502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda9158 lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x7642:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b3e expref: 3373 pid: 15749 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.843192:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200050816:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.843196:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114eda94fb lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c48 expref: 3732 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.843200:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114eda94fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c48 expref: 3732 pid: 15471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.843203:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540f00 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.843204:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba98c0, rc 0) 00000100:00100000:3.0:1713279306.843214:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3731:11955:x1796503281244800:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 221us (251us total) trans 4295202736 rc 301/301 00000100:00100000:3.0:1713279306.843218:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785290 00000100:00100000:2.0:1713279306.844674:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3372:9807:x1796503281243968:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 2524us (2729us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.844680:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223071 00000100:00100000:0.0:1713279306.845065:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.845126:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281244864 00000100:00100000:2.0:1713279306.845131:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281244864 00000100:00100000:2.0:1713279306.845154:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223073 00000100:00100000:2.0:1713279306.845157:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3642:11876:x1796503281244864:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:0.0:1713279306.845169:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.845233:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281244928 00000100:00100000:3.0:1713279306.845238:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281244928 00000100:00100000:3.0:1713279306.845263:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785291 00000100:00100000:3.0:1713279306.845267:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3731:11736:x1796503281244928:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1713279306.845289:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9533 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845295:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9533 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845300:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9533 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845305:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda953a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x235:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845309:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda953a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845312:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda953a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845339:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda9541 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845344:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda9541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845347:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda9541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000004:00010000:3.0:1713279306.845365:0:9221:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda9541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845372:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9533 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845377:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9533 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845382:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9533 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845389:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9533 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845393:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.845396:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9533 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845399:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9533 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845404:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff88008dba4500) 00010000:00010000:3.0:1713279306.845406:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.845408:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9533 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845428:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114eda9533 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845437:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda953a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845440:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda953a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845443:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda953a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845446:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baa400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.845447:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda953a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845450:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda953a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845453:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x39 (ffff880130675700) 00010000:00010000:3.0:1713279306.845454:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.845456:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda953a lrc: 2/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845458:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114eda953a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845464:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda9541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845467:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda9541 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845472:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda9541 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845474:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baaf40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.845476:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda9541 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845478:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda9541 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845481:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ede:0x0].0x0 (ffff88008e4c8000) 00010000:00010000:3.0:1713279306.845482:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.845484:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda9541 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845486:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baaf40/0xfc4b8e114eda9541 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713279306.845510:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:385c4b71-808c-40cf-91de-b076b668d13f+3731:11736:x1796503281244928:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 242us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.845515:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785291 00000100:00100000:0.0:1713279306.845729:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.845756:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281245440 00000100:00100000:3.0:1713279306.845759:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281245440 00000100:00100000:3.0:1713279306.845771:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785292 00000100:00100000:3.0:1713279306.845774:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3719:11204:x1796503281245440:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.845780:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.845785:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda9548 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c4f expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.845807:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114eda954f lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845812:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114eda954f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845816:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114eda954f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845821:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda9556 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845824:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda9556 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845827:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda9556 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845839:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114eda954f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845842:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114eda954f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845845:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114eda954f lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845848:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114eda954f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845851:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298efcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.845852:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114eda954f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.845854:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.845855:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114eda954f lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845862:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:3.0:1713279306.845863:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.845865:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114eda954f lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845867:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114eda954f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845872:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda9556 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845875:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda9556 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845877:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda9556 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845880:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.845881:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda9556 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845884:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda9556 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713279306.845885:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281244992 00010000:00010000:3.0:1713279306.845887:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880130675a00) 00000100:00100000:2.0:1713279306.845888:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281244992 00010000:00010000:3.0:1713279306.845888:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.845890:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda9556 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713279306.845892:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114eda9556 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713279306.845894:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.845905:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda9548 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c4f expref: 3720 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.845907:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281245056 00000100:00100000:2.0:1713279306.845909:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281245056 00010000:00010000:3.0:1713279306.845910:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec240/0xfc4b8e114eda9548 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c4f expref: 3720 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.845914:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ec240, rc 0) 00000100:00100000:2.0:1713279306.845918:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110516 00000100:00100000:2.0:1713279306.845921:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+85:1956:x1796503281244992:12345-192.168.203.4@tcp:1:lfs.0 00000100:00100000:1.0:1713279306.845923:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.845925:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110517 00000100:00100000:3.0:1713279306.845928:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+85:1956:x1796503281245056:12345-192.168.203.4@tcp:16:kworker.0 00000100:00100000:1.0:1713279306.845933:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281245184 00000100:00100000:1.0:1713279306.845936:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281245184 00002000:00010000:2.0:1713279306.845939:0:15783:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x115d:0x0] initial LVB size: 0, mtime: 0x661e9146, atime: 0x661e9146, ctime: 0x661e9146, blocks: 0x0 00010000:00010000:2.0:1713279306.845945:0:15783:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda955d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x115d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.845949:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223074 00000100:00100000:1.0:1713279306.845953:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c569050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3372:11954:x1796503281245184:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:2.0:1713279306.845953:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.845955:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713279306.845955:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+85:1956:x1796503281245056:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 26us (62us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.845958:0:15783:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda955d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x115d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.845959:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110517 00000100:00100000:0.0:1713279306.845964:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.845967:0:15783:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda955d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x115d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.845974:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3719:11204:x1796503281245440:12345-192.168.203.4@tcp:101:touch.0 Request processed in 199us (246us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.845976:0:15783:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda955d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x115d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.845978:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785292 00010000:00010000:2.0:1713279306.845983:0:15783:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda955d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x115d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.845989:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.845990:0:15783:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda955d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x115d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.845996:0:15783:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be1c0 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:2.0:1713279306.845999:0:15783:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda955d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x115d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.846003:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281245760 00000100:00100000:3.0:1713279306.846006:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281245760 00010000:00010000:2.0:1713279306.846010:0:15783:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda955d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x115d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.846017:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785293 00010000:00010000:2.0:1713279306.846019:0:15783:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda955d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x115d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.846020:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3731:11980:x1796503281245760:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:0.0:1713279306.846025:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.846025:0:15783:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda955d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x115d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.846025:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.846030:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda9564 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c56 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.846038:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.846040:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c569050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3373:11954:x1796503281245184:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 86us (116us total) trans 4295183725 rc 0/0 00000100:00100000:1.0:1713279306.846044:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223074 00000100:00100000:1.0:1713279306.846051:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281245312 00000100:00100000:1.0:1713279306.846053:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281245312 00000100:00100000:2.0:1713279306.846055:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+84:1956:x1796503281244992:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 131us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.846061:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110516 00010000:00010000:3.0:1713279306.846063:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114eda956b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00000100:00100000:2.0:1713279306.846082:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281245504 00010000:00010000:3.0:1713279306.846083:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114eda956b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00000100:00100000:2.0:1713279306.846085:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281245504 00000100:00100000:1.0:1713279306.846086:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223075 00000100:00100000:1.0:1713279306.846089:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3373:11855:x1796503281245312:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:3.0:1713279306.846090:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114eda956b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.846096:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023cfc0/0xfc4b8e114eda9572 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.846099:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023cfc0/0xfc4b8e114eda9572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00000100:00100000:2.0:1713279306.846101:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110518 00010000:00010000:3.0:1713279306.846102:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023cfc0/0xfc4b8e114eda9572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00000100:00100000:2.0:1713279306.846104:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+91:1955:x1796503281245504:12345-192.168.203.4@tcp:22:fallocate.0 00000004:00200000:3.0:1713279306.846135:0:15471:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7e3b:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.846138:0:15502:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880090a4f100 x1796503200050816) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda9158 lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x7642:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b3e expref: 3374 pid: 15749 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.846139:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114eda956b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 00000100:00100000:1.0:1713279306.846142:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3374:11855:x1796503281245312:12345-192.168.203.4@tcp:35:touch.0 Request processed in 51us (177us total) trans 4295183726 rc 0/0 00010000:00010000:3.0:1713279306.846143:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114eda956b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00000100:00100000:1.0:1713279306.846146:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223075 00010000:00010000:3.0:1713279306.846146:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114eda956b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.846147:0:15502:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda9158 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x7642:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b3e expref: 3374 pid: 15749 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.846149:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114eda956b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.846151:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023db00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.846153:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114eda956b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.846156:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114eda956b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.846157:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114eda9158 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x7642:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b3e expref: 3373 pid: 15749 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.846158:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281245632 00002000:00010000:2.0:1713279306.846158:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb size from disk: 46934 -> 46934 00000100:00100000:1.0:1713279306.846160:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281245632 00002000:00010000:2.0:1713279306.846160:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00010000:00010000:3.0:1713279306.846160:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.846161:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:2.0:1713279306.846162:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00000100:00100000:0.0:1713279306.846163:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200050816:192.168.203.4@tcp:104: 00002000:00010000:2.0:1713279306.846163:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00010000:00010000:3.0:1713279306.846163:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114eda956b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00002000:00010000:2.0:1713279306.846164:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb blocks from disk: 72 -> 72 00010000:00010000:3.0:1713279306.846166:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114eda956b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00000100:00100000:1.0:1713279306.846168:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785294 00010000:00010000:0.0:1713279306.846170:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7642:0x0].0x0 (ffff88012fbfe100) 00010000:00010000:3.0:1713279306.846170:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023cfc0/0xfc4b8e114eda9572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 00000100:00100000:1.0:1713279306.846171:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3644:11932:x1796503281245632:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1713279306.846172:0:15502:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.846173:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023cfc0/0xfc4b8e114eda9572 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.846176:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023cfc0/0xfc4b8e114eda9572 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.846177:0:15502:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279306.846177:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+92:1955:x1796503281245504:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 72us (152us total) trans 4295010126 rc 0/0 00010000:00010000:3.0:1713279306.846178:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023cfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.846179:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023cfc0/0xfc4b8e114eda9572 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.846180:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279306.846181:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110518 00010000:00010000:3.0:1713279306.846182:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023cfc0/0xfc4b8e114eda9572 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.846183:0:15480:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.846185:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3831 (ffff88007f2ad300) 00010000:00010000:0.0:1713279306.846186:0:15502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.846186:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.846187:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023cfc0/0xfc4b8e114eda9572 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.846190:0:15502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.846190:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023cfc0/0xfc4b8e114eda9572 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 00010000:00010000:1.0:1713279306.846191:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114eda94ed lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7aed:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c41 expref: 3644 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.846192:0:15502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.846199:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7aed:0x0].0x0 (ffff88008eb9f200) 00000100:00100000:2.0:1713279306.846199:0:15492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15492:1796503200050688:192.168.203.4@tcp:105: 00010000:00010000:1.0:1713279306.846201:0:15480:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.846201:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda9564 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c56 expref: 3732 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.846205:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c900/0xfc4b8e114eda9564 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c56 expref: 3732 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.846206:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.846210:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023c900, rc 0) 00000100:00100000:2.0:1713279306.846214:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a147b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:385c4b71-808c-40cf-91de-b076b668d13f+82:1956:x1796503281244416:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 3709us (3822us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.846218:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda9579 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7aed:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:2.0:1713279306.846218:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196552 00010000:00010000:1.0:1713279306.846223:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda9579 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7aed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.846224:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3731:11980:x1796503281245760:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 203us (235us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.846227:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda9579 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7aed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.846228:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785293 00000100:00100000:0.0:1713279306.846235:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd2ad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200050880:0@lo:1000:mdt_io00_004.0 00000100:00100000:0.0:1713279306.846251:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1713279306.846253:0:15480:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008fd28700 reply state ffff880095995000 transno 4295183727 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda9579 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7aed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:0.0:1713279306.846258:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540e40 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.846258:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda9579 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7aed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.846261:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7aed:0x0].0x0 (ffff88008eb9f200) 00010000:00010000:1.0:1713279306.846262:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.846262:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200050880 00000100:00100000:1.0:1713279306.846264:0:15480:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713279306.846264:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200050880 00000100:00100000:0.0:1713279306.846273:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.846285:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3645:11932:x1796503281245632:12345-192.168.203.4@tcp:36:touch.0 Request processed in 113us (246us total) trans 4295183727 rc 0/0 00000100:00100000:2.0:1713279306.846286:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281245888 00000100:00100000:2.0:1713279306.846287:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281245888 00000100:00100000:1.0:1713279306.846290:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785294 00000100:00100000:2.0:1713279306.846296:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223076 00000100:00100000:2.0:1713279306.846298:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3731:11955:x1796503281245888:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.846298:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98861 00000100:00100000:3.0:1713279306.846302:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+95:15502:x1796503200050880:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713279306.846342:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3732:11955:x1796503281245888:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 42us (68us total) trans 4295202737 rc 0/0 00000100:00100000:2.0:1713279306.846346:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223076 00000100:00100000:3.0:1713279306.846354:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+95:15502:x1796503200050880:12345-0@lo:1000:mdt_io00_004.0 Request processed in 52us (102us total) trans 0 rc -2/-2 00000100:00100000:3.0:1713279306.846358:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98861 00000100:00100000:0.0:1713279306.846363:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd2ad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200050880:0@lo:1000:mdt_io00_004.0 00000100:00100000:0.0:1713279306.846385:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd2ad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200050944:0@lo:1000:mdt_io00_004.0 00000100:00100000:0.0:1713279306.846398:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.846404:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540e40 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.846407:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200050944 00000100:00100000:3.0:1713279306.846409:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200050944 00000100:00100000:3.0:1713279306.846437:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98862 00000100:00100000:3.0:1713279306.846439:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+95:15502:x1796503200050944:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:3.0:1713279306.846466:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+95:15502:x1796503200050944:12345-0@lo:1000:mdt_io00_004.0 Request processed in 26us (67us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.846470:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98862 00000100:00100000:0.0:1713279306.846474:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd2ad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200050944:0@lo:1000:mdt_io00_004.0 00000100:00100000:0.0:1713279306.846497:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200051008:0@lo:1000:mdt_io00_004.0 00000100:00100000:0.0:1713279306.846605:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.846616:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540e40 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.846627:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200051008 00000100:00100000:3.0:1713279306.846629:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200051008 00000100:00100000:1.0:1713279306.846630:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.846641:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281245952 00000100:00100000:0.0:1713279306.846644:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281245952 00000100:00100000:3.0:1713279306.846644:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98863 00000100:00100000:3.0:1713279306.846647:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+95:15502:x1796503200051008:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:0.0:1713279306.846658:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785295 00000100:00100000:0.0:1713279306.846661:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3373:11666:x1796503281245952:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.846668:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.846674:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114eda9580 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c5d expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.846694:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda9587 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.846699:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda9587 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.846703:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda9587 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.846726:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3643:11876:x1796503281244864:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1567us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.846728:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+95:15502:x1796503200051008:12345-0@lo:1000:mdt_io00_004.0 Request processed in 80us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.846730:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223073 00000100:00100000:3.0:1713279306.846733:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98863 00000100:00100000:0.0:1713279306.846752:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200051008:0@lo:1000:mdt_io00_004.0 00000100:00100000:0.0:1713279306.846839:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200051072:0@lo:1000:mdt_io00_004.0 00000100:00100000:0.0:1713279306.846854:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.846868:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540e40 going to sleep for 11 seconds 00000004:00200000:0.0:1713279306.846876:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76ef:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.846879:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:2.0:1713279306.846885:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200051072 00000004:00010000:0.0:1713279306.846887:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda9587 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.846889:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200051072 00010000:00010000:0.0:1713279306.846897:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114eda9580 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c5d expref: 3375 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.846904:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda9587 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c5d expref: 3374 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.846907:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98864 00010000:00010000:0.0:1713279306.846908:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76ef:0x0].0x0 (ffff880091b35500) 00010000:00010000:0.0:1713279306.846910:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:2.0:1713279306.846910:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+95:15502:x1796503200051072:12345-0@lo:1000:mdt_io00_004.0 00010000:00010000:0.0:1713279306.846911:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092340d80, rc 0) 00000100:00100000:0.0:1713279306.846933:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3374:11666:x1796503281245952:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 270us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.846937:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785295 00000100:00100000:2.0:1713279306.846942:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+95:15502:x1796503200051072:12345-0@lo:1000:mdt_io00_004.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.846946:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98864 00000100:00100000:0.0:1713279306.846995:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200051072:0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713279306.847011:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.847020:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281246400 00000100:00100000:3.0:1713279306.847023:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281246400 00000100:00100000:3.0:1713279306.847034:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110519 00000100:00100000:3.0:1713279306.847036:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+84:1956:x1796503281246400:12345-192.168.203.4@tcp:16:kworker.0 00000100:00100000:0.0:1713279306.847043:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200051136:0@lo:1000:mdt_io00_004.0 00000100:00100000:0.0:1713279306.847057:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.847063:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540b40 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.847063:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+84:1956:x1796503281246400:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 26us (53us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.847066:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200051136 00000100:00100000:2.0:1713279306.847078:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200051136 00000100:00100000:3.0:1713279306.847079:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110519 00000100:00100000:2.0:1713279306.847091:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98865 00000100:00100000:2.0:1713279306.847094:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+14:15502:x1796503200051136:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713279306.847124:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+14:15502:x1796503200051136:12345-0@lo:1000:mdt_io00_004.0 Request processed in 30us (66us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.847127:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98865 00000100:00100000:0.0:1713279306.847154:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200051136:0@lo:1000:mdt_io00_004.0 00000100:00100000:1.0:1713279306.847168:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.847177:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200051200:0@lo:1000:mdt_io00_004.0 00000100:00100000:3.0:1713279306.847183:0:15525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281246784 00000100:00100000:3.0:1713279306.847186:0:15525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281246784 00000100:00100000:0.0:1713279306.847189:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.847195:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800965409c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.847198:0:15525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14348 00000100:00100000:3.0:1713279306.847200:0:15525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:385c4b71-808c-40cf-91de-b076b668d13f+3732:11854:x1796503281246784:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:2.0:1713279306.847201:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200051200 00000100:00100000:2.0:1713279306.847204:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200051200 00000100:00100000:2.0:1713279306.847214:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98866 00000100:00100000:2.0:1713279306.847217:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+12:15502:x1796503200051200:12345-0@lo:1000:mdt_io00_004.0 00010000:00010000:3.0:1713279306.847220:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.847226:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda93f1 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda93c0 expref: 94 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.847230:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.847242:0:15525:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda93f1 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda93c0 expref: 94 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.847246:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+12:15502:x1796503200051200:12345-0@lo:1000:mdt_io00_004.0 Request processed in 28us (55us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.847247:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.847249:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98866 00000100:00100000:0.0:1713279306.847252:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200051200:0@lo:1000:mdt_io00_004.0 00000040:00080000:0.0:1713279306.847411:0:15502:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x1c0:0x0].1545, 1488 off830296 00000040:00080000:0.0:1713279306.847453:0:15502:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xf8:0x0].2152, 1568 off1528696 00000100:00100000:0.0:1713279306.847467:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200051328:0@lo:1000:mdt_io00_004.0 00000100:00100000:0.0:1713279306.847481:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.847494:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540840 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.847506:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200051328 00000100:00100000:2.0:1713279306.847508:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200051328 00000100:00100000:2.0:1713279306.847517:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98867 00000100:00100000:2.0:1713279306.847519:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+12:15502:x1796503200051328:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713279306.847561:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+13:15502:x1796503200051328:12345-0@lo:1000:mdt_io00_004.0 Request processed in 41us (80us total) trans 4295010127 rc 0/0 00000100:00100000:2.0:1713279306.847565:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98867 00000100:00100000:0.0:1713279306.847567:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200051328:0@lo:1000:mdt_io00_004.0 00000100:00100000:0.0:1713279306.847578:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200051392:0@lo:1000:mdt_io00_004.0 00000100:00100000:0.0:1713279306.847589:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.847594:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540840 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.847598:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200051392 00000100:00100000:2.0:1713279306.847600:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200051392 00000100:00100000:2.0:1713279306.847607:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98868 00000100:00100000:2.0:1713279306.847610:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+14:15502:x1796503200051392:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713279306.847647:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+15:15502:x1796503200051392:12345-0@lo:1000:mdt_io00_004.0 Request processed in 36us (57us total) trans 4295010185 rc 0/0 00000100:00100000:0.0:1713279306.847650:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200051392:0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713279306.847651:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98868 00000004:00080000:0.0:1713279306.847654:0:15502:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880096540f00 with version 32016 00000004:00080000:1.0:1713279306.847715:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32016 rpc_version 32016 00000020:00100000:1.0:1713279306.847736:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1713279306.847742:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880090afed80 x1796503200051520/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1713279306.847756:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200051520:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.847773:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.847782:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.847803:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0600 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.847808:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.847809:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200051520 00000100:00100000:2.0:1713279306.847811:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200051520 00000100:00100000:2.0:1713279306.847817:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281247360 00000100:00100000:2.0:1713279306.847819:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281247360 00000100:00100000:2.0:1713279306.847832:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223077 00000100:00100000:2.0:1713279306.847835:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3719:11957:x1796503281247360:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:3.0:1713279306.847839:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281246848 00000100:00100000:3.0:1713279306.847843:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281246848 00000100:00100000:3.0:1713279306.847860:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110520 00000100:00100000:3.0:1713279306.847864:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+84:1957:x1796503281246848:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1713279306.847885:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11957:x1796503281247360:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 49us (77us total) trans 4295202738 rc 0/0 00000100:00100000:1.0:1713279306.847887:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.847889:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223077 00000100:00100000:2.0:1713279306.847902:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281247488 00000100:00100000:2.0:1713279306.847903:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281247488 00000100:00100000:2.0:1713279306.847911:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223078 00000100:00100000:2.0:1713279306.847913:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3733:11956:x1796503281247488:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:3.0:1713279306.847929:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281246848:12345-192.168.203.4@tcp:2:touch.0 Request processed in 64us (156us total) trans 4295010186 rc 0/0 00000100:00100000:3.0:1713279306.847933:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110520 00000100:00100000:2.0:1713279306.847983:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3734:11956:x1796503281247488:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 67us (96us total) trans 4295202739 rc 0/0 00000100:00100000:2.0:1713279306.847987:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223078 00000100:00100000:2.0:1713279306.848002:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98869 00000100:00100000:2.0:1713279306.848005:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+95:8074:x1796503200051520:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1713279306.848270:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+96:8074:x1796503200051520:12345-0@lo:1000:osp_up0-1.0 Request processed in 264us (488us total) trans 4295202740 rc 0/0 00000100:00100000:2.0:1713279306.848275:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98869 00000100:00100000:1.0:1713279306.848322:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200051520:0@lo:1000:osp_up0-1.0 00000004:00010000:0.0:1713279306.848337:0:15502:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012f38b800 reply state ffff8800895e6000 transno 4295183728 ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.848344:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.848348:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7642:0x0].0x0 (ffff88012fbfe100) 00010000:00010000:0.0:1713279306.848349:0:15502:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1713279306.848351:0:15502:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.848354:0:15502:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114eda951e lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.848357:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114eda951e lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.848360:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114eda951e lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.848363:0:15502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114eda951e lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.848366:0:15502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092343cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.848368:0:15502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114eda951e lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.848371:0:15502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114eda951e lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.848375:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x0 (ffff88012fbfed00) 00010000:00010000:0.0:1713279306.848376:0:15502:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.848378:0:15502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114eda951e lrc: 3/0,0 mode: --/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.848381:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114eda951e lrc: 0/0,0 mode: --/CW res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000004:00010000:0.0:1713279306.848388:0:15502:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012f38b800 reply state ffff8800895e6000 transno 4295183728 ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda9525 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.848392:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda9525 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.848395:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x3631 (ffff88012fbfe000) 00010000:00010000:0.0:1713279306.848396:0:15502:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.848397:0:15502:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1713279306.848399:0:15502:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00010000:00010000:0.0:1713279306.848433:0:15502:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092341d40/0xfc4b8e114eda9476 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda947d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.848438:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092341d40/0xfc4b8e114eda9476 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda947d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.848442:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092341d40/0xfc4b8e114eda9476 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114eda947d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.848453:0:15502:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1713279306.848456:0:15502:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24a:0x0] 00010000:00010000:0.0:1713279306.848458:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092343a80/0xfc4b8e114eda94b5 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9509 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.848462:0:15502:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092343a80/0xfc4b8e114eda94b5 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9509 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.848482:0:6919:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.848488:0:6919:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092341d40/0xfc4b8e114eda9476 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114eda947d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.848494:0:6919:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092341d40 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.848497:0:6919:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092341d40/0xfc4b8e114eda9476 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda947d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.848502:0:6919:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092341d40/0xfc4b8e114eda9476 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda947d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.848511:0:15502:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000403:0x863c:0x0] 00010000:00010000:0.0:1713279306.848514:0:15502:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.848516:0:6919:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092341d40/0xfc4b8e114eda9476 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda947d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.848518:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.848520:0:6919:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713279306.848522:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.848528:0:15502:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1713279306.848533:0:15544:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713279306.848537:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.848538:0:6919:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092341d40/0xfc4b8e114eda9476 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda947d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.848542:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a5b00 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.848542:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092341d40/0xfc4b8e114eda9476 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda947d expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.848545:0:15544:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.848549:0:15544:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.848550:0:15502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3375:10814:x1796503281239872:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 14466us (14507us total) trans 4295183728 rc 0/0 00010000:00010000:3.0:1713279306.848552:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.848552:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279306.848554:0:15502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14346 00010000:00010000:3.0:1713279306.848554:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279306.848561:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200051584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.848561:0:15544:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.848565:0:15544:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713279306.848570:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.848573:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5b00/0xfc4b8e114eda9231 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9238 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.848578:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.848579:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.848580:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279306.848582:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.848593:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200051584 00000100:00100000:2.0:1713279306.848595:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200051584 00000100:00100000:1.0:1713279306.848599:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713279306.848605:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200051648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.848614:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147262 00000100:00100000:2.0:1713279306.848616:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+96:3492:x1796503200051584:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.848620:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.848621:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.848627:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcd80/0xfc4b8e114eda947d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda9476 expref: 96 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.848629:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200051648 00010000:00010000:2.0:1713279306.848633:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x0 (ffff880091714100) 00000100:00100000:3.0:1713279306.848633:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200051648 00010000:00010000:2.0:1713279306.848637:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.848643:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda9238 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfc4b8e114eda9231 expref: 96 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.848652:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+96:3492:x1796503200051584:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (70us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.848656:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196553 00000100:00100000:2.0:1713279306.848658:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147262 00000100:00100000:3.0:1713279306.848659:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+96:3492:x1796503200051648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.848664:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.848669:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200051584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.849374:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.849394:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.849403:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281246080 00000100:00100000:1.0:1713279306.849406:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281246080 00000100:00100000:1.0:1713279306.849437:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281247680 00000100:00100000:0.0:1713279306.849438:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.849438:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281247680 00000100:00100000:2.0:1713279306.849443:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785296 00000100:00100000:2.0:1713279306.849448:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3376:9807:x1796503281246080:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:0.0:1713279306.849450:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.849450:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785297 00000100:00100000:1.0:1713279306.849454:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3376:11666:x1796503281247680:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:2.0:1713279306.849456:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.849460:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.849463:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda9595 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x74e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c72 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.849467:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281246144 00000100:00100000:0.0:1713279306.849469:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281246144 00000100:00100000:3.0:1713279306.849492:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281247744 00000100:00100000:3.0:1713279306.849497:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281247744 00010000:00010000:2.0:1713279306.849498:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda959c lrc: 3/0,1 mode: --/PW res: [0x240000403:0x74e5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.849503:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281246208 00010000:00010000:2.0:1713279306.849504:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda959c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x74e5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.849505:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281246208 00000100:00100000:1.0:1713279306.849507:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98870 00010000:00010000:2.0:1713279306.849509:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda959c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x74e5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.849510:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:1956:x1796503281246144:12345-192.168.203.4@tcp:63:ll_sa.0 00000004:00200000:2.0:1713279306.849513:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x74e5:0x0]: returning size 5 00000100:00100000:3.0:1713279306.849513:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110521 00000100:00100000:0.0:1713279306.849515:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98871 00000100:00100000:3.0:1713279306.849517:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281247744:12345-192.168.203.4@tcp:16:kworker.0 00000100:00100000:0.0:1713279306.849518:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3378:1957:x1796503281246208:12345-192.168.203.4@tcp:63:ll_sa.0 00010000:00010000:1.0:1713279306.849521:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.849528:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda95aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c80 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.849541:0:15580:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.849544:0:15516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda95b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15516 initiator: MDT0 00010000:00010000:2.0:1713279306.849544:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd8c0/0xfc4b8e114eda9595 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x74e5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c72 expref: 3380 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.849547:0:15580:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114eda95b8 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c64 expref: -99 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.849549:0:15516:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda95b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15516 initiator: MDT0 00000100:00100000:3.0:1713279306.849550:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281247744:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 32us (98us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.849552:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda959c lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x74e5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c72 expref: 3379 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.849554:0:15516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda95b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15516 initiator: MDT0 00000100:00100000:3.0:1713279306.849554:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110521 00010000:00010000:2.0:1713279306.849556:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74e5:0x0].0x0 (ffff8800963cc400) 00010000:00010000:2.0:1713279306.849558:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1713279306.849560:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935beac0, rc 0) 00010000:00010000:1.0:1713279306.849561:0:15516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda95bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849563:0:15580:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda95c6 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15580 initiator: MDT0 00010000:00010000:1.0:1713279306.849564:0:15516:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda95bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15516 initiator: MDT0 00010000:00010000:1.0:1713279306.849568:0:15516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda95bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849569:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda95c6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849573:0:15580:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda95c6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00000100:00100000:2.0:1713279306.849575:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3380:9807:x1796503281246080:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 127us (203us total) trans 4295183729 rc 0/0 00010000:00010000:0.0:1713279306.849579:0:15580:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114eda95cd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x237:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15580 initiator: MDT0 00000100:00100000:2.0:1713279306.849579:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785296 00010000:00010000:0.0:1713279306.849582:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114eda95cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849586:0:15580:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114eda95cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849595:0:15516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5200/0xfc4b8e114eda95d4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8694:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15516 initiator: MDT0 00010000:00010000:1.0:1713279306.849601:0:15516:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5200/0xfc4b8e114eda95d4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8694:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15516 initiator: MDT0 00010000:00010000:1.0:1713279306.849606:0:15516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5200/0xfc4b8e114eda95d4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8694:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849613:0:15580:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342d00/0xfc4b8e114eda95db lrc: 3/1,0 mode: --/PR res: [0x240000402:0x797c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15580 initiator: MDT0 00010000:00010000:0.0:1713279306.849618:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092342d00/0xfc4b8e114eda95db lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x797c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849622:0:15580:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092342d00/0xfc4b8e114eda95db lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x797c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00000004:00200000:1.0:1713279306.849631:0:15516:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8694:0x0]: returning size 0 00000004:00200000:1.0:1713279306.849633:0:15516:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00200000:0.0:1713279306.849635:0:15580:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x797c:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.849637:0:15580:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1713279306.849642:0:15580:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880092342d00/0xfc4b8e114eda95db lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x797c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00000004:00010000:1.0:1713279306.849642:0:15516:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5200/0xfc4b8e114eda95d4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8694:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849646:0:15580:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda95c6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849649:0:15580:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda95c6 lrc: 2/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849649:0:15516:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5200/0xfc4b8e114eda95d4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8694:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849652:0:15580:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda95c6 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849655:0:15580:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.849655:0:15516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda95b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849656:0:15580:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda95c6 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849659:0:15580:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda95c6 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849660:0:15516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda95b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849664:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff880092193400) 00010000:00010000:0.0:1713279306.849665:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.849665:0:15516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda95b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849667:0:15580:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda95c6 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849669:0:15516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd61c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.849670:0:15580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114eda95c6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849672:0:15516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda95b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849675:0:15580:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114eda95cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849677:0:15516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda95b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849678:0:15580:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114eda95cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849681:0:15580:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114eda95cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849684:0:15580:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800923433c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.849684:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x0 (ffff88011eea5300) 00010000:00010000:0.0:1713279306.849685:0:15580:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114eda95cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849687:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.849688:0:15580:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114eda95cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849690:0:15516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda95b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849691:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x30 (ffff88012cfc6800) 00010000:00010000:0.0:1713279306.849692:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.849693:0:15580:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114eda95cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849695:0:15516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114eda95b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849696:0:15580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114eda95cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849703:0:15516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda95bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849706:0:15580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114eda95b8 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c64 expref: 3380 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.849709:0:15516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda95bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849712:0:15580:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342d00/0xfc4b8e114eda95db lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x797c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c64 expref: 3379 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.849714:0:15516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda95bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849715:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x797c:0x0].0x0 (ffff88008da65d00) 00010000:00010000:0.0:1713279306.849716:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713279306.849718:0:15580:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092342d00, rc 0) 00010000:00010000:1.0:1713279306.849718:0:15516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.849720:0:15580:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.849720:0:15516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda95bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849723:0:15580:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092342ac0/0xfc4b8e114eda95e2 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c6b expref: -99 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.849724:0:15516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda95bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15516 initiator: MDT0 00010000:00010000:1.0:1713279306.849729:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x3431 (ffff88009e5e1d00) 00010000:00010000:1.0:1713279306.849730:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.849731:0:15516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda95bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15516 initiator: MDT0 00010000:00010000:1.0:1713279306.849735:0:15516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7600/0xfc4b8e114eda95bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849736:0:15580:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda95e9 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15580 initiator: MDT0 00010000:00010000:0.0:1713279306.849740:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda95e9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849744:0:15580:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda95e9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849748:0:15580:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda95f0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x237:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15580 initiator: MDT0 00010000:00010000:1.0:1713279306.849749:0:15516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114eda95aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c80 expref: 3722 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.849751:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda95f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849754:0:15580:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda95f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849758:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5200/0xfc4b8e114eda95d4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8694:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c80 expref: 3721 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.849763:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8694:0x0].0x0 (ffff88009588cc00) 00010000:00010000:1.0:1713279306.849766:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.849768:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd5200, rc 0) 00010000:00010000:0.0:1713279306.849771:0:15580:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f4900/0xfc4b8e114eda95f7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x77ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15580 initiator: MDT0 00010000:00010000:1.0:1713279306.849772:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.849775:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f4900/0xfc4b8e114eda95f7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x77ee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849778:0:15580:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f4900/0xfc4b8e114eda95f7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x77ee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849778:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114eda95fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c8e expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713279306.849783:0:15580:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x77ee:0x0]: returning size 1 00000004:00010000:0.0:1713279306.849790:0:15580:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f4900/0xfc4b8e114eda95f7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x77ee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849794:0:15580:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda95e9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849795:0:15516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114eda9605 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849799:0:15580:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda95e9 lrc: 2/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849802:0:15580:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda95e9 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849802:0:15516:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114eda9605 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849805:0:15580:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801250f6ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.849806:0:15580:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda95e9 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849808:0:15516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114eda9605 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849809:0:15580:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda95e9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849812:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff880092193400) 00010000:00010000:0.0:1713279306.849813:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.849815:0:15580:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda95e9 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849816:0:15516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6400/0xfc4b8e114eda960c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849817:0:15580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114eda95e9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849822:0:15580:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda95f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849822:0:15516:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6400/0xfc4b8e114eda960c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849825:0:15580:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda95f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849828:0:15580:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda95f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849828:0:15516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6400/0xfc4b8e114eda960c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849830:0:15580:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801250f7840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.849832:0:15580:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda95f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849837:0:15580:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda95f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849840:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x35 (ffff88008fda9000) 00010000:00010000:0.0:1713279306.849841:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.849842:0:15580:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda95f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849845:0:15580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114eda95f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849853:0:15580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092342ac0/0xfc4b8e114eda95e2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c6b expref: 3381 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.849856:0:15516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda9613 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x86db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849858:0:15580:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f4900/0xfc4b8e114eda95f7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x77ee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c6b expref: 3380 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.849861:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x77ee:0x0].0x0 (ffff88009588cb00) 00010000:00010000:0.0:1713279306.849862:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713279306.849863:0:15580:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801250f4900, rc 0) 00010000:00010000:1.0:1713279306.849863:0:15516:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda9613 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x86db:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849865:0:15580:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.849868:0:15580:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda961a lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c79 expref: -99 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.849869:0:15516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda9613 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x86db:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849876:0:15580:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda9621 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15580 initiator: MDT0 00010000:00010000:0.0:1713279306.849880:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda9621 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849884:0:15580:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda9621 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00000004:00200000:1.0:1713279306.849888:0:15516:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x86db:0x0]: returning size 0 00010000:00010000:0.0:1713279306.849890:0:15580:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9628 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x237:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15580 initiator: MDT0 00000004:00200000:1.0:1713279306.849891:0:15516:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713279306.849894:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9628 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849897:0:15580:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9628 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00000004:00010000:1.0:1713279306.849897:0:15516:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda9613 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x86db:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15516 initiator: MDT0 00010000:00010000:1.0:1713279306.849902:0:15516:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda9613 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x86db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15516 initiator: MDT0 00010000:00010000:1.0:1713279306.849905:0:15516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114eda9605 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15516 initiator: MDT0 00010000:00010000:1.0:1713279306.849909:0:15516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114eda9605 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849911:0:15580:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd133c0/0xfc4b8e114eda962f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x74d8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15580 initiator: MDT0 00010000:00010000:1.0:1713279306.849911:0:15516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114eda9605 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15516 initiator: MDT0 00010000:00010000:1.0:1713279306.849914:0:15516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd46c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.849915:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd133c0/0xfc4b8e114eda962f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74d8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849915:0:15516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114eda9605 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15516 initiator: MDT0 00010000:00010000:1.0:1713279306.849918:0:15516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114eda9605 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849919:0:15580:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd133c0/0xfc4b8e114eda962f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74d8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849922:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x0 (ffff88011eea5300) 00010000:00010000:1.0:1713279306.849923:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.849925:0:15516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114eda9605 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15516 initiator: MDT0 00010000:00010000:1.0:1713279306.849928:0:15516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114eda9605 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15516 initiator: MDT0 00000004:00200000:0.0:1713279306.849931:0:15580:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x74d8:0x0]: returning size 0 00000004:00200000:0.0:1713279306.849933:0:15580:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1713279306.849933:0:15516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6400/0xfc4b8e114eda960c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15516 initiator: MDT0 00000004:00010000:0.0:1713279306.849936:0:15580:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd133c0/0xfc4b8e114eda962f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74d8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849936:0:15516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6400/0xfc4b8e114eda960c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15516 initiator: MDT0 00010000:00010000:1.0:1713279306.849939:0:15516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6400/0xfc4b8e114eda960c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849940:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd133c0/0xfc4b8e114eda962f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74d8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849941:0:15516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.849943:0:15516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6400/0xfc4b8e114eda960c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849944:0:15580:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda9621 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849946:0:15580:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda9621 lrc: 2/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849946:0:15516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6400/0xfc4b8e114eda960c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849949:0:15580:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda9621 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849949:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x139:0x0].0x3032 (ffff88009e5e1200) 00010000:00010000:1.0:1713279306.849950:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.849951:0:15516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6400/0xfc4b8e114eda960c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849954:0:15580:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801250f7a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.849954:0:15516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6400/0xfc4b8e114eda960c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x139:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15516 initiator: MDT0 00010000:00010000:0.0:1713279306.849956:0:15580:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda9621 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849959:0:15580:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda9621 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849962:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff880092193400) 00010000:00010000:0.0:1713279306.849963:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.849964:0:15580:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda9621 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849965:0:15516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114eda95fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x139:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c8e expref: 3723 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.849967:0:15580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7a80/0xfc4b8e114eda9621 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849971:0:15580:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9628 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849971:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7a80/0xfc4b8e114eda9613 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x86db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c8e expref: 3722 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.849974:0:15580:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9628 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849977:0:15580:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9628 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00010000:00010000:1.0:1713279306.849977:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x86db:0x0].0x0 (ffff88008eba0d00) 00010000:00010000:1.0:1713279306.849978:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713279306.849980:0:15580:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e5f5200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.849980:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd7a80, rc 0) 00010000:00010000:0.0:1713279306.849981:0:15580:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9628 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849984:0:15580:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9628 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849987:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x36 (ffff88009588cf00) 00010000:00010000:0.0:1713279306.849988:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.849989:0:15580:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9628 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.849992:0:15580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9628 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850002:0:15580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114eda961a lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c79 expref: 3382 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.850003:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:1956:x1796503281246144:12345-192.168.203.4@tcp:63:ll_sa.0 Request processed in 491us (564us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.850007:0:15580:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd133c0/0xfc4b8e114eda962f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x74d8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c79 expref: 3381 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.850011:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74d8:0x0].0x0 (ffff88008c1d2300) 00000100:00100000:1.0:1713279306.850011:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98870 00010000:00010000:0.0:1713279306.850012:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713279306.850013:0:15580:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd133c0, rc 0) 00010000:00010000:0.0:1713279306.850015:0:15580:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.850018:0:15580:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda9636 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c87 expref: -99 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.850026:0:15580:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12400/0xfc4b8e114eda963d lrc: 3/1,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15580 initiator: MDT0 00010000:00010000:0.0:1713279306.850030:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12400/0xfc4b8e114eda963d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850033:0:15580:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12400/0xfc4b8e114eda963d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850038:0:15580:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9644 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15580 initiator: MDT0 00010000:00010000:0.0:1713279306.850041:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9644 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850046:0:15580:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9644 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850061:0:15580:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10480/0xfc4b8e114eda964b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7680:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15580 initiator: MDT0 00010000:00010000:0.0:1713279306.850064:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10480/0xfc4b8e114eda964b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7680:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850084:0:15580:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10480/0xfc4b8e114eda964b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7680:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00000004:00200000:0.0:1713279306.850096:0:15580:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7680:0x0]: returning size 0 00000004:00200000:0.0:1713279306.850098:0:15580:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1713279306.850102:0:15580:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10480/0xfc4b8e114eda964b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7680:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850106:0:15580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10480/0xfc4b8e114eda964b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7680:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00000100:00100000:1.0:1713279306.850108:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3382:11666:x1796503281247680:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 652us (713us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.850109:0:15580:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12400/0xfc4b8e114eda963d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850112:0:15580:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12400/0xfc4b8e114eda963d lrc: 2/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850115:0:15580:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12400/0xfc4b8e114eda963d lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00000100:00100000:1.0:1713279306.850115:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785297 00010000:00010000:0.0:1713279306.850118:0:15580:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd12400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.850119:0:15580:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12400/0xfc4b8e114eda963d lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850122:0:15580:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12400/0xfc4b8e114eda963d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850126:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff880092193400) 00010000:00010000:0.0:1713279306.850127:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.850129:0:15580:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12400/0xfc4b8e114eda963d lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850131:0:15580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12400/0xfc4b8e114eda963d lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850135:0:15580:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9644 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850138:0:15580:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9644 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850141:0:15580:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9644 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850143:0:15580:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd11f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.850144:0:15580:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9644 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15580 initiator: MDT1 00000100:00100000:1.0:1713279306.850144:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.850148:0:15580:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9644 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850151:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x3231 (ffff88009588c900) 00010000:00010000:0.0:1713279306.850152:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.850153:0:15580:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9644 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850155:0:15580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9644 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15580 initiator: MDT1 00010000:00010000:0.0:1713279306.850164:0:15580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda9636 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c87 expref: 3382 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.850170:0:15580:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10480/0xfc4b8e114eda964b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7680:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c87 expref: 3381 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.850174:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7680:0x0].0x0 (ffff88008ade5d00) 00010000:00010000:0.0:1713279306.850175:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713279306.850176:0:15580:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd10480, rc 0) 00000100:00100000:2.0:1713279306.850184:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281247808 00000100:00100000:1.0:1713279306.850188:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.850189:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281247808 00000100:00100000:0.0:1713279306.850193:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3381:1957:x1796503281246208:12345-192.168.203.4@tcp:63:ll_sa.0 Request processed in 674us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.850197:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98871 00000100:00100000:2.0:1713279306.850213:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281246336 00000100:00100000:2.0:1713279306.850214:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281246336 00000100:00100000:2.0:1713279306.850227:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785298 00000100:00100000:2.0:1713279306.850230:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3643:11876:x1796503281247808:12345-192.168.203.4@tcp:34:lfs.0 00000100:00100000:1.0:1713279306.850234:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.850237:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785299 00000100:00100000:3.0:1713279306.850242:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3734:11736:x1796503281246336:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.850245:0:6911:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda8a2e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713279306.850250:0:6911:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda8a2e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.850250:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.850252:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda9652 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.850257:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114eda9659 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7ede:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c95 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.850258:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda9652 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00000100:00100000:1.0:1713279306.850261:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.850262:0:6911:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda8a2e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.850263:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda9652 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.850265:0:6911:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713279306.850269:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda9660 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.850273:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda9660 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.850276:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda9660 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.850280:0:6911:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012154ef40/0xfc4b8e114eda8a27 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda8a2e expref: -99 pid: 6943 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1713279306.850288:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202740 is committed 00000100:00100000:3.0:1713279306.850288:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200051712:0@lo:103:jbd2/dm-0-8.0 00000001:00080000:0.0:1713279306.850295:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202739 is committed 00010000:00010000:2.0:1713279306.850311:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda9667 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00000001:00080000:0.0:1713279306.850313:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202738 is committed 00010000:00010000:2.0:1713279306.850315:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda9667 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00000100:00100000:3.0:1713279306.850317:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.850318:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda9667 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00000020:00080000:0.0:1713279306.850322:0:6911:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 16411 batchid updated 00010000:00010000:1.0:1713279306.850323:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8f8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00000020:00080000:0.0:1713279306.850324:0:6911:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 16410 batchid updated 00000020:00080000:0.0:1713279306.850326:0:6911:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 16409 batchid updated 00000020:00080000:0.0:1713279306.850329:0:6911:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 16408 batchid updated 00010000:00010000:1.0:1713279306.850330:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8f8a lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00000020:00080000:0.0:1713279306.850331:0:6911:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 16407 batchid updated 00000004:00010000:2.0:1713279306.850332:0:15471:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda9667 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.850335:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8f8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.850335:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200051712 00010000:00010000:2.0:1713279306.850337:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda9652 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00000100:00100000:3.0:1713279306.850337:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200051712 00010000:00010000:1.0:1713279306.850340:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801222058c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.850341:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda9652 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.850342:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8f8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.850343:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda9652 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.850346:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda9652 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.850347:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8f8a lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.850349:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bf180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.850350:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda9652 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00000100:00100000:3.0:1713279306.850351:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147263 00010000:00010000:2.0:1713279306.850353:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda9652 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00000100:00100000:3.0:1713279306.850354:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+87:3490:x1796503200051712:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1713279306.850355:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x3931 (ffff8801250c1b00) 00010000:00010000:1.0:1713279306.850358:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.850358:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880123701600) 00010000:00010000:2.0:1713279306.850359:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.850359:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.850360:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8f8a lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x24a:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.850361:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda9652 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.850364:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114eda9652 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.850365:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda8f8a lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x24a:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.850367:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93a80/0xfc4b8e114eda8a2e lrc: 0/0,0 mode: --/EX res: [0x240000402:0x721d:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda8a27 expref: 87 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.850369:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda9660 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.850372:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda9660 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.850375:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda9660 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850375:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x721d:0x0].0x0 (ffff8800902cc000) 00010000:00010000:1.0:1713279306.850377:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8f9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.850378:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bd440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.850379:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda9660 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850380:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.850382:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8f9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.850382:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda9660 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00000020:00080000:0.0:1713279306.850384:0:6911:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880096f77540 refcount 2 committed 0 result 0 batchid 16412 00010000:00010000:2.0:1713279306.850385:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3831 (ffff88008d729700) 00000020:00080000:0.0:1713279306.850386:0:6911:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096e84d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880096f77780 00010000:00010000:1.0:1713279306.850387:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8f9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.850387:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:0.0:1713279306.850388:0:6911:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0xf2:0x0].679 00010000:00010000:2.0:1713279306.850388:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda9660 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00000020:00080000:0.0:1713279306.850390:0:6911:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096e84600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d028800 00000020:00080000:0.0:1713279306.850391:0:6911:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x1b7:0x0].194 00010000:00010000:1.0:1713279306.850391:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.850392:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114eda9660 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00000100:00100000:3.0:1713279306.850393:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200051712:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 38us (75us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.850394:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8f9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.850396:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147263 00010000:00010000:1.0:1713279306.850399:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8f9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.850401:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda9667 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.850405:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x3931 (ffff8801250c1d00) 00010000:00010000:2.0:1713279306.850405:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda9667 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.850407:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:0.0:1713279306.850408:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 16412 committed batchid 16411 00010000:00010000:1.0:1713279306.850410:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8f9f lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.850410:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda9667 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00000100:00100000:3.0:1713279306.850429:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200051712:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1713279306.850430:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bfa80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.850432:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda9667 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.850435:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda9667 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.850436:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda8f9f lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x231:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.850440:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71e6:0x0].0x0 (ffff880090bee600) 00010000:00010000:2.0:1713279306.850441:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.850443:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda9667 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.850446:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114eda9667 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.850447:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.850452:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.850454:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e35f80/0xfc4b8e114eda9238 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfc4b8e114eda9231 expref: 53 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.850457:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.850460:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.850461:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.850463:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda93f1 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda93c0 expref: 52 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.850464:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.850464:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.850468:0:15496:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda93f1 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda93c0 expref: 52 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.850469:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.850470:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3643:11876:x1796503281247808:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 238us (325us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.850472:0:15496:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda93f1 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda93c0 expref: 52 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.850474:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785298 00000100:00100000:0.0:1713279306.850475:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.850476:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x862e:0x0].0x0 (ffff88009213a500) 00010000:00010000:3.0:1713279306.850476:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.850479:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1713279306.850481:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.850482:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281246528 00000100:00100000:2.0:1713279306.850484:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281246528 00000100:00100000:0.0:1713279306.850485:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.850486:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda8fa6 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x862e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.850486:0:15496:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda93f1 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda93c0 expref: 52 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.850491:0:15496:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000_UUID:15496:1796503200051776:0@lo:105: 00000100:00100000:2.0:1713279306.850492:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281246656 00000100:00100000:2.0:1713279306.850494:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281246656 00000100:00100000:0.0:1713279306.850495:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281246976 00000100:00100000:0.0:1713279306.850497:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281246976 00000100:00100000:2.0:1713279306.850500:0:15471:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281247104 00000100:00100000:2.0:1713279306.850512:0:15471:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281247104 00000100:00100000:2.0:1713279306.850521:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785300 00000100:00100000:2.0:1713279306.850524:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3383:11204:x1796503281246528:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.850524:0:15496:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.850528:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785301 00010000:00010000:2.0:1713279306.850530:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.850531:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3643:11711:x1796503281246656:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.850535:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.850535:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda966e lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175c9c expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.850535:0:15496:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0d80 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.850537:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.850544:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9675 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ca3 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.850549:0:6913:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1713279306.850554:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200051776 00000100:00100000:3.0:1713279306.850556:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200051776 00010000:00010000:2.0:1713279306.850571:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda967c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.850576:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9683 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.850576:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda967c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00000100:00100000:3.0:1713279306.850576:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33445 00010000:00010000:2.0:1713279306.850579:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda967c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00000100:00100000:3.0:1713279306.850579:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a3c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15496:x1796503200051776:12345-0@lo:105: 00010000:00010000:0.0:1713279306.850581:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9683 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.850585:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9683 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850585:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda968a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:3.0:1713279306.850585:0:6913:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.850589:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda968a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850590:0:6913:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.850591:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9691 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.850592:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda968a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.850594:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9691 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.850594:0:6913:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.850598:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9691 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.850598:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.850598:0:6913:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713279306.850600:0:15471:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:3.0:1713279306.850601:0:6913:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.850605:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda967c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850605:0:6913:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.850607:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda967c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850609:0:6913:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.850610:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9683 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850610:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda967c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00000100:00100000:1.0:1713279306.850612:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281247232 00010000:00010000:0.0:1713279306.850613:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9683 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850613:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda967c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.850615:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9683 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.850615:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281247232 00010000:00010000:2.0:1713279306.850616:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.850617:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda967c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850617:0:6913:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88008d4b8240) 00010000:00010000:0.0:1713279306.850619:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9683 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850620:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda967c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.850621:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.850623:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9683 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850624:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:2.0:1713279306.850625:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.850626:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9683 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850626:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda967c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.850629:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880089dc3a00) 00010000:00010000:2.0:1713279306.850629:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda967c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.850631:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.850631:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281247616 00010000:00010000:0.0:1713279306.850632:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9683 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.850632:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281247616 00000100:00100000:3.0:1713279306.850633:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a3c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15496:x1796503200051776:12345-0@lo:105: Request processed in 53us (110us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.850634:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9683 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:3.0:1713279306.850636:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33445 00010000:00010000:2.0:1713279306.850637:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda968a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.850639:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9691 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850640:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda968a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.850642:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda968a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.850643:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9691 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850645:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a064480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.850646:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9691 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.850646:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785302 00010000:00010000:2.0:1713279306.850646:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda968a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.850648:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd121c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.850649:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9691 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850649:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda968a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00000100:00100000:1.0:1713279306.850651:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3384:11855:x1796503281246976:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.850652:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9691 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850654:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88008d729f00) 00010000:00010000:0.0:1713279306.850655:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880089dc3900) 00010000:00010000:0.0:1713279306.850656:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.850656:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.850657:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9691 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850658:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda968a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.850659:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.850660:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9691 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850661:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda968a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00000100:00100000:3.0:1713279306.850663:0:15496:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000_UUID:15496:1796503200051776:0@lo:105: 00010000:00010000:1.0:1713279306.850667:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114eda9698 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175caa expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.850668:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.850670:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9675 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ca3 expref: 3645 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.850674:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9675 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ca3 expref: 3645 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.850678:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+52:3492:x1796503200051648:12345-0@lo:103:ldlm_bl.0 Request processed in 2019us (2058us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.850679:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd106c0, rc 0) 00010000:00010000:2.0:1713279306.850680:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda966e lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c9c expref: 3385 pid: 15471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.850682:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196553 00010000:00010000:2.0:1713279306.850685:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda966e lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c9c expref: 3385 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.850690:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bc000, rc 0) 00010000:00010000:3.0:1713279306.850691:0:15526:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.850693:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3644:11711:x1796503281246656:12345-192.168.203.4@tcp:101:touch.0 Request processed in 161us (230us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.850696:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda969f lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.850696:0:15526:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.850697:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785301 00010000:00010000:1.0:1713279306.850704:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda969f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.850704:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3384:11204:x1796503281246528:12345-192.168.203.4@tcp:101:touch.0 Request processed in 180us (444us total) trans 0 rc 301/301 00000004:00080000:3.0:1713279306.850704:0:15526:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1713279306.850706:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785303 00000100:00100000:0.0:1713279306.850708:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3384:11960:x1796503281247104:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:2.0:1713279306.850709:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785300 00010000:00010000:1.0:1713279306.850711:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda969f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.850713:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.850717:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11d40/0xfc4b8e114eda96a6 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175cb1 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.850717:0:15471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785304 00010000:00010000:1.0:1713279306.850720:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda96ad lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.850720:0:15471:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3643:11912:x1796503281247232:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.850725:0:15471:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.850726:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda96ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.850731:0:15471:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda96b4 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175cb8 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.850734:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda96bb lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.850736:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda96ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.850739:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda96bb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.850743:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda96bb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.850748:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda96c2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.850749:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b1b00/0xfc4b8e114eda96c9 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:0.0:1713279306.850751:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda96c2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850753:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b1b00/0xfc4b8e114eda96c9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.850754:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda96c2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850756:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b1b00/0xfc4b8e114eda96c9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850761:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda96d0 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.850762:0:15471:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda96d7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 00010000:00010000:2.0:1713279306.850766:0:15471:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda96d7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850767:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda96d0 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.850769:0:15471:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda96d7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850771:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda96d0 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.850778:0:15471:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b1b00/0xfc4b8e114eda96c9 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850778:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda96de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x260:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.850781:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b1b00/0xfc4b8e114eda96c9 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:0.0:1713279306.850782:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda96ec lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.850782:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda96e5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.850783:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda96de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279306.850786:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda96ec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850786:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b1b00/0xfc4b8e114eda96c9 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850788:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda96de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279306.850789:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda96ec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.850789:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b1b00/0xfc4b8e114eda96c9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.850790:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda96e5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.850791:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b1b00 already unused, calling callback (ffffffffa0f0d730) 00000004:00200000:0.0:1713279306.850793:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7bca:0x0]: returning size 27670 00010000:00010000:2.0:1713279306.850793:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b1b00/0xfc4b8e114eda96c9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:1.0:1713279306.850796:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda96e5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.850796:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b1b00/0xfc4b8e114eda96c9 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.850799:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880091b35d00) 00010000:00010000:2.0:1713279306.850800:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.850800:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda96fa lrc: 3/0,1 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00000004:00200000:1.0:1713279306.850802:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7364:0x0]: returning size 0 00010000:00010000:2.0:1713279306.850802:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b1b00/0xfc4b8e114eda96c9 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.850804:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b1b00/0xfc4b8e114eda96c9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850806:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda96fa lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.850808:0:15471:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda96d7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850809:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda96fa lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.850811:0:15471:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda96d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.850814:0:15471:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda96d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.850816:0:15471:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b0480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.850816:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda9708 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25b:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.850818:0:15471:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda96d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850819:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda9708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.850822:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda9708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.850823:0:15471:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda96d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT1 00010000:00010000:2.0:1713279306.850826:0:15471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff880129b60f00) 00010000:00010000:2.0:1713279306.850827:0:15471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.850828:0:15471:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda96d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00000100:00100000:1.0:1713279306.850831:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785305 00010000:00010000:2.0:1713279306.850831:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda96d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT1 00010000:00010000:3.0:1713279306.850835:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7ad1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00000100:00100000:1.0:1713279306.850836:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3721:11959:x1796503281247616:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.850840:0:15471:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda96b4 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cb8 expref: 3644 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.850841:0:15526:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda91cf lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x7ad1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b5a expref: 3386 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.850844:0:15471:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda96b4 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cb8 expref: 3644 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.850844:0:15526:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 4/0,1 mode: --/EX res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.850846:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.850848:0:15471:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f192ac0, rc 0) 00010000:00010000:1.0:1713279306.850853:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda9716 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175cbf expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.850855:0:15526:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda91cf lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7ad1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b5a expref: 3386 pid: 15471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.850859:0:15471:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:385c4b71-808c-40cf-91de-b076b668d13f+3643:11912:x1796503281247232:12345-192.168.203.4@tcp:101:touch.0 Request processed in 138us (325us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.850862:0:15471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785304 00010000:00010000:3.0:1713279306.850862:0:15526:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda91cf lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7ad1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b5a expref: 3386 pid: 15471 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.850871:0:15526:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001_UUID:15526:1796503200051840:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.850873:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281247936 00010000:00010000:0.0:1713279306.850875:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda96bb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.850875:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281247936 00010000:00010000:0.0:1713279306.850879:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda96bb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.850882:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda96bb lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.850884:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223079 00010000:00010000:0.0:1713279306.850885:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda96bb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.850887:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10d80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.850887:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3643:11932:x1796503281247936:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:3.0:1713279306.850887:0:15526:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0d80 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.850889:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda96bb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.850891:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda96bb lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.850896:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:0.0:1713279306.850897:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.850898:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda971d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.850899:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda96bb lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.850901:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda96bb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.850906:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda96c2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.850906:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda971d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.850909:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda96c2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.850912:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda96c2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.850912:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda971d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.850914:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda9724 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.850917:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd13600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.850918:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda96c2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.850919:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda9724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.850921:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda96c2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.850922:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda972b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.850923:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda9724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.850924:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3631 (ffff88009588c500) 00010000:00010000:0.0:1713279306.850925:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.850926:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda96c2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.850928:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda972b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000004:00200000:3.0:1713279306.850928:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7ede:0x0]: returning size 0 00010000:00010000:0.0:1713279306.850929:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda96c2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.850933:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3644:11932:x1796503281247936:12345-192.168.203.4@tcp:35:touch.0 Request processed in 45us (700us total) trans 4295183732 rc 0/0 00010000:00010000:1.0:1713279306.850934:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda972b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.850936:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223079 00010000:00010000:0.0:1713279306.850944:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11d40/0xfc4b8e114eda96a6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cb1 expref: 3387 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.850947:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda8da0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x84a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.850949:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda96ec lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cb1 expref: 3386 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.850951:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda8da0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x84a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.850952:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7bca:0x0].0x0 (ffff880093598800) 00010000:00010000:0.0:1713279306.850953:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713279306.850954:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd10fc0, rc 0) 00010000:00010000:2.0:1713279306.850954:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda8da0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x84a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.850957:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800958d6ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.850958:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda8da0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x84a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.850961:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda8da0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x84a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.850965:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x84a3:0x0].0x0 (ffff880096e84e00) 00010000:00010000:2.0:1713279306.850967:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.850968:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3386:11960:x1796503281247104:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 259us (482us total) trans 4295183730 rc 0/0 00010000:00010000:2.0:1713279306.850968:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda8da0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x84a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00000100:00100000:0.0:1713279306.850971:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785303 00010000:00010000:2.0:1713279306.850971:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda8da0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x84a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.850975:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919a0000/0xfc4b8e114eda8da7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00000004:00200000:1.0:1713279306.850977:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x863c:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.850978:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919a0000/0xfc4b8e114eda8da7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.850981:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919a0000/0xfc4b8e114eda8da7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.850984:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda971d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.850984:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800919a0000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.850985:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919a0000/0xfc4b8e114eda8da7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.850988:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919a0000/0xfc4b8e114eda8da7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.850990:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda971d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.850992:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x0 (ffff880096e84a00) 00010000:00010000:2.0:1713279306.850993:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.850994:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919a0000/0xfc4b8e114eda8da7 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.850995:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda971d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.850997:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919a0000/0xfc4b8e114eda8da7 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.851000:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda971d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.851002:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda9246 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.851003:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.851004:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda971d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.851005:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda9246 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.851007:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda971d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.851008:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda9246 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.851010:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ef3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.851012:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:2.0:1713279306.851012:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda9246 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.851014:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.851014:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda9246 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.851015:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda971d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.851018:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114eda971d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.851018:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x38 (ffff880092ae7700) 00010000:00010000:2.0:1713279306.851020:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.851021:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda9246 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x14f:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.851023:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda972b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.851024:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114eda9246 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x14f:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.851029:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda972b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.851030:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda9254 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.851032:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda972b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.851033:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda9254 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.851034:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.851035:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda972b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.851036:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda9254 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.851038:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda972b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.851038:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298edb00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.851040:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda9254 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.851041:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3131 (ffff8800958c9500) 00010000:00010000:1.0:1713279306.851042:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.851042:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda9254 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.851043:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda972b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.851046:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114eda972b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.851046:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x38 (ffff880092ae7500) 00010000:00010000:2.0:1713279306.851047:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.851048:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda9254 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.851050:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114eda9254 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x148:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.851057:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.851059:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda9716 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cbf expref: 3721 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.851060:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.851063:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114eda9716 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cbf expref: 3721 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.851063:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.851081:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298efa80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.851082:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd4480, rc 0) 00010000:00010000:2.0:1713279306.851082:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.851085:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.851090:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x843e:0x0].0x0 (ffff88008e4c8b00) 00010000:00010000:2.0:1713279306.851091:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.851092:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.851095:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114eda925b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x843e:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT0 00000100:00100000:1.0:1713279306.851098:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3720:11959:x1796503281247616:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 262us (501us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.851102:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785305 00000100:00100000:0.0:1713279306.851109:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.851120:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281248064 00000100:00100000:2.0:1713279306.851122:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281248064 00000100:00100000:1.0:1713279306.851136:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200051648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.851141:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785306 00000100:00100000:2.0:1713279306.851143:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11986:x1796503281248064:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.851148:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.851153:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda9739 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175cc6 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.851156:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.851162:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda969f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.851166:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda969f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.851166:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281248128 00000100:00100000:3.0:1713279306.851169:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281248128 00010000:00010000:1.0:1713279306.851170:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda969f lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.851173:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda969f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.851175:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.851177:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda969f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.851179:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda969f lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.851182:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda9740 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.851184:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880123701600) 00000100:00100000:3.0:1713279306.851184:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785307 00010000:00010000:1.0:1713279306.851185:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.851187:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda969f lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.851187:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda9740 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000100:00100000:3.0:1713279306.851187:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:10814:x1796503281248128:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.851189:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114eda969f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00000100:00100000:0.0:1713279306.851191:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.851191:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda9740 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.851192:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.851194:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda96ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.851197:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda96ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00000004:00200000:2.0:1713279306.851197:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7fe9:0x0]: returning size 46934 00010000:00010000:3.0:1713279306.851198:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009681cfc0/0xfc4b8e114eda9747 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ccd expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.851200:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda96ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.851203:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.851204:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda96ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.851207:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda96ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.851210:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3131 (ffff8800958c9700) 00010000:00010000:1.0:1713279306.851211:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.851212:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda96ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.851215:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114eda96ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.851215:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda9755 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851220:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda9755 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851224:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda9755 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.851229:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114eda9698 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175caa expref: 3386 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.851229:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c480/0xfc4b8e114eda975c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851233:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c480/0xfc4b8e114eda975c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.851235:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda96e5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175caa expref: 3385 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.851236:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c480/0xfc4b8e114eda975c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.851238:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7364:0x0].0x0 (ffff88012bacd300) 00010000:00010000:1.0:1713279306.851239:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.851240:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd73c0, rc 0) 00000100:00100000:1.0:1713279306.851253:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3385:11855:x1796503281246976:12345-192.168.203.4@tcp:101:touch.0 Request processed in 603us (777us total) trans 4295183731 rc 0/0 00000100:00100000:1.0:1713279306.851256:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785302 00010000:00010000:3.0:1713279306.851257:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda9763 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x863c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851261:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda9763 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x863c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851264:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda9763 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x863c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00000004:00200000:3.0:1713279306.851287:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x863c:0x0]: returning size 4096 00000004:00200000:3.0:1713279306.851289:0:15481:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:3.0:1713279306.851295:0:15481:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda9763 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x863c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851299:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda9755 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851303:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda9755 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851306:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda9755 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851308:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda9755 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851311:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009681c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.851313:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda9755 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851316:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda9755 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851321:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.851322:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.851324:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda9755 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851327:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114eda9755 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851332:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c480/0xfc4b8e114eda975c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851335:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c480/0xfc4b8e114eda975c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851338:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c480/0xfc4b8e114eda975c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851340:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009681c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.851342:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c480/0xfc4b8e114eda975c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851344:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c480/0xfc4b8e114eda975c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851347:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3131 (ffff8801250c1400) 00010000:00010000:3.0:1713279306.851348:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.851350:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c480/0xfc4b8e114eda975c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851352:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c480/0xfc4b8e114eda975c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.851356:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.851364:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009681cfc0/0xfc4b8e114eda9747 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ccd expref: 3715 pid: 15481 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713279306.851367:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800969d0cc0 with version 29434 00010000:00010000:3.0:1713279306.851371:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880122206400/0xfc4b8e114eda9763 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x863c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ccd expref: 3714 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.851374:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x863c:0x0].0x0 (ffff8801250c1f00) 00010000:00010000:3.0:1713279306.851376:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1713279306.851377:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122206400, rc 0) 00000020:00080000:1.0:1713279306.851378:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16407 cancel update log [0x240000401:0xf2:0x0].674: rc = 0 00000004:00080000:2.0:1713279306.851389:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29434 rpc_version 29434 00000100:00100000:3.0:1713279306.851393:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:10814:x1796503281248128:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 206us (237us total) trans 0 rc 0/0 00000020:00080000:1.0:1713279306.851396:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16407 cancel update log [0x200000400:0x1b7:0x0].189: rc = 0 00000100:00100000:3.0:1713279306.851397:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785307 00000020:00100000:2.0:1713279306.851398:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.851402:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.851402:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012e7e9880 x1796503200051968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000004:00080000:1.0:1713279306.851407:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800969d0300 with version 29435 00000020:00080000:1.0:1713279306.851409:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16408 cancel update log [0x240000401:0xf2:0x0].675: rc = 0 00000100:00100000:2.0:1713279306.851428:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e9880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200051968:0@lo:1000:osp_up1-0.0 00000020:00080000:1.0:1713279306.851431:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16408 cancel update log [0x200000400:0x1b7:0x0].190: rc = 0 00000004:00080000:1.0:1713279306.851440:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800969d0d80 with version 29436 00000020:00080000:1.0:1713279306.851442:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16409 cancel update log [0x240000401:0xf2:0x0].676: rc = 0 00000100:00100000:2.0:1713279306.851447:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1713279306.851449:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16409 cancel update log [0x200000400:0x1b7:0x0].191: rc = 0 00000004:00080000:1.0:1713279306.851457:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800969d09c0 with version 29437 00000020:00080000:1.0:1713279306.851459:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16410 cancel update log [0x240000401:0xf2:0x0].677: rc = 0 00000100:00100000:2.0:1713279306.851459:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e75fb40 going to sleep for 11 seconds 00000020:00080000:1.0:1713279306.851464:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16410 cancel update log [0x200000400:0x1b7:0x0].192: rc = 0 00000004:00080000:1.0:1713279306.851472:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800969d0e40 with version 29438 00000020:00080000:1.0:1713279306.851473:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16411 cancel update log [0x240000401:0xf2:0x0].678: rc = 0 00000020:00080000:1.0:1713279306.851479:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16411 cancel update log [0x200000400:0x1b7:0x0].193: rc = 0 00000100:00100000:3.0:1713279306.851486:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281248320 00000100:00100000:3.0:1713279306.851489:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281248320 00000020:00080000:1.0:1713279306.851491:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16411 00000100:00100000:0.0:1713279306.851497:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200051968 00000100:00100000:3.0:1713279306.851497:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281248448 00000100:00100000:3.0:1713279306.851498:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281248448 00000100:00100000:1.0:1713279306.851500:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785308 00000100:00100000:0.0:1713279306.851501:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200051968 00000100:00100000:1.0:1713279306.851504:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:11981:x1796503281248320:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.851506:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785309 00000100:00100000:3.0:1713279306.851508:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3644:11876:x1796503281248448:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.851510:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.851511:0:15483:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:0.0:1713279306.851513:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98872 00010000:00010000:3.0:1713279306.851514:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.851516:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:8634:x1796503200051968:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1713279306.851519:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9189 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x119:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b45 expref: 3714 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.851519:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda976a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x71e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175cdb expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.851525:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x119:0x0].0x0 (ffff88009228ea00) 00010000:00010000:1.0:1713279306.851527:0:15483:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.851532:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5f80/0xfc4b8e114eda9771 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x119:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175cd4 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.851544:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880122207180/0xfc4b8e114eda9778 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851549:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122207180/0xfc4b8e114eda9778 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.851552:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda977f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x119:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.851553:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122207180/0xfc4b8e114eda9778 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.851556:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda977f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000004:00200000:3.0:1713279306.851557:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x71e6:0x0]: returning size 0 00010000:00010000:1.0:1713279306.851560:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda977f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.851565:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda978d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x119:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713279306.851569:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+87:8634:x1796503200051968:12345-0@lo:1000:osp_up1-0.0 Request processed in 52us (120us total) trans 4295183733 rc 0/0 00010000:00010000:1.0:1713279306.851569:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda978d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.851572:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda978d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713279306.851573:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98872 00000100:00100000:2.0:1713279306.851581:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e9880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200051968:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1713279306.851585:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29435 rpc_version 29435 00010000:00010000:3.0:1713279306.851585:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda976a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x71e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cdb expref: 3647 pid: 15481 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1713279306.851591:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1713279306.851592:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880122207180/0xfc4b8e114eda9778 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cdb expref: 3646 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.851594:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012e7eb480 x1796503200052096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1713279306.851595:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71e6:0x0].0x0 (ffff880090bee600) 00010000:00010000:3.0:1713279306.851597:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1713279306.851598:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122207180, rc 0) 00000100:00100000:2.0:1713279306.851602:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7eb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200052096:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1713279306.851605:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda9794 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8284:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.851612:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda9794 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8284:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.851617:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda9794 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8284:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000004:00200000:1.0:1713279306.851622:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8284:0x0]: returning size 0 00000100:00100000:0.0:1713279306.851643:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.851646:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3646:11876:x1796503281248448:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 136us (244us total) trans 4295183734 rc 0/0 00000100:00100000:2.0:1713279306.851647:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.851649:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785309 00010000:00010000:1.0:1713279306.851652:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda977f lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.851658:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda977f lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.851658:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012edd90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.851666:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200052096 00010000:00010000:1.0:1713279306.851667:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda977f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.851669:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200052096 00010000:00010000:1.0:1713279306.851672:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda977f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.851676:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.851678:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda977f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713279306.851679:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.851681:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281248192 00000100:00100000:3.0:1713279306.851683:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281248192 00010000:00010000:1.0:1713279306.851684:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda977f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.851684:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98873 00000100:00100000:2.0:1713279306.851688:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+87:8634:x1796503200052096:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1713279306.851690:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x119:0x0].0x0 (ffff88009228ea00) 00010000:00010000:1.0:1713279306.851692:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.851692:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281248512 00000100:00100000:3.0:1713279306.851693:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281248512 00010000:00010000:1.0:1713279306.851695:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda977f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.851699:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114eda977f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.851707:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda978d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.851707:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110522 00000100:00100000:3.0:1713279306.851710:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1956:x1796503281248192:12345-192.168.203.4@tcp:1:lfs.0 00000100:00100000:0.0:1713279306.851712:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110523 00010000:00010000:1.0:1713279306.851712:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda978d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713279306.851716:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281248512:12345-192.168.203.4@tcp:16:kworker.0 00010000:00010000:1.0:1713279306.851717:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda978d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.851721:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.851721:0:15506:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda97a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.851724:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda978d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.851729:0:15506:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d4baf40/0xfc4b8e114ed63716 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39160d60 expref: 86 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.851732:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda978d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.851733:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.851734:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.851736:0:15506:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda97a2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.851738:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x119:0x0].0x3831 (ffff88012cfc6500) 00010000:00010000:1.0:1713279306.851740:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.851742:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda978d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x119:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713279306.851746:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281248512:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 30us (104us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.851747:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4d80/0xfc4b8e114eda978d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x119:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.851747:0:15506:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d4baf40/0xfc4b8e114ed63716 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39160d60 expref: 86 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.851750:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110523 00010000:00010000:3.0:1713279306.851753:0:15506:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d4baf40/0xfc4b8e114ed63716 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39160d60 expref: 86 pid: 15509 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.851756:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+88:8634:x1796503200052096:12345-0@lo:1000:osp_up1-0.0 Request processed in 65us (106us total) trans 4295183735 rc 0/0 00000100:00100000:2.0:1713279306.851762:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98873 00000100:00100000:3.0:1713279306.851762:0:15506:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15506:1796503200052160:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.851769:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5f80/0xfc4b8e114eda9771 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x119:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cd4 expref: 3716 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.851779:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda9794 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8284:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cd4 expref: 3715 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.851782:0:15506:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c09c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.851786:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8284:0x0].0x0 (ffff88008ad67600) 00000100:00100000:2.0:1713279306.851786:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7eb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200052096:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1713279306.851787:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.851789:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf46c0, rc 0) 00000004:00080000:2.0:1713279306.851792:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29436 rpc_version 29436 00000100:00100000:3.0:1713279306.851792:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281248640 00000100:00100000:3.0:1713279306.851794:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281248640 00000020:00100000:2.0:1713279306.851800:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.851804:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880122c01c00 x1796503200052288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.851807:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785310 00000100:00100000:3.0:1713279306.851810:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3719:11711:x1796503281248640:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.851812:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:11981:x1796503281248320:12345-192.168.203.4@tcp:101:touch.0 Request processed in 306us (455us total) trans 4295202741 rc 0/0 00000100:00100000:2.0:1713279306.851815:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c01c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200052288:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713279306.851815:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.851818:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785308 00010000:00010000:3.0:1713279306.851821:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda97a9 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ce2 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.851833:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.851842:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800976f9900 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.851853:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200052288 00000100:00100000:2.0:1713279306.851856:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200052288 00010000:00010000:3.0:1713279306.851860:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda97b0 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851865:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda97b0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.851866:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114eda9659 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7ede:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c95 expref: 3722 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.851868:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98874 00010000:00010000:3.0:1713279306.851868:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda97b0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.851870:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda9739 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cc6 expref: 3716 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.851872:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+88:8634:x1796503200052288:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713279306.851875:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda97b7 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.851876:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda9724 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c95 expref: 3721 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.851878:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda9740 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cc6 expref: 3715 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.851881:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda97b7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.851882:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:0.0:1713279306.851883:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1713279306.851884:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda97b7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.851885:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ec000, rc 0) 00010000:00010000:1.0:1713279306.851887:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ede:0x0].0x0 (ffff88008e4c8000) 00010000:00010000:1.0:1713279306.851889:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1713279306.851891:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801250a9200, rc 0) 00000004:00200000:3.0:1713279306.851893:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:3.0:1713279306.851897:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda97b0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851900:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda97b0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851903:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda97b0 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851906:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda97b0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851909:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800923421c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.851910:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda97b0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851913:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda97b0 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851917:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8801250c1500) 00010000:00010000:3.0:1713279306.851918:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.851920:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda97b0 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00000100:00100000:2.0:1713279306.851922:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+89:8634:x1796503200052288:12345-0@lo:1000:osp_up1-0.0 Request processed in 49us (88us total) trans 4295183736 rc 0/0 00010000:00010000:3.0:1713279306.851922:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923421c0/0xfc4b8e114eda97b0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00000100:00100000:2.0:1713279306.851929:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98874 00010000:00010000:3.0:1713279306.851929:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda97b7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851932:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda97b7 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00000100:00100000:1.0:1713279306.851933:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3721:11736:x1796503281246336:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1690us (1745us total) trans 4295202742 rc 0/0 00010000:00010000:3.0:1713279306.851935:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda97b7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851937:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c9b5680 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.851939:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785299 00010000:00010000:3.0:1713279306.851939:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda97b7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.851941:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda97b7 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.851942:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:11986:x1796503281248064:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 796us (908us total) trans 4295202743 rc 0/0 00010000:00010000:3.0:1713279306.851944:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff8801250c1200) 00010000:00010000:3.0:1713279306.851945:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.851946:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda97b7 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.851947:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785306 00010000:00010000:3.0:1713279306.851949:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114eda97b7 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00000100:00100000:2.0:1713279306.851952:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c01c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200052288:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1713279306.851957:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29437 rpc_version 29437 00010000:00010000:3.0:1713279306.851962:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda97a9 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ce2 expref: 3720 pid: 15481 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1713279306.851965:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1713279306.851966:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092343840/0xfc4b8e114eda97a9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ce2 expref: 3720 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.851969:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880122c03b80 x1796503200052416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1713279306.851971:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092343840, rc 0) 00000100:00100000:2.0:1713279306.851980:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c03b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200052416:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713279306.851982:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.851984:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3719:11711:x1796503281248640:12345-192.168.203.4@tcp:101:touch.0 Request processed in 174us (305us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.851989:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785310 00000100:00100000:3.0:1713279306.851997:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281248832 00000100:00100000:2.0:1713279306.851998:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.851998:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281248832 00000100:00100000:2.0:1713279306.852007:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba28d80 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.852008:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785311 00000100:00100000:3.0:1713279306.852011:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3646:11912:x1796503281248832:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.852012:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200052416 00000100:00100000:0.0:1713279306.852015:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200052416 00010000:00010000:3.0:1713279306.852015:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.852019:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda97be lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ce9 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.852025:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98875 00000100:00100000:0.0:1713279306.852028:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+89:8634:x1796503200052416:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713279306.852055:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda97c5 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.852063:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda97c5 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.852085:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda97c5 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:0.0:1713279306.852088:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+90:8634:x1796503200052416:12345-0@lo:1000:osp_up1-0.0 Request processed in 58us (89us total) trans 4295183737 rc 0/0 00000100:00100000:0.0:1713279306.852092:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98875 00010000:00010000:3.0:1713279306.852092:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda97cc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.852095:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda97cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.852099:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda97cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:2.0:1713279306.852105:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c03b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200052416:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1713279306.852108:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00000004:00080000:2.0:1713279306.852111:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29438 rpc_version 29438 00010000:00010000:3.0:1713279306.852113:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda97c5 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.852116:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda97c5 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00000020:00100000:2.0:1713279306.852119:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1713279306.852119:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda97c5 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00000100:00100000:2.0:1713279306.852122:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880122c01180 x1796503200052544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1713279306.852123:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda97c5 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.852125:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e9d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.852126:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda97c5 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.852129:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda97c5 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.852133:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff8801250c1a00) 00010000:00010000:3.0:1713279306.852134:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.852136:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda97c5 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:2.0:1713279306.852138:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c01180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200052544:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713279306.852138:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda97c5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.852143:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda97cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.852145:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda97cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.852148:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda97cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.852151:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906ea640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.852152:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda97cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00000100:00100000:2.0:1713279306.852156:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.852157:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda97cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.852160:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff8801250c1600) 00010000:00010000:3.0:1713279306.852161:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.852163:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda97cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.852165:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda97cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:2.0:1713279306.852174:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba28d80 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.852183:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200052544 00010000:00010000:3.0:1713279306.852183:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda97be lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ce9 expref: 3647 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.852186:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200052544 00010000:00010000:3.0:1713279306.852189:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda97be lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ce9 expref: 3647 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.852196:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98876 00010000:00010000:3.0:1713279306.852196:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c9b5200, rc 0) 00000100:00100000:0.0:1713279306.852199:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+90:8634:x1796503200052544:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713279306.852212:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3646:11912:x1796503281248832:12345-192.168.203.4@tcp:101:touch.0 Request processed in 200us (230us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.852215:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785311 00000100:00100000:0.0:1713279306.852240:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+91:8634:x1796503200052544:12345-0@lo:1000:osp_up1-0.0 Request processed in 40us (84us total) trans 4295183738 rc 0/0 00000100:00100000:0.0:1713279306.852244:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98876 00000100:00100000:2.0:1713279306.852255:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c01180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200052544:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713279306.853386:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.853441:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.853453:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281248960 00000100:00100000:3.0:1713279306.853458:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281248960 00000100:00100000:3.0:1713279306.853479:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281249088 00000100:00100000:3.0:1713279306.853480:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281249088 00000100:00100000:3.0:1713279306.853490:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785312 00000100:00100000:3.0:1713279306.853493:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:11204:x1796503281248960:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.853501:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.853507:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9440/0xfc4b8e114eda97d3 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175cf0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.853509:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785313 00000100:00100000:2.0:1713279306.853514:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3719:11966:x1796503281249088:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.853522:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.853529:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda97da lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175cf7 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.853548:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.853551:0:15526:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880121534e00 x1796503200051840) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda91cf lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7ad1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b5a expref: 3384 pid: 15471 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.853557:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.853558:0:15526:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda91cf lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7ad1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b5a expref: 3384 pid: 15471 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.853566:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.853566:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda91cf lrc: 0/0,0 mode: --/PW res: [0x240000402:0x7ad1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b5a expref: 3384 pid: 15471 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.853568:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda97e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00000100:00100000:3.0:1713279306.853573:0:15526:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001_UUID:15526:1796503200051840:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.853574:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda97e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.853575:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.853579:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda97e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00000100:00100000:1.0:1713279306.853581:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281249344 00010000:00010000:3.0:1713279306.853581:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ad1:0x0].0x0 (ffff880082706a00) 00000100:00100000:0.0:1713279306.853583:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.853583:0:15526:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00000100:00100000:1.0:1713279306.853585:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281249344 00010000:00010000:2.0:1713279306.853586:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda97ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.853587:0:15526:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.853600:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda97ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.853601:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.853601:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.853604:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda97ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.853610:0:15526:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00000100:00100000:0.0:1713279306.853614:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281249408 00000100:00100000:1.0:1713279306.853614:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785314 00010000:00010000:3.0:1713279306.853616:0:15526:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00000100:00100000:0.0:1713279306.853617:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281249408 00000100:00100000:1.0:1713279306.853619:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3384:11855:x1796503281249344:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:3.0:1713279306.853620:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.853621:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda97f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.853628:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda97f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.853632:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda97f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.853633:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281249472 00000100:00100000:0.0:1713279306.853634:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281249472 00000004:00200000:2.0:1713279306.853635:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x8235:0x0]: returning size 12827 00000100:00100000:1.0:1713279306.853636:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281249600 00000100:00100000:1.0:1713279306.853640:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281249600 00000100:00100000:0.0:1713279306.853643:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110524 00000100:00100000:0.0:1713279306.853646:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+85:1956:x1796503281249408:12345-192.168.203.4@tcp:1:lfs.0 00000100:00100000:1.0:1713279306.853656:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110525 00010000:00010000:2.0:1713279306.853656:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda97e8 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00000100:00100000:1.0:1713279306.853660:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+87:1956:x1796503281249472:12345-192.168.203.4@tcp:101:ll_agl.0 00010000:00010000:2.0:1713279306.853660:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda97e8 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.853663:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda97e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00002000:00010000:0.0:1713279306.853666:0:9197:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0xf15:0x0] initial LVB size: 0, mtime: 0x661e9149, atime: 0x661e9149, ctime: 0x661e9149, blocks: 0x0 00010000:00010000:2.0:1713279306.853666:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda97e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.853667:0:15519:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.853669:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.853670:0:9197:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda9804 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.853670:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda97e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.853673:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda97e8 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.853676:0:9197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.853677:0:9197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.853678:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:0.0:1713279306.853679:0:9197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda9804 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.853679:0:15519:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda980b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1186:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175cfe expref: -99 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.853679:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.853681:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda97e8 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.853684:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114eda97e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.853686:0:9197:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda9804 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.853691:0:9197:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda9804 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713279306.853691:0:15519:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x1186:0x0] initial LVB size: 0, mtime: 0x661e9149, atime: 0x661e9149, ctime: 0x661e9149, blocks: 0x0 00010000:00010000:2.0:1713279306.853691:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda97ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.853694:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda97ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.853695:0:9197:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda9804 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.853697:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda97ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.853699:0:9197:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda9804 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.853700:0:15519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.853700:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.853701:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda97ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.853702:0:9197:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd11440 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:1.0:1713279306.853702:0:15519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.853704:0:9197:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda9804 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.853704:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda97ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.853707:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x37 (ffff880129b60800) 00010000:00010000:1.0:1713279306.853708:0:15519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda980b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->262143) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cfe expref: 88 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713279306.853708:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.853709:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda97ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.853711:0:9197:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda9804 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.853711:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114eda97ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.853718:0:9197:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda9804 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.853718:0:15519:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012baf6400/0xfc4b8e114eda980b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->262143) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cfe expref: 88 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713279306.853722:0:9197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda9804 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.853726:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298eef40/0xfc4b8e114eda97da lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cf7 expref: 3722 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.853727:0:15519:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf6400, rc 0) 00000004:00010000:3.0:1713279306.853730:0:15526:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007f1d4000 reply state ffff88012b12b000 transno 4295183739 ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.853732:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda97f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cf7 expref: 3721 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.853735:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8235:0x0].0x0 (ffff880096da6c00) 00010000:00010000:2.0:1713279306.853736:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.853738:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ed200, rc 0) 00010000:00010000:3.0:1713279306.853738:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.853741:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ad1:0x0].0x0 (ffff880082706a00) 00010000:00010000:3.0:1713279306.853743:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1713279306.853744:0:15526:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.853747:0:15526:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda96fa lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00000100:00100000:0.0:1713279306.853748:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+85:1956:x1796503281249408:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 100us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.853749:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+88:1956:x1796503281249472:12345-192.168.203.4@tcp:101:ll_agl.0 Request processed in 87us (163us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.853750:0:15526:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda96fa lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00000100:00100000:0.0:1713279306.853752:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110524 00010000:00010000:3.0:1713279306.853753:0:15526:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda96fa lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00000100:00100000:1.0:1713279306.853756:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110525 00010000:00010000:3.0:1713279306.853756:0:15526:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda96fa lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00000100:00100000:2.0:1713279306.853758:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3721:11966:x1796503281249088:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 242us (316us total) trans 4295202744 rc 0/0 00010000:00010000:3.0:1713279306.853759:0:15526:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b46c0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.853761:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110526 00010000:00010000:3.0:1713279306.853761:0:15526:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda96fa lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00000100:00100000:0.0:1713279306.853763:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+92:1957:x1796503281249600:12345-192.168.203.4@tcp:101:ll_agl.0 00000100:00100000:2.0:1713279306.853764:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785313 00010000:00010000:3.0:1713279306.853764:0:15526:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda96fa lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.853767:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880091b35d00) 00010000:00010000:0.0:1713279306.853768:0:9197:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.853768:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.853770:0:15526:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda96fa lrc: 3/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.853773:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114eda96fa lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279306.853775:0:9197:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd10240/0xfc4b8e114eda9812 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x119d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d05 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713279306.853781:0:9197:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x119d:0x0] initial LVB size: 0, mtime: 0x661e9149, atime: 0x661e9149, ctime: 0x661e9149, blocks: 0x0 00000004:00010000:3.0:1713279306.853781:0:15526:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007f1d4000 reply state ffff88012b12b000 transno 4295183739 ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda9708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00000100:00100000:2.0:1713279306.853783:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281248704 00010000:00010000:1.0:1713279306.853785:0:15658:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.853786:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281248704 00010000:00010000:3.0:1713279306.853786:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda9708 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279306.853787:0:9197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.853788:0:9197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.853789:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3331 (ffff8801250c1000) 00010000:00010000:3.0:1713279306.853790:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.853790:0:15526:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1713279306.853791:0:9197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd10240/0xfc4b8e114eda9812 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x119d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->262143) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d05 expref: 93 pid: 9197 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713279306.853792:0:15526:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda96d0 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.853795:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114eda96e5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175caa expref: 3386 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.853795:0:15526:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda96d0 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.853797:0:15526:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda96d0 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279306.853798:0:9197:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd10240/0xfc4b8e114eda9812 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x119d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->262143) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d05 expref: 93 pid: 9197 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713279306.853800:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281249216 00010000:00010000:3.0:1713279306.853800:0:15526:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda96d0 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00000100:00100000:2.0:1713279306.853802:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281249216 00010000:00010000:3.0:1713279306.853802:0:15526:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023e880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.853803:0:15526:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda96d0 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.853804:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7364:0x0].0x0 (ffff88012bacd300) 00010000:00010000:3.0:1713279306.853806:0:15526:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda96d0 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279306.853807:0:9197:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd10240, rc 0) 00010000:00010000:1.0:1713279306.853807:0:15658:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.853809:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff8801250c1a00) 00010000:00010000:3.0:1713279306.853810:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.853811:0:15526:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda96d0 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00000100:00100000:0.0:1713279306.853816:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+93:1957:x1796503281249600:12345-192.168.203.4@tcp:101:ll_agl.0 Request processed in 52us (214us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.853816:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114eda96d0 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00000100:00100000:0.0:1713279306.853819:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110526 00000100:00100000:2.0:1713279306.853822:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223080 00000004:00010000:3.0:1713279306.853822:0:15526:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007f1d4000 reply state ffff88012b12b000 transno 4295183739 ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda96de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279306.853825:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda96de lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00000100:00100000:2.0:1713279306.853826:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130146450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3386:11666:x1796503281248704:12345-192.168.203.4@tcp:37:lfs.0 00010000:00010000:3.0:1713279306.853828:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x3331 (ffff8801250c1100) 00000100:00100000:1.0:1713279306.853829:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223081 00010000:00010000:3.0:1713279306.853829:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.853830:0:15526:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:3.0:1713279306.853833:0:15526:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.853834:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3386:11960:x1796503281249216:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:3.0:1713279306.853837:0:15526:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.853841:0:15526:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.853845:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.853849:0:15526:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1713279306.853852:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281249728 00000100:00100000:0.0:1713279306.853854:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281249728 00000100:00100000:0.0:1713279306.853862:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110527 00000100:00100000:0.0:1713279306.853865:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+93:1957:x1796503281249728:12345-192.168.203.4@tcp:101:ll_agl.0 00010000:00010000:0.0:1713279306.853869:0:9197:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.853871:0:15526:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3387:11374:x1796503281242304:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 14665us (14717us total) trans 4295183739 rc 0/0 00010000:00010000:0.0:1713279306.853875:0:9197:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801237db840/0xfc4b8e114eda9819 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1035:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d13 expref: -99 pid: 9197 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.853876:0:15526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14347 00002000:00010000:0.0:1713279306.853882:0:9197:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000400:0x1035:0x0] initial LVB size: 0, mtime: 0x661e9148, atime: 0x661e9148, ctime: 0x661e9148, blocks: 0x0 00010000:00010000:0.0:1713279306.853887:0:9197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.853888:0:9197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.853888:0:6918:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.853890:0:6918:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.853891:0:9197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801237db840/0xfc4b8e114eda9819 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1035:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->262143) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d13 expref: 94 pid: 9197 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713279306.853894:0:6918:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d4b8240 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:0.0:1713279306.853896:0:9197:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801237db840/0xfc4b8e114eda9819 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1035:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->262143) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d13 expref: 94 pid: 9197 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713279306.853897:0:6918:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.853900:0:9197:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801237db840, rc 0) 00000004:00010000:3.0:1713279306.853901:0:6918:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.853911:0:6918:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.853912:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+94:1957:x1796503281249728:12345-192.168.203.4@tcp:101:ll_agl.0 Request processed in 46us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.853914:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3387:11960:x1796503281249216:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 78us (353us total) trans 4295183740 rc 0/0 00010000:00010000:3.0:1713279306.853914:0:6918:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1713279306.853917:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110527 00000100:00100000:1.0:1713279306.853921:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223081 00010000:00010000:3.0:1713279306.853922:0:6918:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.853926:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008d4b8240/0xfc4b8e114eda93c0 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda93f1 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.853927:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200052608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.853933:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.853933:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.853934:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279306.853941:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.853941:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda97e1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.853946:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda97e1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.853953:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda97e1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.853964:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200052608 00010000:00010000:1.0:1713279306.853966:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9820 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7364:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000100:00100000:3.0:1713279306.853967:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200052608 00010000:00010000:1.0:1713279306.853974:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9820 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.853977:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda93f1 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda93c0 expref: 52 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.853978:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.853981:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9820 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.853985:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281249792 00000100:00100000:0.0:1713279306.853987:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281249792 00000100:00100000:3.0:1713279306.853991:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196554 00000100:00100000:3.0:1713279306.853996:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+52:3491:x1796503200052608:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.853997:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110528 00000100:00100000:0.0:1713279306.853999:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281249792:12345-192.168.203.4@tcp:16:kworker.0 00010000:00010000:3.0:1713279306.854003:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.854007:0:15496:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda93f1 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda93c0 expref: 52 pid: 15580 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713279306.854015:0:15658:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800900e0380 reply state ffff8800a56b3000 transno 4295183741 ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9820 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.854015:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda93f1 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda93c0 expref: 52 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.854020:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281249792:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 19us (41us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.854020:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00000100:00100000:0.0:1713279306.854023:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110528 00010000:00010000:3.0:1713279306.854023:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.854026:0:15496:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.854027:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9820 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.854029:0:15496:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.854033:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7364:0x0].0x0 (ffff88012bacd300) 00010000:00010000:1.0:1713279306.854035:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.854037:0:15658:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.854037:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.854044:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.854050:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281249856 00000100:00100000:0.0:1713279306.854052:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281249856 00000100:00100000:3.0:1713279306.854055:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+51:3491:x1796503200052608:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.854059:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196554 00000100:00100000:0.0:1713279306.854060:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110529 00000100:00100000:0.0:1713279306.854062:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+94:1956:x1796503281249856:12345-192.168.203.4@tcp:101:ll_agl.0 00010000:00010000:0.0:1713279306.854082:0:11415:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.854083:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3388:11855:x1796503281249344:12345-192.168.203.4@tcp:36:touch.0 Request processed in 449us (500us total) trans 4295183741 rc 0/0 00010000:00010000:3.0:1713279306.854087:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.854088:0:11415:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801237da400/0xfc4b8e114eda9827 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x107b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d1a expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.854089:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785314 00010000:00010000:3.0:1713279306.854091:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00002000:00010000:0.0:1713279306.854095:0:11415:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000400:0x107b:0x0] initial LVB size: 0, mtime: 0x661e9148, atime: 0x661e9148, ctime: 0x661e9148, blocks: 0x0 00010000:00010000:0.0:1713279306.854101:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.854102:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.854105:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801237da400/0xfc4b8e114eda9827 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x107b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->262143) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d1a expref: 95 pid: 11415 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713279306.854109:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200052672:0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713279306.854125:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.854133:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.854146:0:15506:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15506:1796503200052160:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.854153:0:15506:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda97a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.854162:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200052672 00000100:00100000:3.0:1713279306.854164:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200052672 00000100:00100000:3.0:1713279306.854173:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98877 00000100:00100000:3.0:1713279306.854175:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+91:15525:x1796503200052672:12345-0@lo:1000:mdt_io00_009.0 00010000:00010000:0.0:1713279306.854187:0:11415:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801237da400/0xfc4b8e114eda9827 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x107b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->262143) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d1a expref: 95 pid: 11415 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713279306.854192:0:11415:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801237da400, rc 0) 00000100:00100000:3.0:1713279306.854206:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+91:15525:x1796503200052672:12345-0@lo:1000:mdt_io00_009.0 Request processed in 29us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.854207:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+95:1956:x1796503281249856:12345-192.168.203.4@tcp:101:ll_agl.0 Request processed in 144us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.854211:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110529 00000100:00100000:3.0:1713279306.854212:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98877 00000100:00100000:1.0:1713279306.854221:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.854228:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200052608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.854233:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200052672:0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713279306.854242:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00080000:3.0:1713279306.854247:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x7d86:0x0] 00000100:00100000:3.0:1713279306.854262:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200052736:0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713279306.854272:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.854275:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.854277:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.854284:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.854291:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281249984 00000100:00100000:3.0:1713279306.854293:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281249984 00000100:00100000:0.0:1713279306.854294:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281249920 00000100:00100000:0.0:1713279306.854296:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281249920 00010000:00010000:3.0:1713279306.854301:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d4baf40/0xfc4b8e114ed63716 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39160d60 expref: 88 pid: 15509 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.854305:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110530 00000100:00100000:0.0:1713279306.854308:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+85:1956:x1796503281249920:12345-192.168.203.4@tcp:1:lfs.0 00000100:00100000:3.0:1713279306.854311:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196555 00000100:00100000:3.0:1713279306.854313:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+88:1956:x1796503281249984:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.854318:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.854319:0:15500:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda982e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1101:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713279306.854324:0:6915:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x102a:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1713279306.854325:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x102a:0x0] updating lvb mtime from disk: 0 -> 1713279300 00010000:00010000:0.0:1713279306.854326:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009023d680/0xfc4b8e114ed9dff0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1101:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a61 expref: 85 pid: 15504 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1713279306.854327:0:6915:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x102a:0x0] updating lvb ctime from disk: 0 -> 1713279300 00002000:00010000:3.0:1713279306.854328:0:6915:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x102a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1713279306.854331:0:6915:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d4baf40/0xfc4b8e114ed63716 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39160d60 expref: 88 pid: 15509 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.854332:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008942d200/0xfc4b8e114ed9eb26 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1101:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172de8 expref: 88 pid: 11415 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713279306.854335:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713279306.854335:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.854336:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.854336:0:6915:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d4baf40/0xfc4b8e114ed63716 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39160d60 expref: 88 pid: 15509 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.854337:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda982e lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1101:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.854345:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d4baf40/0xfc4b8e114ed63716 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39160d60 expref: 88 pid: 15509 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.854346:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281249664 00010000:00010000:0.0:1713279306.854348:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008942d200/0xfc4b8e114ed9eb26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1101:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172de8 expref: 88 pid: 11415 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713279306.854350:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281249664 00010000:00010000:3.0:1713279306.854351:0:6915:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.854352:0:6915:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.854354:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008942d200/0xfc4b8e114ed9eb26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1101:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172de8 expref: 87 pid: 11415 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.854354:0:6915:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda97a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.854358:0:6915:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda97a2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.854360:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200052800:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.854364:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281250112 00010000:00010000:3.0:1713279306.854365:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.854366:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281250112 00000100:00100000:2.0:1713279306.854374:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281250240 00000100:00100000:2.0:1713279306.854376:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281250240 00010000:00010000:0.0:1713279306.854377:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009023d680/0xfc4b8e114ed9dff0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1101:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a61 expref: 85 pid: 15504 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713279306.854380:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+87:1956:x1796503281249984:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 65us (160us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.854382:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009023d680/0xfc4b8e114ed9dff0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1101:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a61 expref: 85 pid: 15504 timeout: 509 lvb_type: 1 00000100:00100000:3.0:1713279306.854383:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196555 00000100:00100000:2.0:1713279306.854386:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785315 00000100:00100000:0.0:1713279306.854387:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200052864:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.854391:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:10814:x1796503281249664:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.854392:0:15506:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda97a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.854396:0:15506:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda97a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.854397:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800965400c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.854399:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.854403:0:15506:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda97a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.854406:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785316 00010000:00010000:2.0:1713279306.854408:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114eda9835 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d0c expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.854408:0:15506:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda97a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.854409:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3647:11711:x1796503281250112:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.854431:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.854434:0:15506:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda97a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.854437:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda983c lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d21 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.854438:0:15506:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ea5f180 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:3.0:1713279306.854440:0:15506:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda97a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.854444:0:15506:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda97a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.854451:0:15506:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda97a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.854455:0:15506:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea5f180/0xfc4b8e114eda97a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x102a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.854459:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda984a lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.854460:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9843 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00000100:00100000:1.0:1713279306.854461:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785317 00010000:00010000:0.0:1713279306.854464:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda984a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.854466:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3648:11912:x1796503281250240:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.854467:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9843 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.854468:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda984a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.854474:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda9851 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.854474:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9843 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.854475:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.854477:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda9851 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.854479:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1956:x1796503281248192:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 2767us (3286us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.854481:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda9851 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.854483:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114eda9858 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d28 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.854485:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110522 00010000:00010000:2.0:1713279306.854486:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda985f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.854492:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda985f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.854493:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda984a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.854496:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda984a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.854498:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda985f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.854499:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda984a lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.854500:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200052736 00010000:00010000:0.0:1713279306.854502:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda984a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.854503:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200052736 00010000:00010000:0.0:1713279306.854505:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c868900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.854506:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda984a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.854509:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda984a lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.854512:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9866 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.854513:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880122e5f600) 00000100:00100000:3.0:1713279306.854513:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98878 00010000:00010000:0.0:1713279306.854515:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.854515:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+91:15525:x1796503200052736:12345-0@lo:1000:mdt_io00_009.0 00010000:00010000:0.0:1713279306.854517:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda984a lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.854519:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9866 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.854520:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114eda984a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.854525:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda9851 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.854526:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9866 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.854528:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda9851 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.854531:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda9851 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.854533:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c86a880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.854534:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda9851 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000004:00200000:2.0:1713279306.854534:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x83dc:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.854535:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda986d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.854537:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda9851 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.854540:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880122e5f900) 00010000:00010000:1.0:1713279306.854541:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda986d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.854542:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.854543:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda9851 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.854545:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114eda9851 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.854546:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+91:15525:x1796503200052736:12345-0@lo:1000:mdt_io00_009.0 Request processed in 29us (267us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.854547:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda986d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.854549:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98878 00010000:00010000:0.0:1713279306.854558:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda983c lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d21 expref: 3649 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.854558:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9843 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.854562:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114eda983c lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d21 expref: 3649 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.854563:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9866 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.854563:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200052736:0@lo:1000:mdt_io00_009.0 00010000:00010000:2.0:1713279306.854564:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9843 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.854567:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f557840, rc 0) 00010000:00010000:1.0:1713279306.854568:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9866 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.854569:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9843 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.854572:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9843 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.854573:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9866 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.854575:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ed680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.854576:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9843 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.854578:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9866 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.854580:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3648:11711:x1796503281250112:12345-192.168.203.4@tcp:101:touch.0 Request processed in 170us (309us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.854580:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9843 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.854583:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf5440 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.854584:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785316 00010000:00010000:2.0:1713279306.854584:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x0 (ffff880129b60a00) 00010000:00010000:1.0:1713279306.854586:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9866 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.854586:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.854587:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9843 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.854591:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9866 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.854593:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114eda9843 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.854598:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880130675900) 00010000:00010000:2.0:1713279306.854598:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda985f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.854600:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.854601:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda985f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.854602:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9866 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.854604:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda985f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.854607:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9866 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.854607:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ecfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.854608:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda985f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.854611:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda985f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.854614:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x3131 (ffff880129b60300) 00010000:00010000:1.0:1713279306.854615:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda986d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.854615:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.854616:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda985f lrc: 2/0,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.854619:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114eda985f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.854620:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda986d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.854626:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda986d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.854630:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf6ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.854633:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda986d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.854634:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114eda9835 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d0c expref: 3719 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.854638:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda986d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.854639:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114eda9835 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d0c expref: 3719 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.854643:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff880130675500) 00010000:00010000:1.0:1713279306.854646:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.854646:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ecd80, rc 0) 00010000:00010000:1.0:1713279306.854648:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda986d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.854653:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda986d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.854661:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:10814:x1796503281249664:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 270us (419us total) trans 4295202745 rc 301/301 00000100:00100000:2.0:1713279306.854665:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785315 00010000:00010000:1.0:1713279306.854671:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114eda9858 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d28 expref: 3647 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.854678:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114eda9858 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d28 expref: 3647 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.854687:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf4900, rc 0) 00000100:00100000:1.0:1713279306.854709:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3646:11912:x1796503281250240:12345-192.168.203.4@tcp:101:touch.0 Request processed in 241us (374us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.854715:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785317 00000100:00100000:3.0:1713279306.854927:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200052928:0@lo:403:mdt_io00_009.0 00000100:00100000:3.0:1713279306.854944:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.854959:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0780 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.854968:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200052928 00000100:00100000:3.0:1713279306.854970:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200052928 00000100:00100000:3.0:1713279306.854980:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98879 00000100:00100000:3.0:1713279306.854982:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+91:15525:x1796503200052928:12345-0@lo:403:mdt_io00_009.0 00000100:00100000:2.0:1713279306.855093:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130146450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3387:11666:x1796503281248704:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1265us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.855097:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223080 00000100:00100000:0.0:1713279306.855345:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.855361:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.855369:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281250496 00000100:00100000:0.0:1713279306.855372:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.855372:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281250496 00000100:00100000:2.0:1713279306.855373:0:15526:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281250624 00000100:00100000:2.0:1713279306.855375:0:15526:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281250624 00000100:00100000:3.0:1713279306.855384:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281250432 00000100:00100000:3.0:1713279306.855385:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281250432 00000100:00100000:0.0:1713279306.855387:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.855394:0:15526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14349 00000100:00100000:3.0:1713279306.855395:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147264 00000100:00100000:2.0:1713279306.855398:0:15526:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_010:385c4b71-808c-40cf-91de-b076b668d13f+3647:11876:x1796503281250624:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:3.0:1713279306.855398:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+3647:1956:x1796503281250496:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:3.0:1713279306.855402:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.855409:0:15526:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.855409:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114eda90e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b29 expref: 3647 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.855431:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114eda906a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175aea expref: 3647 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.855437:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880123701600) 00010000:00010000:2.0:1713279306.855438:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x13a:0x0].0x0 (ffff880123701d00) 00010000:00010000:2.0:1713279306.855440:0:15526:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.855441:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.855452:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15526 initiator: MDT0 00000100:00100000:0.0:1713279306.855453:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147265 00000100:00100000:3.0:1713279306.855455:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+3645:1956:x1796503281250496:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 57us (93us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.855456:0:15526:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15526 initiator: MDT1 00000100:00100000:0.0:1713279306.855457:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b25ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3721:1956:x1796503281250432:12345-192.168.203.4@tcp:103:lfs.0 00000100:00100000:3.0:1713279306.855459:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147264 00010000:00010000:2.0:1713279306.855460:0:15526:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279306.855462:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.855467:0:15526:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c00000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001-mdtlov_UUID:15526:1796503200052992:0@lo:101:mdt_io00_010.0 00010000:00010000:0.0:1713279306.855470:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539d40/0xfc4b8e114eda9207 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x84a3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b6f expref: 3721 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.855476:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x84a3:0x0].0x0 (ffff880096e84e00) 00010000:00010000:0.0:1713279306.855478:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.855486:0:15526:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.855492:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b25ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3720:1956:x1796503281250432:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 35us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.855495:0:15526:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800976f9900 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.855496:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147265 00010000:00010000:0.0:1713279306.855519:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114eda9882 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.855524:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114eda9882 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.855528:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114eda9882 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000100:00100000:2.0:1713279306.855530:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200052992 00000100:00100000:2.0:1713279306.855533:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200052992 00010000:00010000:0.0:1713279306.855544:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda97e1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.855547:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda97e1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:2.0:1713279306.855548:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98880 00010000:00010000:0.0:1713279306.855550:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda97e1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:2.0:1713279306.855552:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+51:15526:x1796503200052992:12345-0@lo:101:mdt_io00_010.0 00010000:00010000:0.0:1713279306.855553:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda97e1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.855555:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e8900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.855557:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda97e1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.855560:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda97e1 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.855562:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.855563:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:0.0:1713279306.855565:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.855566:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda97e1 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.855569:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda97e1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.855570:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda9889 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda987b expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.855573:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114eda9882 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.855576:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114eda9882 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.855579:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114eda9882 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.855581:0:15494:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 2/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.855582:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c868480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.855584:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114eda9882 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.855587:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114eda9882 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.855587:0:15494:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda9889 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda987b expref: 52 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.855590:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880131204d00) 00010000:00010000:0.0:1713279306.855591:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.855592:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114eda9882 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.855595:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114eda9882 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.855597:0:15494:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.855604:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda9889 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda987b expref: 52 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.855607:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9440/0xfc4b8e114eda97d3 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cf0 expref: 3717 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.855611:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9440/0xfc4b8e114eda97d3 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cf0 expref: 3717 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.855611:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:2.0:1713279306.855613:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.855615:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906e9440, rc 0) 00010000:00010000:2.0:1713279306.855616:0:15494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda9889 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda987b expref: 52 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.855622:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ef180, rc 0) 00000100:00100000:0.0:1713279306.855636:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:11204:x1796503281248960:12345-192.168.203.4@tcp:101:touch.0 Request processed in 2142us (2252us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.855640:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785312 00000100:00100000:2.0:1713279306.855643:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+52:15526:x1796503200052992:12345-0@lo:101:mdt_io00_010.0 Request processed in 90us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.855647:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281250688 00000100:00100000:0.0:1713279306.855649:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281250688 00000100:00100000:2.0:1713279306.855652:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98880 00000100:00100000:0.0:1713279306.855658:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785318 00000100:00100000:0.0:1713279306.855661:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3387:11374:x1796503281250688:12345-192.168.203.4@tcp:34:lfs.0 00000100:00100000:2.0:1713279306.855670:0:15526:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4295202740 gen 2 00000004:00080000:2.0:1713279306.855675:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202682 committed transno 4295202740 00010000:00010000:0.0:1713279306.855679:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9890 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.855683:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9890 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855687:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9890 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000004:00080000:2.0:1713279306.855689:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202683 committed transno 4295202740 00010000:00010000:0.0:1713279306.855692:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114eda9897 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.855695:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114eda9897 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855699:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114eda9897 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000004:00080000:2.0:1713279306.855700:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202684 committed transno 4295202740 00000004:00080000:2.0:1713279306.855710:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202685 committed transno 4295202740 00010000:00010000:0.0:1713279306.855728:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114eda989e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7ae1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.855731:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114eda989e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7ae1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000004:00080000:2.0:1713279306.855731:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202686 committed transno 4295202740 00010000:00010000:0.0:1713279306.855734:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114eda989e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7ae1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000004:00080000:2.0:1713279306.855741:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202687 committed transno 4295202740 00000004:00010000:0.0:1713279306.855748:0:15485:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114eda989e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7ae1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855752:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9890 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000004:00080000:2.0:1713279306.855752:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202688 committed transno 4295202740 00010000:00010000:0.0:1713279306.855756:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9890 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855761:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9890 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855764:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9890 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855767:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c869200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.855768:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9890 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855771:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9890 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855775:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880131204f00) 00010000:00010000:0.0:1713279306.855776:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:2.0:1713279306.855776:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202689 committed transno 4295202740 00010000:00010000:0.0:1713279306.855777:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9890 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855780:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9890 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855793:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114eda9897 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855796:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114eda9897 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00000004:00080000:2.0:1713279306.855797:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202690 committed transno 4295202740 00000004:00080000:2.0:1713279306.855809:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202691 committed transno 4295202740 00000004:00080000:2.0:1713279306.855818:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202692 committed transno 4295202740 00000004:00080000:2.0:1713279306.855828:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202693 committed transno 4295202740 00000004:00080000:2.0:1713279306.855838:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202694 committed transno 4295202740 00000004:00080000:2.0:1713279306.855861:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202695 committed transno 4295202740 00000004:00080000:2.0:1713279306.855870:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202697 committed transno 4295202740 00000004:00080000:2.0:1713279306.855880:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202698 committed transno 4295202740 00000004:00080000:2.0:1713279306.855889:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202699 committed transno 4295202740 00010000:00010000:0.0:1713279306.855892:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114eda9897 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855897:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c86ad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.855898:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114eda9897 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000004:00080000:2.0:1713279306.855899:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202700 committed transno 4295202740 00010000:00010000:0.0:1713279306.855904:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114eda9897 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855909:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3731 (ffff880131204400) 00000004:00080000:2.0:1713279306.855909:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202701 committed transno 4295202740 00010000:00010000:0.0:1713279306.855911:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.855912:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114eda9897 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855915:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114eda9897 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000004:00080000:2.0:1713279306.855918:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202702 committed transno 4295202740 00010000:00010000:0.0:1713279306.855922:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114eda989e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7ae1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855925:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114eda989e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7ae1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855928:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114eda989e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7ae1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855930:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c869f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.855932:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114eda989e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7ae1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855934:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114eda989e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7ae1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00000004:00080000:2.0:1713279306.855935:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202703 committed transno 4295202740 00010000:00010000:0.0:1713279306.855937:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ae1:0x0].0x0 (ffff880091738f00) 00010000:00010000:0.0:1713279306.855938:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.855940:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114eda989e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x7ae1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.855942:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114eda989e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7ae1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.855944:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00080000:2.0:1713279306.855951:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202704 committed transno 4295202740 00000004:00080000:2.0:1713279306.855961:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202705 committed transno 4295202740 00000100:00100000:0.0:1713279306.855964:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3387:11374:x1796503281250688:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 301us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.855966:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.855968:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785318 00000100:00100000:0.0:1713279306.855980:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281250752 00000004:00080000:2.0:1713279306.855980:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202706 committed transno 4295202740 00000100:00100000:0.0:1713279306.855982:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281250752 00000004:00080000:2.0:1713279306.855996:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202707 committed transno 4295202740 00000100:00100000:0.0:1713279306.855997:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110531 00000100:00100000:0.0:1713279306.856000:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+86:1957:x1796503281250752:12345-192.168.203.4@tcp:16:kworker.0 00000004:00080000:2.0:1713279306.856006:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202708 committed transno 4295202740 00000100:00100000:1.0:1713279306.856008:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00080000:2.0:1713279306.856015:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202709 committed transno 4295202740 00000100:00100000:0.0:1713279306.856021:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+86:1957:x1796503281250752:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 20us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.856025:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110531 00000100:00100000:1.0:1713279306.856025:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00080000:2.0:1713279306.856025:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202710 committed transno 4295202740 00000100:00100000:0.0:1713279306.856031:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281250880 00000100:00100000:0.0:1713279306.856032:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281250880 00000004:00080000:2.0:1713279306.856048:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202711 committed transno 4295202740 00000100:00100000:0.0:1713279306.856051:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110532 00000100:00100000:0.0:1713279306.856053:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+82:11966:x1796503281250880:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.856057:0:11415:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.856062:0:11415:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c86b600/0xfc4b8e114eda98a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d3d expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.856062:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202713 committed transno 4295202740 00010000:00010000:0.0:1713279306.856087:0:11415:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800945521c0/0xfc4b8e114eda2ac7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->28671) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174002 expref: 94 pid: 15539 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.856087:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202714 committed transno 4295202740 00010000:00010000:0.0:1713279306.856092:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713279306.856093:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713279306.856095:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c86b600/0xfc4b8e114eda98a5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [12288->28671] (req 12288->28671) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d3d expref: 83 pid: 11415 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.856097:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202715 committed transno 4295202740 00000100:00100000:1.0:1713279306.856105:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00080000:2.0:1713279306.856108:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202716 committed transno 4295202740 00010000:00010000:0.0:1713279306.856109:0:11415:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800945521c0/0xfc4b8e114eda2ac7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->28671) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174002 expref: 94 pid: 15539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.856114:0:11415:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800945521c0/0xfc4b8e114eda2ac7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->28671) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174002 expref: 94 pid: 15539 timeout: 509 lvb_type: 0 00000004:00080000:2.0:1713279306.856118:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202717 committed transno 4295202740 00000100:00100000:0.0:1713279306.856120:0:11415:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11415:1796503200053056:192.168.203.4@tcp:104: 00000004:00080000:2.0:1713279306.856126:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202718 committed transno 4295202740 00000100:00100000:0.0:1713279306.856135:0:11415:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800965406c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.856135:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281251072 00000004:00080000:2.0:1713279306.856135:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202722 committed transno 4295202740 00000100:00100000:1.0:1713279306.856138:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281251072 00000004:00080000:2.0:1713279306.856145:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202723 committed transno 4295202740 00000100:00100000:0.0:1713279306.856149:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200052800:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.856154:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200052864:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.856156:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281250816 00000100:00100000:1.0:1713279306.856159:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281250816 00010000:00010000:0.0:1713279306.856162:0:15500:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda982e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1101:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.856163:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202724 committed transno 4295202740 00000100:00100000:1.0:1713279306.856171:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785319 00000004:00080000:2.0:1713279306.856173:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202725 committed transno 4295202740 00000100:00100000:0.0:1713279306.856175:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785320 00000100:00100000:1.0:1713279306.856175:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3720:11955:x1796503281251072:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:0.0:1713279306.856178:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3387:11855:x1796503281250816:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.856183:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.856184:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:2.0:1713279306.856184:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202726 committed transno 4295202740 00010000:00010000:0.0:1713279306.856189:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda98ac lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7364:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d36 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.856192:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5680/0xfc4b8e114eda98b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d44 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.856194:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202728 committed transno 4295202740 00000004:00080000:2.0:1713279306.856203:0:15526:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202740 committed transno 4295202740 00010000:00010000:0.0:1713279306.856205:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda98ac lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7364:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d36 expref: 3388 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.856210:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e880/0xfc4b8e114eda98ac lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7364:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d36 expref: 3388 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.856216:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda98ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:3.0:1713279306.856216:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+91:15525:x1796503200052928:12345-0@lo:403:mdt_io00_009.0 Request processed in 1232us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.856217:0:15526:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c00000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001-mdtlov_UUID:15526:1796503200052992:0@lo:101:mdt_io00_010.0 00010000:00010000:0.0:1713279306.856221:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7364:0x0].0x0 (ffff88012bacd300) 00000100:00100000:3.0:1713279306.856221:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98879 00010000:00010000:0.0:1713279306.856222:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1713279306.856223:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda98ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.856224:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942e880, rc 0) 00010000:00010000:2.0:1713279306.856227:0:15526:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.856230:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda98ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.856234:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3388:11855:x1796503281250816:12345-192.168.203.4@tcp:101:touch.0 Request processed in 55us (226us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.856234:0:15526:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.856235:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15525:1796503200052928:0@lo:403:mdt_io00_009.0 00000100:00100000:0.0:1713279306.856237:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785320 00010000:00010000:1.0:1713279306.856239:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda98c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.856243:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda98c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.856259:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281251008 00010000:00010000:1.0:1713279306.856260:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda98c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.856262:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281251008 00010000:00010000:2.0:1713279306.856273:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008942d200/0xfc4b8e114ed9eb26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1101:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172de8 expref: 86 pid: 11415 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.856297:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196556 00000100:00100000:2.0:1713279306.856302:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1957:x1796503281251008:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.856309:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00200000:1.0:1713279306.856317:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.856319:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008942d200/0xfc4b8e114ed9eb26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1101:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172de8 expref: 86 pid: 11415 timeout: 509 lvb_type: 1 00010000:00010000:2.0:1713279306.856327:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008942d200/0xfc4b8e114ed9eb26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1101:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172de8 expref: 86 pid: 11415 timeout: 509 lvb_type: 1 00010000:00010000:2.0:1713279306.856339:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008942d200/0xfc4b8e114ed9eb26 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1101:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172de8 expref: 86 pid: 11415 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.856346:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda98ba lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.856347:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.856351:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda98ba lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.856355:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda98ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.856360:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda98ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.856365:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf4000 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.856366:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+85:1957:x1796503281251008:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 63us (261us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.856368:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda98ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.856372:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196556 00010000:00010000:1.0:1713279306.856373:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda98ba lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.856380:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.856382:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.856384:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda98ba lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.856387:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4000/0xfc4b8e114eda98ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.856392:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda98c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.856395:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda98c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.856401:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda98c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.856404:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf4fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.856405:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda98c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.856408:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda98c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.856411:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff880130675200) 00010000:00010000:1.0:1713279306.856430:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.856432:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda98c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.856435:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda98c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.856451:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5680/0xfc4b8e114eda98b3 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d44 expref: 3722 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.856455:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5680/0xfc4b8e114eda98b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d44 expref: 3722 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.856459:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf5680, rc 0) 00000100:00100000:1.0:1713279306.856475:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3721:11955:x1796503281251072:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 300us (533us total) trans 4295202746 rc 301/301 00000100:00100000:1.0:1713279306.856480:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785319 00010000:00010000:3.0:1713279306.856692:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda98cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.856698:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda98cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.856702:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda98cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.856708:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda98d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x14f:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.856711:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda98d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.856714:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda98d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.856718:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda98dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x148:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.856721:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda98dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.856724:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda98dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.856731:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114eda98e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x148:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.856734:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114eda98e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.856737:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114eda98e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.856749:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x854f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.856754:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda93ff lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x854f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bfb expref: 3720 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.856758:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 4/0,1 mode: --/EX res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.856769:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda93ff lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x854f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bfb expref: 3720 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.856774:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda93ff lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x854f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bfb expref: 3720 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.856780:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200053120:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.856804:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0780 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.857024:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.857045:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.857049:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.857049:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281251136 00000100:00100000:2.0:1713279306.857053:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281251136 00000100:00100000:1.0:1713279306.857056:0:15502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281251392 00000100:00100000:1.0:1713279306.857059:0:15502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281251392 00010000:00010000:2.0:1713279306.857061:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009023d680/0xfc4b8e114ed9dff0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1101:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a61 expref: 86 pid: 15504 timeout: 509 lvb_type: 1 00000100:00100000:0.0:1713279306.857064:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.857087:0:15502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14350 00000100:00100000:2.0:1713279306.857088:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196557 00000100:00100000:1.0:1713279306.857091:0:15502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3388:9807:x1796503281251392:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:2.0:1713279306.857092:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:385c4b71-808c-40cf-91de-b076b668d13f+86:1954:x1796503281251136:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.857096:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.857102:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009023d680/0xfc4b8e114ed9dff0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1101:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a61 expref: 86 pid: 15504 timeout: 509 lvb_type: 1 00010000:00010000:2.0:1713279306.857107:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009023d680/0xfc4b8e114ed9dff0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1101:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a61 expref: 86 pid: 15504 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.857110:0:15502:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:0.0:1713279306.857115:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.857117:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009023d680/0xfc4b8e114ed9dff0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1101:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a61 expref: 86 pid: 15504 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.857120:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114ed63533 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x74e5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39160cc6 expref: 3388 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.857122:0:15492:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.857123:0:15492:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.857125:0:15492:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda982e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1101:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.857129:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74e5:0x0].0x0 (ffff8800963cc400) 00010000:00010000:2.0:1713279306.857130:0:15492:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda982e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1101:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.857132:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.857134:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114eda93ce lrc: 0/0,0 mode: --/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175be6 expref: 3387 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.857139:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74de:0x0].0x0 (ffff880136671500) 00010000:00010000:2.0:1713279306.857142:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.857143:0:15502:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.857143:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281251456 00010000:00010000:0.0:1713279306.857146:0:15500:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda982e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.857147:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281251456 00010000:00010000:0.0:1713279306.857151:0:15500:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda982e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.857156:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:385c4b71-808c-40cf-91de-b076b668d13f+85:1954:x1796503281251136:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 64us (134us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.857157:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 15502 initiator: MDT0 00010000:00010000:0.0:1713279306.857159:0:15500:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda982e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.857160:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196557 00010000:00010000:0.0:1713279306.857163:0:15500:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda982e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.857163:0:15502:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 15502 initiator: MDT1 00000100:00100000:3.0:1713279306.857165:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223082 00010000:00010000:0.0:1713279306.857167:0:15500:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda982e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.857168:0:15502:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279306.857169:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281251776 00000100:00100000:3.0:1713279306.857169:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3387:11666:x1796503281251456:12345-192.168.203.4@tcp:37:lfs.0 00010000:00010000:0.0:1713279306.857170:0:15500:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801237d9b00 already unused, calling callback (ffffffffa085fb20) 00000100:00100000:2.0:1713279306.857171:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281251776 00010000:00010000:0.0:1713279306.857172:0:15500:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda982e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.857176:0:15500:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda982e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.857179:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c160380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200053184:0@lo:101:mdt_io00_004.0 00000100:00100000:2.0:1713279306.857179:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110533 00000100:00100000:2.0:1713279306.857182:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281251776:12345-192.168.203.4@tcp:16:kworker.0 00010000:00010000:0.0:1713279306.857183:0:15500:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda982e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.857187:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda982e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.857200:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.857202:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281251776:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 19us (69us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.857206:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110533 00000100:00100000:1.0:1713279306.857211:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800959c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.857222:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281251264 00000100:00100000:1.0:1713279306.857225:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281251264 00000100:00100000:2.0:1713279306.857248:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281251584 00000100:00100000:2.0:1713279306.857251:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281251584 00000100:00100000:1.0:1713279306.857253:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785321 00000100:00100000:1.0:1713279306.857258:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:10814:x1796503281251264:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:2.0:1713279306.857261:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785322 00000100:00100000:2.0:1713279306.857264:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281251584:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.857267:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.857269:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+84:1956:x1796503281249920:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 2959us (2992us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.857269:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.857275:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda9900 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d52 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.857276:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda98f9 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d4b expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.857305:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114eda9907 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.857311:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda990e lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.857312:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114eda9907 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.857316:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda990e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.857318:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114eda9907 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.857320:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda990e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857326:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda9915 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.857330:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17a80/0xfc4b8e114eda991c lrc: 3/1,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.857330:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda9915 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857333:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda9915 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.857335:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17a80/0xfc4b8e114eda991c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.857341:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17a80/0xfc4b8e114eda991c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00000004:00200000:2.0:1713279306.857341:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:2.0:1713279306.857345:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda990e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857348:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda990e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857351:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda990e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857354:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda990e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857360:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bfcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.857362:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda990e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857365:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda990e lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857369:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88009bf9a000) 00010000:00010000:2.0:1713279306.857370:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.857372:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda990e lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857374:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda990e lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857379:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda9915 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00000004:00200000:1.0:1713279306.857381:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x83dc:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.857382:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda9915 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857384:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda9915 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857387:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bf3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.857397:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda9915 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857400:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda9915 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857403:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88008a21ee00) 00010000:00010000:2.0:1713279306.857405:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.857406:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda9915 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857409:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda9915 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.857437:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda9900 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d52 expref: 3722 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.857438:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114eda9907 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.857441:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda9900 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d52 expref: 3722 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.857445:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114eda9907 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.857447:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935be1c0, rc 0) 00010000:00010000:1.0:1713279306.857449:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114eda9907 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.857455:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114eda9907 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.857459:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281251584:12345-192.168.203.4@tcp:101:touch.0 Request processed in 195us (345us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.857461:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe15680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.857463:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114eda9907 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.857463:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785322 00010000:00010000:1.0:1713279306.857466:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114eda9907 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.857471:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x0 (ffff880130675e00) 00010000:00010000:1.0:1713279306.857473:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.857474:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114eda9907 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.857477:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe15680/0xfc4b8e114eda9907 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.857483:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17a80/0xfc4b8e114eda991c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.857495:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17a80/0xfc4b8e114eda991c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.857498:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17a80/0xfc4b8e114eda991c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.857500:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe17a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.857501:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17a80/0xfc4b8e114eda991c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.857504:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17a80/0xfc4b8e114eda991c lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.857507:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x3131 (ffff880130675100) 00010000:00010000:1.0:1713279306.857508:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.857510:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17a80/0xfc4b8e114eda991c lrc: 2/0,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.857510:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.857513:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17a80/0xfc4b8e114eda991c lrc: 0/0,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.857517:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281251968 00000100:00100000:2.0:1713279306.857518:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281251968 00010000:00010000:2.0:1713279306.857525:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800945521c0/0xfc4b8e114eda2ac7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174002 expref: 95 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.857530:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda98f9 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d4b expref: 3718 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.857534:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf5d40/0xfc4b8e114eda98f9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d4b expref: 3718 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.857534:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196558 00000100:00100000:2.0:1713279306.857537:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+95:1957:x1796503281251968:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.857540:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf5d40, rc 0) 00010000:00010000:2.0:1713279306.857541:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.857546:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800945521c0/0xfc4b8e114eda2ac7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174002 expref: 95 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.857551:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800945521c0/0xfc4b8e114eda2ac7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->28671) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174002 expref: 95 pid: 15539 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.857555:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:10814:x1796503281251264:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 297us (506us total) trans 4295202747 rc 301/301 00000100:00100000:1.0:1713279306.857559:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785321 00010000:00010000:2.0:1713279306.857559:0:15492:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.857560:0:15492:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.857563:0:15492:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c86b600/0xfc4b8e114eda98a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->28671) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d3d expref: 83 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.857568:0:15492:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c86b600/0xfc4b8e114eda98a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->28671) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d3d expref: 83 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.857579:0:15492:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008c86b600/0xfc4b8e114eda98a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->28671) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d3d expref: 83 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.857584:0:15492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15492:1796503200053248:192.168.203.4@tcp:105: 00000100:00100000:0.0:1713279306.857588:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110530 00000100:00100000:1.0:1713279306.857593:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.857597:0:15492:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012edd90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.857606:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281252032 00000100:00100000:3.0:1713279306.857609:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281252032 00000100:00100000:3.0:1713279306.857628:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110534 00000100:00100000:3.0:1713279306.857631:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+85:1957:x1796503281252032:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:0.0:1713279306.857644:0:11415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800945521c0/0xfc4b8e114eda2ac7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->28671) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174002 expref: 95 pid: 15539 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.857651:0:11415:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11415:1796503200053056:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.857659:0:11415:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c86b600/0xfc4b8e114eda98a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->28671) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d3d expref: 83 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.857665:0:11415:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c86b600, rc 0) 00000100:00100000:0.0:1713279306.857676:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+83:11966:x1796503281250880:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 1622us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.857679:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110532 00000100:00100000:3.0:1713279306.857700:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1957:x1796503281252032:12345-192.168.203.4@tcp:2:touch.0 Request processed in 68us (107us total) trans 4295010187 rc 0/0 00000100:00100000:0.0:1713279306.857705:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.857705:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110534 00000100:00100000:2.0:1713279306.857706:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.857716:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281252288 00000100:00100000:0.0:1713279306.857718:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.857718:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281252288 00000100:00100000:1.0:1713279306.857730:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281251712 00000100:00100000:2.0:1713279306.857732:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.857732:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223083 00000100:00100000:1.0:1713279306.857733:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281251712 00000100:00100000:3.0:1713279306.857734:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3721:11955:x1796503281252288:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1713279306.857735:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.857742:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281251904 00000100:00100000:1.0:1713279306.857743:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281251904 00000100:00100000:2.0:1713279306.857745:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281252160 00000100:00100000:2.0:1713279306.857748:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281252160 00000100:00100000:0.0:1713279306.857757:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.857759:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785323 00000100:00100000:1.0:1713279306.857762:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3390:11204:x1796503281251904:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.857763:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281250368 00000100:00100000:2.0:1713279306.857764:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281250368 00010000:00010000:1.0:1713279306.857768:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.857773:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785324 00010000:00010000:1.0:1713279306.857776:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda992a lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d60 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.857776:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3391:11985:x1796503281250368:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:3.0:1713279306.857776:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3722:11955:x1796503281252288:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 41us (72us total) trans 4295202748 rc 0/0 00000100:00100000:3.0:1713279306.857780:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223083 00010000:00010000:2.0:1713279306.857781:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.857786:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda9931 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d2f expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.857789:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281252352 00000100:00100000:3.0:1713279306.857791:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281252352 00000100:00100000:3.0:1713279306.857799:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110535 00000100:00100000:3.0:1713279306.857801:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+84:1956:x1796503281252352:12345-192.168.203.4@tcp:16:kworker.0 00010000:00010000:2.0:1713279306.857816:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda9938 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x75c9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00000100:00100000:3.0:1713279306.857818:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+84:1956:x1796503281252352:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 17us (87us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.857822:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda993f lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.857822:0:15481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114eda683f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175094 expref: 3393 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.857822:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110535 00010000:00010000:2.0:1713279306.857826:0:15481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda9938 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x75c9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.857829:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda993f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.857835:0:15481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114eda683f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175094 expref: 3393 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.857836:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda993f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.857838:0:15525:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880121534a80 x1796503200053120) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda93ff lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x854f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bfb expref: 3721 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.857841:0:15481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114eda683f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175094 expref: 3393 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.857843:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9946 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.857846:0:15481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121400700 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:15481:1796503200053312:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.857846:0:15525:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda93ff lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x854f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bfb expref: 3721 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.857848:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9946 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.857853:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9946 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.857854:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda93ff lrc: 0/0,0 mode: --/PW res: [0x200000403:0x854f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175bfb expref: 3721 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.857860:0:15481:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800976f9900 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.857861:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200053120:192.168.203.4@tcp:104: 00000004:00200000:1.0:1713279306.857875:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:3.0:1713279306.857877:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x854f:0x0].0x0 (ffff88008dba4d00) 00010000:00010000:1.0:1713279306.857880:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda993f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.857880:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.857884:0:15525:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.857885:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda993f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.857886:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785325 00010000:00010000:3.0:1713279306.857887:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.857889:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda993f lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.857889:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3645:11912:x1796503281252160:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.857893:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.857893:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.857894:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda993f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.857897:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.857898:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe16400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.857899:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc900/0xfc4b8e114eda994d lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d67 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.857899:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.857900:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda993f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.857905:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda993f lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.857912:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:1.0:1713279306.857914:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.857917:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda993f lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.857921:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda993f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.857937:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9946 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.857938:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9954 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.857942:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9946 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.857943:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9954 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.857946:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9946 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.857947:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9954 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.857950:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe15b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.857952:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9946 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.857955:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda995b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.857956:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9946 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.857958:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda995b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.857960:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880130675800) 00010000:00010000:2.0:1713279306.857961:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda995b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.857962:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.857964:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9946 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.857968:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9946 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00000004:00200000:2.0:1713279306.857968:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:2.0:1713279306.857973:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9954 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.857976:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9954 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.857979:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9954 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.857982:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9954 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.857985:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.857986:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9954 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.857988:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda992a lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d60 expref: 3393 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.857989:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9954 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.857993:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88012fbfe400) 00010000:00010000:2.0:1713279306.857994:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.857995:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda992a lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d60 expref: 3393 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.857996:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9954 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00000004:00010000:3.0:1713279306.858000:0:15525:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880090afc700 reply state ffff8800980b7000 transno 4295202749 ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.858001:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9954 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.858003:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe14480, rc 0) 00010000:00010000:2.0:1713279306.858006:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda995b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858007:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.858008:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda995b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858010:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x854f:0x0].0x0 (ffff88008dba4d00) 00010000:00010000:2.0:1713279306.858011:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda995b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858012:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.858014:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008957c900 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.858014:0:15525:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.858015:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda995b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858016:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda98dd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.858018:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda995b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858020:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda98dd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.858021:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88012fbfe500) 00000100:00100000:1.0:1713279306.858022:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3392:11204:x1796503281251904:12345-192.168.203.4@tcp:101:touch.0 Request processed in 258us (302us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.858022:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.858023:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda98dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.858024:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda995b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858026:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda98dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.858028:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785323 00010000:00010000:2.0:1713279306.858028:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda995b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858029:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906eb3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.858030:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda98dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.858033:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda98dd lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.858037:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x0 (ffff880091b34100) 00010000:00010000:3.0:1713279306.858038:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.858040:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda98dd lrc: 3/0,0 mode: --/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.858042:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda98dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.858045:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc900/0xfc4b8e114eda994d lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d67 expref: 3646 pid: 15483 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.858046:0:15525:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880090afc700 reply state ffff8800980b7000 transno 4295202749 ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114eda98e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.858050:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114eda98e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.858051:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc900/0xfc4b8e114eda994d lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d67 expref: 3646 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.858053:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x34 (ffff8801250c1700) 00010000:00010000:3.0:1713279306.858054:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.858055:0:15525:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:3.0:1713279306.858057:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda98cf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.858060:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785326 00010000:00010000:3.0:1713279306.858060:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda98cf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.858062:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda98cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.858064:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3391:11374:x1796503281251712:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.858064:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bc900, rc 0) 00010000:00010000:3.0:1713279306.858065:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda98cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.858082:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.858085:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e8b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.858087:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda98cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.858089:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda9962 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7ae1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d59 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.858089:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda98cf lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.858092:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3645:11912:x1796503281252160:12345-192.168.203.4@tcp:101:touch.0 Request processed in 201us (356us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.858093:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x0 (ffff8801250c1c00) 00010000:00010000:3.0:1713279306.858094:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.858095:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda98cf lrc: 3/0,0 mode: --/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.858098:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785325 00010000:00010000:3.0:1713279306.858098:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda98cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00000004:00010000:3.0:1713279306.858105:0:15525:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880090afc700 reply state ffff8800980b7000 transno 4295202749 ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda98d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.858108:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda98d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.858125:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x34 (ffff8801250c1300) 00010000:00010000:3.0:1713279306.858126:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.858127:0:15525:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000004:00080000:3.0:1713279306.858129:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x7d86:0x0] 00010000:00010000:1.0:1713279306.858132:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda9969 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7ae1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.858133:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.858136:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.858138:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.858139:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda9969 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7ae1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.858141:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.858142:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.858144:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda9969 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7ae1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.858145:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 15525 initiator: MDT0 00000004:00200000:1.0:1713279306.858148:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7ae1:0x0]: returning size 0 00010000:00010000:3.0:1713279306.858148:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:3.0:1713279306.858149:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.858152:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda9889 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda987b expref: 51 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.858156:0:15525:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda9889 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114eda987b expref: 51 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.858160:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda9889 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114eda987b expref: 51 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.858170:0:15525:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda9889 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda987b expref: 51 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.858176:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda9962 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7ae1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d59 expref: 3394 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.858176:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200053376:0@lo:105: 00010000:00010000:1.0:1713279306.858183:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda9969 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7ae1:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d59 expref: 3393 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.858187:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ae1:0x0].0x0 (ffff880091738f00) 00010000:00010000:1.0:1713279306.858188:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1713279306.858190:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe146c0, rc 0) 00000100:00100000:3.0:1713279306.858192:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.858204:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3393:11374:x1796503281251712:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 140us (499us total) trans 4295183742 rc 0/0 00000100:00100000:1.0:1713279306.858208:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785326 00000100:00100000:3.0:1713279306.858209:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0900 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.858213:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200053376 00000100:00100000:2.0:1713279306.858216:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200053376 00000100:00100000:2.0:1713279306.858240:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33446 00000100:00100000:2.0:1713279306.858245:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121537b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15525:x1796503200053376:12345-0@lo:105: 00010000:00010000:2.0:1713279306.858252:0:6913:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.858259:0:6913:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.858266:0:6913:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.858272:0:6913:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.858278:0:6913:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.858285:0:6913:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.858297:0:6913:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8801298ecb40) 00010000:00010000:0.0:1713279306.858300:0:15526:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.858305:0:15526:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.858313:0:15526:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000004:00080000:0.0:1713279306.858320:0:15526:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x84a3:0x0] 00000100:00100000:2.0:1713279306.858320:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121537b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15525:x1796503200053376:12345-0@lo:105: Request processed in 75us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.858325:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33446 00000100:00100000:0.0:1713279306.858335:0:15526:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccbb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001-mdtlov_UUID:15526:1796503200053440:0@lo:1000:mdt_io00_010.0 00000100:00100000:2.0:1713279306.858355:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200053376:0@lo:105: 00000100:00100000:0.0:1713279306.858360:0:15526:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.858366:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.858371:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114eda958e lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.858402:0:15525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:385c4b71-808c-40cf-91de-b076b668d13f+3722:11854:x1796503281246784:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 11199us (11235us total) trans 4295202749 rc 0/0 00000100:00100000:2.0:1713279306.858408:0:15525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14348 00000100:00100000:1.0:1713279306.858435:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200053184 00000100:00100000:1.0:1713279306.858438:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200053184 00000100:00100000:0.0:1713279306.858440:0:15526:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800965400c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.858453:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200053440 00000100:00100000:1.0:1713279306.858455:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200053440 00000100:00100000:1.0:1713279306.858465:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98881 00000100:00100000:1.0:1713279306.858467:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+53:15502:x1796503200053184:12345-0@lo:101:mdt_io00_004.0 00010000:00010000:1.0:1713279306.858473:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.858478:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda98f2 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.858479:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.858487:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda9889 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda987b expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.858491:0:15516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.858501:0:15516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda9889 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda987b expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.858506:0:15516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000_UUID:15516:1796503200053504:0@lo:104: 00000100:00100000:1.0:1713279306.858520:0:15516:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.858521:0:15525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281252544 00000100:00100000:2.0:1713279306.858525:0:15525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281252544 00000100:00100000:1.0:1713279306.858527:0:15516:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0600 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.858535:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98882 00000100:00100000:1.0:1713279306.858537:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+54:15526:x1796503200053440:12345-0@lo:1000:mdt_io00_010.0 00000100:00100000:2.0:1713279306.858547:0:15525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14351 00000100:00100000:2.0:1713279306.858552:0:15525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:385c4b71-808c-40cf-91de-b076b668d13f+3722:11736:x1796503281252544:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:0.0:1713279306.858568:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.858573:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.858580:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281252736 00010000:00010000:2.0:1713279306.858581:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.858582:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281252736 00010000:00010000:2.0:1713279306.858587:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.858592:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223084 00000100:00100000:1.0:1713279306.858595:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:10814:x1796503281252736:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:2.0:1713279306.858602:0:15525:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.858620:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000100:00100000:3.0:1713279306.858637:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3391:11666:x1796503281251456:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1466us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.858640:0:15492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15492:1796503200053248:192.168.203.4@tcp:105: 00000100:00100000:3.0:1713279306.858642:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223082 00010000:00010000:2.0:1713279306.858647:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.858648:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:10814:x1796503281252736:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 52us (80us total) trans 4295202750 rc 0/0 00000100:00100000:1.0:1713279306.858652:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223084 00000100:00100000:2.0:1713279306.858661:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+94:1957:x1796503281251968:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1122us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.858666:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196558 00000100:00100000:1.0:1713279306.858679:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+54:15526:x1796503200053440:12345-0@lo:1000:mdt_io00_010.0 Request processed in 140us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.858679:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200053504 00000100:00100000:2.0:1713279306.858681:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200053504 00000100:00100000:1.0:1713279306.858682:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98882 00000100:00100000:0.0:1713279306.858685:0:15526:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccbb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001-mdtlov_UUID:15526:1796503200053440:0@lo:1000:mdt_io00_010.0 00000100:00100000:2.0:1713279306.858693:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33447 00000100:00100000:2.0:1713279306.858696:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15516:x1796503200053504:12345-0@lo:104: 00010000:00010000:2.0:1713279306.858703:0:6913:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.858735:0:15516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000_UUID:15516:1796503200053504:0@lo:104: 00010000:00010000:2.0:1713279306.858737:0:6913:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1713279306.858741:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15516:x1796503200053504:12345-0@lo:104: Request processed in 44us (220us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.858744:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 53 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.858746:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33447 00010000:00010000:1.0:1713279306.858751:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.858753:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.858753:0:8071:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713279306.858756:0:15516:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 53 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.858757:0:8071:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.858762:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe161c0, rc 0) 00010000:00010000:3.0:1713279306.858762:0:8071:0:(ldlm_lockd.c:1968:ldlm_handle_bl_callback()) Lock ffff8801298ecb40 is referenced, will be cancelled later 00010000:00010000:3.0:1713279306.858763:0:8071:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.858767:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.858768:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.858769:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279306.858771:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.858784:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+53:15502:x1796503200053184:12345-0@lo:101:mdt_io00_004.0 Request processed in 314us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.858786:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.858789:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98881 00000100:00100000:3.0:1713279306.858796:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281252608 00000100:00100000:3.0:1713279306.858799:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281252608 00000100:00100000:2.0:1713279306.858807:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.858809:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c160380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200053184:0@lo:101:mdt_io00_004.0 00000100:00100000:3.0:1713279306.858815:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281252864 00010000:00010000:1.0:1713279306.858817:0:15502:0:(ldlm_request.c:762:ldlm_cli_enqueue_fini()) ### enqueue reply includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.858817:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281252864 00000100:00100000:2.0:1713279306.858821:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281252992 00010000:00010000:1.0:1713279306.858823:0:15502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.858824:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281252992 00000100:00100000:3.0:1713279306.858825:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785327 00000100:00100000:3.0:1713279306.858828:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3723:11978:x1796503281252608:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.858829:0:15502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.858833:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.858837:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785328 00010000:00010000:3.0:1713279306.858839:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda9985 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d6e expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.858842:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3645:11711:x1796503281252864:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.858843:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785329 00000100:00100000:1.0:1713279306.858847:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:11976:x1796503281252992:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.858849:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.858854:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.858857:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122205680/0xfc4b8e114eda998c lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d75 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.858861:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14900/0xfc4b8e114eda9993 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d7c expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.858879:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda999a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.858885:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda999a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.858887:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda99a1 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.858889:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda999a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.858894:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda99a1 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858896:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda99a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.858899:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda99a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.858900:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda99a1 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858902:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda99a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.858906:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda99af lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.858910:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda99b6 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.858914:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda99af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.858916:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda99b6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.858920:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda99af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.858921:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda99b6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.858930:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda99bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.858935:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda99bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.858939:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda99a1 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.858940:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda99bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000004:00200000:3.0:1713279306.858942:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8297:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.858945:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda99a1 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858946:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda999a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.858949:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda999a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.858950:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda99a1 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858952:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda999a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.858955:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda99a1 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858956:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda999a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.858958:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd11d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.858960:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801222058c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.858960:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda999a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.858962:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda99a1 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858963:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda999a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.858964:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda99c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.858968:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.858969:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.858970:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda99c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.858971:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda99a1 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858971:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda999a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.858974:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11d40/0xfc4b8e114eda999a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.858976:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda99c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.858978:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88012fbfe200) 00010000:00010000:3.0:1713279306.858978:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda99a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.858980:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:1.0:1713279306.858981:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x84eb:0x0]: returning size 6184 00010000:00010000:3.0:1713279306.858981:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda99a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.858982:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda99a1 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858985:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda99a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.858987:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114eda99a1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858987:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd13600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.858988:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda99a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.858991:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda99a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.858994:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x39 (ffff8801250c1b00) 00010000:00010000:2.0:1713279306.858995:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda99b6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.858995:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.858996:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda99a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.858999:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd13600/0xfc4b8e114eda99a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.859000:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda99b6 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.859005:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda99b6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.859009:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda99af lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.859009:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134a40240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.859011:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda99b6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.859012:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda9985 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d6e expref: 3724 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.859014:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda99af lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.859016:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda99b6 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.859016:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda9985 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d6e expref: 3724 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.859019:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda99af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.859020:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906e8fc0, rc 0) 00010000:00010000:2.0:1713279306.859022:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff88012fbfed00) 00010000:00010000:1.0:1713279306.859023:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda99af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.859024:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.859026:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda99b6 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.859027:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe16d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.859029:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda99af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.859030:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40240/0xfc4b8e114eda99b6 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.859034:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda99af lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00000100:00100000:3.0:1713279306.859036:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3723:11978:x1796503281252608:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 207us (265us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.859039:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785327 00010000:00010000:1.0:1713279306.859040:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:1.0:1713279306.859042:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.859045:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda99af lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.859048:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880122205680/0xfc4b8e114eda998c lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d75 expref: 3646 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.859049:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114eda99af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.859055:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122205680/0xfc4b8e114eda998c lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d75 expref: 3646 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.859056:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda99bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.859064:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122205680, rc 0) 00010000:00010000:1.0:1713279306.859065:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda99bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.859083:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda99bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.859085:0:15526:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccbb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001-mdtlov_UUID:15526:1796503200053632:0@lo:403:mdt_io00_010.0 00010000:00010000:1.0:1713279306.859087:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe158c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.859089:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda99bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.859094:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda99bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00000100:00100000:2.0:1713279306.859095:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3645:11711:x1796503281252864:12345-192.168.203.4@tcp:101:touch.0 Request processed in 251us (307us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.859100:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff880130675f00) 00000100:00100000:2.0:1713279306.859101:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785328 00010000:00010000:1.0:1713279306.859102:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.859103:0:15526:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.859104:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda99bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.859108:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe158c0/0xfc4b8e114eda99bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.859115:0:15526:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800965406c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.859130:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14900/0xfc4b8e114eda9993 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d7c expref: 3721 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.859138:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda99c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d7c expref: 3720 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.859143:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84eb:0x0].0x0 (ffff88012061ff00) 00010000:00010000:1.0:1713279306.859145:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.859147:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe17cc0, rc 0) 00000100:00100000:1.0:1713279306.859157:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200053632 00000100:00100000:1.0:1713279306.859160:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200053632 00000100:00100000:1.0:1713279306.859189:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98883 00000100:00100000:1.0:1713279306.859192:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+53:15526:x1796503200053632:12345-0@lo:403:mdt_io00_010.0 00000100:00100000:0.0:1713279306.859964:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.859973:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281253568 00000100:00100000:0.0:1713279306.859975:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281253568 00000100:00100000:0.0:1713279306.859992:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785330 00000100:00100000:0.0:1713279306.859995:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3645:11912:x1796503281253568:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.860001:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.860007:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda99d2 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d83 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.860032:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda99d9 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.860035:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.860037:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda99d9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.860041:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda99d9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.860048:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281253120 00000100:00100000:3.0:1713279306.860053:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281253120 00000100:00100000:2.0:1713279306.860055:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.860083:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223085 00000100:00100000:3.0:1713279306.860087:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3391:11855:x1796503281253120:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1713279306.860094:0:15481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121400700 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:15481:1796503200053312:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.860102:0:15481:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda9938 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x75c9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:2.0:1713279306.860119:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.860128:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.860134:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281253632 00000100:00100000:2.0:1713279306.860136:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281253632 00010000:00010000:0.0:1713279306.860145:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114eda99e0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.860148:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281253376 00000100:00100000:3.0:1713279306.860148:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3392:11855:x1796503281253120:12345-192.168.203.4@tcp:35:touch.0 Request processed in 60us (114us total) trans 4295183743 rc 0/0 00000100:00100000:2.0:1713279306.860149:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281253376 00010000:00010000:0.0:1713279306.860150:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114eda99e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.860152:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223085 00010000:00010000:0.0:1713279306.860154:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114eda99e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.860156:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785331 00000100:00100000:2.0:1713279306.860159:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:11204:x1796503281253632:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.860165:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda99d9 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.860165:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281253184 00010000:00010000:2.0:1713279306.860167:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.860167:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281253184 00010000:00010000:0.0:1713279306.860169:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda99d9 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.860172:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda99d9 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.860173:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda99e7 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d8a expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.860175:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda99d9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.860176:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110536 00010000:00010000:0.0:1713279306.860177:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.860179:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda99d9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.860179:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+84:1957:x1796503281253184:12345-192.168.203.4@tcp:16:kworker.0 00010000:00010000:0.0:1713279306.860184:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda99d9 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.860189:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880096da6500) 00010000:00010000:0.0:1713279306.860190:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.860191:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda99d9 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.860194:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda99d9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.860198:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+84:1957:x1796503281253184:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 19us (79us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.860200:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114eda99e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.860200:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda99ee lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.860202:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114eda99e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.860202:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110536 00010000:00010000:0.0:1713279306.860205:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114eda99e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.860205:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda99ee lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.860208:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942d680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.860209:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114eda99e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.860209:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda99ee lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.860211:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785332 00010000:00010000:0.0:1713279306.860212:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114eda99e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.860215:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff880096da6400) 00010000:00010000:2.0:1713279306.860215:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114eda99f5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.860215:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3647:11854:x1796503281253376:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1713279306.860216:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.860217:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114eda99e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.860219:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114eda99f5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.860220:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114eda99e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.860222:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114eda99f5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.860230:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda99fc lrc: 3/1,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.860232:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda99d2 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d83 expref: 3647 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.860235:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda99ee lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.860236:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda99fc lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.860237:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c240/0xfc4b8e114eda99d2 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d83 expref: 3647 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.860238:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda99ee lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.860241:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda99ee lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.860241:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda99fc lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.860242:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942c240, rc 0) 00010000:00010000:2.0:1713279306.860244:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda99ee lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.860246:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9a03 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x252:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.860247:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134a40b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.860249:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda99ee lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.860250:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9a03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860253:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9a03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.860255:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3646:11912:x1796503281253568:12345-192.168.203.4@tcp:101:touch.0 Request processed in 259us (291us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.860255:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda99ee lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713279306.860259:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785330 00010000:00010000:2.0:1713279306.860259:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:2.0:1713279306.860260:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.860262:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda99ee lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.860265:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda99ee lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.860270:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114eda99f5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.860273:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114eda99f5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.860275:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114eda99f5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.860278:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f084d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.860279:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114eda99f5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.860280:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9a0a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x74f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.860283:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.860283:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114eda99f5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.860284:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9a0a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860287:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9a0a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.860289:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff88009e5e1d00) 00010000:00010000:2.0:1713279306.860291:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:3.0:1713279306.860292:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x74f3:0x0]: returning size 1 00010000:00010000:2.0:1713279306.860293:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114eda99f5 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000004:00010000:3.0:1713279306.860296:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9a0a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.860298:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114eda99f5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.860301:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda99fc lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.860307:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.860307:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda99fc lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860310:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda99fc lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860313:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda99fc lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.860314:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281254080 00010000:00010000:3.0:1713279306.860315:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.860316:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda99e7 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d8a expref: 3722 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.860317:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281254080 00010000:00010000:3.0:1713279306.860317:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda99fc lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860320:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda99fc lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.860323:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda99e7 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d8a expref: 3722 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.860324:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x0 (ffff88012514da00) 00010000:00010000:3.0:1713279306.860326:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.860327:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785333 00010000:00010000:3.0:1713279306.860327:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda99fc lrc: 3/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.860330:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3723:11711:x1796503281254080:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.860330:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134a41f80, rc 0) 00010000:00010000:3.0:1713279306.860330:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114eda99fc lrc: 0/0,0 mode: --/CR res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860335:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9a03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860337:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9a03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.860338:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.860340:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9a03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860343:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd106c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.860344:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda9a11 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d98 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.860345:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9a03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860348:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9a03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.860349:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:11204:x1796503281253632:12345-192.168.203.4@tcp:101:touch.0 Request processed in 188us (293us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.860351:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x36 (ffff8801250c1e00) 00010000:00010000:3.0:1713279306.860352:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.860353:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9a03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.860356:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785331 00010000:00010000:3.0:1713279306.860356:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9a03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860362:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9a0a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860364:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9a0a lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x74f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860367:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9a0a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x74f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860369:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd121c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.860371:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9a0a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x74f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860373:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9a0a lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x74f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.860377:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74f3:0x0].0x0 (ffff8801250c1400) 00010000:00010000:0.0:1713279306.860378:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9a18 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.860378:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.860379:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9a0a lrc: 2/0,0 mode: --/PR res: [0x240000403:0x74f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.860383:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9a18 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.860384:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9a0a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x74f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.860385:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.860387:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9a18 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860394:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9a1f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.860396:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281253312 00010000:00010000:0.0:1713279306.860398:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9a1f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.860398:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281253312 00010000:00010000:0.0:1713279306.860401:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9a1f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00000100:00100000:3.0:1713279306.860402:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3645:11854:x1796503281253376:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 186us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.860407:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785332 00010000:00010000:2.0:1713279306.860408:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114eda683f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175094 expref: 3392 pid: 15752 timeout: 509 lvb_type: 0 00000004:00200000:0.0:1713279306.860409:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:0.0:1713279306.860428:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9a18 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860431:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9a18 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860434:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9a18 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00000100:00100000:3.0:1713279306.860434:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281253248 00000100:00100000:3.0:1713279306.860436:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281253248 00010000:00010000:0.0:1713279306.860438:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9a18 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860440:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942cd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.860441:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9a18 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.860441:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196559 00010000:00010000:0.0:1713279306.860444:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9a18 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00000100:00100000:3.0:1713279306.860445:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110537 00000100:00100000:2.0:1713279306.860446:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3392:1957:x1796503281253312:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.860447:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+94:1956:x1796503281253248:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:0.0:1713279306.860448:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880096da6e00) 00010000:00010000:0.0:1713279306.860449:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.860451:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9a18 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.860453:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.860456:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9a18 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.860458:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114eda683f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175094 expref: 3392 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.860461:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9a1f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00002000:00010000:3.0:1713279306.860463:0:11415:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000400:0x1050:0x0] initial LVB size: 0, mtime: 0x661e9148, atime: 0x661e9148, ctime: 0x661e9148, blocks: 0x0 00010000:00010000:0.0:1713279306.860464:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9a1f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.860466:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114eda683f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175094 expref: 3392 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.860466:0:11415:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9a26 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1050:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.860467:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9a1f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860469:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942d8c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.860470:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9a1f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.860471:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.860472:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.860473:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9a1f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.860474:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9a26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1050:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.860476:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880091738a00) 00010000:00010000:0.0:1713279306.860477:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.860477:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114eda683f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175094 expref: 3392 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.860478:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9a1f lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.860480:0:11415:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9a26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1050:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.860481:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9a1f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:3.0:1713279306.860486:0:11415:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9a26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1050:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.860490:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75c9:0x0].0x0 (ffff88008eb9f100) 00010000:00010000:3.0:1713279306.860490:0:11415:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9a26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1050:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.860493:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda9938 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x75c9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.860494:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda9a11 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d98 expref: 3724 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.860497:0:11415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9a26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1050:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.860498:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda9a11 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d98 expref: 3724 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.860498:0:15492:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda9938 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x75c9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.860500:0:11415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10000 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:3.0:1713279306.860502:0:11415:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9a26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1050:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.860504:0:15492:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda9938 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x75c9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.860505:0:11415:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9a26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1050:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.860506:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942eac0, rc 0) 00010000:00010000:3.0:1713279306.860511:0:11415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9a26 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1050:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.860514:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.860514:0:11415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9a26 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1050:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.860520:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3723:11711:x1796503281254080:12345-192.168.203.4@tcp:101:touch.0 Request processed in 189us (212us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.860522:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+53:15526:x1796503200053632:12345-0@lo:403:mdt_io00_010.0 Request processed in 1327us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.860524:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785333 00000100:00100000:1.0:1713279306.860528:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98883 00000100:00100000:2.0:1713279306.860529:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3391:1957:x1796503281253312:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 82us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.860535:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196559 00000100:00100000:3.0:1713279306.860535:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+94:1956:x1796503281253248:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.860539:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110537 00000100:00100000:0.0:1713279306.860547:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.860550:0:15481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda9938 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x75c9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:0.0:1713279306.860555:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281253696 00010000:00010000:2.0:1713279306.860555:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda9938 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x75c9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:0.0:1713279306.860557:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281253696 00000100:00100000:1.0:1713279306.860560:0:15526:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccbb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001-mdtlov_UUID:15526:1796503200053632:0@lo:403:mdt_io00_010.0 00000004:00200000:2.0:1713279306.860563:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x75c9:0x0]: returning size 30052 00000100:00100000:0.0:1713279306.860567:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785334 00000100:00100000:0.0:1713279306.860569:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3723:11955:x1796503281253696:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.860574:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.860579:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda9a34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d91 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.860596:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda9a3b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860600:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda9a3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860604:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda9a3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.860605:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda9931 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d2f expref: 3392 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.860609:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda9a42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860613:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda9a42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.860615:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bdb00/0xfc4b8e114eda9938 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x75c9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d2f expref: 3391 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.860616:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda9a42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.860621:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75c9:0x0].0x0 (ffff88008eb9f100) 00010000:00010000:2.0:1713279306.860624:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1713279306.860626:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bdb00, rc 0) 00010000:00010000:0.0:1713279306.860636:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114eda9a49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860640:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114eda9a49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.860643:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3391:11985:x1796503281250368:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 2865us (2884us total) trans 4295183744 rc 0/0 00010000:00010000:0.0:1713279306.860644:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114eda9a49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.860649:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785324 00000004:00200000:0.0:1713279306.860666:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00000004:00200000:0.0:1713279306.860669:0:6929:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1713279306.860674:0:6929:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114eda9a49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.860674:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.860678:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda9a3b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860681:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda9a3b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860684:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda9a3b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860687:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda9a3b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860689:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.860691:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda9a3b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860694:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda9a3b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860698:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:0.0:1713279306.860700:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.860701:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda9a3b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.860703:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.860703:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281253760 00010000:00010000:0.0:1713279306.860704:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ef40/0xfc4b8e114eda9a3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00000100:00100000:3.0:1713279306.860705:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281253760 00010000:00010000:0.0:1713279306.860709:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda9a42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860711:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda9a42 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860714:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda9a42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00000100:00100000:3.0:1713279306.860716:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110538 00010000:00010000:0.0:1713279306.860717:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.860718:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda9a42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00000100:00100000:3.0:1713279306.860719:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+83:1955:x1796503281253760:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:0.0:1713279306.860721:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda9a42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860724:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff880089dc2800) 00010000:00010000:0.0:1713279306.860725:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.860725:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.860726:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda9a42 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860729:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e400/0xfc4b8e114eda9a42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.860739:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cb40/0xfc4b8e114eda9a34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d91 expref: 3725 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.860744:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114eda9a49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d91 expref: 3724 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.860748:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:0.0:1713279306.860749:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713279306.860751:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942e640, rc 0) 00000100:00100000:0.0:1713279306.860761:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3724:11955:x1796503281253696:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 191us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.860764:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785334 00002000:00010000:3.0:1713279306.860774:0:15506:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb size from disk: 12827 -> 12827 00002000:00010000:3.0:1713279306.860776:0:15506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.860778:0:15506:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:3.0:1713279306.860779:0:15506:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.860781:0:15506:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:3.0:1713279306.860791:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+84:1955:x1796503281253760:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 71us (117us total) trans 4295010128 rc 0/0 00000100:00100000:3.0:1713279306.860795:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110538 00000100:00100000:3.0:1713279306.860806:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281253824 00000100:00100000:3.0:1713279306.860808:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281253824 00000100:00100000:3.0:1713279306.860824:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281253952 00000100:00100000:3.0:1713279306.860825:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281253952 00000100:00100000:3.0:1713279306.860836:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223086 00000100:00100000:3.0:1713279306.860838:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130145850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:11666:x1796503281253824:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:2.0:1713279306.860843:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223087 00000100:00100000:2.0:1713279306.860847:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:10814:x1796503281253952:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1713279306.860899:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:10814:x1796503281253952:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 52us (174us total) trans 4295202752 rc 0/0 00000100:00100000:2.0:1713279306.860904:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223087 00010000:00010000:1.0:1713279306.861106:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00010000:00010000:1.0:1713279306.861117:0:15526:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175af1 expref: 3390 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.861123:0:15526:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.861138:0:15526:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175af1 expref: 3390 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.861148:0:15526:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175af1 expref: 3390 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.861157:0:15526:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001_UUID:15526:1796503200053696:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.861163:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.861172:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281254208 00000100:00100000:0.0:1713279306.861174:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281254208 00000100:00100000:1.0:1713279306.861183:0:15526:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096e07840 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.861187:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785335 00000100:00100000:0.0:1713279306.861189:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:11991:x1796503281254208:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.861196:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.861200:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ed00/0xfc4b8e114eda9a57 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175d9f expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.861201:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:11976:x1796503281252992:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 2353us (2393us total) trans 4295202751 rc 0/0 00000100:00100000:1.0:1713279306.861208:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785329 00010000:00010000:0.0:1713279306.861277:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda9a5e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.861283:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda9a5e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.861288:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda9a5e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.861291:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00200000:0.0:1713279306.861293:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7fe9:0x0]: returning size 46934 00000100:00100000:3.0:1713279306.861317:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281254272 00000100:00100000:3.0:1713279306.861320:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281254272 00010000:00010000:0.0:1713279306.861326:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942ed00/0xfc4b8e114eda9a57 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d9f expref: 3726 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.861332:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110539 00000100:00100000:3.0:1713279306.861335:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+84:1957:x1796503281254272:12345-192.168.203.4@tcp:16:kworker.0 00010000:00010000:0.0:1713279306.861336:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda9a5e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d9f expref: 3725 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.861340:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:0.0:1713279306.861341:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1713279306.861342:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed51f80, rc 0) 00000100:00100000:0.0:1713279306.861358:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11991:x1796503281254208:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 167us (195us total) trans 4295202753 rc 0/0 00000100:00100000:3.0:1713279306.861358:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+84:1957:x1796503281254272:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 22us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.861361:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785335 00000100:00100000:3.0:1713279306.861362:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110539 00000100:00100000:0.0:1713279306.861559:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.861569:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281254400 00000100:00100000:0.0:1713279306.861570:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.861573:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281254400 00000100:00100000:0.0:1713279306.861577:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281254784 00000100:00100000:0.0:1713279306.861580:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281254784 00000100:00100000:1.0:1713279306.861580:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.861585:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785336 00000100:00100000:2.0:1713279306.861588:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3391:11855:x1796503281254400:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.861594:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.861595:0:6942:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281254592 00000100:00100000:0.0:1713279306.861598:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785337 00000100:00100000:1.0:1713279306.861598:0:6942:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281254592 00010000:00010000:2.0:1713279306.861600:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0873c0/0xfc4b8e114eda9a6c lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175da6 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.861601:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3646:11912:x1796503281254784:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.861606:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.861613:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda9a73 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175db4 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.861616:0:6942:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14352 00000100:00100000:1.0:1713279306.861621:0:6942:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:385c4b71-808c-40cf-91de-b076b668d13f+3647:11854:x1796503281254592:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:2.0:1713279306.861621:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda9a7a lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.861626:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda9a7a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861630:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda9a7a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861635:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda9a81 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.861637:0:6942:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.861639:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda9a81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861641:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda9a81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.861646:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda9a88 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.861648:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800923406c0/0xfc4b8e114eda83e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x263:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175771 expref: 3647 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.861650:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda9a88 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.861654:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda9a88 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.861657:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x263:0x0].0x0 (ffff880090a56d00) 00010000:00010000:0.0:1713279306.861662:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda9a8f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.861663:0:6942:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.861665:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda9a8f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.861668:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda9a8f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.861673:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda9a96 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x717a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000004:00200000:0.0:1713279306.861675:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:1.0:1713279306.861677:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.861678:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda9a96 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x717a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.861680:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda9a88 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.861681:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda9a96 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x717a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.861683:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda9a88 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.861683:0:6942:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 6942 initiator: MDT1 00000004:00200000:2.0:1713279306.861684:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x717a:0x0]: returning size 7667712 00010000:00010000:0.0:1713279306.861686:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda9a88 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.861689:0:6942:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x1000000000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279306.861690:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda9a88 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.861692:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.861694:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda9a88 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.861696:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda9a88 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00000100:00100000:1.0:1713279306.861699:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c1180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200053760:0@lo:101:mdt_io00_001.0 00010000:00010000:0.0:1713279306.861700:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88012fbfee00) 00010000:00010000:0.0:1713279306.861701:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.861703:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda9a88 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.861703:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda9a7a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861707:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda9a7a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.861708:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114eda9a88 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.861710:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda9a7a lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861713:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda9a7a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.861714:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda9a8f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.861716:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f085b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.861717:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda9a8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.861717:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda9a7a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.861718:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.861719:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda9a8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.861721:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda9a7a lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.861722:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d322640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.861724:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda9a8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.861725:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880096da6900) 00010000:00010000:0.0:1713279306.861726:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda9a8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.861726:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.861727:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096e073c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.861728:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda9a7a lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.861729:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880094e7b100) 00010000:00010000:0.0:1713279306.861730:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.861731:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda9a8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.861731:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f085b00/0xfc4b8e114eda9a7a lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.861734:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114eda9a8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.861736:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda9a81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.861737:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200053760 00010000:00010000:2.0:1713279306.861739:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda9a81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.861740:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200053760 00010000:00010000:2.0:1713279306.861742:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda9a81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861745:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f0846c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.861746:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda9a81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.861747:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda9a73 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175db4 expref: 3646 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.861749:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda9a81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.861751:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114eda9a73 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175db4 expref: 3646 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.861752:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3231 (ffff880096da6200) 00010000:00010000:2.0:1713279306.861753:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.861754:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda9a81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861757:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0846c0/0xfc4b8e114eda9a81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.861760:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d320b40, rc 0) 00000100:00100000:1.0:1713279306.861763:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98884 00000100:00100000:1.0:1713279306.861767:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+53:6942:x1796503200053760:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1713279306.861771:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f0873c0/0xfc4b8e114eda9a6c lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175da6 expref: 3394 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.861775:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3645:11912:x1796503281254784:12345-192.168.203.4@tcp:101:touch.0 Request processed in 173us (204us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.861775:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.861778:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda9a96 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x717a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175da6 expref: 3393 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.861779:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785337 00010000:00010000:2.0:1713279306.861782:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x717a:0x0].0x0 (ffff880090aad100) 00010000:00010000:1.0:1713279306.861783:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9aab lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda9a9d expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.861784:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.861785:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f086400, rc 0) 00010000:00010000:1.0:1713279306.861798:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.861798:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3393:11855:x1796503281254400:12345-192.168.203.4@tcp:101:touch.0 Request processed in 209us (239us total) trans 4295183745 rc 0/0 00000100:00100000:3.0:1713279306.861799:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.861802:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785336 00010000:00010000:1.0:1713279306.861804:0:15516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9aab lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda9a9d expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.861812:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281254656 00010000:00010000:1.0:1713279306.861813:0:15516:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.861814:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281254656 00010000:00010000:1.0:1713279306.861821:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9aab lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9a9d expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.861823:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785338 00000100:00100000:2.0:1713279306.861825:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3393:11204:x1796503281254656:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.861827:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.861829:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.861830:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.861831:0:15516:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.861834:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114eda9ab2 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175dad expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.861836:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094669680, rc 0) 00000100:00100000:1.0:1713279306.861856:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+54:6942:x1796503200053760:12345-0@lo:101:mdt_io00_001.0 Request processed in 88us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.861861:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98884 00010000:00010000:2.0:1713279306.861874:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9ab9 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.861880:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c1180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6942:1796503200053760:0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1713279306.861880:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9ab9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861886:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9ab9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.861888:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.861894:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.861899:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda9ac0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.861904:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda9ac0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861910:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda9ac0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:2.0:1713279306.861923:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:2.0:1713279306.861929:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9ab9 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861934:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9ab9 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861939:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9ab9 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861944:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9ab9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861949:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f192ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.861951:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9ab9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861956:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9ab9 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861963:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:2.0:1713279306.861965:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.861968:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9ab9 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861976:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f192ac0/0xfc4b8e114eda9ab9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861985:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda9ac0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861990:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda9ac0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861995:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda9ac0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.861999:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b0480 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.862002:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.862002:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda9ac0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.862006:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.862006:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda9ac0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.862012:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880096da6800) 00010000:00010000:2.0:1713279306.862014:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.862016:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda9ac0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.862018:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.862021:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114eda9ac0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:0.0:1713279306.862023:0:15534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281255104 00000100:00100000:0.0:1713279306.862025:0:15534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281255104 00000100:00100000:0.0:1713279306.862040:0:15534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14353 00000100:00100000:1.0:1713279306.862040:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.862041:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114eda9ab2 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dad expref: 3395 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.862043:0:15534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3395:11374:x1796503281255104:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:2.0:1713279306.862048:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114eda9ab2 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dad expref: 3395 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.862049:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281254912 00000100:00100000:1.0:1713279306.862051:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281254912 00010000:00010000:2.0:1713279306.862059:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919a0000, rc 0) 00000100:00100000:1.0:1713279306.862063:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281255168 00000100:00100000:1.0:1713279306.862064:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281255168 00010000:00010000:0.0:1713279306.862079:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.862083:0:15534:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.862087:0:15534:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x1000000000000 pid: 15534 initiator: MDT1 00000100:00100000:1.0:1713279306.862090:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785339 00000100:00100000:1.0:1713279306.862093:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3645:11711:x1796503281254912:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.862094:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200053824:0@lo:101:mdt_io00_011.0 00000100:00100000:2.0:1713279306.862098:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3394:11204:x1796503281254656:12345-192.168.203.4@tcp:101:touch.0 Request processed in 270us (298us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.862099:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.862104:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785338 00010000:00010000:1.0:1713279306.862105:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9ace lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175dbb expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.862109:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.862117:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540000 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.862117:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785340 00000100:00100000:2.0:1713279306.862121:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:11981:x1796503281255168:12345-192.168.203.4@tcp:36:touch.0 00000100:00100000:0.0:1713279306.862126:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200053824 00010000:00010000:1.0:1713279306.862126:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9ad5 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.862128:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200053824 00010000:00010000:1.0:1713279306.862131:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9ad5 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.862135:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9ad5 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:0.0:1713279306.862137:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98885 00010000:00010000:2.0:1713279306.862138:0:15480:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.862139:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+54:15534:x1796503200053824:12345-0@lo:101:mdt_io00_011.0 00010000:00010000:1.0:1713279306.862141:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9adc lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.862144:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.862145:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9adc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.862148:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9adc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.862148:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf46c0/0xfc4b8e114eda9794 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8284:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cd4 expref: 3724 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.862149:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda9ae3 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda9ac7 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.862157:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8284:0x0].0x0 (ffff88008ad67600) 00010000:00010000:0.0:1713279306.862158:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9aab lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9a9d expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.862160:0:15480:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.862162:0:15516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda9ae3 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda9ac7 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.862163:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9ad5 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.862166:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9ad5 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.862169:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9ad5 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.862172:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9ad5 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.862173:0:15516:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9aab lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9a9d expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.862174:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed0ba80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.862176:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9ad5 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.862179:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda9ae3 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9ac7 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.862179:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9ad5 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.862182:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.862183:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880130675700) 00010000:00010000:0.0:1713279306.862184:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.862184:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.862185:0:15516:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.862185:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9ad5 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.862188:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9ad5 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.862189:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d323180, rc 0) 00010000:00010000:1.0:1713279306.862193:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9adc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.862195:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9aea lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8284:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.862196:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9adc lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.862199:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9adc lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.862202:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801349258c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.862203:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9adc lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.862203:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9aea lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8284:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.862204:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130145850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:11666:x1796503281253824:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1363us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.862205:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:15534:x1796503200053824:12345-0@lo:101:mdt_io00_011.0 Request processed in 65us (95us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.862206:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9adc lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.862208:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223086 00000100:00100000:0.0:1713279306.862209:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98885 00010000:00010000:1.0:1713279306.862209:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880130675000) 00010000:00010000:2.0:1713279306.862209:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9aea lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8284:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.862211:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.862212:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9adc lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.862217:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9adc lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00000100:00100000:0.0:1713279306.862222:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200053824:0@lo:101:mdt_io00_011.0 00010000:00010000:0.0:1713279306.862228:0:15534:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.862228:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281255232 00000100:00100000:3.0:1713279306.862230:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281255232 00010000:00010000:0.0:1713279306.862232:0:15534:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.862234:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9ace lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dbb expref: 3646 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.862241:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9ace lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dbb expref: 3646 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.862245:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110540 00000100:00100000:3.0:1713279306.862248:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+86:1956:x1796503281255232:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:1.0:1713279306.862249:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed098c0, rc 0) 00000004:00010000:2.0:1713279306.862258:0:15480:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801313c2300 reply state ffff880097711000 transno 4295202754 ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9aea lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8284:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.862266:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9aea lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8284:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.862268:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3645:11711:x1796503281254912:12345-192.168.203.4@tcp:101:touch.0 Request processed in 172us (266us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.862271:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8284:0x0].0x0 (ffff88008ad67600) 00000100:00100000:1.0:1713279306.862274:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785339 00010000:00010000:2.0:1713279306.862274:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.862276:0:15480:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713279306.862305:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:11981:x1796503281255168:12345-192.168.203.4@tcp:36:touch.0 Request processed in 182us (284us total) trans 4295202754 rc 0/0 00000100:00100000:2.0:1713279306.862311:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785340 00002000:00010000:3.0:1713279306.862320:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb size from disk: 30052 -> 30052 00002000:00010000:3.0:1713279306.862321:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.862323:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1713279306.862324:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.862326:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb blocks from disk: 0 -> 40 00000100:00100000:3.0:1713279306.862338:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+87:1956:x1796503281255232:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 89us (299us total) trans 4295010188 rc 0/0 00000100:00100000:3.0:1713279306.862342:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110540 00000100:00100000:0.0:1713279306.867043:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.867062:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.867082:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.867104:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.867117:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281255552 00000100:00100000:1.0:1713279306.867117:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281255936 00000100:00100000:3.0:1713279306.867119:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.867120:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281255552 00000100:00100000:2.0:1713279306.867120:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281256064 00000100:00100000:1.0:1713279306.867122:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281255936 00000100:00100000:2.0:1713279306.867125:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281256064 00000100:00100000:3.0:1713279306.867128:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.867137:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.867138:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281255296 00000100:00100000:1.0:1713279306.867140:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281255296 00000100:00100000:2.0:1713279306.867149:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785341 00000100:00100000:3.0:1713279306.867151:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.867153:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3724:11990:x1796503281255936:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:1.0:1713279306.867156:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785342 00000100:00100000:3.0:1713279306.867159:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281255680 00000100:00100000:1.0:1713279306.867161:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3645:11988:x1796503281256064:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.867162:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.867162:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281255680 00010000:00010000:1.0:1713279306.867168:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.867169:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda9af1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175dc9 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.867174:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281255360 00010000:00010000:1.0:1713279306.867175:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda9af8 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175dd0 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.867176:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281255360 00000100:00100000:3.0:1713279306.867176:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110541 00000100:00100000:3.0:1713279306.867180:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+94:1956:x1796503281255680:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:0.0:1713279306.867187:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175af1 expref: 3395 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.867219:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda9aff lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.867219:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda9b06 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.867225:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda9b06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.867226:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda9aff lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.867230:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda9aff lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.867230:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda9b06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.867233:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281255424 00000100:00100000:0.0:1713279306.867235:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281255424 00010000:00010000:1.0:1713279306.867237:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda9b14 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.867237:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda9b0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.867240:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda9b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.867241:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda9b14 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.867243:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda9b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.867244:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda9b14 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.867247:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281255616 00000100:00100000:0.0:1713279306.867248:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281255616 00000100:00100000:0.0:1713279306.867256:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196560 00000100:00100000:0.0:1713279306.867260:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3395:1956:x1796503281255360:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.867263:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca9b00/0xfc4b8e114eda9b1b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.867265:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.867268:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca9b00/0xfc4b8e114eda9b1b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.867269:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175af1 expref: 3395 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.867271:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca9b00/0xfc4b8e114eda9b1b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00200000:1.0:1713279306.867275:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7bca:0x0]: returning size 27670 00010000:00010000:0.0:1713279306.867276:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175af1 expref: 3395 pid: 15753 timeout: 509 lvb_type: 0 00000004:00200000:2.0:1713279306.867280:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8297:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.867284:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x13a:0x0].0x0 (ffff880123701d00) 00010000:00010000:2.0:1713279306.867286:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda9b06 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.867287:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.867289:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda9b06 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.867291:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.867292:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda9b06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.867295:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.867295:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda9b06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.867298:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b0240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.867299:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda9aff lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.867300:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda9b06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.867302:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.867303:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda9aff lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.867303:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda9b06 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00002000:00010000:3.0:1713279306.867303:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb size from disk: 46934 -> 46934 00002000:00010000:3.0:1713279306.867305:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00010000:00010000:1.0:1713279306.867306:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda9aff lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00002000:00010000:3.0:1713279306.867306:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00010000:00010000:2.0:1713279306.867307:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00002000:00010000:3.0:1713279306.867308:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00010000:00010000:1.0:1713279306.867309:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda9aff lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.867309:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:3.0:1713279306.867309:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb blocks from disk: 72 -> 64 00010000:00010000:2.0:1713279306.867311:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda9b06 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.867312:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134927180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.867313:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda9aff lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.867313:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b0240/0xfc4b8e114eda9b06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.867316:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda9aff lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.867319:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3395:1956:x1796503281255360:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 59us (199us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.867319:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda9b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.867321:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:1.0:1713279306.867322:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.867322:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda9b0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.867323:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196560 00010000:00010000:1.0:1713279306.867324:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda9aff lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.867324:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda9b0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00000100:00100000:3.0:1713279306.867326:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+95:1956:x1796503281255680:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 144us (174us total) trans 4295010129 rc 0/0 00010000:00010000:1.0:1713279306.867327:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114eda9aff lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.867330:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091805440 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.867330:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110541 00010000:00010000:2.0:1713279306.867331:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda9b0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.867332:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147266 00010000:00010000:1.0:1713279306.867332:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda9b14 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.867334:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3726:1955:x1796503281255424:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.867334:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda9b0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.867335:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda9b14 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.867337:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x39 (ffff880092ae7700) 00010000:00010000:1.0:1713279306.867338:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda9b14 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.867338:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.867339:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.867339:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda9b0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.867341:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fca86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.867342:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda9b14 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.867342:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114eda9b0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.867343:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114eda9a49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5a21:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d91 expref: 3726 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.867345:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda9b14 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.867345:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147267 00000100:00100000:3.0:1713279306.867348:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b25ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:1956:x1796503281255616:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.867349:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3631 (ffff880130675600) 00010000:00010000:0.0:1713279306.867350:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5a21:0x0].0x0 (ffff880093af7300) 00010000:00010000:1.0:1713279306.867350:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.867351:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.867351:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda9b14 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.867353:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.867354:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114eda9b14 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.867355:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda9af1 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dc9 expref: 3725 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.867359:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3725:1955:x1796503281255424:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 24us (231us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.867360:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b21c0/0xfc4b8e114eda9af1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dc9 expref: 3725 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.867361:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114eda9a5e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d9f expref: 3725 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.867363:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147266 00010000:00010000:2.0:1713279306.867364:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800926b21c0, rc 0) 00010000:00010000:1.0:1713279306.867369:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114eda9af8 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dd0 expref: 3648 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.867369:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:3.0:1713279306.867371:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.867375:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca9b00/0xfc4b8e114eda9b1b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dd0 expref: 3647 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.867379:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7bca:0x0].0x0 (ffff880093598800) 00000100:00100000:2.0:1713279306.867379:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3723:11990:x1796503281255936:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 225us (316us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.867380:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:3.0:1713279306.867380:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b25ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:1956:x1796503281255616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 31us (242us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.867381:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fca9b00, rc 0) 00000100:00100000:2.0:1713279306.867384:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785341 00000100:00100000:3.0:1713279306.867384:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147267 00000100:00100000:0.0:1713279306.867387:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785343 00000100:00100000:2.0:1713279306.867393:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785344 00000100:00100000:2.0:1713279306.867396:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3394:11984:x1796503281255552:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:1.0:1713279306.867397:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3647:11988:x1796503281256064:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 236us (314us total) trans 4295183746 rc 0/0 00000100:00100000:1.0:1713279306.867402:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785342 00010000:00010000:2.0:1713279306.867402:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.867407:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda9b29 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175dc2 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.867440:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:10814:x1796503281255296:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:1.0:1713279306.867452:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114eda9071 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x13a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175af1 expref: 3395 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.867457:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114eda9b30 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00000100:00100000:3.0:1713279306.867458:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.867462:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda9b37 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.867462:0:15526:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001_UUID:15526:1796503200053696:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.867463:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114eda9b30 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.867466:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114eda9b30 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867467:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda9b37 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.867469:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281255808 00000100:00100000:3.0:1713279306.867471:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281255808 00010000:00010000:0.0:1713279306.867472:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda9b37 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.867472:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114eda9b3e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.867476:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114eda9b3e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867477:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda9b45 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.867477:0:15526:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.867479:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114eda9b3e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867481:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda9b45 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.867483:0:15526:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279306.867484:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda9b45 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.867484:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223088 00010000:00010000:1.0:1713279306.867487:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00000100:00100000:3.0:1713279306.867487:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3723:11966:x1796503281255808:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:1.0:1713279306.867499:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda9b4c lrc: 3/0,1 mode: --/PW res: [0x240000401:0x13a:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00000004:00200000:2.0:1713279306.867504:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76b7:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.867505:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda9b4c lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.867508:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114eda9b30 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867510:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda9b53 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.867511:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda9b4c lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.867511:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114eda9b30 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867514:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda9b53 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.867514:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114eda9b30 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867517:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda9b53 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.867517:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114eda9b30 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.867519:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d4baf40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.867521:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114eda9b30 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00000004:00200000:0.0:1713279306.867522:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x83dc:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.867522:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda9b5a lrc: 3/0,1 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.867525:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114eda9b30 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00000004:00010000:0.0:1713279306.867527:0:15483:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda9b53 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.867527:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda9b5a lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.867529:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:2.0:1713279306.867530:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.867531:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda9b37 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.867531:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda9b5a lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.867531:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114eda9b30 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867534:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda9b37 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.867534:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114eda9b30 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867537:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda9b37 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.867537:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9b61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x233:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00010000:00010000:2.0:1713279306.867539:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114eda9b3e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867540:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda9b37 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.867540:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9b61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00000100:00100000:3.0:1713279306.867541:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3724:11966:x1796503281255808:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 53us (83us total) trans 4295202755 rc 0/0 00010000:00010000:2.0:1713279306.867542:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114eda9b3e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867543:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9b61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279306.867545:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.867545:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114eda9b3e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.867545:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223088 00010000:00010000:0.0:1713279306.867547:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda9b37 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.867548:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d4b8240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.867549:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114eda9b3e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867550:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda9b37 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.867552:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114eda9b3e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867554:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x0 (ffff8801250c1500) 00010000:00010000:0.0:1713279306.867555:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.867555:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff880091b35d00) 00010000:00010000:0.0:1713279306.867556:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda9b37 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.867556:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.867557:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114eda9b3e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867559:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320d80/0xfc4b8e114eda9b37 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.867560:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114eda9b3e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867564:0:15526:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x71e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15526 initiator: MDT0 00010000:00010000:0.0:1713279306.867567:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda9b45 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.867570:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda9b45 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.867570:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda9b29 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dc2 expref: 3394 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.867571:0:15526:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880122207180/0xfc4b8e114eda9778 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cdb expref: 3646 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.867573:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda9b45 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.867575:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114eda9b29 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dc2 expref: 3394 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.867575:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.867576:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.867577:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda9b45 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.867577:0:15526:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279306.867579:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea5f180, rc 0) 00010000:00010000:0.0:1713279306.867580:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda9b45 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.867583:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x3131 (ffff8801250c1200) 00010000:00010000:0.0:1713279306.867584:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.867585:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda9b45 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.867588:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323cc0/0xfc4b8e114eda9b45 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.867590:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.867593:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3393:11984:x1796503281255552:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 196us (553us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.867594:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda9b53 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.867594:0:15526:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880122207180/0xfc4b8e114eda9778 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cdb expref: 3646 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.867596:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda9b53 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.867596:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785344 00010000:00010000:0.0:1713279306.867599:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda9b53 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.867602:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320900 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.867602:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.867603:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda9b53 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.867604:0:15526:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880122207180/0xfc4b8e114eda9778 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cdb expref: 3646 pid: 15481 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.867604:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281256256 00010000:00010000:0.0:1713279306.867606:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda9b53 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.867606:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281256256 00010000:00010000:0.0:1713279306.867609:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x83dc:0x0].0x0 (ffff88008f645500) 00010000:00010000:0.0:1713279306.867610:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.867611:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda9b53 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713279306.867613:0:15526:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001_UUID:15526:1796503200053952:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.867614:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d320900/0xfc4b8e114eda9b53 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.867615:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281256640 00000100:00100000:3.0:1713279306.867616:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.867617:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281256640 00000100:00100000:3.0:1713279306.867621:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281257088 00000100:00100000:2.0:1713279306.867623:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281256704 00000100:00100000:2.0:1713279306.867624:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281256704 00000100:00100000:3.0:1713279306.867624:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281257088 00000100:00100000:2.0:1713279306.867631:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785345 00000100:00100000:0.0:1713279306.867632:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:10814:x1796503281255296:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 242us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.867633:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223089 00000100:00100000:2.0:1713279306.867634:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3647:11879:x1796503281256256:12345-192.168.203.4@tcp:34:lfs.0 00000100:00100000:3.0:1713279306.867635:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3395:11985:x1796503281257088:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:0.0:1713279306.867637:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785343 00000100:00100000:1.0:1713279306.867638:0:15526:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096e07840 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.867645:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785346 00000100:00100000:0.0:1713279306.867648:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3395:11855:x1796503281256640:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1713279306.867653:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda9b6f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00000100:00100000:1.0:1713279306.867654:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785347 00000100:00100000:1.0:1713279306.867657:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3395:11666:x1796503281256704:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:2.0:1713279306.867659:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda9b6f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867660:0:15483:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.867666:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114eda9a96 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x717a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175da6 expref: 3396 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.867666:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda9b6f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867671:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x717a:0x0].0x0 (ffff880090aad100) 00010000:00010000:0.0:1713279306.867673:0:15483:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.867674:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114eda9b76 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.867677:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda9b7d lrc: 3/1,0 mode: --/CR res: [0x240000400:0x242:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:3.0:1713279306.867681:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3395:11985:x1796503281257088:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 44us (63us total) trans 4295183747 rc 0/0 00010000:00010000:1.0:1713279306.867682:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda9b7d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.867683:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114eda9b76 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.867684:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223089 00010000:00010000:1.0:1713279306.867686:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda9b7d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.867689:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114eda9b76 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867691:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda9b84 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x242:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.867695:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda9b84 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.867698:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda9b84 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.867702:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda9b8b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x717a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.867706:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda9b8b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x717a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00000100:00100000:3.0:1713279306.867708:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.867710:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda9b8b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x717a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.867713:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda9b92 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00000100:00100000:3.0:1713279306.867715:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281257152 00000100:00100000:3.0:1713279306.867717:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281257152 00010000:00010000:1.0:1713279306.867720:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114eda9b99 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.867720:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda9b92 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867724:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114eda9b99 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.867725:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110542 00010000:00010000:2.0:1713279306.867726:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda9b92 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867728:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114eda9b99 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.867728:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+95:1957:x1796503281257152:12345-192.168.203.4@tcp:22:fallocate.0 00000004:00200000:2.0:1713279306.867733:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76b7:0x0]: returning size 4096 00000004:00010000:2.0:1713279306.867740:0:15481:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda9b92 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000004:00010000:0.0:1713279306.867742:0:15483:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008c162a00 reply state ffff880095771000 transno 4295183748 ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda9b8b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x717a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000004:00010000:1.0:1713279306.867742:0:6929:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114eda9b99 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.867746:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda9b6f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867747:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda9b8b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x717a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.867747:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda9b7d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.867750:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x717a:0x0].0x0 (ffff880090aad100) 00010000:00010000:1.0:1713279306.867750:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda9b7d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.867751:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.867752:0:15483:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.867752:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda9b6f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867753:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda9b7d lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.867755:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda9b7d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.867757:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda9b6f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867758:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095249d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.867760:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda9b7d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.867762:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda9b6f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867764:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda9b7d lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.867766:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c9b5200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.867768:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda9b6f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867769:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x242:0x0].0x0 (ffff880130675b00) 00010000:00010000:1.0:1713279306.867770:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.867771:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda9b7d lrc: 3/0,0 mode: --/CR res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00000100:00100000:0.0:1713279306.867773:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3396:11855:x1796503281256640:12345-192.168.203.4@tcp:36:touch.0 Request processed in 123us (181us total) trans 4295183748 rc 0/0 00010000:00010000:1.0:1713279306.867774:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114eda9b7d lrc: 0/0,0 mode: --/CR res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00000100:00100000:0.0:1713279306.867776:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785346 00010000:00010000:2.0:1713279306.867777:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda9b6f lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867779:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda9b84 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.867782:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda9b84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00002000:00010000:3.0:1713279306.867782:0:15506:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb size from disk: 6184 -> 6184 00010000:00010000:2.0:1713279306.867784:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00002000:00010000:3.0:1713279306.867784:0:15506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb mtime from disk: 1713279304 -> 1713279304 00010000:00010000:1.0:1713279306.867785:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda9b84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.867786:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:3.0:1713279306.867786:0:15506:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb atime from disk: 1713279300 -> 0 00010000:00010000:1.0:1713279306.867787:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133315b00 already unused, calling callback (ffffffffa0f0d730) 00002000:00010000:3.0:1713279306.867787:0:15506:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb ctime from disk: 1713279304 -> 1713279306 00010000:00010000:2.0:1713279306.867788:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda9b6f lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00002000:00010000:3.0:1713279306.867788:0:15506:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb blocks from disk: 8 -> 56 00010000:00010000:1.0:1713279306.867789:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda9b84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.867791:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda9b84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.867793:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114eda9b6f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867794:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x242:0x0].0x3131 (ffff880130675900) 00010000:00010000:1.0:1713279306.867796:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.867797:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda9b84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00000100:00100000:0.0:1713279306.867799:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.867799:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114eda9b84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.867800:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114eda9b76 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.867801:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+96:1957:x1796503281257152:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 72us (92us total) trans 4295010130 rc 0/0 00000100:00100000:3.0:1713279306.867804:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110542 00010000:00010000:2.0:1713279306.867805:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114eda9b76 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867806:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114eda9b99 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.867809:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114eda9b99 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.867810:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114eda9b76 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867812:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114eda9b99 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.867814:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133314fc0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.867815:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.867815:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114eda9b99 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.867815:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c9b5680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.867817:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114eda9b76 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867818:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114eda9b99 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.867821:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6c09:0x0].0x0 (ffff880122263f00) 00010000:00010000:1.0:1713279306.867822:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.867822:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114eda9b76 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867823:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114eda9b99 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.867826:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114eda9b99 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.867827:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff880129b60300) 00010000:00010000:2.0:1713279306.867829:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.867831:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114eda9b76 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.867834:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281257216 00010000:00010000:2.0:1713279306.867836:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114eda9b76 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.867837:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281257216 00000100:00100000:0.0:1713279306.867843:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.867845:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3395:11666:x1796503281256704:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 187us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.867845:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110543 00010000:00010000:2.0:1713279306.867846:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda9b92 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.867848:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+96:1955:x1796503281257216:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:1.0:1713279306.867850:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785347 00000100:00100000:0.0:1713279306.867851:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281256192 00010000:00010000:2.0:1713279306.867851:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda9b92 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00000100:00100000:0.0:1713279306.867853:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281256192 00010000:00010000:2.0:1713279306.867856:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda9b92 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.867858:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281256384 00000100:00100000:1.0:1713279306.867860:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281256384 00010000:00010000:2.0:1713279306.867860:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.867862:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda9b92 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00000100:00100000:0.0:1713279306.867865:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785348 00010000:00010000:2.0:1713279306.867866:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda9b92 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00000100:00100000:0.0:1713279306.867868:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3724:11993:x1796503281256192:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.867872:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76b7:0x0].0x0 (ffff880129b60800) 00000100:00100000:1.0:1713279306.867873:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785349 00010000:00010000:0.0:1713279306.867874:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.867874:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.867876:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3648:11912:x1796503281256384:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.867876:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda9b92 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.867879:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda9ba0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175dd7 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.867881:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114eda9b92 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.867882:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.867888:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092455d40/0xfc4b8e114eda9ba7 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175dde expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.867903:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+97:1955:x1796503281257216:12345-192.168.203.4@tcp:2:touch.0 Request processed in 53us (86us total) trans 4295010131 rc 0/0 00000100:00100000:2.0:1713279306.867905:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3649:11879:x1796503281256256:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 269us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.867906:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110543 00010000:00010000:1.0:1713279306.867907:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda9bae lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.867911:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda9bae lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.867911:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785345 00010000:00010000:0.0:1713279306.867913:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda9bb5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.867915:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda9bae lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.867918:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda9bb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.867920:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda9bbc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.867922:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda9bb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.867924:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda9bbc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.867926:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.867927:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114eda9bc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.867927:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda9bbc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.867931:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114eda9bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.867934:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114eda9bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.867937:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda9bae lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.867938:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.867940:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda9bae lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.867943:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda9bae lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.867946:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda9bae lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.867948:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d2d7a80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.867949:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281256512 00010000:00010000:1.0:1713279306.867950:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda9bae lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.867953:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda9bae lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.867953:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281256512 00010000:00010000:1.0:1713279306.867957:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880130675300) 00000100:00100000:3.0:1713279306.867957:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.867958:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:0.0:1713279306.867960:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.867960:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda9bae lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.867962:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114eda9bae lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.867963:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281257344 00010000:00010000:0.0:1713279306.867964:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda9bb5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:3.0:1713279306.867965:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281257344 00010000:00010000:1.0:1713279306.867967:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda9bbc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.867968:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda9bb5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.867968:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785350 00010000:00010000:1.0:1713279306.867969:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda9bbc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.867970:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda9bb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.867972:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda9bbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.867972:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:11204:x1796503281256512:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.867974:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda9bb5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:3.0:1713279306.867974:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223090 00010000:00010000:1.0:1713279306.867975:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d2d58c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.867976:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda9bbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.867976:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:11986:x1796503281257344:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:0.0:1713279306.867977:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.867978:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda9bb5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.867979:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda9bbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.867981:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda9bb5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.867983:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff880130675a00) 00010000:00010000:0.0:1713279306.867985:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.867985:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.867986:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.867986:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281257408 00010000:00010000:1.0:1713279306.867987:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda9bbc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.867988:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda9bb5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.867988:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281257408 00010000:00010000:0.0:1713279306.867990:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114eda9bb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.867995:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114eda9bbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.867996:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114eda9bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.867998:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114eda9bc3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.868001:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114eda9bc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.868001:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147268 00010000:00010000:0.0:1713279306.868004:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.868005:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114eda9bc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.868005:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:1957:x1796503281257408:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.868008:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114eda9bc3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.868011:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.868012:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092455d40/0xfc4b8e114eda9ba7 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dde expref: 3648 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.868014:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff8801250c1a00) 00010000:00010000:0.0:1713279306.868015:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.868017:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114eda9bc3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.868019:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114eda9bc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.868019:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092455d40/0xfc4b8e114eda9ba7 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dde expref: 3648 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.868019:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114eda9740 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x7fe9:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cc6 expref: 3726 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.868028:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092455d40, rc 0) 00010000:00010000:2.0:1713279306.868028:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:0.0:1713279306.868031:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda9ba0 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dd7 expref: 3725 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.868031:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.868033:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11986:x1796503281257344:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 55us (74us total) trans 4295202756 rc 0/0 00010000:00010000:0.0:1713279306.868035:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114eda9ba0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dd7 expref: 3725 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.868037:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223090 00010000:00010000:0.0:1713279306.868040:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d322400, rc 0) 00000100:00100000:1.0:1713279306.868043:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3647:11912:x1796503281256384:12345-192.168.203.4@tcp:101:touch.0 Request processed in 165us (198us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.868045:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:1957:x1796503281257408:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 39us (118us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.868047:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.868049:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785349 00000100:00100000:0.0:1713279306.868050:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3724:11993:x1796503281256192:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 181us (250us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.868051:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147268 00010000:00010000:3.0:1713279306.868053:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda9bca lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175de5 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.868054:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785348 00010000:00010000:3.0:1713279306.868088:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda9bd1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.868094:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda9bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.868099:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda9bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1713279306.868102:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.868104:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9bd8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.868108:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.868111:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1713279306.868116:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281256832 00000100:00100000:1.0:1713279306.868119:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281256832 00010000:00010000:3.0:1713279306.868124:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda9bd1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.868130:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda9bd1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.868133:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda9bd1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.868136:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda9bd1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1713279306.868139:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785351 00010000:00010000:3.0:1713279306.868139:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd12ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.868140:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda9bd1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1713279306.868142:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.868143:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda9bd1 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1713279306.868144:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3647:11995:x1796503281256832:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.868147:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:3.0:1713279306.868149:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.868151:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281256960 00010000:00010000:3.0:1713279306.868151:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda9bd1 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.868152:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.868153:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281256960 00010000:00010000:3.0:1713279306.868153:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114eda9bd1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.868158:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.868161:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda9bdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175dec expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.868161:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9bd8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.868164:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.868166:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd11f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.868168:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1713279306.868169:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785352 00010000:00010000:3.0:1713279306.868171:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9bd8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1713279306.868172:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3724:11711:x1796503281256960:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.868174:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880089dc3900) 00010000:00010000:3.0:1713279306.868176:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.868177:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9bd8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.868178:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.868179:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11f80/0xfc4b8e114eda9bd8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.868183:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda9be6 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175df3 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.868190:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda9bca lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175de5 expref: 3724 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.868194:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11440/0xfc4b8e114eda9bca lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175de5 expref: 3724 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.868198:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd11440, rc 0) 00000100:00100000:3.0:1713279306.868208:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:11204:x1796503281256512:12345-192.168.203.4@tcp:101:touch.0 Request processed in 235us (270us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.868212:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785350 00010000:00010000:0.0:1713279306.868223:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda9bed lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868237:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda9bed lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868241:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda9bed lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000004:00200000:1.0:1713279306.868242:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7693:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.868246:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114eda9bf4 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868250:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114eda9bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868253:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114eda9bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000004:00200000:0.0:1713279306.868260:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:0.0:1713279306.868265:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda9bed lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868267:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda9bed lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868270:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda9bed lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868273:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda9bed lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868276:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.868278:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda9bed lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.868280:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda9bdf lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dec expref: 3649 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.868281:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda9bed lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868285:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8801250c1600) 00010000:00010000:0.0:1713279306.868286:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.868287:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114eda9bdf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dec expref: 3649 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.868288:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda9bed lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868290:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114eda9bed lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868295:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114eda9bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868298:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114eda9bf4 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868300:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114eda9bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868302:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801312f6640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.868302:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958d6ac0, rc 0) 00010000:00010000:0.0:1713279306.868304:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114eda9bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868307:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114eda9bf4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868310:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880131204400) 00010000:00010000:0.0:1713279306.868311:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.868312:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114eda9bf4 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.868315:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114eda9bf4 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.868317:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3648:11995:x1796503281256832:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 172us (214us total) trans 4295183749 rc 301/301 00000100:00100000:1.0:1713279306.868323:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785351 00010000:00010000:0.0:1713279306.868328:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda9be6 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175df3 expref: 3725 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.868332:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114eda9be6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175df3 expref: 3725 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.868338:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3218c0, rc 0) 00000100:00100000:0.0:1713279306.868348:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3724:11711:x1796503281256960:12345-192.168.203.4@tcp:101:touch.0 Request processed in 175us (206us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.868352:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785352 00000100:00100000:0.0:1713279306.870917:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.870939:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.870955:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.870965:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.870968:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.870980:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.870984:0:6943:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281257728 00000100:00100000:0.0:1713279306.870987:0:6943:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281257728 00000100:00100000:1.0:1713279306.870996:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281257856 00000100:00100000:3.0:1713279306.870997:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281257600 00000100:00100000:0.0:1713279306.871001:0:6943:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281258112 00000100:00100000:1.0:1713279306.871001:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281257856 00000100:00100000:3.0:1713279306.871002:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281257600 00000100:00100000:0.0:1713279306.871003:0:6943:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281258112 00000100:00100000:2.0:1713279306.871009:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.871011:0:6943:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14354 00000100:00100000:0.0:1713279306.871014:0:6943:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:10814:x1796503281257728:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:3.0:1713279306.871018:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110544 00000100:00100000:3.0:1713279306.871022:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+87:1957:x1796503281257600:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:1.0:1713279306.871023:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281257984 00000100:00100000:1.0:1713279306.871025:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281257984 00010000:00010000:0.0:1713279306.871029:0:6943:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.871030:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281258176 00000100:00100000:2.0:1713279306.871033:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281258176 00010000:00010000:0.0:1713279306.871038:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a6f40/0xfc4b8e114ed4f754 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3915aab8 expref: 3724 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.871041:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785353 00010000:00010000:0.0:1713279306.871046:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x83dc:0x0].0x0 (ffff88008f645500) 00000100:00100000:1.0:1713279306.871046:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3395:11666:x1796503281257856:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.871048:0:6943:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.871052:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785354 00010000:00010000:0.0:1713279306.871054:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.871056:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.871056:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3724:11992:x1796503281257984:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.871061:0:6943:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda9ae3 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9ac7 expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.871063:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.871065:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda9c09 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6c09:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175dfa expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.871066:0:6943:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.871078:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda9c10 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e01 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713279306.871092:0:15506:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0xefd:0x0] updating lvb size from disk: 7667712 -> 7667712 00002000:00010000:3.0:1713279306.871094:0:15506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xefd:0x0] updating lvb mtime from disk: 1713279305 -> 1713279305 00002000:00010000:3.0:1713279306.871096:0:15506:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0xefd:0x0] updating lvb atime from disk: 1713279305 -> 1713279305 00002000:00010000:3.0:1713279306.871098:0:15506:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0xefd:0x0] updating lvb ctime from disk: 1713279305 -> 1713279305 00002000:00010000:3.0:1713279306.871099:0:15506:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0xefd:0x0] updating lvb blocks from disk: 14976 -> 14976 00010000:00010000:2.0:1713279306.871112:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda9c17 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x84eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1713279306.871119:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+88:1957:x1796503281257600:12345-192.168.203.4@tcp:2:touch.0 Request processed in 96us (180us total) trans 4295010189 rc 0/0 00010000:00010000:1.0:1713279306.871120:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092542640/0xfc4b8e114eda9c1e lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6c09:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.871120:0:15474:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076cb40/0xfc4b8e114eda8d0d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a03 expref: 3725 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.871123:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110544 00010000:00010000:2.0:1713279306.871125:0:15474:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda99c4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d7c expref: 3723 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.871128:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092542640/0xfc4b8e114eda9c1e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6c09:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.871129:0:15474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda9c17 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x84eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.871136:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092542640/0xfc4b8e114eda9c1e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6c09:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:3.0:1713279306.871136:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281257536 00010000:00010000:0.0:1713279306.871138:0:6943:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda9ae3 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9ac7 expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.871138:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281257536 00010000:00010000:2.0:1713279306.871139:0:15474:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda99c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d7c expref: 3723 pid: 15658 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713279306.871141:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x6c09:0x0]: returning size 5 00010000:00010000:0.0:1713279306.871144:0:6943:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.871144:0:15474:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda99c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d7c expref: 3724 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.871146:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223091 00000100:00100000:3.0:1713279306.871149:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:11976:x1796503281257536:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.871150:0:15474:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096755180 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000_UUID:15474:1796503200054080:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.871158:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14355 00000100:00100000:0.0:1713279306.871161:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:385c4b71-808c-40cf-91de-b076b668d13f+3648:11879:x1796503281258112:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:2.0:1713279306.871169:0:15474:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013076cb40/0xfc4b8e114eda8d0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a03 expref: 3725 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.871174:0:15474:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076cb40/0xfc4b8e114eda8d0d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a03 expref: 3725 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.871176:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114eda9c09 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6c09:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dfa expref: 3398 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.871179:0:15474:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096756680 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000_UUID:15474:1796503200054144:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.871183:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092542640/0xfc4b8e114eda9c1e lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6c09:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dfa expref: 3397 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.871185:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713279306.871186:0:15474:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606c180 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.871188:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6c09:0x0].0x0 (ffff880122263f00) 00010000:00010000:0.0:1713279306.871189:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.871190:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1713279306.871191:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542640, rc 0) 00010000:00010000:0.0:1713279306.871193:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713279306.871196:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785355 00000100:00100000:3.0:1713279306.871198:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11976:x1796503281257536:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 47us (241us total) trans 4295202757 rc 0/0 00000100:00100000:2.0:1713279306.871199:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11974:x1796503281258176:12345-192.168.203.4@tcp:101:mkdir.0 00000100:00100000:0.0:1713279306.871200:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121984000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200054208:0@lo:101:mdt_io00_007.0 00000100:00100000:3.0:1713279306.871202:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223091 00010000:00010000:2.0:1713279306.871204:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.871208:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3397:11666:x1796503281257856:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 162us (292us total) trans 4295183750 rc 0/0 00010000:00010000:2.0:1713279306.871209:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114eda9c33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e08 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.871212:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785353 00000100:00100000:0.0:1713279306.871216:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.871224:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800965406c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.871227:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda9c3a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.871231:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda9c3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.871232:0:15526:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff8801313c3800 x1796503200053952) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880122207180/0xfc4b8e114eda9778 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cdb expref: 3648 pid: 15481 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.871235:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200054208 00010000:00010000:2.0:1713279306.871236:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda9c3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.871237:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200054208 00000100:00100000:3.0:1713279306.871238:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.871240:0:15526:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880122207180/0xfc4b8e114eda9778 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cdb expref: 3648 pid: 15481 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.871242:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda9c41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.871245:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda9c41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.871247:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122207180/0xfc4b8e114eda9778 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cdb expref: 3648 pid: 15481 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.871248:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda9c41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.871249:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98886 00000100:00100000:0.0:1713279306.871251:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15514:x1796503200054208:12345-0@lo:101:mdt_io00_007.0 00000100:00100000:3.0:1713279306.871252:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281258240 00000100:00100000:1.0:1713279306.871253:0:15526:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_010:lustre-MDT0001_UUID:15526:1796503200053952:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.871255:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281258240 00010000:00010000:0.0:1713279306.871256:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.871259:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71e6:0x0].0x0 (ffff880090bee600) 00010000:00010000:0.0:1713279306.871262:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda9c48 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda9c2c expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.871262:0:15526:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871265:0:15526:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871268:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279306.871270:0:15494:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.871270:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda9c4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7ccb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.871270:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110545 00010000:00010000:2.0:1713279306.871273:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda9c4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7ccb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.871274:0:15494:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda9c48 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda9c2c expref: 56 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.871274:0:15526:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00000100:00100000:3.0:1713279306.871275:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+97:1956:x1796503281258240:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:2.0:1713279306.871277:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda9c4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7ccb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.871278:0:15526:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279306.871280:0:15494:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.871281:0:15526:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279306.871285:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda9c48 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9c2c expref: 56 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.871289:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:0.0:1713279306.871290:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.871292:0:15494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 56 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.871296:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092345440, rc 0) 00000100:00100000:0.0:1713279306.871309:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15514:x1796503200054208:12345-0@lo:101:mdt_io00_007.0 Request processed in 57us (93us total) trans 0 rc 0/0 00000004:00200000:2.0:1713279306.871311:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7ccb:0x0]: returning size 4096 00000100:00100000:0.0:1713279306.871313:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98886 00000004:00200000:2.0:1713279306.871313:0:15473:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1713279306.871320:0:15473:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda9c4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7ccb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.871324:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda9c3a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00002000:00010000:3.0:1713279306.871326:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb size from disk: 46934 -> 46934 00000100:00100000:0.0:1713279306.871327:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121984000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200054208:0@lo:101:mdt_io00_007.0 00010000:00010000:2.0:1713279306.871328:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda9c3a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00002000:00010000:3.0:1713279306.871328:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.871330:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00010000:00010000:2.0:1713279306.871331:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda9c3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00002000:00010000:3.0:1713279306.871331:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.871332:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb blocks from disk: 64 -> 64 00010000:00010000:0.0:1713279306.871333:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.871334:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda9c3a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.871336:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134a41f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.871337:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.871338:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda9c3a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.871341:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda9c3a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.871345:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00000100:00100000:3.0:1713279306.871345:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+98:1956:x1796503281258240:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 70us (107us total) trans 4295010132 rc 0/0 00010000:00010000:2.0:1713279306.871347:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.871348:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda9c3a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.871351:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a41f80/0xfc4b8e114eda9c3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.871351:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110545 00010000:00010000:2.0:1713279306.871355:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda9c41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.871358:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda9c41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.871361:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda9c41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.871364:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134a40b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.871366:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda9c41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.871369:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda9c41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.871372:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x30 (ffff88012fbfed00) 00010000:00010000:2.0:1713279306.871374:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.871375:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda9c41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.871377:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40b40/0xfc4b8e114eda9c41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.871388:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114eda9c33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e08 expref: 3726 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.871394:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a40240/0xfc4b8e114eda9c4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7ccb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e08 expref: 3725 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.871397:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ccb:0x0].0x0 (ffff88012fbfe400) 00010000:00010000:2.0:1713279306.871398:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713279306.871399:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134a40240, rc 0) 00000100:00100000:2.0:1713279306.871432:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11974:x1796503281258176:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 232us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.871436:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785355 00000004:00010000:1.0:1713279306.871439:0:15526:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880098cca300 reply state ffff88012b12c000 transno 4295183751 ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871449:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871454:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71e6:0x0].0x0 (ffff880090bee600) 00010000:00010000:1.0:1713279306.871456:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1713279306.871458:0:15526:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713279306.871462:0:15526:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda9b5a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871467:0:15526:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda9b5a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871472:0:15526:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda9b5a lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871477:0:15526:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda9b5a lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871482:0:15526:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097887cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.871484:0:15526:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda9b5a lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871489:0:15526:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda9b5a lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871499:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880130675e00) 00010000:00010000:1.0:1713279306.871501:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.871502:0:15526:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda9b5a lrc: 3/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871506:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114eda9b5a lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00000004:00010000:1.0:1713279306.871513:0:15526:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880098cca300 reply state ffff88012b12c000 transno 4295183751 ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9b61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871517:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9b61 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871520:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3831 (ffff880130675100) 00010000:00010000:1.0:1713279306.871521:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.871522:0:15526:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1713279306.871525:0:15526:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871528:0:15526:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871530:0:15526:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871533:0:15526:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871536:0:15526:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe15f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.871537:0:15526:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871543:0:15526:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871548:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x13a:0x0].0x0 (ffff880123701d00) 00010000:00010000:1.0:1713279306.871550:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.871552:0:15526:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871557:0:15526:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114eda9a50 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00000004:00010000:1.0:1713279306.871566:0:15526:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880098cca300 reply state ffff88012b12c000 transno 4295183751 ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda9b4c lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871572:0:15526:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda9b4c lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:1.0:1713279306.871577:0:15526:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x13a:0x0].0x3831 (ffff880130675800) 00010000:00010000:1.0:1713279306.871579:0:15526:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.871580:0:15526:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000004:00080000:1.0:1713279306.871585:0:15526:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x84a3:0x0] 00010000:00010000:1.0:1713279306.871591:0:15526:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 6 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.871596:0:15526:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 6 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.871602:0:15526:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 6 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.871620:0:15526:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1713279306.871637:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.871642:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 6 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.871647:0:9214:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ecb40 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.871650:0:9214:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.871654:0:9214:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.871657:0:15526:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_010:385c4b71-808c-40cf-91de-b076b668d13f+3649:11876:x1796503281250624:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 16257us (16312us total) trans 4295183751 rc 0/0 00000100:00100000:1.0:1713279306.871663:0:15526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14349 00000100:00100000:0.0:1713279306.871665:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.871669:0:9214:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.871672:0:9214:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.871689:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.871693:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.871693:0:9214:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801298ecb40/0xfc4b8e114eda987b lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9889 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.871696:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200054272:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.871702:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.871703:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279306.871705:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281258368 00010000:00010000:3.0:1713279306.871705:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279306.871708:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281258368 00000100:00100000:0.0:1713279306.871710:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.871712:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281258624 00000100:00100000:3.0:1713279306.871714:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281258624 00000100:00100000:1.0:1713279306.871715:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.871722:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.871725:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785356 00000100:00100000:3.0:1713279306.871729:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223092 00000100:00100000:2.0:1713279306.871730:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3397:11204:x1796503281258368:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.871734:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130145c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11981:x1796503281258624:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1713279306.871740:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200054272 00000100:00100000:2.0:1713279306.871742:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200054272 00000100:00100000:0.0:1713279306.871750:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.871751:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda9889 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfc4b8e114eda987b expref: 56 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.871761:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281258496 00000100:00100000:0.0:1713279306.871763:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281258496 00000100:00100000:2.0:1713279306.871764:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196561 00000100:00100000:1.0:1713279306.871766:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281258752 00000100:00100000:2.0:1713279306.871768:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+56:3492:x1796503200054272:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.871769:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281258752 00010000:00010000:2.0:1713279306.871774:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.871775:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785357 00000100:00100000:0.0:1713279306.871779:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3650:11912:x1796503281258496:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.871784:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.871785:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785358 00000100:00100000:1.0:1713279306.871789:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3650:11711:x1796503281258752:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.871790:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda9c56 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e16 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.871797:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.871803:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130145c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3726:11981:x1796503281258624:12345-192.168.203.4@tcp:35:touch.0 Request processed in 68us (138us total) trans 4295202758 rc 0/0 00010000:00010000:1.0:1713279306.871807:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda9c5d lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e1d expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.871808:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223092 00010000:00010000:2.0:1713279306.871815:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.871824:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda9c64 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e0f expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.871827:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281258816 00000100:00100000:3.0:1713279306.871830:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281258816 00010000:00010000:1.0:1713279306.871837:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda9c6b lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.871838:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110546 00000100:00100000:3.0:1713279306.871840:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+84:11988:x1796503281258816:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.871844:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda9c6b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.871845:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.871851:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda9c6b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.871852:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda9c72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e24 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.871859:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda9c79 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00002000:00010000:3.0:1713279306.871861:0:15506:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x105b:0x0] initial LVB size: 27670, mtime: 0x661e914a, atime: 0x0, ctime: 0x661e914a, blocks: 0x50 00010000:00010000:1.0:1713279306.871865:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda9c79 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.871868:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d200/0xfc4b8e114eda9c80 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.871868:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.871869:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.871870:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda9c79 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.871875:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d200/0xfc4b8e114eda9c80 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.871875:0:15506:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda9c72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e24 expref: 85 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.871882:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d200/0xfc4b8e114eda9c80 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.871885:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd12400/0xfc4b8e114eda9c72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e24 expref: 85 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.871889:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda9c6b lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.871890:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda9c87 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.871893:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd12400, rc 0) 00010000:00010000:1.0:1713279306.871894:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda9c6b lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.871896:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda9c87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.871898:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda9c6b lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.871901:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda9c87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.871902:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda9c6b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.871906:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925433c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.871908:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda9c6b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.871908:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+85:11988:x1796503281258816:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 66us (198us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.871913:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda9c6b lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.871914:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110546 00000004:00200000:2.0:1713279306.871915:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:0.0:1713279306.871919:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda9c8e lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.871919:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880130675d00) 00010000:00010000:1.0:1713279306.871921:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.871921:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d200/0xfc4b8e114eda9c80 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.871923:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda9c6b lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.871924:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda9c8e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.871926:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d200/0xfc4b8e114eda9c80 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.871927:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114eda9c6b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.871929:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda9c8e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.871931:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d200/0xfc4b8e114eda9c80 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.871934:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda9c79 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.871935:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d200/0xfc4b8e114eda9c80 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.871936:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda9c95 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.871937:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda9c79 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.871939:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda9c95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.871940:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda9c79 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.871940:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942d200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.871942:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d200/0xfc4b8e114eda9c80 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.871943:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda9c95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.871943:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.871944:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda9c79 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.871947:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda9c79 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.871947:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d200/0xfc4b8e114eda9c80 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.871951:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880130675200) 00010000:00010000:1.0:1713279306.871952:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:0.0:1713279306.871953:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:1.0:1713279306.871953:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda9c79 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.871954:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:1.0:1713279306.871955:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114eda9c79 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.871956:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.871958:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d200/0xfc4b8e114eda9c80 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.871959:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda9c8e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.871962:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d200/0xfc4b8e114eda9c80 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.871963:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda9c8e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.871966:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda9c8e lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.871969:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda9c8e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.871969:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda9c5d lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e1d expref: 3652 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.871969:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda9c87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.871971:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fef8b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.871973:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda9c8e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.871973:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114eda9c5d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e1d expref: 3652 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.871973:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda9c87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.871976:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda9c8e lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.871977:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda9c87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.871979:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925421c0, rc 0) 00010000:00010000:0.0:1713279306.871980:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880129b60f00) 00010000:00010000:0.0:1713279306.871981:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.871981:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe16f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.871983:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda9c8e lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.871984:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda9c87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.871985:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114eda9c8e lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.871988:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda9c87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.871992:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3651:11711:x1796503281258752:12345-192.168.203.4@tcp:101:touch.0 Request processed in 204us (242us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.871993:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88012fbfe200) 00010000:00010000:2.0:1713279306.871994:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.871996:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785358 00010000:00010000:2.0:1713279306.871996:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda9c87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.872000:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114eda9c87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.872016:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda9c95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.872018:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda9c64 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e0f expref: 3398 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.872019:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda9c95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.872023:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114eda9c64 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e0f expref: 3398 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.872025:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda9c95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.872027:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800943f3600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.872028:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008957c900, rc 0) 00010000:00010000:0.0:1713279306.872029:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda9c95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.872031:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda9c95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.872035:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88008ad67b00) 00010000:00010000:0.0:1713279306.872036:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.872037:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda9c95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.872040:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114eda9c95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.872045:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3397:11204:x1796503281258368:12345-192.168.203.4@tcp:101:touch.0 Request processed in 315us (353us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.872051:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785356 00010000:00010000:0.0:1713279306.872054:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda9c56 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e16 expref: 3650 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.872058:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114eda9c56 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e16 expref: 3650 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.872064:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312c58c0, rc 0) 00000100:00100000:0.0:1713279306.872144:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3649:11912:x1796503281258496:12345-192.168.203.4@tcp:101:touch.0 Request processed in 363us (419us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.872148:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785357 00000001:00080000:0.0:1713279306.872440:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202758 is committed 00000001:00080000:0.0:1713279306.872449:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202755 is committed 00000020:00080000:0.0:1713279306.872466:0:6911:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 16412 batchid updated 00010000:00010000:2.0:1713279306.872471:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9aea lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8284:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.872478:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9aea lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8284:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.872481:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda98d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.872483:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9aea lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8284:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.872487:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda98d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.872491:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b1b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.872494:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9aea lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8284:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.872495:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda98d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.872498:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906eb600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.872499:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9aea lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8284:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.872501:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda98d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.872505:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda98d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.872506:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8284:0x0].0x0 (ffff88008ad67600) 00010000:00010000:2.0:1713279306.872508:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.872510:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9aea lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8284:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.872512:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x34 (ffff8801250c1300) 00010000:00010000:1.0:1713279306.872514:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.872515:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800926b1b00/0xfc4b8e114eda9aea lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8284:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.872516:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda98d6 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x14f:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.872517:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114eda9889 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfc4b8e114eda987b expref: 56 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.872520:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114eda98d6 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x14f:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.872527:0:6915:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.872530:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114eda98e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.872530:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1713279306.872534:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16412 00010000:00010000:1.0:1713279306.872535:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114eda98e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.872535:0:6915:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.872539:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114eda98e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.872539:0:6915:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.872543:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e9680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.872543:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.872546:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114eda98e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.872550:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114eda98e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.872554:0:6915:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.872555:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x34 (ffff8801250c1700) 00010000:00010000:1.0:1713279306.872557:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.872559:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114eda98e4 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00000100:00100000:3.0:1713279306.872560:0:6915:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7ead80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6915:1796503200054336:0@lo:105: 00000004:00080000:2.0:1713279306.872562:0:6958:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009606cd80 with version 29439 00010000:00010000:1.0:1713279306.872563:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114eda98e4 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x148:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00000020:00080000:2.0:1713279306.872566:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16412 cancel update log [0x240000401:0xf2:0x0].679: rc = 0 00010000:00010000:1.0:1713279306.872571:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.872575:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00000100:00100000:3.0:1713279306.872576:0:6915:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.872579:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.872582:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906eba80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.872584:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.872588:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00000020:00080000:2.0:1713279306.872592:0:6958:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16412 cancel update log [0x200000400:0x1b7:0x0].194: rc = 0 00000100:00100000:3.0:1713279306.872592:0:6915:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0300 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.872593:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x854f:0x0].0x0 (ffff88008dba4d00) 00010000:00010000:1.0:1713279306.872594:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000020:00080000:2.0:1713279306.872595:0:6958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16412 00010000:00010000:1.0:1713279306.872596:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00000004:00080000:2.0:1713279306.872599:0:8634:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a975b780 version 29439 rpc_version 29439 00000100:00100000:0.0:1713279306.872600:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200054336 00010000:00010000:1.0:1713279306.872600:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114eda98eb lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x854f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00000100:00100000:0.0:1713279306.872603:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200054336 00000020:00100000:2.0:1713279306.872611:0:8634:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.872615:0:8634:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880096756a00 x1796503200054464/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.872620:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33448 00000100:00100000:0.0:1713279306.872623:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6915:x1796503200054336:12345-0@lo:105: 00000100:00100000:2.0:1713279306.872624:0:8634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096756a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200054464:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713279306.872629:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.872634:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.872638:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.872642:0:9213:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.872645:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.872645:0:8634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.872649:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.872653:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.872660:0:8634:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012edd90c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.872661:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88012baf7cc0) 00010000:00010000:2.0:1713279306.872672:0:15502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.872676:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200054464 00010000:00010000:2.0:1713279306.872678:0:15502:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.872680:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6915:x1796503200054336:12345-0@lo:105: Request processed in 56us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.872680:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200054464 00000100:00100000:0.0:1713279306.872683:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33448 00000004:00080000:2.0:1713279306.872686:0:15502:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1713279306.872694:0:6915:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7ead80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6915:1796503200054336:0@lo:105: 00000100:00100000:1.0:1713279306.872698:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98887 00000100:00100000:1.0:1713279306.872701:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac44a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+91:8634:x1796503200054464:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713279306.872703:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.872719:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda9c9c lrc: 3/0,1 mode: --/CW res: [0x240000403:0x74de:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15502 initiator: MDT0 00010000:00010000:2.0:1713279306.872723:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda9c9c lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x74de:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00000100:00100000:3.0:1713279306.872726:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+55:3492:x1796503200054272:12345-0@lo:103:ldlm_bl.0 Request processed in 956us (1009us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.872727:0:15502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda9c9c lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x74de:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00000100:00100000:0.0:1713279306.872730:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200054272:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.872732:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda9ca3 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x74de:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15502 initiator: MDT0 00000100:00100000:3.0:1713279306.872732:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196561 00010000:00010000:2.0:1713279306.872735:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda9ca3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x74de:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.872738:0:15502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda9ca3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x74de:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.872749:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 3/0,1 mode: --/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15502 initiator: MDT0 00010000:00010000:2.0:1713279306.872754:0:15502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda959c lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x74e5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c72 expref: 3396 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.872758:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac44a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+92:8634:x1796503200054464:12345-0@lo:1000:osp_up1-0.0 Request processed in 56us (113us total) trans 4295183752 rc 0/0 00010000:00010000:2.0:1713279306.872758:0:15502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 4/0,1 mode: --/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279306.872763:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98887 00010000:00010000:2.0:1713279306.872768:0:15502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda959c lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x74e5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c72 expref: 3396 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.872773:0:15502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda959c lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x74e5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c72 expref: 3396 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.872775:0:8634:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096756a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8634:1796503200054464:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1713279306.872779:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096755500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200054528:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.872795:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a840 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.872914:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.872926:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.872928:0:15474:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096755180 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000_UUID:15474:1796503200054080:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.872933:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281259392 00000100:00100000:3.0:1713279306.872937:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281259392 00000100:00100000:2.0:1713279306.872942:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.872945:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281258880 00000100:00100000:3.0:1713279306.872947:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281258880 00010000:00010000:3.0:1713279306.872957:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda99c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d7c expref: 3713 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.872959:0:15474:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096756680 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000_UUID:15474:1796503200054144:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.872971:0:15474:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda9c17 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x84eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1713279306.872973:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196562 00000100:00100000:0.0:1713279306.872976:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.872977:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:1957:x1796503281258880:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.872984:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.872987:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281259520 00010000:00010000:3.0:1713279306.872988:0:6915:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda99c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d7c expref: 3713 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.872991:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.872991:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281259520 00010000:00010000:3.0:1713279306.872996:0:6915:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda99c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d7c expref: 3714 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.872999:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.873005:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281259648 00000100:00100000:1.0:1713279306.873007:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281258944 00010000:00010000:3.0:1713279306.873007:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe17cc0/0xfc4b8e114eda99c4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d7c expref: 3714 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.873008:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281259648 00000100:00100000:1.0:1713279306.873010:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281258944 00000100:00100000:0.0:1713279306.873011:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.873016:0:6915:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84eb:0x0].0x0 (ffff88012061ff00) 00010000:00010000:3.0:1713279306.873020:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda9c17 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x84eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1713279306.873022:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281259072 00000100:00100000:1.0:1713279306.873024:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110547 00000100:00100000:2.0:1713279306.873024:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281259072 00010000:00010000:3.0:1713279306.873026:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda9c17 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x84eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1713279306.873028:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+88:1957:x1796503281258944:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:2.0:1713279306.873031:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076cb40/0xfc4b8e114eda8d0d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a03 expref: 3720 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.873031:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.873041:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196563 00010000:00010000:1.0:1713279306.873043:0:11415:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092540900/0xfc4b8e114eda9cb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.873044:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121403100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:385c4b71-808c-40cf-91de-b076b668d13f+3720:1955:x1796503281259072:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.873047:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.873047:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:1957:x1796503281258880:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 70us (120us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.873048:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.873051:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013076cb40/0xfc4b8e114eda8d0d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a03 expref: 3720 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.873052:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196562 00010000:00010000:1.0:1713279306.873053:0:11415:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d29440/0xfc4b8e114ecedee7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x40000080020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913d572 expref: 88 pid: 9198 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.873059:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013076cb40/0xfc4b8e114eda8d0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a03 expref: 3720 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.873060:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.873061:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.873064:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092540900/0xfc4b8e114eda9cb1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.873065:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281259776 00010000:00010000:2.0:1713279306.873076:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076cb40/0xfc4b8e114eda8d0d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175a03 expref: 3720 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.873078:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281259776 00010000:00010000:2.0:1713279306.873082:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84eb:0x0].0x0 (ffff88012061ff00) 00010000:00010000:2.0:1713279306.873085:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda9c17 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x84eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1713279306.873086:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.873088:0:15492:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda9c17 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x84eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1713279306.873089:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281259200 00000100:00100000:3.0:1713279306.873090:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281259200 00010000:00010000:2.0:1713279306.873091:0:15492:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda9c17 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x84eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.873093:0:11415:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d29440/0xfc4b8e114ecedee7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x50000080020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913d572 expref: 88 pid: 9198 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.873097:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785359 00010000:00010000:2.0:1713279306.873099:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.873100:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11204:x1796503281259520:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.873102:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.873102:0:11415:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d29440/0xfc4b8e114ecedee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x70000480020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913d572 expref: 88 pid: 9198 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.873107:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.873112:0:11415:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11415:1796503200054592:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.873112:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda9cb8 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e32 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.873119:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121403100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:385c4b71-808c-40cf-91de-b076b668d13f+3719:1955:x1796503281259072:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 74us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.873123:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196563 00000100:00100000:1.0:1713279306.873131:0:11415:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096e070c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.873132:0:15474:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda9c17 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x84eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.873136:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda9c17 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x84eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.873137:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda9cbf lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000004:00200000:2.0:1713279306.873141:0:15474:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x84eb:0x0]: returning size 6184 00000100:00100000:1.0:1713279306.873143:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785360 00010000:00010000:3.0:1713279306.873145:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda9cbf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.873148:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3650:11912:x1796503281259648:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.873151:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda9cbf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.873157:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.873160:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda9ccd lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.873164:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda9cd4 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e39 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.873166:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda9ccd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.873171:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda9ccd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.873174:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114eda9c10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e01 expref: 3720 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.873184:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda9c17 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x84eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e01 expref: 3719 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.873188:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84eb:0x0].0x0 (ffff88012061ff00) 00010000:00010000:1.0:1713279306.873189:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda9cdb lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.873189:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda9cbf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.873190:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1713279306.873191:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801222058c0, rc 0) 00010000:00010000:3.0:1713279306.873194:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda9cbf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.873195:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda9cdb lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.873200:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda9cbf lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.873201:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda9cdb lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.873203:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda9cbf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.873205:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3719:11992:x1796503281257984:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 2149us (2238us total) trans 4295202759 rc 0/0 00010000:00010000:3.0:1713279306.873206:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e8b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.873208:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda9cbf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.873209:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda9ce2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.873209:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785354 00010000:00010000:3.0:1713279306.873211:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda9cbf lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.873214:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda9ce2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.873215:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00000100:00100000:2.0:1713279306.873217:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785361 00010000:00010000:3.0:1713279306.873217:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.873218:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda9cbf lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.873220:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda9ce2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:2.0:1713279306.873220:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3397:11981:x1796503281259776:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.873221:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114eda9cbf lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.873225:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.873226:0:15474:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1713279306.873227:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda9ccd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.873229:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda9ccd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.873232:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114eda90ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ff:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175b30 expref: 3397 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.873233:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda9cdb lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.873233:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda9ccd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.873235:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906eb3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.873236:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda9cdb lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.873236:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda9ccd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.873237:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x1ff:0x0].0x0 (ffff88007f009300) 00010000:00010000:3.0:1713279306.873239:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda9ccd lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.873240:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda9cdb lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.873242:0:15474:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.873245:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda9cdb lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.873245:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880135885c00) 00010000:00010000:2.0:1713279306.873246:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda9ce9 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e40 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.873247:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.873248:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.873248:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda9ccd lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.873250:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda9cdb lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.873251:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb3c0/0xfc4b8e114eda9ccd lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.873253:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda9cdb lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.873257:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88008e8c9200) 00010000:00010000:1.0:1713279306.873258:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.873260:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda9cdb lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.873262:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114eda9cdb lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.873265:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda9cf0 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.873266:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda9cb8 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e32 expref: 3713 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.873267:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda9ce2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.873269:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda9cf0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.873270:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda9ce2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.873272:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801237d9b00/0xfc4b8e114eda9cb8 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e32 expref: 3713 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.873273:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda9ce2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.873275:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda9cf0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.873276:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092542880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.873277:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda9ce2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.873279:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801237d9b00, rc 0) 00010000:00010000:1.0:1713279306.873280:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda9ce2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.873280:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114eda9cf7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ff:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.873283:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114eda9cf7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ff:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.873285:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88008e8c9000) 00010000:00010000:1.0:1713279306.873286:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.873287:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda9ce2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.873287:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114eda9cf7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ff:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.873290:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092542880/0xfc4b8e114eda9ce2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00000100:00100000:3.0:1713279306.873300:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11204:x1796503281259520:12345-192.168.203.4@tcp:101:touch.0 Request processed in 198us (323us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.873302:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda9cd4 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e39 expref: 3651 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.873306:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092541440/0xfc4b8e114eda9cd4 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e39 expref: 3651 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.873306:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785359 00010000:00010000:1.0:1713279306.873312:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092541440, rc 0) 00010000:00010000:2.0:1713279306.873316:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114eda9cfe lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7321:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1713279306.873319:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785362 00010000:00010000:2.0:1713279306.873320:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114eda9cfe lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7321:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00000100:00100000:3.0:1713279306.873323:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3650:11876:x1796503281259200:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:2.0:1713279306.873324:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114eda9cfe lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7321:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00000004:00200000:2.0:1713279306.873327:0:15474:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7321:0x0]: returning size 0 00000100:00100000:1.0:1713279306.873328:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3650:11912:x1796503281259648:12345-192.168.203.4@tcp:101:touch.0 Request processed in 180us (328us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.873333:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785360 00000100:00100000:1.0:1713279306.873345:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281259136 00010000:00010000:2.0:1713279306.873346:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda9cf0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00000100:00100000:1.0:1713279306.873347:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281259136 00010000:00010000:3.0:1713279306.873347:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda9d0c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.873350:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda9cf0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.873352:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda9d0c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.873353:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda9cf0 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.873356:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda9cf0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.873356:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda9d0c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.873361:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223093 00010000:00010000:2.0:1713279306.873361:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe17a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.873362:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda9cf0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.873364:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda9d13 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.873365:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3399:11855:x1796503281259136:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:2.0:1713279306.873366:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda9cf0 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.873367:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda9d13 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.873370:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x1ff:0x0].0x0 (ffff88008d729700) 00010000:00010000:3.0:1713279306.873370:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda9d13 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.873371:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.873373:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda9cf0 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.873375:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114eda9cf0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.873380:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114eda9cf7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1ff:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.873383:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114eda9cf7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ff:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.873386:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114eda9cf7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ff:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.873389:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe15680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.873390:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114eda9cf7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ff:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.873392:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114eda9cf7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ff:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.873395:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x1ff:0x0].0x3931 (ffff88008d729f00) 00010000:00010000:3.0:1713279306.873395:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda9d1a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.873397:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.873398:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114eda9cf7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ff:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.873399:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda9d1a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.873401:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114eda9cf7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ff:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.873402:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda9d1a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.873434:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114eda9ce9 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x1ff:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e40 expref: 3401 pid: 15474 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.873435:0:15482:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda9d1a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.873440:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda9d0c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.873441:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114eda9cfe lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7321:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e40 expref: 3400 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.873443:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda9d0c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.873445:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7321:0x0].0x0 (ffff880095455500) 00010000:00010000:2.0:1713279306.873446:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713279306.873446:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda9d0c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.873448:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012374c480, rc 0) 00010000:00010000:3.0:1713279306.873449:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda9d0c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.873452:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906ea640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.873454:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda9d0c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.873455:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3400:11855:x1796503281259136:12345-192.168.203.4@tcp:35:touch.0 Request processed in 87us (461us total) trans 4295183754 rc 0/0 00010000:00010000:3.0:1713279306.873457:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda9d0c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.873461:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223093 00000100:00100000:2.0:1713279306.873461:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3400:11981:x1796503281259776:12345-192.168.203.4@tcp:101:touch.0 Request processed in 240us (414us total) trans 4295183753 rc 0/0 00010000:00010000:3.0:1713279306.873461:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880135885d00) 00010000:00010000:3.0:1713279306.873463:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.873464:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785361 00010000:00010000:3.0:1713279306.873464:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda9d0c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.873467:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114eda9d0c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.873474:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda9d13 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.873478:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda9d13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.873483:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda9d13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.873487:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e9d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.873489:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda9d13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.873493:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.873493:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda9d13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.873499:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3131 (ffff88012fbfe500) 00010000:00010000:3.0:1713279306.873502:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.873504:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda9d13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.873512:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114eda9d13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.873520:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda9d1a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.873525:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda9d1a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.873529:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281259904 00010000:00010000:3.0:1713279306.873530:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda9d1a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.873532:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281259904 00010000:00010000:3.0:1713279306.873534:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e9440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.873536:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda9d1a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.873541:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda9d1a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.873547:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7364:0x0].0x0 (ffff88012bacd300) 00010000:00010000:3.0:1713279306.873549:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.873551:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda9d1a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.873554:0:15502:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880096755500 x1796503200054528) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda959c lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x74e5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c72 expref: 3399 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.873556:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9440/0xfc4b8e114eda9d1a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.873561:0:15502:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda959c lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x74e5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c72 expref: 3399 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.873567:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114eda959c lrc: 0/0,0 mode: --/PW res: [0x240000403:0x74e5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c72 expref: 3399 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.873576:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096755500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200054528:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.873581:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74e5:0x0].0x0 (ffff8800963cc400) 00000100:00100000:3.0:1713279306.873582:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3649:11876:x1796503281259200:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 258us (496us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.873583:0:15502:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 3/0,1 mode: --/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873587:0:15502:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 15502 initiator: MDT1 00000100:00100000:3.0:1713279306.873587:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785362 00010000:00010000:2.0:1713279306.873590:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873595:0:15502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873598:0:15502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00000100:00100000:3.0:1713279306.873599:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281259264 00010000:00010000:2.0:1713279306.873601:0:15502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00000100:00100000:3.0:1713279306.873601:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281259264 00000100:00100000:3.0:1713279306.873609:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110548 00000100:00100000:3.0:1713279306.873612:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b42c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+85:1955:x1796503281259264:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:0.0:1713279306.873614:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.873629:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281260032 00000100:00100000:1.0:1713279306.873633:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281260032 00010000:00010000:2.0:1713279306.873635:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873638:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873641:0:15502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873644:0:15502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe15b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.873645:0:15502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873648:0:15502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279306.873649:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223094 00010000:00010000:2.0:1713279306.873652:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74e5:0x0].0x0 (ffff8800963cc400) 00000100:00100000:1.0:1713279306.873653:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11986:x1796503281260032:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:2.0:1713279306.873653:0:15502:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00002000:00010000:3.0:1713279306.873653:0:15506:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb size from disk: 27670 -> 27670 00010000:00010000:2.0:1713279306.873655:0:15502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 2/0,0 mode: --/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00002000:00010000:3.0:1713279306.873655:0:15506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.873656:0:15506:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:2.0:1713279306.873657:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114eda9caa lrc: 0/0,0 mode: --/EX res: [0x240000403:0x74e5:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00002000:00010000:3.0:1713279306.873657:0:15506:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.873659:0:15506:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb blocks from disk: 80 -> 80 00010000:00010000:2.0:1713279306.873664:0:15502:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda9c9c lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x74de:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873667:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda9c9c lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x74de:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873670:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda9c9c lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x74de:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00000100:00100000:3.0:1713279306.873671:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b42c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+86:1955:x1796503281259264:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 58us (568us total) trans 4295010190 rc 0/0 00010000:00010000:2.0:1713279306.873672:0:15502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda9c9c lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x74de:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00000100:00100000:3.0:1713279306.873674:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110548 00010000:00010000:2.0:1713279306.873675:0:15502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe14fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.873676:0:15502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda9c9c lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x74de:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873679:0:15502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda9c9c lrc: 5/0,0 mode: CW/CW res: [0x240000403:0x74de:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873681:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74de:0x0].0x0 (ffff88009bf9a000) 00010000:00010000:2.0:1713279306.873683:0:15502:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.873684:0:15502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda9c9c lrc: 3/0,0 mode: --/CW res: [0x240000403:0x74de:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873687:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114eda9c9c lrc: 0/0,0 mode: --/CW res: [0x240000403:0x74de:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873693:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda9ca3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x74de:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00000100:00100000:3.0:1713279306.873693:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785363 00000100:00100000:3.0:1713279306.873696:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3718:11711:x1796503281259392:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.873698:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda9ca3 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x74de:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.873701:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.873702:0:15502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda9ca3 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x74de:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873707:0:15502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe14480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.873707:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda9d21 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e2b expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.873709:0:15502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda9ca3 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x74de:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873713:0:15502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda9ca3 lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x74de:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279306.873718:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11986:x1796503281260032:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 62us (103us total) trans 4295202760 rc 0/0 00010000:00010000:2.0:1713279306.873719:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74de:0x0].0x3031 (ffff88008a21ee00) 00010000:00010000:2.0:1713279306.873721:0:15502:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.873723:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223094 00010000:00010000:2.0:1713279306.873723:0:15502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda9ca3 lrc: 2/0,0 mode: --/PW res: [0x240000403:0x74de:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873728:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14480/0xfc4b8e114eda9ca3 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x74de:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.873740:0:15502:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.873744:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda9d28 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.873747:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.873749:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda9d28 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.873753:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda9d28 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.873758:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.873758:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda9d2f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.873762:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda9d2f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.873765:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda9d2f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.873773:0:15502:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000004:00020000:2.0:1713279306.873776:0:15502:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0001: migrate [0x240000403:0x74de:0x0]/10 failed: rc = -114 00010000:00010000:3.0:1713279306.873782:0:6919:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.873785:0:6919:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.873789:0:6919:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf7cc0 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.873791:0:6919:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.873795:0:6919:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.873802:0:15502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3398:9807:x1796503281251392:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 16709us (16754us total) trans 0 rc -114/-114 00010000:00010000:3.0:1713279306.873805:0:6919:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.873808:0:6919:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713279306.873809:0:15502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14350 00000100:00100000:1.0:1713279306.873816:0:11415:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11415:1796503200054592:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.873821:0:6919:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.873824:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1713279306.873824:0:11415:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092540900/0xfc4b8e114eda9cb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.873825:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012baf7cc0/0xfc4b8e114eda98f2 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9977 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.873830:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279306.873831:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200054656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.873831:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.873832:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279306.873838:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785364 00000100:00100000:2.0:1713279306.873842:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3397:11989:x1796503281259904:12345-192.168.203.4@tcp:101:fallocate.0 00000004:00200000:3.0:1713279306.873842:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00000100:00100000:0.0:1713279306.873845:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.873846:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda9d28 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.873850:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.873852:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda9d28 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.873855:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda9d28 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.873857:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114eda9d36 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e47 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.873858:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda9d28 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.873860:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f557840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.873861:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda9d28 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.873863:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.873864:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda9d28 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.873868:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880122e5f900) 00010000:00010000:3.0:1713279306.873869:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.873871:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda9d28 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.873874:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114eda9d28 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.873878:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda9d2f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.873880:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda9d2f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.873883:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda9d2f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.873886:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c869f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.873888:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda9d2f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.873890:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda9d2f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.873894:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880122e5f600) 00010000:00010000:3.0:1713279306.873895:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.873896:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda9d3d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.873896:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda9d2f lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.873899:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114eda9d2f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.873904:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda9d3d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.873910:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda9d3d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.873912:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda9d21 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e2b expref: 3719 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.873916:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114eda9d21 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e2b expref: 3719 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.873919:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda9d44 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.873921:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906e8900, rc 0) 00010000:00010000:2.0:1713279306.873925:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda9d44 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.873934:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda9d44 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.873936:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3718:11711:x1796503281259392:12345-192.168.203.4@tcp:101:touch.0 Request processed in 239us (1023us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.873940:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785363 00010000:00010000:2.0:1713279306.873959:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114eda9d4b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.873966:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114eda9d4b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.873972:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114eda9d4b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000004:00200000:2.0:1713279306.873977:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x74d1:0x0]: returning size 39808 00000100:00100000:3.0:1713279306.873999:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.874004:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda9d3d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.874009:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281260224 00000100:00100000:1.0:1713279306.874010:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.874010:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda9d3d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.874011:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281260224 00010000:00010000:2.0:1713279306.874015:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda9d3d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.874020:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda9d3d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.874022:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785365 00010000:00010000:2.0:1713279306.874025:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf5680 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.874025:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3649:11912:x1796503281260224:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.874027:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda9d3d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.874030:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.874033:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda9d3d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.874038:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114eda9d59 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e4e expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.874039:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:2.0:1713279306.874042:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.874044:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda9d3d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.874049:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114eda9d3d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.874057:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda9d44 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.874062:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda9d44 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.874081:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda9d44 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.874086:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf4fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.874089:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda9d44 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00000100:00100000:0.0:1713279306.874091:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.874094:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda9d44 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.874100:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x33 (ffff880091714100) 00010000:00010000:3.0:1713279306.874100:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9d60 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.874102:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.874104:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda9d44 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.874108:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9d60 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.874109:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114eda9d44 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.874114:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9d60 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.874122:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda9d67 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.874124:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.874128:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda9d67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.874129:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114eda9d36 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e47 expref: 3400 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.874133:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda9d67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.874138:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4000/0xfc4b8e114eda9d4b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e47 expref: 3399 pid: 15481 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713279306.874143:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:2.0:1713279306.874147:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74d1:0x0].0x0 (ffff88008d597900) 00010000:00010000:3.0:1713279306.874148:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9d60 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.874149:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1713279306.874151:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf4000, rc 0) 00010000:00010000:3.0:1713279306.874151:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9d60 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.874154:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9d60 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.874157:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281260544 00010000:00010000:3.0:1713279306.874158:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9d60 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.874160:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281260544 00010000:00010000:3.0:1713279306.874160:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c869200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.874162:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9d60 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.874165:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9d60 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.874170:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88009e5e1200) 00000100:00100000:0.0:1713279306.874171:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223095 00000100:00100000:2.0:1713279306.874171:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3399:11989:x1796503281259904:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 328us (676us total) trans 4295183755 rc 0/0 00010000:00010000:3.0:1713279306.874171:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.874172:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9d60 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.874174:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3651:11995:x1796503281260544:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:3.0:1713279306.874175:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114eda9d60 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.874176:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785364 00000100:00100000:1.0:1713279306.874180:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.874180:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda9d67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.874183:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda9d67 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.874186:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281260416 00010000:00010000:3.0:1713279306.874186:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda9d67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.874188:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281260416 00010000:00010000:3.0:1713279306.874188:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c868480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.874189:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda9d67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.874192:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda9d67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.874195:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88009e5e1d00) 00010000:00010000:3.0:1713279306.874196:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.874197:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda9d67 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.874198:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281260672 00000100:00100000:2.0:1713279306.874199:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281260672 00010000:00010000:3.0:1713279306.874202:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114eda9d67 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.874216:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785366 00010000:00010000:3.0:1713279306.874216:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114eda9d59 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e4e expref: 3651 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.874220:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3400:11204:x1796503281260416:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.874221:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785367 00010000:00010000:3.0:1713279306.874221:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114eda9d59 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e4e expref: 3652 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.874225:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3400:11855:x1796503281260672:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.874226:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.874226:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c86ad00, rc 0) 00010000:00010000:1.0:1713279306.874231:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.874232:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114eda9d6e lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e5c expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.874238:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda9d75 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e63 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.874241:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3651:11912:x1796503281260224:12345-192.168.203.4@tcp:101:touch.0 Request processed in 214us (242us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.874244:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3651:11995:x1796503281260544:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 68us (121us total) trans 4295183756 rc 0/0 00000100:00100000:3.0:1713279306.874245:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785365 00000100:00100000:0.0:1713279306.874249:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223095 00010000:00010000:1.0:1713279306.874260:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda9d7c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.874265:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda9d7c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.874269:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda9d7c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.874270:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9d83 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.874277:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda9d8a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.874277:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9d83 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.874280:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda9d8a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.874282:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9d83 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.874284:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda9d8a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.874290:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9d91 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.874295:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9d91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.874298:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200054656 00010000:00010000:2.0:1713279306.874300:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9d91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.874300:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200054656 00010000:00010000:3.0:1713279306.874308:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713279306.874311:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:1.0:1713279306.874314:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda9d98 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7d55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.874316:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9d83 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.874316:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281260096 00000100:00100000:3.0:1713279306.874317:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281260096 00010000:00010000:1.0:1713279306.874319:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda9d98 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7d55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.874320:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9d83 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.874322:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda9d98 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7d55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.874322:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d29440/0xfc4b8e114ecedee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x60000480020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913d572 expref: 89 pid: 9198 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.874324:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9d83 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00000004:00200000:1.0:1713279306.874326:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7d55:0x0]: returning size 0 00010000:00010000:2.0:1713279306.874328:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9d83 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.874330:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196564 00010000:00010000:2.0:1713279306.874332:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf6ac0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.874333:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+55:3492:x1796503200054656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.874334:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9d83 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.874337:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.874338:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9d83 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.874340:0:15496:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.874344:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:1.0:1713279306.874345:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda9d7c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.874345:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.874347:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9d83 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:0.0:1713279306.874348:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196565 00010000:00010000:1.0:1713279306.874348:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda9d7c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.874350:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe161c0/0xfc4b8e114eda9977 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda98f2 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.874351:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda9d7c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.874351:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114eda9d83 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:0.0:1713279306.874352:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+89:1956:x1796503281260096:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.874354:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda9d7c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.874355:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.874357:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ceacd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.874357:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9d91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.874358:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.874358:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda9d7c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.874358:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.874361:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda9d7c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.874361:0:15496:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 15525 initiator: MDT0 00002000:00010000:0.0:1713279306.874364:0:6916:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0xf21:0x0] updating lvb size from disk: 0 -> 5 00010000:00010000:3.0:1713279306.874364:0:15496:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.874365:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9d91 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00002000:00010000:0.0:1713279306.874366:0:6916:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0xf21:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1713279306.874366:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880129b60a00) 00010000:00010000:1.0:1713279306.874367:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.874368:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9aab lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9a9d expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.874369:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d29440/0xfc4b8e114ecedee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x60000480020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913d572 expref: 89 pid: 9198 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.874369:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda9d7c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.874369:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9d91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.874371:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ceacd80/0xfc4b8e114eda9d7c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.874372:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.874374:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9d91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.874376:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d29440/0xfc4b8e114ecedee7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x50000480020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913d572 expref: 89 pid: 9198 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.874376:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.874377:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda9d8a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.874378:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9d91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.874380:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda9d8a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.874382:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88008d729300) 00010000:00010000:1.0:1713279306.874383:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda9d8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.874384:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.874385:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076d200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.874386:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d29440/0xfc4b8e114ecedee7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x44801480020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913d572 expref: 89 pid: 9198 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.874386:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda9d8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.874386:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9d91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.874389:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda9d8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.874390:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114eda9d91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.874390:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+54:3492:x1796503200054656:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (544us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.874392:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.874392:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3331 (ffff880130675500) 00010000:00010000:0.0:1713279306.874393:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.874393:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.874394:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda9d8a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.874394:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196564 00010000:00010000:0.0:1713279306.874395:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092540900/0xfc4b8e114eda9cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.874397:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076d200/0xfc4b8e114eda9d8a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.874400:0:6916:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092540900/0xfc4b8e114eda9cb1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.874405:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114eda9d6e lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e5c expref: 3403 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.874409:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.874410:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114eda9d6e lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e5c expref: 3404 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.874410:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.874428:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092541b00/0xfc4b8e114eda9d75 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e63 expref: 3404 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.874430:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.874432:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf4900, rc 0) 00000100:00100000:0.0:1713279306.874435:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+88:1956:x1796503281260096:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 83us (572us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.874437:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda9d98 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7d55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e63 expref: 3402 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.874439:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196565 00010000:00010000:1.0:1713279306.874441:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d55:0x0].0x0 (ffff88008c124000) 00010000:00010000:1.0:1713279306.874442:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.874443:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013076fcc0, rc 0) 00000100:00100000:2.0:1713279306.874448:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:11204:x1796503281260416:12345-192.168.203.4@tcp:101:touch.0 Request processed in 227us (357us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.874453:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785366 00000100:00100000:0.0:1713279306.874457:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200054656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.874458:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:11855:x1796503281260672:12345-192.168.203.4@tcp:101:touch.0 Request processed in 232us (279us total) trans 4295183757 rc 0/0 00000100:00100000:1.0:1713279306.874462:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785367 00010000:00010000:0.0:1713279306.874466:0:11415:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092540900/0xfc4b8e114eda9cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.874466:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281260352 00000100:00100000:2.0:1713279306.874469:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281260352 00010000:00010000:0.0:1713279306.874470:0:11415:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092540900/0xfc4b8e114eda9cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.874481:0:11415:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092540900/0xfc4b8e114eda9cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.874482:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110549 00000100:00100000:1.0:1713279306.874484:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.874485:0:11415:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092540900/0xfc4b8e114eda9cb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.874486:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+84:11992:x1796503281260352:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.874486:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda9da6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.874489:0:11415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092540900/0xfc4b8e114eda9cb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.874490:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda9da6 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.874492:0:11415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540900 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:2.0:1713279306.874492:0:15783:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.874494:0:11415:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092540900/0xfc4b8e114eda9cb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.874497:0:11415:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092540900/0xfc4b8e114eda9cb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.874497:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda9da6 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.874500:0:15783:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9dad lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e55 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.874503:0:11415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092540900/0xfc4b8e114eda9cb1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.874503:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114eda9db4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x235:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.874507:0:11415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092540900/0xfc4b8e114eda9cb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.874507:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.874508:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114eda9db4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.874512:0:15783:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe17180/0xfc4b8e114eda07b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->57343) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917363f expref: 97 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.874514:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114eda9db4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.874518:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.874519:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.874523:0:15783:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9dad lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [24576->40959] (req 24576->40959) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e55 expref: 85 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.874525:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.874526:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+87:1957:x1796503281258944:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 1498us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.874530:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110547 00010000:00010000:3.0:1713279306.874532:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.874537:0:15783:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe17180/0xfc4b8e114eda07b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->57343) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917363f expref: 97 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.874540:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d2b3c0/0xfc4b8e114ed9e6a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172c8a expref: 3717 pid: 6930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.874546:0:15783:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe17180/0xfc4b8e114eda07b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->57343) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917363f expref: 97 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.874547:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095070fc0/0xfc4b8e114ed9ec61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172e3c expref: 3712 pid: 15488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.874553:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda9724 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c95 expref: 3717 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.874556:0:15783:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096755500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0001_UUID:15783:1796503200054720:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.874559:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 6/0,1 mode: --/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.874561:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281261056 00000100:00100000:1.0:1713279306.874563:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281261056 00010000:00010000:3.0:1713279306.874574:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda9724 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c95 expref: 3717 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.874576:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785368 00000100:00100000:2.0:1713279306.874578:0:15783:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a840 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.874579:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3650:11876:x1796503281261056:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.874583:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda9724 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c95 expref: 3717 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.874584:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.874588:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281260800 00000100:00100000:0.0:1713279306.874590:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281260800 00010000:00010000:1.0:1713279306.874590:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114eda9dc2 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7364:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e6a expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.874592:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121536a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200054784:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.874598:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281260928 00000100:00100000:0.0:1713279306.874600:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281260928 00000100:00100000:0.0:1713279306.874607:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223096 00000100:00100000:0.0:1713279306.874609:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3652:11988:x1796503281260800:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.874613:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223097 00010000:00010000:3.0:1713279306.874613:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095070fc0/0xfc4b8e114ed9ec61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172e3c expref: 3712 pid: 15488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.874617:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda9dc9 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7364:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.874618:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3401:9807:x1796503281260928:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:3.0:1713279306.874618:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095070fc0/0xfc4b8e114ed9ec61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172e3c expref: 3712 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.874621:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda9dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7364:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.874623:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121535500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200054848:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.874625:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda9dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7364:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000004:00200000:1.0:1713279306.874630:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7364:0x0]: returning size 0 00010000:00010000:3.0:1713279306.874632:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d2b3c0/0xfc4b8e114ed9e6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172c8a expref: 3717 pid: 6930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.874636:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d2b3c0/0xfc4b8e114ed9e6a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172c8a expref: 3717 pid: 6930 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.874641:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200054912:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.874650:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.874653:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3401:9807:x1796503281260928:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 33us (126us total) trans 0 rc -116/-116 00000100:00100000:2.0:1713279306.874659:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223097 00010000:00010000:1.0:1713279306.874664:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114eda9dc2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7364:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e6a expref: 3655 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.874674:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda9dc9 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7364:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e6a expref: 3654 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.874679:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3654:11988:x1796503281260800:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 68us (194us total) trans 4295183759 rc 0/0 00010000:00010000:1.0:1713279306.874680:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7364:0x0].0x0 (ffff88012bacd300) 00010000:00010000:1.0:1713279306.874682:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:0.0:1713279306.874683:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223096 00010000:00010000:1.0:1713279306.874684:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013076e880, rc 0) 00000100:00100000:1.0:1713279306.874703:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3653:11876:x1796503281261056:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 121us (194us total) trans 4295183758 rc 0/0 00000100:00100000:1.0:1713279306.874709:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785368 00000100:00100000:1.0:1713279306.874811:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.874842:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281261184 00000100:00100000:2.0:1713279306.874845:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281261184 00000100:00100000:2.0:1713279306.874858:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785369 00000100:00100000:2.0:1713279306.874861:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3653:11711:x1796503281261184:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.874866:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.874872:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9dd7 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e71 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.874896:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9dde lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.874903:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9dde lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.874910:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9dde lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.874919:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9de5 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.874925:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9de5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.874931:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9de5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.874948:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9dde lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.874953:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9dde lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.874959:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9dde lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.874964:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9dde lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.874968:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed098c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.874971:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9dde lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.874976:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9dde lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.874983:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88008d11ee00) 00010000:00010000:2.0:1713279306.874985:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.874987:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9dde lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.874992:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114eda9dde lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.875000:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9de5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.875005:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9de5 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.875010:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9de5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.875015:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed0ba80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.875017:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9de5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.875025:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9de5 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.875031:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880130675700) 00010000:00010000:2.0:1713279306.875033:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.875035:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9de5 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.875039:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114eda9de5 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.875057:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9dd7 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e71 expref: 3654 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.875064:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114eda9dd7 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e71 expref: 3654 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.875088:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801349258c0, rc 0) 00000100:00100000:2.0:1713279306.875118:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3653:11711:x1796503281261184:12345-192.168.203.4@tcp:101:touch.0 Request processed in 254us (307us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.875123:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785369 00000100:00100000:0.0:1713279306.875125:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.875155:0:15502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281261312 00000100:00100000:3.0:1713279306.875158:0:15502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281261312 00000100:00100000:3.0:1713279306.875172:0:15502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14356 00000100:00100000:3.0:1713279306.875175:0:15502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3401:11666:x1796503281261312:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1713279306.875189:0:15502:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1713279306.875197:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114eda86a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x264:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175835 expref: 3401 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.875203:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x264:0x0].0x0 (ffff880130675400) 00010000:00010000:3.0:1713279306.875212:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114eda9587 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c5d expref: 3400 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.875216:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76ef:0x0].0x0 (ffff880091b35500) 00010000:00010000:3.0:1713279306.875220:0:15502:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.875230:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 15502 initiator: MDT0 00010000:00010000:3.0:1713279306.875233:0:15502:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.875237:0:15502:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x1000000000000 pid: 15502 initiator: MDT1 00000100:00100000:3.0:1713279306.875244:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200054976:0@lo:101:mdt_io00_004.0 00000100:00100000:3.0:1713279306.875258:0:15502:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.875265:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0300 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.875272:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200054976 00000100:00100000:1.0:1713279306.875275:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200054976 00000100:00100000:1.0:1713279306.875287:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98888 00000100:00100000:1.0:1713279306.875290:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+54:15502:x1796503200054976:12345-0@lo:101:mdt_io00_004.0 00010000:00010000:1.0:1713279306.875296:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.875304:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda9df3 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda9dec expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.875317:0:15494:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda9c48 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9c2c expref: 55 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.875328:0:15494:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda9df3 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda9dec expref: 55 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.875345:0:15494:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda9c48 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9c2c expref: 55 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.875354:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda9df3 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9dec expref: 55 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.875359:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.875361:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.875363:0:15494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9aab lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9a9d expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.875368:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013076f840, rc 0) 00000100:00100000:1.0:1713279306.875397:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15502:x1796503200054976:12345-0@lo:101:mdt_io00_004.0 Request processed in 106us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.875402:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98888 00000100:00100000:3.0:1713279306.875427:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15502:1796503200054976:0@lo:101:mdt_io00_004.0 00010000:00010000:3.0:1713279306.875435:0:15502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.875439:0:15502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.875761:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.875783:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.875797:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281261440 00000100:00100000:0.0:1713279306.875799:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281261440 00000100:00100000:2.0:1713279306.875800:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281261568 00000100:00100000:2.0:1713279306.875804:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281261568 00000100:00100000:0.0:1713279306.875812:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785370 00000100:00100000:0.0:1713279306.875823:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11204:x1796503281261440:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.875829:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.875835:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013597cd80/0xfc4b8e114eda9dfa lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e78 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.875838:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785371 00000100:00100000:2.0:1713279306.875842:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3400:11855:x1796503281261568:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1713279306.875856:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114eda9e01 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.875857:0:15481:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.875858:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.875861:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114eda9e01 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.875865:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114eda9e01 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.875865:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076fcc0/0xfc4b8e114eda9d98 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7d55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e63 expref: 3400 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.875874:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281261632 00000100:00100000:0.0:1713279306.875875:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281261632 00000100:00100000:3.0:1713279306.875875:0:15783:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096755500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0001_UUID:15783:1796503200054720:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.875878:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d55:0x0].0x0 (ffff88008c124000) 00000100:00100000:1.0:1713279306.875880:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.875880:0:15481:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.875883:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe17180/0xfc4b8e114eda07b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->57343) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917363f expref: 98 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.875887:0:15783:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9dad lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 4 type: EXT [24576->40959] (req 24576->40959) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e55 expref: 85 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.875893:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196566 00000100:00100000:1.0:1713279306.875894:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.875895:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+98:1954:x1796503281261632:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.875896:0:15783:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d4b3180, rc 0) 00010000:00010000:2.0:1713279306.875908:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda9e08 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7d55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.875914:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda9e08 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.875915:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.875917:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+85:11992:x1796503281260352:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 1430us (1908us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.875920:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda9e08 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.875921:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110549 00000100:00100000:3.0:1713279306.875935:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281261696 00000100:00100000:3.0:1713279306.875937:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281261696 00010000:00010000:0.0:1713279306.875945:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.875945:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095070fc0/0xfc4b8e114ed9ec61 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172e3c expref: 3715 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.875953:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe17180/0xfc4b8e114eda07b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->57343) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917363f expref: 98 pid: 15506 timeout: 509 lvb_type: 0 00000004:00010000:2.0:1713279306.875954:0:15481:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012ee30e00 reply state ffff880097716000 transno 4295183760 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda9e08 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.875956:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196567 00000100:00100000:3.0:1713279306.875958:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:1956:x1796503281261696:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.875959:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe17180/0xfc4b8e114eda07b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->57343) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917363f expref: 98 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.875961:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda9e08 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7d55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.875963:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.875966:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d55:0x0].0x0 (ffff88008c124000) 00010000:00010000:3.0:1713279306.875966:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095070fc0/0xfc4b8e114ed9ec61 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172e3c expref: 3715 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.875968:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe17180/0xfc4b8e114eda07b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->57343) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917363f expref: 98 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.875968:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.875969:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.875970:0:15481:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.875971:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095070fc0/0xfc4b8e114ed9ec61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172e3c expref: 3715 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.875974:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.875975:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.875978:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9dad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e55 expref: 84 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.875979:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ede:0x0].0x0 (ffff88008e4c8000) 00010000:00010000:3.0:1713279306.875981:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.875983:0:6916:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9dad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e55 expref: 84 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.875985:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.875988:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.875991:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.875991:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.875995:0:6916:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9dad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e55 expref: 84 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.875998:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3401:11855:x1796503281261568:12345-192.168.203.4@tcp:36:touch.0 Request processed in 154us (215us total) trans 4295183760 rc 0/0 00000100:00100000:0.0:1713279306.876000:0:6916:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200055104:192.168.203.4@tcp:105: 00000100:00100000:3.0:1713279306.876001:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:1956:x1796503281261696:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 41us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.876003:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785371 00000100:00100000:3.0:1713279306.876006:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196567 00000100:00100000:3.0:1713279306.876011:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281261760 00000100:00100000:2.0:1713279306.876012:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281261888 00000100:00100000:3.0:1713279306.876012:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281261760 00000100:00100000:2.0:1713279306.876014:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281261888 00000100:00100000:0.0:1713279306.876016:0:6916:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.876017:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d2b3c0/0xfc4b8e114ed9e6a3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172c8a expref: 3718 pid: 6930 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.876024:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281262208 00000100:00100000:2.0:1713279306.876026:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281262208 00000100:00100000:3.0:1713279306.876027:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196568 00000100:00100000:1.0:1713279306.876029:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.876030:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:385c4b71-808c-40cf-91de-b076b668d13f+3718:1956:x1796503281261760:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.876033:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.876035:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785372 00010000:00010000:3.0:1713279306.876036:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d2b3c0/0xfc4b8e114ed9e6a3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172c8a expref: 3718 pid: 6930 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.876037:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281262016 00000100:00100000:0.0:1713279306.876039:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281262016 00000100:00100000:2.0:1713279306.876039:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3401:11981:x1796503281261888:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:3.0:1713279306.876040:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d2b3c0/0xfc4b8e114ed9e6a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172c8a expref: 3718 pid: 6930 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.876046:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ede:0x0].0x0 (ffff88008e4c8000) 00010000:00010000:3.0:1713279306.876047:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00000100:00100000:0.0:1713279306.876050:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223098 00010000:00010000:3.0:1713279306.876050:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876051:0:15481:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.876053:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130141c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:9807:x1796503281262016:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:3.0:1713279306.876053:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.876056:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.876059:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114eda9cfe lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7321:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e40 expref: 3402 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.876064:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:385c4b71-808c-40cf-91de-b076b668d13f+3718:1956:x1796503281261760:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 33us (97us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.876079:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7321:0x0].0x0 (ffff880095455500) 00000100:00100000:3.0:1713279306.876079:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196568 00010000:00010000:2.0:1713279306.876082:0:15481:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.876089:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281262080 00000100:00100000:3.0:1713279306.876091:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281262080 00000100:00100000:3.0:1713279306.876099:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110550 00010000:00010000:2.0:1713279306.876101:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda9e0f lrc: 3/0,1 mode: --/PW res: [0x240000403:0x7321:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00000100:00100000:3.0:1713279306.876102:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+86:1956:x1796503281262080:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:2.0:1713279306.876105:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda9e0f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7321:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.876109:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda9e0f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7321:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00002000:00010000:3.0:1713279306.876119:0:15783:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0xf44:0x0] initial LVB size: 0, mtime: 0x661e9149, atime: 0x661e9149, ctime: 0x661e9149, blocks: 0x0 00010000:00010000:3.0:1713279306.876122:0:15783:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d322640/0xfc4b8e114eda9e16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.876125:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130141c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3402:9807:x1796503281262016:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 70us (229us total) trans 4295183761 rc 0/0 00010000:00010000:3.0:1713279306.876127:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.876128:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713279306.876129:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223098 00010000:00010000:3.0:1713279306.876130:0:15783:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d322640/0xfc4b8e114eda9e16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.876132:0:15481:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008fd2b800 reply state ffff880097714000 transno 4295183762 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda9e0f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7321:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.876136:0:15783:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d322640/0xfc4b8e114eda9e16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.876137:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda9e0f lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7321:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.876140:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7321:0x0].0x0 (ffff880095455500) 00010000:00010000:2.0:1713279306.876141:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.876141:0:15783:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d322640/0xfc4b8e114eda9e16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.876142:0:15481:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.876145:0:15783:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d322640/0xfc4b8e114eda9e16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.876149:0:15783:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d322640/0xfc4b8e114eda9e16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.876151:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda9e1d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.876152:0:15783:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d322640 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:3.0:1713279306.876154:0:15783:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d322640/0xfc4b8e114eda9e16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.876156:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda9e1d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.876160:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda9e1d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.876161:0:15783:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d322640/0xfc4b8e114eda9e16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.876163:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3403:11981:x1796503281261888:12345-192.168.203.4@tcp:36:touch.0 Request processed in 123us (282us total) trans 4295183762 rc 0/0 00000100:00100000:2.0:1713279306.876166:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785372 00010000:00010000:3.0:1713279306.876167:0:15783:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d322640/0xfc4b8e114eda9e16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.876171:0:15783:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d322640/0xfc4b8e114eda9e16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.876174:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114eda9e01 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.876174:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785373 00010000:00010000:0.0:1713279306.876177:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114eda9e01 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.876177:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3653:11912:x1796503281262208:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.876180:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114eda9e01 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.876182:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.876183:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114eda9e01 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.876186:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096b9ed00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.876187:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114eda9e01 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.876187:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda9e24 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e7f expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.876190:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114eda9e01 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.876194:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+86:1956:x1796503281262080:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 91us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.876195:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:0.0:1713279306.876197:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.876198:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114eda9e01 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.876198:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110550 00010000:00010000:0.0:1713279306.876202:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114eda9e01 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.876206:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda9e1d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.876208:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda9e2b lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.876209:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda9e1d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.876211:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda9e1d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.876212:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda9e2b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.876214:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012068e400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.876214:0:15525:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880121536a00 x1796503200054784) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda9724 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c95 expref: 3717 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.876215:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda9e1d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.876216:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda9e2b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.876218:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda9e1d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.876221:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff8800938ab700) 00010000:00010000:2.0:1713279306.876221:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9e32 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876221:0:15525:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda9724 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c95 expref: 3717 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.876223:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.876224:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda9e1d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.876224:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9e32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.876226:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114eda9e1d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.876227:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9e32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.876228:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114eda9724 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7ede:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c95 expref: 3717 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.876236:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda9e2b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.876238:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121536a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200054784:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.876240:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda9e2b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.876243:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda9e2b lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.876244:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095070fc0/0xfc4b8e114ed9ec61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172e3c expref: 3714 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.876245:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda9e2b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.876248:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e8fc0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.876249:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121535500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200054848:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.876250:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda9e2b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.876254:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d2b3c0/0xfc4b8e114ed9e6a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7ede:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172c8a expref: 3716 pid: 6930 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.876255:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda9e2b lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.876258:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200054912:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.876259:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880130675000) 00010000:00010000:2.0:1713279306.876260:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.876261:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda9e2b lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.876264:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114eda9e2b lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.876266:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ede:0x0].0x0 (ffff88008e4c8000) 00010000:00010000:3.0:1713279306.876268:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876269:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9e32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.876271:0:15525:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876272:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9e32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.876274:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9e32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.876275:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876277:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.876278:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9e32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.876281:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9e32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.876281:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.876284:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013597cd80/0xfc4b8e114eda9dfa lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e78 expref: 3713 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.876284:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff880130675f00) 00010000:00010000:3.0:1713279306.876284:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876285:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.876287:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9e32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.876287:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.876289:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013597cd80/0xfc4b8e114eda9dfa lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e78 expref: 3713 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.876289:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114eda9e32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.876294:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013597cd80, rc 0) 00010000:00010000:2.0:1713279306.876300:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda9e24 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e7f expref: 3654 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.876305:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16d00/0xfc4b8e114eda9e24 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e7f expref: 3654 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.876307:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11204:x1796503281261440:12345-192.168.203.4@tcp:101:touch.0 Request processed in 482us (547us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.876310:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe16d00, rc 0) 00000100:00100000:0.0:1713279306.876311:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785370 00000100:00100000:1.0:1713279306.876312:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.876319:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281262336 00000100:00100000:0.0:1713279306.876321:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281262336 00000100:00100000:2.0:1713279306.876322:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3653:11912:x1796503281262208:12345-192.168.203.4@tcp:101:touch.0 Request processed in 144us (331us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.876325:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785373 00010000:00010000:3.0:1713279306.876330:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.876333:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785374 00010000:00010000:3.0:1713279306.876333:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00000100:00100000:2.0:1713279306.876336:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3716:11711:x1796503281262336:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.876336:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.876339:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e5f5200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.876340:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.876341:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.876344:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876345:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9e39 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e86 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.876349:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ede:0x0].0x0 (ffff88008e4c8000) 00010000:00010000:3.0:1713279306.876350:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1713279306.876351:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.876354:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114eda9dbb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7ede:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.876360:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda9da6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.876363:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda9da6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.876366:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda9da6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.876369:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda9da6 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.876371:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c86a880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.876372:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda9da6 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876374:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9e40 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876375:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda9da6 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876378:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9e40 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876378:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff880089dc2200) 00010000:00010000:3.0:1713279306.876379:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.876381:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda9da6 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876382:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9e40 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876384:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c86a880/0xfc4b8e114eda9da6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876387:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114eda9e47 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876389:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114eda9db4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876390:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114eda9e47 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876392:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114eda9db4 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876394:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114eda9e47 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876394:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114eda9db4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.876397:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c868900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.876398:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114eda9db4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT0 00000004:00200000:2.0:1713279306.876401:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:3.0:1713279306.876401:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114eda9db4 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.876404:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x39 (ffff880089dc2900) 00010000:00010000:2.0:1713279306.876405:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9e40 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876405:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.876406:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114eda9db4 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876408:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9e40 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876408:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868900/0xfc4b8e114eda9db4 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876428:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9e40 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.876431:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9e40 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.876434:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd106c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.876435:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9e40 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876435:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876438:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9e40 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876438:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876442:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88008c2e7f00) 00010000:00010000:2.0:1713279306.876443:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.876443:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876445:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9e40 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876446:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.876447:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114eda9e40 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876447:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.876450:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000020 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.876452:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114eda9e47 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876454:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:3.0:1713279306.876455:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.876457:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114eda9e47 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876457:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9aab lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9a9d expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.876460:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114eda9e47 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876461:0:15525:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9aab lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda9a9d expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.876462:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.876463:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114eda9e47 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876465:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9aab lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda9a9d expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.876466:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114eda9e47 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.876469:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88008c2e7e00) 00010000:00010000:3.0:1713279306.876469:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda9ae3 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9ac7 expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.876470:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.876471:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114eda9e47 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.876474:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114eda9e47 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.876479:0:15525:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9aab lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9a9d expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.876485:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e8000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200055168:0@lo:105: 00010000:00010000:2.0:1713279306.876486:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9e39 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e86 expref: 3717 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.876490:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd121c0/0xfc4b8e114eda9e39 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e86 expref: 3717 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.876494:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd121c0, rc 0) 00000100:00100000:3.0:1713279306.876500:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.876510:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3716:11711:x1796503281262336:12345-192.168.203.4@tcp:101:touch.0 Request processed in 173us (199us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.876513:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785374 00000100:00100000:3.0:1713279306.876515:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.876527:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200055168 00000100:00100000:0.0:1713279306.876530:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200055168 00000100:00100000:0.0:1713279306.876541:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33449 00000100:00100000:0.0:1713279306.876544:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15525:x1796503200055168:12345-0@lo:105: 00010000:00010000:0.0:1713279306.876548:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.876553:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.876557:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.876560:0:9213:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.876564:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.876571:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.876574:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.876582:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88008fe16880) 00000100:00100000:0.0:1713279306.876599:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:15525:x1796503200055168:12345-0@lo:105: Request processed in 54us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.876602:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33449 00000100:00100000:3.0:1713279306.876602:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e8000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15525:1796503200055168:0@lo:105: 00010000:00010000:1.0:1713279306.876604:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.876609:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.876612:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114eda997e lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.876613:0:6942:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00000004:00020000:3.0:1713279306.876617:0:15525:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200000402:0x7f51:0x0]/9 failed: rc = -114 00000004:00080000:1.0:1713279306.876627:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1713279306.876637:0:15525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:385c4b71-808c-40cf-91de-b076b668d13f+3715:11736:x1796503281252544:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 18085us (18157us total) trans 0 rc -114/-114 00000100:00100000:3.0:1713279306.876642:0:15525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14351 00010000:00010000:1.0:1713279306.876704:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda9e4e lrc: 3/0,1 mode: --/CW res: [0x240000400:0x263:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.876711:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda9e4e lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.876718:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda9e4e lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00000100:00100000:3.0:1713279306.876726:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.876728:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda9e55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x263:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.876733:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda9e55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x263:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.876738:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda9e55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x263:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.876747:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 3/0,1 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.876751:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281262400 00000100:00100000:2.0:1713279306.876754:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281262400 00010000:00010000:1.0:1713279306.876755:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda85ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757ef expref: 3652 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.876761:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 4/0,1 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00000100:00100000:2.0:1713279306.876765:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110551 00000100:00100000:2.0:1713279306.876768:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+98:11989:x1796503281262400:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.876772:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.876776:0:6942:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda85ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757ef expref: 3652 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.876778:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda9e63 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1032:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e8d expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.876786:0:6942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda85ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757ef expref: 3652 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.876788:0:15506:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bf8f840/0xfc4b8e114eda3f3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1032:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174606 expref: 84 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.876792:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.876793:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1713279306.876795:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089d180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001_UUID:6942:1796503200055232:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.876795:0:15506:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda9e63 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x1032:0x0].0x0 rrc: 3 type: EXT [8192->24575] (req 8192->24575) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e8d expref: 99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.876804:0:15506:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bf8f840/0xfc4b8e114eda3f3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1032:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->36863) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174606 expref: 84 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.876809:0:15506:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bf8f840/0xfc4b8e114eda3f3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1032:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->36863) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174606 expref: 84 pid: 15500 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.876815:0:15506:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096755180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15506:1796503200055296:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.876821:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800969d0600 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.876828:0:15506:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606c900 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.876935:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.876951:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281262528 00000100:00100000:2.0:1713279306.876955:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281262528 00000100:00100000:2.0:1713279306.876973:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785375 00000100:00100000:2.0:1713279306.876977:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3653:11983:x1796503281262528:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.876985:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.876992:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11d40/0xfc4b8e114eda9e6a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e94 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.877032:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda9e71 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.877039:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda9e71 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.877045:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda9e71 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.877055:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda9e78 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.877061:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda9e78 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.877079:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda9e78 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000004:00200000:2.0:1713279306.877131:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7d86:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.877138:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda9e71 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.877143:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda9e71 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.877148:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda9e71 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.877153:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda9e71 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.877161:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a064480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.877164:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda9e71 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.877169:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda9e71 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.877173:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.877176:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:2.0:1713279306.877179:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.877181:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda9e71 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.877186:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a064480/0xfc4b8e114eda9e71 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.877193:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda9e78 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.877198:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda9e78 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.877203:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda9e78 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.877207:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be400 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.877209:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.877210:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda9e78 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.877211:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281262592 00000100:00100000:1.0:1713279306.877215:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281262592 00010000:00010000:2.0:1713279306.877215:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda9e78 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.877218:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281262720 00000100:00100000:0.0:1713279306.877220:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281262720 00010000:00010000:2.0:1713279306.877221:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3731 (ffff88008e59ca00) 00010000:00010000:2.0:1713279306.877223:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.877226:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda9e78 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.877230:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114eda9e78 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.877231:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223099 00000100:00100000:0.0:1713279306.877234:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3715:11736:x1796503281262720:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1713279306.877241:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785376 00000100:00100000:1.0:1713279306.877245:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:9807:x1796503281262592:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.877247:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11d40/0xfc4b8e114eda9e6a lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e94 expref: 3654 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.877253:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.877254:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11d40/0xfc4b8e114eda9e6a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e94 expref: 3654 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.877259:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3715:11736:x1796503281262720:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 24us (49us total) trans 0 rc -116/-116 00010000:00010000:2.0:1713279306.877261:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd11d40, rc 0) 00000100:00100000:0.0:1713279306.877263:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223099 00010000:00010000:1.0:1713279306.877263:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114eda9e7f lrc: 2/0,0 mode: --/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175e9b expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.877280:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3653:11983:x1796503281262528:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 301us (344us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.877285:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785375 00010000:00010000:1.0:1713279306.877289:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda9e86 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877295:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda9e86 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877301:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda9e86 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877312:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda9e8d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877317:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda9e8d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877322:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda9e8d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877342:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda9e86 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877347:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda9e86 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877352:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda9e86 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877357:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda9e86 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877362:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d9806c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.877365:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda9e86 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877369:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda9e86 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877377:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x20a:0x0].0x0 (ffff88008f653900) 00010000:00010000:1.0:1713279306.877379:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.877382:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda9e86 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877386:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114eda9e86 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877394:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda9e8d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877399:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda9e8d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877403:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda9e8d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877408:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.877411:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda9e8d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877433:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda9e8d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877439:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x20a:0x0].0x3031 (ffff88008b918500) 00010000:00010000:1.0:1713279306.877441:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.877443:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda9e8d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877447:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114eda9e8d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x20a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.877466:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114eda9e7f lrc: 1/0,0 mode: --/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e9b expref: 3713 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.877473:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114eda9e7f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e9b expref: 3713 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.877480:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d982d00, rc 0) 00000100:00100000:1.0:1713279306.877503:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:9807:x1796503281262592:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 257us (330us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.877507:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785376 00000100:00100000:2.0:1713279306.877558:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.877594:0:6916:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200055104:192.168.203.4@tcp:105: 00000100:00100000:1.0:1713279306.877596:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089d180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001_UUID:6942:1796503200055232:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.877596:0:15506:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096755180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15506:1796503200055296:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.877601:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.877603:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 3/0,1 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.877606:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda9e63 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x1032:0x0].0x0 rrc: 3 type: EXT [8192->24575] (req 8192->24575) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e8d expref: 99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.877613:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd13600, rc 0) 00000100:00100000:0.0:1713279306.877614:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+99:1954:x1796503281261632:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1717us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.877614:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281262848 00000100:00100000:1.0:1713279306.877616:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281262848 00000100:00100000:0.0:1713279306.877618:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196566 00000100:00100000:3.0:1713279306.877626:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+98:11989:x1796503281262400:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 857us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.877627:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785377 00000100:00100000:3.0:1713279306.877630:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110551 00000100:00100000:1.0:1713279306.877631:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3403:11204:x1796503281262848:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.877639:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.877646:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda9e94 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ea2 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.877687:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda9e9b lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.877691:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.877693:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda9e9b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.877699:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda9e9b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.877705:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281262912 00010000:00010000:1.0:1713279306.877706:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9833c0/0xfc4b8e114eda9ea2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.877708:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281262912 00000100:00100000:0.0:1713279306.877709:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.877711:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9833c0/0xfc4b8e114eda9ea2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.877716:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9833c0/0xfc4b8e114eda9ea2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.877718:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281262976 00010000:00010000:2.0:1713279306.877720:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bf8f840/0xfc4b8e114eda3f3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1032:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->36863) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174606 expref: 85 pid: 15500 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.877721:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281262976 00000004:00200000:1.0:1713279306.877726:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:3.0:1713279306.877727:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda85ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757ef expref: 3653 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.877732:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda9e9b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.877736:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda9e9b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.877737:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196569 00000100:00100000:0.0:1713279306.877738:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.877741:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda9e9b lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.877741:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281263040 00000100:00100000:2.0:1713279306.877742:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281262912:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.877742:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281263040 00010000:00010000:1.0:1713279306.877746:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda9e9b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.877748:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196570 00010000:00010000:2.0:1713279306.877748:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.877749:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980d80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.877751:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147269 00000100:00100000:0.0:1713279306.877752:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:385c4b71-808c-40cf-91de-b076b668d13f+3653:1957:x1796503281262976:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.877752:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda9e9b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.877754:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+3715:1957:x1796503281263040:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:0.0:1713279306.877757:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.877757:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda9e9b lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.877757:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bf8f840/0xfc4b8e114eda3f3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1032:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->36863) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174606 expref: 85 pid: 15500 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.877758:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.877761:0:6915:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda85ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757ef expref: 3653 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.877763:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:1.0:1713279306.877764:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.877765:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce533c0/0xfc4b8e114eda8fb4 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ac0 expref: 3715 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.877766:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bf8f840/0xfc4b8e114eda3f3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1032:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->36863) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174606 expref: 85 pid: 15500 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.877767:0:6915:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda85ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x252:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757ef expref: 3653 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.877767:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda9e9b lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.877770:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980d80/0xfc4b8e114eda9e9b lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.877772:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x0 (ffff880096e84a00) 00010000:00010000:3.0:1713279306.877773:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.877775:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114eda85ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x252:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391757ef expref: 3653 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.877775:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9833c0/0xfc4b8e114eda9ea2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.877777:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9833c0/0xfc4b8e114eda9ea2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.877779:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bf8f840/0xfc4b8e114eda3f3b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1032:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->36863) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174606 expref: 85 pid: 15500 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.877780:0:6915:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x0 (ffff88012514da00) 00010000:00010000:1.0:1713279306.877780:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9833c0/0xfc4b8e114eda9ea2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.877783:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 3/0,1 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.877783:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d9833c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.877784:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9833c0/0xfc4b8e114eda9ea2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.877785:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+3714:1957:x1796503281263040:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 30us (49us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.877786:0:6915:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.877787:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713279306.877788:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147269 00010000:00010000:0.0:1713279306.877789:0:6915:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6942 initiator: MDT1 00010000:00010000:2.0:1713279306.877789:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.877790:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9833c0/0xfc4b8e114eda9ea2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.877793:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88008b918d00) 00010000:00010000:2.0:1713279306.877793:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda9e63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1032:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->24575) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e8d expref: 97 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.877794:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.877796:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9833c0/0xfc4b8e114eda9ea2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.877800:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9833c0/0xfc4b8e114eda9ea2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.877801:0:6916:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda9e63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1032:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->24575) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e8d expref: 97 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.877803:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.877813:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:385c4b71-808c-40cf-91de-b076b668d13f+3652:1957:x1796503281262976:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 61us (103us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.877813:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda9e94 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ea2 expref: 3404 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.877817:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196570 00010000:00010000:2.0:1713279306.877817:0:6916:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd13600/0xfc4b8e114eda9e63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1032:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->24575) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e8d expref: 97 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.877818:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980240/0xfc4b8e114eda9e94 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ea2 expref: 3404 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.877822:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d980240, rc 0) 00000100:00100000:2.0:1713279306.877825:0:6916:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096755180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200055360:192.168.203.4@tcp:105: 00010000:00010000:1.0:1713279306.877830:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00000100:00100000:0.0:1713279306.877834:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.877834:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.877840:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda9ea9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x252:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.877843:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281263104 00010000:00010000:1.0:1713279306.877844:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda9ea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00000100:00100000:2.0:1713279306.877844:0:6916:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606c180 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.877845:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281263104 00010000:00010000:1.0:1713279306.877847:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda9ea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00000100:00100000:3.0:1713279306.877853:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110552 00000100:00100000:3.0:1713279306.877855:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+85:1955:x1796503281263104:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:1.0:1713279306.877864:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982640/0xfc4b8e114eda9eb0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x74f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00000100:00100000:2.0:1713279306.877867:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.877868:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982640/0xfc4b8e114eda9eb0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x74f3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.877871:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982640/0xfc4b8e114eda9eb0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x74f3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00000100:00100000:2.0:1713279306.877883:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00002000:00010000:3.0:1713279306.877902:0:15506:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb size from disk: 6184 -> 6184 00002000:00010000:3.0:1713279306.877904:0:15506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb mtime from disk: 1713279304 -> 1713279304 00002000:00010000:3.0:1713279306.877905:0:15506:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1713279306.877906:0:15506:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00000100:00100000:2.0:1713279306.877907:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00002000:00010000:3.0:1713279306.877908:0:15506:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb blocks from disk: 56 -> 56 00000100:00100000:3.0:1713279306.877922:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+86:1955:x1796503281263104:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 66us (87us total) trans 4295010133 rc 0/0 00000100:00100000:3.0:1713279306.877926:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110552 00000100:00100000:0.0:1713279306.877927:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.877943:0:15525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281263232 00000100:00100000:3.0:1713279306.877944:0:15525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281263232 00000004:00010000:1.0:1713279306.877950:0:6942:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801313c1880 reply state ffff8800726cf000 transno 4295183763 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982640/0xfc4b8e114eda9eb0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x74f3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00000100:00100000:3.0:1713279306.877955:0:15525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14357 00010000:00010000:1.0:1713279306.877956:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982640/0xfc4b8e114eda9eb0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x74f3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00000100:00100000:3.0:1713279306.877957:0:15525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:385c4b71-808c-40cf-91de-b076b668d13f+3653:11876:x1796503281263232:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:1.0:1713279306.877959:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74f3:0x0].0x0 (ffff880096eff400) 00010000:00010000:1.0:1713279306.877961:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1713279306.877962:0:6942:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713279306.877964:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.877967:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.877970:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.877973:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.877976:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dca880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.877977:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.877979:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 15525 initiator: MDT0 00010000:00010000:1.0:1713279306.877982:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT1 00000100:00100000:2.0:1713279306.877983:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281263296 00010000:00010000:3.0:1713279306.877983:0:15525:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.877986:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x0 (ffff88012514da00) 00010000:00010000:1.0:1713279306.877987:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.877987:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281263296 00010000:00010000:3.0:1713279306.877987:0:15525:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x1000000000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.877988:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 3/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.877991:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114eda9e5c lrc: 0/0,0 mode: --/CW res: [0x240000400:0x252:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00000100:00100000:3.0:1713279306.877994:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7eb100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200055424:0@lo:101:mdt_io00_009.0 00000004:00010000:1.0:1713279306.877996:0:6942:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801313c1880 reply state ffff8800726cf000 transno 4295183763 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda9ea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.878000:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda9ea9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00000100:00100000:2.0:1713279306.878001:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281263360 00010000:00010000:1.0:1713279306.878002:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x36 (ffff88008b918f00) 00000100:00100000:2.0:1713279306.878003:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281263360 00010000:00010000:1.0:1713279306.878004:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.878004:0:6942:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1713279306.878006:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda9e4e lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.878008:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda9e4e lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00000100:00100000:3.0:1713279306.878008:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.878011:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda9e4e lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00000100:00100000:2.0:1713279306.878011:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281263488 00000100:00100000:2.0:1713279306.878013:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281263488 00010000:00010000:1.0:1713279306.878014:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda9e4e lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00000100:00100000:3.0:1713279306.878015:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c03c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.878016:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009160a880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.878018:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda9e4e lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.878021:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda9e4e lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT1 00000100:00100000:2.0:1713279306.878024:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785378 00010000:00010000:1.0:1713279306.878025:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x263:0x0].0x0 (ffff880089dc3a00) 00010000:00010000:1.0:1713279306.878026:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.878027:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda9e4e lrc: 3/0,0 mode: --/CW res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00000100:00100000:3.0:1713279306.878028:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785379 00010000:00010000:1.0:1713279306.878029:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114eda9e4e lrc: 0/0,0 mode: --/CW res: [0x240000400:0x263:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00000100:00100000:2.0:1713279306.878029:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3714:11736:x1796503281263296:12345-192.168.203.4@tcp:34:lfs.0 00000100:00100000:3.0:1713279306.878031:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3404:11855:x1796503281263360:12345-192.168.203.4@tcp:101:touch.0 00000004:00010000:1.0:1713279306.878034:0:6942:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801313c1880 reply state ffff8800726cf000 transno 4295183763 ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda9e55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x263:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT1 00010000:00010000:3.0:1713279306.878036:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.878038:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda9e55 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x263:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:1.0:1713279306.878040:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x263:0x0].0x36 (ffff8800954bed00) 00010000:00010000:1.0:1713279306.878041:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.878041:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda9ebe lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7d55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ea9 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.878042:0:6942:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:1.0:1713279306.878045:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.878049:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878050:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda9ec5 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.878052:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.878056:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda9ebe lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7d55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ea9 expref: 3405 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878057:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda9ec5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.878061:0:6942:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1713279306.878062:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ed00/0xfc4b8e114eda9ebe lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7d55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ea9 expref: 3405 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878063:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda9ec5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.878082:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d55:0x0].0x0 (ffff88008c124000) 00000100:00100000:0.0:1713279306.878083:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200055424 00010000:00010000:3.0:1713279306.878084:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713279306.878085:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942ed00, rc 0) 00000100:00100000:0.0:1713279306.878086:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200055424 00010000:00010000:2.0:1713279306.878086:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9ecc lrc: 3/1,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3032 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.878092:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9ecc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.878098:0:6942:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:385c4b71-808c-40cf-91de-b076b668d13f+3655:11854:x1796503281254592:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 16476us (16518us total) trans 4295183763 rc 0/0 00010000:00010000:2.0:1713279306.878098:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9ecc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.878099:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3405:11855:x1796503281263360:12345-192.168.203.4@tcp:101:touch.0 Request processed in 67us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.878103:0:6942:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14352 00000100:00100000:3.0:1713279306.878103:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785379 00000100:00100000:3.0:1713279306.878111:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785380 00010000:00010000:1.0:1713279306.878114:0:15544:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1713279306.878114:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3654:11711:x1796503281263488:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.878117:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.878118:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.878121:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe16880 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:2.0:1713279306.878123:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda9ed3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.878123:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cb40/0xfc4b8e114eda9eda lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175eb0 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.878124:0:15544:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878127:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda9ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00000004:00010000:1.0:1713279306.878128:0:15544:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878131:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda9ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.878133:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98889 00000100:00100000:0.0:1713279306.878136:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200055424:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713279306.878137:0:15544:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.878140:0:15544:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713279306.878141:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.878142:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda9ee1 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000004:00010000:2.0:1713279306.878145:0:15482:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda9ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.878147:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda9ee8 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114eda9eb7 expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.878147:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda9ee1 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.878150:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda9ec5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.878153:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda9ec5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.878153:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda9ee1 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.878156:0:15494:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda9df3 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9dec expref: 56 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.878156:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878159:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda9ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.878160:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fe16880/0xfc4b8e114eda9a9d lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9aab expref: -99 pid: 6942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.878161:0:15494:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda9ee8 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114eda9eb7 expref: 56 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878162:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda9ec5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.878162:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200055488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.878164:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bc900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.878166:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.878166:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.878166:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda9ec5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.878168:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.878169:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda9ec5 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.878172:0:15494:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda9df3 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9dec expref: 56 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878173:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff880091b34600) 00010000:00010000:2.0:1713279306.878174:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.878176:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda9ec5 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.878177:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda9ee8 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9eb7 expref: 56 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.878177:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.878178:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bc900/0xfc4b8e114eda9ec5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.878179:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3404:11204:x1796503281262848:12345-192.168.203.4@tcp:101:touch.0 Request processed in 548us (623us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.878181:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:0.0:1713279306.878183:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.878183:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785377 00010000:00010000:0.0:1713279306.878185:0:15494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda9ae3 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9ac7 expref: 56 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878187:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9ecc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.878188:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880089fe1680, rc 0) 00010000:00010000:2.0:1713279306.878190:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9ecc lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.878192:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9ecc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.878192:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114eda9eef lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.878195:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.878196:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9ecc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.878196:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114eda9eef lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.878199:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114eda9eef lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.878201:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9ecc lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.878205:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15525:x1796503200055424:12345-0@lo:101:mdt_io00_009.0 Request processed in 69us (196us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.878205:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x3032 (ffff880091b34800) 00010000:00010000:2.0:1713279306.878206:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.878207:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.878207:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9ecc lrc: 2/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.878210:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98889 00010000:00010000:2.0:1713279306.878210:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114eda9ecc lrc: 0/0,0 mode: --/PR res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.878212:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda9ee1 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.878214:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda9ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.878216:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda9ee1 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.878217:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda9ed3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.878219:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda9ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.878219:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda9ee1 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.878222:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.878223:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda9ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.878224:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200055488 00010000:00010000:3.0:1713279306.878224:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda9ee1 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.878226:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200055488 00010000:00010000:2.0:1713279306.878226:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda9ed3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.878227:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.878228:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f44:0x0].0x0 (ffff880131200b00) 00010000:00010000:3.0:1713279306.878229:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda9ee1 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.878230:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.878230:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.878231:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9aab lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9a9d expref: 56 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878231:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda9ed3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.878232:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda9ee1 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.878233:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114eda9ed3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.878235:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880094e7b100) 00010000:00010000:3.0:1713279306.878236:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.878238:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda9ee1 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.878239:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196571 00010000:00010000:3.0:1713279306.878241:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114eda9ee1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.878242:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+56:3490:x1796503200055488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.878245:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114eda9eef lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.878246:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.878248:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9aab lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda9a9d expref: 56 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.878248:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114eda9eef lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.878251:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114eda9eef lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.878252:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3714:11736:x1796503281263296:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 224us (369us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.878253:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.878254:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114eda9eef lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.878257:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785378 00010000:00010000:3.0:1713279306.878257:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114eda9eef lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.878263:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880089dc2100) 00010000:00010000:3.0:1713279306.878264:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.878265:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281263616 00010000:00010000:3.0:1713279306.878265:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114eda9eef lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.878267:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281263616 00010000:00010000:3.0:1713279306.878268:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114eda9eef lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.878280:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cb40/0xfc4b8e114eda9eda lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175eb0 expref: 3656 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.878282:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281263680 00000100:00100000:2.0:1713279306.878284:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281263680 00010000:00010000:3.0:1713279306.878284:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cb40/0xfc4b8e114eda9eda lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175eb0 expref: 3656 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.878287:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785381 00010000:00010000:3.0:1713279306.878288:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942cb40, rc 0) 00000100:00100000:1.0:1713279306.878291:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3655:11912:x1796503281263616:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.878293:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785382 00000100:00100000:2.0:1713279306.878296:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3404:9807:x1796503281263680:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.878301:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.878301:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.878303:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3655:11711:x1796503281263488:12345-192.168.203.4@tcp:101:touch.0 Request processed in 188us (378us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.878306:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114eda9aab lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda9a9d expref: 56 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.878307:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785380 00010000:00010000:1.0:1713279306.878309:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114eda9efd lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175eb7 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878309:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda9ef6 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x234:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ebe expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.878312:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:0.0:1713279306.878314:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda9ae3 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9ac7 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.878319:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda9ae3 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda9ac7 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.878323:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda9ae3 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda9ac7 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.878323:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7eb100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200055424:0@lo:101:mdt_io00_009.0 00010000:00010000:2.0:1713279306.878326:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda9f04 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x234:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.878327:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.878329:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878330:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda9f04 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.878333:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda9f04 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.878333:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.878336:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda9ae3 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9ac7 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878338:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda9f0b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.878341:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda9f0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.878342:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6917:1796503200055616:0@lo:105: 00010000:00010000:2.0:1713279306.878344:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda9f0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.878355:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda9f12 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.878356:0:6917:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.878362:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540540 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.878362:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda9f12 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.878367:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda9f19 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.878368:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda9f12 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.878370:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200055616 00010000:00010000:2.0:1713279306.878371:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda9f19 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.878372:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200055616 00010000:00010000:2.0:1713279306.878374:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda9f19 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.878376:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda9f20 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.878381:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33450 00010000:00010000:1.0:1713279306.878381:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda9f20 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.878383:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6917:x1796503200055616:12345-0@lo:105: 00000004:00200000:2.0:1713279306.878383:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x74de:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.878385:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda9f20 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00200000:2.0:1713279306.878385:0:15482:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713279306.878388:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.878389:0:15482:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda9f19 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.878392:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878393:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda9f04 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.878395:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713279306.878396:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:2.0:1713279306.878396:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda9f04 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.878399:0:9213:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.878399:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda9f04 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.878402:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.878402:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda9f12 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.878402:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda9f04 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.878404:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bfcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.878405:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.878406:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda9f12 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.878406:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda9f04 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.878408:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda9f04 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.878428:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x234:0x0].0x0 (ffff8800938ab100) 00010000:00010000:2.0:1713279306.878430:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.878432:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda9f12 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.878432:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda9f04 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.878435:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfcc0/0xfc4b8e114eda9f04 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.878437:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda9f12 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.878440:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.878440:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda9f0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.878442:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda9f0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.878443:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda9f12 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.878445:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda9f0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.878447:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda9f12 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.878448:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bc000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.878449:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda9f0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.878452:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda9f0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.878453:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880090bee800) 00010000:00010000:1.0:1713279306.878454:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.878455:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x234:0x0].0x3031 (ffff8800938abc00) 00010000:00010000:1.0:1713279306.878456:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda9f12 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.878456:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.878458:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda9f0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.878460:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114eda9f12 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.878460:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114eda9f0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x234:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.878463:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.878467:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda9f20 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.878471:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114eda9ef6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x234:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ebe expref: 3406 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.878472:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda9f20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.878475:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88012d3221c0) 00010000:00010000:1.0:1713279306.878476:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda9f20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.878479:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.878480:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda9f19 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ebe expref: 3405 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.878482:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda9f20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.878483:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74de:0x0].0x0 (ffff8800938abd00) 00010000:00010000:2.0:1713279306.878484:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713279306.878486:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935be880, rc 0) 00010000:00010000:1.0:1713279306.878489:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda9f20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.878491:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6917:x1796503200055616:12345-0@lo:105: Request processed in 107us (135us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.878494:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880090beea00) 00000100:00100000:0.0:1713279306.878495:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33450 00010000:00010000:1.0:1713279306.878496:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.878498:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda9f20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.878499:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3405:9807:x1796503281263680:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 202us (268us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.878503:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114eda9f20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.878503:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785382 00010000:00010000:0.0:1713279306.878506:0:15534:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.878510:0:15534:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.878519:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1713279306.878522:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114eda9efd lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175eb7 expref: 3655 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.878529:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114eda9efd lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175eb7 expref: 3655 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.878536:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d981f80, rc 0) 00000100:00100000:2.0:1713279306.878545:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.878552:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281263616:12345-192.168.203.4@tcp:101:touch.0 Request processed in 260us (344us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.878557:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785381 00010000:00010000:0.0:1713279306.878567:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda9f27 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.878567:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281263744 00000100:00100000:1.0:1713279306.878570:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281263744 00010000:00010000:0.0:1713279306.878571:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda9f27 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.878575:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda9f27 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.878580:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539d40/0xfc4b8e114eda9f2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x260:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.878583:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785383 00010000:00010000:0.0:1713279306.878584:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539d40/0xfc4b8e114eda9f2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00000100:00100000:1.0:1713279306.878586:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3405:12000:x1796503281263744:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:0.0:1713279306.878587:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539d40/0xfc4b8e114eda9f2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00000100:00100000:3.0:1713279306.878588:0:6916:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096755180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200055360:192.168.203.4@tcp:105: 00010000:00010000:1.0:1713279306.878591:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.878594:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.878597:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983840/0xfc4b8e114eda9f35 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x258:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ec5 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.878608:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281262912:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 867us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.878613:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196569 00010000:00010000:1.0:1713279306.878615:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda9f3c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x258:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.878620:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda9f3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x258:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.878623:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda9f3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x258:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00200000:1.0:1713279306.878636:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x258:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.878637:0:15473:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:1.0:1713279306.878647:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983840/0xfc4b8e114eda9f35 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ec5 expref: 3407 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.878653:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda9f3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x258:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ec5 expref: 3406 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.878657:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda9f43 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.878657:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x258:0x0].0x0 (ffff880096eff800) 00010000:00010000:1.0:1713279306.878658:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1713279306.878659:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d982400, rc 0) 00000100:00100000:2.0:1713279306.878659:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.878664:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda9f43 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.878668:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda9f43 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00000100:00100000:3.0:1713279306.878668:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281264064 00000100:00100000:3.0:1713279306.878670:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281264064 00000100:00100000:1.0:1713279306.878672:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3406:12000:x1796503281263744:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 85us (127us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.878673:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda9f4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25b:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00000100:00100000:2.0:1713279306.878673:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.878676:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda9f4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00000100:00100000:1.0:1713279306.878676:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785383 00010000:00010000:0.0:1713279306.878679:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda9f4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00000100:00100000:1.0:1713279306.878683:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785384 00000100:00100000:1.0:1713279306.878686:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3714:12004:x1796503281264064:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.878691:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.878692:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7ae1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.878695:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda9f58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ecc expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.878697:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda9969 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x7ae1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d59 expref: 3405 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.878701:0:15534:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.878711:0:15534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda9969 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7ae1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d59 expref: 3405 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.878714:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.878715:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda9f5f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.878717:0:15534:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda9969 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7ae1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d59 expref: 3405 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.878720:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda9f5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.878722:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.878722:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281264000 00000100:00100000:0.0:1713279306.878723:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001_UUID:15534:1796503200055680:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.878724:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda9f5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.878724:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281264000 00010000:00010000:1.0:1713279306.878730:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda9f66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.878732:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110553 00010000:00010000:1.0:1713279306.878733:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda9f66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.878735:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+98:1956:x1796503281264000:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:1.0:1713279306.878736:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda9f66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.878737:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540900 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.878738:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.878748:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281264192 00000100:00100000:0.0:1713279306.878750:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281264192 00000100:00100000:0.0:1713279306.878761:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110554 00000100:00100000:0.0:1713279306.878764:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+99:1955:x1796503281264192:12345-192.168.203.4@tcp:2:touch.0 00000004:00200000:1.0:1713279306.878782:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.878802:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda9f5f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00002000:00010000:3.0:1713279306.878803:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb size from disk: 39808 -> 39808 00002000:00010000:3.0:1713279306.878805:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00010000:00010000:1.0:1713279306.878806:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda9f5f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00002000:00010000:3.0:1713279306.878807:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb atime from disk: 1713279299 -> 1713279299 00010000:00010000:1.0:1713279306.878808:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda9f5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00002000:00010000:3.0:1713279306.878808:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.878809:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb blocks from disk: 56 -> 72 00010000:00010000:1.0:1713279306.878811:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda9f5f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.878814:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d9821c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.878815:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda9f5f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.878819:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda9f5f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.878823:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00000100:00100000:0.0:1713279306.878825:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:1955:x1796503281264192:12345-192.168.203.4@tcp:2:touch.0 Request processed in 60us (86us total) trans 4295010135 rc 0/0 00010000:00010000:1.0:1713279306.878825:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.878825:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:1956:x1796503281264000:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 89us (111us total) trans 4295010134 rc 0/0 00010000:00010000:1.0:1713279306.878826:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda9f5f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.878829:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114eda9f5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.878829:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110553 00000100:00100000:0.0:1713279306.878831:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110554 00010000:00010000:1.0:1713279306.878833:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda9f66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.878836:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda9f66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.878839:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda9f66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.878840:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281264128 00010000:00010000:1.0:1713279306.878842:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983600 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.878842:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281264128 00010000:00010000:1.0:1713279306.878843:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda9f66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.878846:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda9f66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.878849:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6917:1796503200055616:0@lo:105: 00010000:00010000:1.0:1713279306.878849:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff88008dba4500) 00010000:00010000:1.0:1713279306.878850:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.878850:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785385 00010000:00010000:1.0:1713279306.878851:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda9f66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.878853:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114eda9f66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.878853:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3717:11854:x1796503281264128:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1713279306.878855:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.878868:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda9f74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x148:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.878869:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+55:3490:x1796503200055488:12345-0@lo:103:ldlm_bl.0 Request processed in 626us (692us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.878869:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda9f58 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ecc expref: 3717 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.878873:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196571 00010000:00010000:3.0:1713279306.878873:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda9f74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.878874:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114eda9f58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ecc expref: 3717 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.878877:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda9f74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.878878:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d981440, rc 0) 00000100:00100000:2.0:1713279306.878880:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200055488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.878881:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281263936 00000100:00100000:0.0:1713279306.878883:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281263936 00010000:00010000:3.0:1713279306.878883:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9f7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x148:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878886:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878889:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.878890:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223100 00000100:00100000:0.0:1713279306.878894:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3717:11992:x1796503281263936:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:1.0:1713279306.878894:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3717:12004:x1796503281264064:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 206us (235us total) trans 4295202761 rc 301/301 00000100:00100000:1.0:1713279306.878898:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785384 00010000:00010000:3.0:1713279306.878915:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9f82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8272:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878918:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9f82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8272:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878921:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9f82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8272:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000004:00200000:3.0:1713279306.878926:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8272:0x0]: returning size 2 00000004:00010000:3.0:1713279306.878931:0:15658:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9f82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8272:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878935:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda9f74 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878938:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda9f74 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878941:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda9f74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878944:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda9f74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878949:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942eac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.878950:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda9f74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878953:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda9f74 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878957:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x0 (ffff880091b34100) 00010000:00010000:3.0:1713279306.878958:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.878960:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda9f74 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878962:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942eac0/0xfc4b8e114eda9f74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878967:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878970:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9f7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878972:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878974:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942d8c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.878976:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878979:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9f7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878982:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x3431 (ffff880089dc2800) 00010000:00010000:3.0:1713279306.878983:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.878985:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9f7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878987:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d8c0/0xfc4b8e114eda9f7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878993:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9f82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8272:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878995:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9f82 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x8272:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.878998:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9f82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8272:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.879000:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942cd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.879001:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9f82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8272:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.879004:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9f82 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8272:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.879007:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8272:0x0].0x0 (ffff880091738a00) 00010000:00010000:3.0:1713279306.879008:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.879009:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9f82 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x8272:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.879012:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942cd80/0xfc4b8e114eda9f82 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8272:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.879016:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.879026:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.879030:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3717:11854:x1796503281264128:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 176us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.879034:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3717:11992:x1796503281263936:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 138us (358us total) trans 4295202762 rc 0/0 00000100:00100000:3.0:1713279306.879034:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785385 00000100:00100000:1.0:1713279306.879036:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.879038:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223100 00000100:00100000:3.0:1713279306.879045:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281264384 00000100:00100000:3.0:1713279306.879047:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281264384 00000100:00100000:0.0:1713279306.879050:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281264256 00000100:00100000:2.0:1713279306.879051:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281264512 00000100:00100000:0.0:1713279306.879052:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281264256 00000100:00100000:2.0:1713279306.879054:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281264512 00000100:00100000:3.0:1713279306.879059:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785386 00000100:00100000:0.0:1713279306.879061:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110555 00000100:00100000:3.0:1713279306.879061:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3716:11736:x1796503281264384:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:0.0:1713279306.879063:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+87:1957:x1796503281264256:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:3.0:1713279306.879081:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.879082:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785387 00010000:00010000:3.0:1713279306.879086:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda9f89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7f44:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ed3 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.879087:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11204:x1796503281264512:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.879094:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.879102:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda9f90 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175eda expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.879114:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114eda9f97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7f44:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.879119:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114eda9f97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f44:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.879123:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114eda9f97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7f44:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1713279306.879127:0:15474:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7f44:0x0]: returning size 0 00010000:00010000:2.0:1713279306.879129:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda9f9e lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.879135:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+88:1957:x1796503281264256:12345-192.168.203.4@tcp:2:touch.0 Request processed in 70us (110us total) trans 4295010191 rc 0/0 00010000:00010000:2.0:1713279306.879136:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda9f9e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.879139:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110555 00010000:00010000:2.0:1713279306.879142:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda9f9e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879150:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda9fac lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.879153:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114eda9f89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7f44:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ed3 expref: 3719 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.879156:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda9fac lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.879160:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114eda9f97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f44:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ed3 expref: 3718 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.879161:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda9fac lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.879164:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f44:0x0].0x0 (ffff880131200b00) 00010000:00010000:3.0:1713279306.879165:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1713279306.879166:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942d680, rc 0) 00010000:00010000:2.0:1713279306.879176:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda9f9e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879181:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda9f9e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00000100:00100000:3.0:1713279306.879182:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3718:11736:x1796503281264384:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 119us (165us total) trans 4295202763 rc 0/0 00000100:00100000:3.0:1713279306.879185:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785386 00010000:00010000:2.0:1713279306.879186:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda9f9e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879191:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda9f9e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879195:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bd440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.879198:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda9f9e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879203:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda9f9e lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879213:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:2.0:1713279306.879215:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.879217:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda9f9e lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879222:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bd440/0xfc4b8e114eda9f9e lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879230:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda9fac lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879235:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda9fac lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879240:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda9fac lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879244:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bf180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.879246:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda9fac lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879252:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda9fac lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879258:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880096b8e800) 00010000:00010000:2.0:1713279306.879260:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.879261:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda9fac lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879266:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bf180/0xfc4b8e114eda9fac lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.879283:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda9f90 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175eda expref: 3713 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.879291:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfa80/0xfc4b8e114eda9f90 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175eda expref: 3713 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.879297:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bfa80, rc 0) 00000100:00100000:2.0:1713279306.879318:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11204:x1796503281264512:12345-192.168.203.4@tcp:101:touch.0 Request processed in 230us (279us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.879324:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785387 00000100:00100000:0.0:1713279306.879561:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.879586:0:15534:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff88009089d880 x1796503200055680) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda9969 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7ae1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d59 expref: 3405 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.879590:0:6942:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281264640 00000100:00100000:1.0:1713279306.879593:0:6942:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281264640 00010000:00010000:2.0:1713279306.879597:0:15534:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda9969 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7ae1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d59 expref: 3405 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.879609:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114eda9969 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x7ae1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d59 expref: 3405 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.879613:0:6942:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14358 00000100:00100000:1.0:1713279306.879616:0:6942:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:385c4b71-808c-40cf-91de-b076b668d13f+3718:11854:x1796503281264640:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:2.0:1713279306.879618:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001_UUID:15534:1796503200055680:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.879628:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ae1:0x0].0x0 (ffff880091738f00) 00010000:00010000:2.0:1713279306.879631:0:15534:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.879633:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.879637:0:15534:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.879639:0:6942:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda9ee8 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114eda9eb7 expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.879643:0:6942:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.879643:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.879654:0:6942:0:(ldlm_lockd.c:1002:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda9ee8 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9eb7 expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.879656:0:15534:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.879661:0:6942:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.879662:0:15534:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.879667:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00000100:00100000:0.0:1713279306.879683:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.879700:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281264768 00000100:00100000:3.0:1713279306.879703:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281264768 00000100:00100000:0.0:1713279306.879704:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.879714:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281264832 00000100:00100000:3.0:1713279306.879716:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281264832 00000100:00100000:3.0:1713279306.879723:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785388 00000100:00100000:3.0:1713279306.879726:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3405:9807:x1796503281264768:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1713279306.879750:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 3/0,1 mode: --/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.879756:0:15482:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda9f19 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ebe expref: 3405 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.879759:0:15482:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 4/0,1 mode: --/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.879769:0:15482:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda9f19 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ebe expref: 3406 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.879774:0:15482:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda9f19 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ebe expref: 3406 pid: 15482 timeout: 509 lvb_type: 0 00000004:00010000:2.0:1713279306.879776:0:15534:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801313c0380 reply state ffff88007ffeb000 transno 4295183764 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00000100:00100000:1.0:1713279306.879777:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.879779:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.879780:0:15482:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096755180 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0001_UUID:15482:1796503200055808:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.879785:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.879791:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ae1:0x0].0x0 (ffff880091738f00) 00010000:00010000:2.0:1713279306.879793:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1713279306.879795:0:15534:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713279306.879798:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281264960 00010000:00010000:2.0:1713279306.879798:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda9f43 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00000100:00100000:3.0:1713279306.879798:0:15482:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0300 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.879801:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281264960 00010000:00010000:2.0:1713279306.879804:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda9f43 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00000100:00100000:3.0:1713279306.879805:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281265024 00000100:00100000:3.0:1713279306.879807:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281265024 00010000:00010000:2.0:1713279306.879809:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda9f43 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.879814:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda9f43 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00000100:00100000:3.0:1713279306.879816:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785389 00010000:00010000:2.0:1713279306.879818:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c53b3c0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.879818:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:12000:x1796503281264832:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:2.0:1713279306.879821:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda9f43 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00000100:00100000:1.0:1713279306.879822:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785390 00010000:00010000:3.0:1713279306.879823:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.879825:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3407:11204:x1796503281265024:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.879829:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda9f43 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279306.879829:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f5440/0xfc4b8e114eda9fc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x146:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ee1 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.879831:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.879836:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012d397800) 00010000:00010000:1.0:1713279306.879837:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981680/0xfc4b8e114eda9fc8 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ee8 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.879838:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.879840:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda9f43 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.879845:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53b3c0/0xfc4b8e114eda9f43 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00000100:00100000:0.0:1713279306.879848:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110556 00010000:00010000:3.0:1713279306.879848:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda9fcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x146:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1713279306.879851:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+86:1956:x1796503281264960:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:3.0:1713279306.879852:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda9fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x146:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00000004:00010000:2.0:1713279306.879854:0:15534:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801313c0380 reply state ffff88007ffeb000 transno 4295183764 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda9f4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279306.879856:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda9fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x146:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.879860:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda9f4a lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.879864:0:11415:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda9fd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1113:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.879866:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3731 (ffff88012d397100) 00010000:00010000:2.0:1713279306.879868:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.879869:0:15534:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1713279306.879870:0:15474:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x146:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.879871:0:11415:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009023cb40/0xfc4b8e114ed9e01a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1113:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a7d expref: 86 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713279306.879871:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda9fdd lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.879872:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda9f27 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00000004:00200000:3.0:1713279306.879872:0:15474:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:1.0:1713279306.879875:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda9fdd lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.879876:0:11415:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe14d80/0xfc4b8e114ed9f1a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1113:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172fbd expref: 87 pid: 11415 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713279306.879877:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda9f27 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.879879:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.879879:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda9fdd lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.879880:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.879882:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda9fd6 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1113:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.879882:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda9f27 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279306.879882:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f5440/0xfc4b8e114eda9fc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x146:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ee1 expref: 3714 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.879885:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda9fe4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.879887:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda9f27 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.879888:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda9fe4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.879889:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7a80/0xfc4b8e114eda9fcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x146:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ee1 expref: 3713 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.879891:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda9fe4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.879892:0:11415:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe14d80/0xfc4b8e114ed9f1a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1113:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172fbd expref: 87 pid: 11415 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713279306.879892:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880123732400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.879893:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x146:0x0].0x0 (ffff880096da6e00) 00010000:00010000:2.0:1713279306.879894:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda9f27 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279306.879894:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713279306.879895:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801250f7a80, rc 0) 00010000:00010000:0.0:1713279306.879897:0:11415:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe14d80/0xfc4b8e114ed9f1a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1113:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172fbd expref: 87 pid: 11415 timeout: 509 lvb_type: 1 00000004:00200000:1.0:1713279306.879899:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:2.0:1713279306.879899:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda9f27 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.879903:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda9fdd lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.879906:0:11415:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11415:1796503200055872:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.879906:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88008ad67800) 00010000:00010000:1.0:1713279306.879907:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda9fdd lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.879907:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:12000:x1796503281264832:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 87us (202us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.879908:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.879910:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda9fdd lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.879910:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda9f27 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00000100:00100000:3.0:1713279306.879910:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785389 00010000:00010000:1.0:1713279306.879913:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda9fdd lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.879915:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114eda9f27 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.879916:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.879917:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda9fdd lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.879920:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda9fdd lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000004:00010000:2.0:1713279306.879923:0:15534:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801313c0380 reply state ffff88007ffeb000 transno 4295183764 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539d40/0xfc4b8e114eda9f2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.879924:0:11415:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009023cb40/0xfc4b8e114ed9e01a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1113:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a7d expref: 86 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713279306.879924:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:1.0:1713279306.879925:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.879926:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda9fdd lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.879929:0:11415:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009023cb40/0xfc4b8e114ed9e01a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1113:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a7d expref: 86 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.879929:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114eda9fdd lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.879929:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539d40/0xfc4b8e114eda9f2e lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00000100:00100000:0.0:1713279306.879933:0:11415:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11415:1796503200055936:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.879934:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda9fe4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.879934:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x3731 (ffff88008ad67e00) 00010000:00010000:2.0:1713279306.879936:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.879937:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda9fe4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.879937:0:15534:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:1.0:1713279306.879940:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda9fe4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.879941:0:11415:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540840 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.879942:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.879943:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.879944:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda9fe4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.879947:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda9fe4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.879947:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.879950:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880093401d00) 00010000:00010000:2.0:1713279306.879950:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.879951:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.879952:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda9fe4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.879955:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114eda9fe4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.879956:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.879963:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281265152 00000100:00100000:0.0:1713279306.879964:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281265152 00010000:00010000:1.0:1713279306.879967:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981680/0xfc4b8e114eda9fc8 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ee8 expref: 3409 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.879967:0:15534:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1713279306.879970:0:6918:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713279306.879971:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981680/0xfc4b8e114eda9fc8 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ee8 expref: 3409 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.879973:0:6918:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.879974:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223101 00010000:00010000:1.0:1713279306.879975:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d981680, rc 0) 00000100:00100000:0.0:1713279306.879976:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3408:11855:x1796503281265152:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:3.0:1713279306.879977:0:6918:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d3221c0 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.879979:0:6918:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.879984:0:6918:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.879989:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3409:11204:x1796503281265024:12345-192.168.203.4@tcp:101:touch.0 Request processed in 163us (210us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.879992:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785390 00000100:00100000:2.0:1713279306.879995:0:15534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3409:11374:x1796503281255104:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 17949us (17987us total) trans 4295183764 rc 0/0 00010000:00010000:3.0:1713279306.879995:0:6918:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.879998:0:6918:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713279306.880002:0:15534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14353 00010000:00010000:3.0:1713279306.880006:0:6918:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.880010:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d3221c0/0xfc4b8e114eda9ac7 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9ae3 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.880016:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.880017:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.880017:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279306.880018:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713279306.880024:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200056000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.880025:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3408:11855:x1796503281265152:12345-192.168.203.4@tcp:35:touch.0 Request processed in 47us (77us total) trans 4295183765 rc 0/0 00000100:00100000:0.0:1713279306.880029:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223101 00000100:00100000:2.0:1713279306.880043:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.880055:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200056000 00000100:00100000:1.0:1713279306.880058:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200056000 00010000:00010000:1.0:1713279306.880064:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda9ae3 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9ac7 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.880092:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196572 00000100:00100000:1.0:1713279306.880095:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+55:3490:x1796503200056000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.880100:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.880103:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda9ae3 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda9ac7 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.880109:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114eda9ae3 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda9ac7 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.880115:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.880118:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.880121:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.880124:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.880128:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda9c48 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9c2c expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.880135:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.880143:0:6943:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880147:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00000100:00100000:1.0:1713279306.880150:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+54:3490:x1796503200056000:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.880153:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196572 00000100:00100000:2.0:1713279306.880161:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200056000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.880201:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b180/0xfc4b8e114eda9feb lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880205:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b180/0xfc4b8e114eda9feb lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880210:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b180/0xfc4b8e114eda9feb lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880215:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda9ff2 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24a:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880218:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda9ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880221:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda9ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880226:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda9ff9 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x231:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880228:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda9ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880231:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda9ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880235:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f286c0/0xfc4b8e114edaa000 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x231:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880238:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f286c0/0xfc4b8e114edaa000 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880241:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f286c0/0xfc4b8e114edaa000 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880246:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880250:0:6943:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5440/0xfc4b8e114ed6811b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x83dc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391624dd expref: 3718 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.880255:0:6943:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.880265:0:6943:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5440/0xfc4b8e114ed6811b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x83dc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391624dd expref: 3718 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.880270:0:6943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5440/0xfc4b8e114ed6811b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x83dc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391624dd expref: 3718 pid: 15470 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.880275:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121403100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6943:1796503200056064:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.880298:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540000 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.880494:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.880500:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.880524:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281265536 00000100:00100000:3.0:1713279306.880525:0:15482:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096755180 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0001_UUID:15482:1796503200055808:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.880527:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281265536 00010000:00010000:3.0:1713279306.880533:0:15482:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 3/0,1 mode: --/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.880537:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.880539:0:11415:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11415:1796503200055872:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.880541:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223102 00000100:00100000:1.0:1713279306.880543:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3408:11989:x1796503281265536:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:0.0:1713279306.880548:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281265280 00000100:00100000:0.0:1713279306.880550:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281265280 00000100:00100000:3.0:1713279306.880550:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281265408 00000100:00100000:3.0:1713279306.880552:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281265408 00000100:00100000:0.0:1713279306.880563:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785391 00000100:00100000:0.0:1713279306.880566:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281265280:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.880566:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785392 00000100:00100000:3.0:1713279306.880569:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3719:11711:x1796503281265408:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.880572:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.880576:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.880578:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaa00e lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175eef expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.880581:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7840/0xfc4b8e114edaa015 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ef6 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.880599:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa01c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.880603:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa01c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.880605:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3409:11989:x1796503281265536:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 60us (111us total) trans 4295183766 rc 0/0 00010000:00010000:0.0:1713279306.880607:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa01c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.880612:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223102 00010000:00010000:0.0:1713279306.880613:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa023 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.880616:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa023 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.880619:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa023 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.880620:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114edaa02a lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880625:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114edaa02a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.880627:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa01c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.880629:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114edaa02a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.880630:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa01c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.880633:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa01c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.880634:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800945521c0/0xfc4b8e114edaa031 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880638:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800945521c0/0xfc4b8e114edaa031 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880641:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800945521c0/0xfc4b8e114edaa031 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00000004:00200000:3.0:1713279306.880648:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:3.0:1713279306.880653:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114edaa02a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880656:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114edaa02a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880658:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114edaa02a lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880661:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114edaa02a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880664:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801250f6ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.880666:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114edaa02a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880669:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114edaa02a lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880673:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880096da6200) 00010000:00010000:3.0:1713279306.880674:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.880676:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114edaa02a lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880679:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f6ac0/0xfc4b8e114edaa02a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880684:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800945521c0/0xfc4b8e114edaa031 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880686:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800945521c0/0xfc4b8e114edaa031 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880689:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800945521c0/0xfc4b8e114edaa031 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880691:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800945521c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.880692:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800945521c0/0xfc4b8e114edaa031 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880695:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800945521c0/0xfc4b8e114edaa031 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880699:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880096da6400) 00010000:00010000:3.0:1713279306.880700:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.880701:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800945521c0/0xfc4b8e114edaa031 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880704:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945521c0/0xfc4b8e114edaa031 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.880707:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa01c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.880712:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f2b600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.880714:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa01c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.880716:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7840/0xfc4b8e114edaa015 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ef6 expref: 3720 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.880721:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801250f7840/0xfc4b8e114edaa015 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ef6 expref: 3720 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.880726:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801250f7840, rc 0) 00000100:00100000:1.0:1713279306.880739:0:11415:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11415:1796503200055936:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.880742:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3719:11711:x1796503281265408:12345-192.168.203.4@tcp:101:touch.0 Request processed in 172us (205us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.880745:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785392 00010000:00010000:1.0:1713279306.880750:0:11415:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda9fd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1113:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.880751:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa01c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.880757:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff8801250c1400) 00010000:00010000:0.0:1713279306.880758:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.880760:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa01c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.880763:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa01c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.880769:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa023 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.880773:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa023 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.880776:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.880778:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f298c0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.880779:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.880780:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.880782:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa023 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.880786:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff8801250c1c00) 00010000:00010000:0.0:1713279306.880787:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.880788:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa023 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.880789:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.880789:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281265856 00010000:00010000:0.0:1713279306.880790:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa023 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.880791:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281265856 00000100:00100000:3.0:1713279306.880799:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785393 00000100:00100000:3.0:1713279306.880801:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3409:11374:x1796503281265856:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1713279306.880804:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaa00e lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175eef expref: 3655 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.880804:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281265664 00000100:00100000:1.0:1713279306.880808:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281265664 00010000:00010000:0.0:1713279306.880810:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaa00e lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175eef expref: 3655 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.880816:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f2aac0, rc 0) 00010000:00010000:1.0:1713279306.880818:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe14d80/0xfc4b8e114ed9f1a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1113:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172fbd expref: 88 pid: 11415 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.880818:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114edaa038 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.880823:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114edaa038 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880827:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114edaa038 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:0.0:1713279306.880831:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121403100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6943:1796503200056064:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.880831:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaa03f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00000100:00100000:1.0:1713279306.880834:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196573 00010000:00010000:3.0:1713279306.880835:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaa03f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.880838:0:6943:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00000100:00100000:1.0:1713279306.880838:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+88:1957:x1796503281265664:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.880838:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaa03f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.880844:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.880851:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe14d80/0xfc4b8e114ed9f1a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1113:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172fbd expref: 88 pid: 11415 timeout: 509 lvb_type: 1 00000100:00100000:0.0:1713279306.880856:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281265280:12345-192.168.203.4@tcp:101:touch.0 Request processed in 289us (356us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.880857:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe14d80/0xfc4b8e114ed9f1a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1113:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172fbd expref: 88 pid: 11415 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.880858:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114edaa046 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7abf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.880860:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785391 00010000:00010000:3.0:1713279306.880861:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114edaa046 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7abf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.880865:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe14d80/0xfc4b8e114ed9f1a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1113:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172fbd expref: 88 pid: 11415 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.880865:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114edaa046 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7abf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.880871:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:3.0:1713279306.880879:0:15481:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114edaa046 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7abf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.880886:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+87:1957:x1796503281265664:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 48us (96us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.880886:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114edaa038 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880890:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114edaa038 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.880893:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196573 00010000:00010000:3.0:1713279306.880894:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114edaa038 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880899:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114edaa038 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880903:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094550fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.880906:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114edaa038 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880911:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114edaa038 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880917:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880096da6900) 00010000:00010000:3.0:1713279306.880919:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.880922:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114edaa038 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880927:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114edaa038 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880937:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaa03f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880942:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaa03f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880947:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaa03f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00000100:00100000:0.0:1713279306.880949:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.880951:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094550d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.880953:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaa03f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.880958:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281265728 00010000:00010000:3.0:1713279306.880958:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaa03f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.880960:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281265728 00000100:00100000:0.0:1713279306.880963:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.880964:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3031 (ffff880096da6800) 00010000:00010000:3.0:1713279306.880965:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.880966:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009023cb40/0xfc4b8e114ed9e01a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1113:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a7d expref: 87 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.880967:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaa03f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880970:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaa03f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.880973:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281265600 00000100:00100000:1.0:1713279306.880975:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281265600 00010000:00010000:3.0:1713279306.880975:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114edaa046 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7abf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880978:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114edaa046 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7abf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.880979:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda9f19 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ebe expref: 3410 pid: 15482 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.880981:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196574 00010000:00010000:3.0:1713279306.880983:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114edaa046 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7abf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880986:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e60a880 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.880987:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121403100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+87:1954:x1796503281265728:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.880987:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114edaa046 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7abf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880991:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114edaa046 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7abf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.880994:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196575 00010000:00010000:3.0:1713279306.880994:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7abf:0x0].0x0 (ffff8800938abf00) 00010000:00010000:2.0:1713279306.880995:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.880995:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.880997:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3410:1954:x1796503281265600:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.880997:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114edaa046 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x7abf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.880999:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114edaa046 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7abf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.881000:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.881003:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda9f19 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ebe expref: 3410 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.881004:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009023cb40/0xfc4b8e114ed9e01a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1113:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a7d expref: 87 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.881008:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda9f19 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ebe expref: 3410 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.881013:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009023cb40/0xfc4b8e114ed9e01a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1113:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a7d expref: 87 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.881015:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114eda9f19 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x74de:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ebe expref: 3410 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.881020:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74de:0x0].0x0 (ffff8800938abd00) 00010000:00010000:1.0:1713279306.881023:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 3/0,1 mode: --/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.881026:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009023cb40/0xfc4b8e114ed9e01a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1113:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a7d expref: 87 pid: 15519 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.881027:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15482 initiator: MDT1 00000100:00100000:3.0:1713279306.881027:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3409:11374:x1796503281265856:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 223us (247us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.881030:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15482 initiator: MDT1 00000100:00100000:3.0:1713279306.881031:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785393 00010000:00010000:2.0:1713279306.881034:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.881036:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.881038:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.881039:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda9fd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1113:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.881046:0:6916:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda9fd6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1113:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.881048:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3408:1954:x1796503281265600:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 51us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.881052:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196575 00000100:00100000:3.0:1713279306.881052:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.881058:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.881059:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.881059:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281266048 00000100:00100000:3.0:1713279306.881061:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281266048 00010000:00010000:1.0:1713279306.881062:0:11415:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda9fd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1113:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.881081:0:11415:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda9fd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1113:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.881086:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785394 00000100:00100000:2.0:1713279306.881088:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121403100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+86:1954:x1796503281265728:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 100us (138us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.881089:0:11415:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda9fd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1113:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.881089:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3408:11855:x1796503281266048:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.881093:0:11415:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda9fd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1113:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.881094:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196574 00010000:00010000:3.0:1713279306.881095:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.881097:0:11415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda9fd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1113:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.881100:0:11415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c53ad00 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:3.0:1713279306.881101:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114edaa04d lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f04 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.881102:0:11415:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda9fd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1113:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.881105:0:11415:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda9fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1113:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.881106:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.881113:0:11415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda9fd6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1113:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.881117:0:11415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c53ad00/0xfc4b8e114eda9fd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1113:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.881126:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaa054 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.881130:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaa054 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.881134:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaa054 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.881139:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114edaa05b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.881143:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114edaa05b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.881146:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114edaa05b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.881157:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+85:1956:x1796503281264960:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 1305us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.881161:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110556 00000100:00100000:1.0:1713279306.881172:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281266176 00000100:00100000:1.0:1713279306.881173:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281266176 00010000:00010000:3.0:1713279306.881175:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114edaa062 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x70ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.881179:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.881180:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114edaa062 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x70ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.881182:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223103 00010000:00010000:3.0:1713279306.881183:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114edaa062 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x70ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.881185:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3719:13150:x1796503281266176:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000004:00200000:3.0:1713279306.881186:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x70ad:0x0]: returning size 0 00000100:00100000:0.0:1713279306.881189:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281265920 00000100:00100000:0.0:1713279306.881192:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281265920 00000100:00100000:2.0:1713279306.881193:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281266304 00000100:00100000:2.0:1713279306.881196:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281266304 00000100:00100000:0.0:1713279306.881205:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785395 00010000:00010000:3.0:1713279306.881206:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaa054 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:0.0:1713279306.881208:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11204:x1796503281265920:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.881210:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaa054 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00000100:00100000:2.0:1713279306.881212:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785396 00010000:00010000:0.0:1713279306.881214:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.881215:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaa054 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00000100:00100000:2.0:1713279306.881216:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3654:11711:x1796503281266304:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.881218:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaa054 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.881220:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092920240/0xfc4b8e114edaa070 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175efd expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.881221:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8cb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.881222:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaa054 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.881225:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.881225:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaa054 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.881229:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88007f2ad300) 00010000:00010000:3.0:1713279306.881230:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.881231:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaa054 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.881232:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3720:13150:x1796503281266176:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 46us (174us total) trans 4295202764 rc 0/0 00010000:00010000:2.0:1713279306.881233:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd8c0/0xfc4b8e114edaa077 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f0b expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.881234:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaa054 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.881236:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223103 00010000:00010000:3.0:1713279306.881239:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114edaa05b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.881241:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa07e lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.881242:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114edaa05b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.881245:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa07e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.881245:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114edaa05b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.881247:0:15482:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.881247:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8dd40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.881248:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114edaa05b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.881249:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa07e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.881251:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.881254:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa085 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.881254:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114edaa05b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.881257:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3431 (ffff88007f2ad800) 00010000:00010000:3.0:1713279306.881258:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.881259:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114edaa05b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.881260:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa085 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.881261:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.881261:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114edaa08c lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.881262:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114edaa05b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.881263:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa085 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.881264:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.881268:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114edaa08c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.881270:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.881273:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.881274:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.881274:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114edaa08c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.881275:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa07e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.881277:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.881278:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa07e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.881278:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114edaa04d lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f04 expref: 3411 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.881281:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa07e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.881281:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74de:0x0].0x0 (ffff8800938abd00) 00010000:00010000:1.0:1713279306.881282:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:2.0:1713279306.881283:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114edaa093 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.881284:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa07e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.881284:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 2/0,0 mode: --/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.881286:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942c480/0xfc4b8e114eda9fba lrc: 0/0,0 mode: --/EX res: [0x240000403:0x74de:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.881287:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68b600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.881288:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa07e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.881288:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114edaa062 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x70ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f04 expref: 3410 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.881289:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114edaa093 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.881291:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa07e lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.881294:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x70ad:0x0].0x0 (ffff88008dba4c00) 00010000:00010000:0.0:1713279306.881295:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:3.0:1713279306.881295:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713279306.881296:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.881297:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bf8ef40, rc 0) 00010000:00010000:0.0:1713279306.881298:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa07e lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.881298:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114edaa093 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.881300:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa07e lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.881305:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa085 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.881308:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa085 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1713279306.881310:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3410:9807:x1796503281264768:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 1582us (1627us total) trans 0 rc -114/-114 00010000:00010000:0.0:1713279306.881311:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa085 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.881314:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68ad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.881315:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa085 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.881315:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114edaa08c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.881315:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3410:11855:x1796503281266048:12345-192.168.203.4@tcp:101:touch.0 Request processed in 224us (261us total) trans 4295183767 rc 0/0 00000100:00100000:1.0:1713279306.881316:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785388 00010000:00010000:0.0:1713279306.881318:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa085 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.881320:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff88012d397a00) 00010000:00010000:2.0:1713279306.881320:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114edaa08c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.881322:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.881322:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785394 00010000:00010000:0.0:1713279306.881323:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa085 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.881325:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa085 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.881326:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114edaa08c lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.881330:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114edaa08c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.881335:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.881336:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092920240/0xfc4b8e114edaa070 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175efd expref: 3714 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.881337:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114edaa08c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.881340:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092920240/0xfc4b8e114edaa070 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175efd expref: 3714 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.881343:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114edaa08c lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.881344:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092920240, rc 0) 00010000:00010000:2.0:1713279306.881349:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880096b8e400) 00010000:00010000:2.0:1713279306.881352:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.881354:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114edaa08c lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.881356:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11204:x1796503281265920:12345-192.168.203.4@tcp:101:touch.0 Request processed in 147us (250us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.881359:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114edaa08c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.881360:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785395 00010000:00010000:2.0:1713279306.881367:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114edaa093 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.881371:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114edaa093 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.881377:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114edaa093 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.881381:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.881383:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114edaa093 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.881388:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114edaa093 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.881394:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880096b8e500) 00010000:00010000:2.0:1713279306.881396:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.881398:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114edaa093 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.881403:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122205440/0xfc4b8e114edaa093 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.881449:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd8c0/0xfc4b8e114edaa077 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f0b expref: 3655 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.881456:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd8c0/0xfc4b8e114edaa077 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f0b expref: 3655 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.881465:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bd8c0, rc 0) 00000100:00100000:2.0:1713279306.881486:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3654:11711:x1796503281266304:12345-192.168.203.4@tcp:101:touch.0 Request processed in 269us (306us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.881492:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785396 00000100:00100000:0.0:1713279306.881861:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.881908:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281266432 00000100:00100000:2.0:1713279306.881912:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281266432 00000100:00100000:0.0:1713279306.881924:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.881935:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785397 00000100:00100000:2.0:1713279306.881940:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281266432:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.881947:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.881950:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281266560 00000100:00100000:1.0:1713279306.881953:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281266560 00010000:00010000:2.0:1713279306.881956:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114edaa09a lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f12 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.881966:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223104 00000100:00100000:1.0:1713279306.881969:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f848450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3409:11981:x1796503281266560:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:2.0:1713279306.881998:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114edaa0a1 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.882005:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114edaa0a1 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882010:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114edaa0a1 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882019:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114edaa0a8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.882024:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114edaa0a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.882028:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f848450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3410:11981:x1796503281266560:12345-192.168.203.4@tcp:35:touch.0 Request processed in 58us (103us total) trans 4295183768 rc 0/0 00010000:00010000:2.0:1713279306.882029:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114edaa0a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.882032:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223104 00000100:00100000:0.0:1713279306.882035:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00200000:2.0:1713279306.882038:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:2.0:1713279306.882043:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114edaa0a1 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.882045:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281266688 00000100:00100000:0.0:1713279306.882047:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281266688 00010000:00010000:2.0:1713279306.882047:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114edaa0a1 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882050:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114edaa0a1 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882055:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114edaa0a1 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.882058:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785398 00010000:00010000:2.0:1713279306.882058:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c9b5200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.882059:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114edaa0a1 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.882061:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3410:11374:x1796503281266688:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.882062:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114edaa0a1 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882078:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096b8ec00) 00010000:00010000:0.0:1713279306.882079:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.882080:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.882082:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114edaa0a1 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.882085:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaa0af lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7abf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f19 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.882085:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5200/0xfc4b8e114edaa0a1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882090:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114edaa0a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882093:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114edaa0a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882096:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114edaa0a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882098:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ea5f180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.882100:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114edaa0a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882102:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114edaa0a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882109:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880096b8e300) 00010000:00010000:2.0:1713279306.882111:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.882112:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114edaa0a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.882114:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688b40/0xfc4b8e114edaa0b6 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7abf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.882115:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ea5f180/0xfc4b8e114edaa0a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.882118:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688b40/0xfc4b8e114edaa0b6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7abf:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.882123:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688b40/0xfc4b8e114edaa0b6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7abf:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000004:00200000:0.0:1713279306.882127:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7abf:0x0]: returning size 0 00010000:00010000:2.0:1713279306.882129:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114edaa09a lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f12 expref: 3655 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.882133:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114edaa09a lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f12 expref: 3655 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.882137:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c9b5680, rc 0) 00010000:00010000:0.0:1713279306.882153:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaa0af lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7abf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f19 expref: 3413 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.882154:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281266432:12345-192.168.203.4@tcp:101:touch.0 Request processed in 214us (293us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.882158:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785397 00010000:00010000:0.0:1713279306.882217:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688b40/0xfc4b8e114edaa0b6 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7abf:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f19 expref: 3412 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.882221:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7abf:0x0].0x0 (ffff8800938abf00) 00010000:00010000:0.0:1713279306.882223:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1713279306.882224:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e688b40, rc 0) 00000100:00100000:1.0:1713279306.882224:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.882234:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281266944 00000100:00100000:2.0:1713279306.882237:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281266944 00000100:00100000:3.0:1713279306.882240:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.882242:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3413:11374:x1796503281266688:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 180us (207us total) trans 4295183769 rc 0/0 00000100:00100000:2.0:1713279306.882246:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785399 00000100:00100000:0.0:1713279306.882250:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785398 00000100:00100000:2.0:1713279306.882250:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3413:11204:x1796503281266944:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.882256:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281266752 00000100:00100000:2.0:1713279306.882257:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281266752 00010000:00010000:2.0:1713279306.882264:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5440/0xfc4b8e114ed6811b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x83dc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391624dd expref: 3720 pid: 15470 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.882272:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196576 00000100:00100000:2.0:1713279306.882274:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3720:1954:x1796503281266752:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.882278:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.882281:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5440/0xfc4b8e114ed6811b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x83dc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391624dd expref: 3720 pid: 15470 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.882286:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5440/0xfc4b8e114ed6811b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x83dc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391624dd expref: 3720 pid: 15470 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.882287:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.882294:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5440/0xfc4b8e114ed6811b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x83dc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391624dd expref: 3720 pid: 15470 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.882299:0:15534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281267008 00010000:00010000:2.0:1713279306.882299:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x83dc:0x0].0x0 (ffff88008f645500) 00000100:00100000:0.0:1713279306.882301:0:15534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281267008 00010000:00010000:2.0:1713279306.882302:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.882305:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.882308:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6943 initiator: MDT0 00000100:00100000:0.0:1713279306.882312:0:15534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14359 00000100:00100000:0.0:1713279306.882314:0:15534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_011:385c4b71-808c-40cf-91de-b076b668d13f+3720:11736:x1796503281267008:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:2.0:1713279306.882315:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.882323:0:6943:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00000100:00100000:2.0:1713279306.882327:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3720:1954:x1796503281266752:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 51us (88us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.882328:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00000100:00100000:2.0:1713279306.882330:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196576 00010000:00010000:0.0:1713279306.882331:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.882336:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.882339:0:15534:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.882340:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.882344:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114edaa0cb lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f20 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.882345:0:15534:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.882350:0:15534:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.882377:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114edaa0d2 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.882381:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114edaa0d2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882385:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114edaa0d2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882390:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114edaa0d9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.882394:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114edaa0d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882397:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114edaa0d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000004:00200000:2.0:1713279306.882403:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:2.0:1713279306.882407:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114edaa0d2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882426:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114edaa0d2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882429:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114edaa0d2 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882432:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114edaa0d2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882435:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d4baf40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.882436:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114edaa0d2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882439:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114edaa0d2 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.882442:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.882446:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:2.0:1713279306.882447:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.882448:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114edaa0d2 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882451:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4baf40/0xfc4b8e114edaa0d2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882456:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114edaa0d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882459:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114edaa0d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882462:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114edaa0d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882464:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091805440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.882465:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114edaa0d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882468:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114edaa0d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882471:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880096b8ed00) 00010000:00010000:2.0:1713279306.882472:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.882473:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114edaa0d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882476:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114edaa0d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882488:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114edaa0cb lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f20 expref: 3413 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.882492:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d4b8240/0xfc4b8e114edaa0cb lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f20 expref: 3413 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.882496:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d4b8240, rc 0) 00000100:00100000:2.0:1713279306.882511:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3412:11204:x1796503281266944:12345-192.168.203.4@tcp:101:touch.0 Request processed in 260us (290us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.882515:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785399 00000100:00100000:0.0:1713279306.882700:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.882715:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281267264 00000100:00100000:2.0:1713279306.882719:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281267264 00000100:00100000:2.0:1713279306.882733:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785400 00000100:00100000:2.0:1713279306.882738:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3412:11855:x1796503281267264:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1713279306.882754:0:15752:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.882762:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114edaa062 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x70ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f04 expref: 3412 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.882771:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x70ad:0x0].0x0 (ffff88008dba4c00) 00010000:00010000:2.0:1713279306.882773:0:15752:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.882798:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114edaa0e0 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x70ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.882805:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114edaa0e0 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x70ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.882811:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114edaa0e0 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x70ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000004:00010000:2.0:1713279306.882843:0:15752:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007f02f480 reply state ffff880094151000 transno 4295183770 ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114edaa0e0 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x70ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.882852:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.882855:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114edaa0e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x70ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.882861:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281267328 00010000:00010000:2.0:1713279306.882861:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x70ad:0x0].0x0 (ffff88008dba4c00) 00010000:00010000:2.0:1713279306.882863:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.882864:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281267328 00000100:00100000:2.0:1713279306.882864:0:15752:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713279306.882874:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785401 00000100:00100000:0.0:1713279306.882877:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3414:11374:x1796503281267328:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.882882:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.882887:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.882888:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114edaa0e7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7abf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f27 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.882893:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.882898:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.882902:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114edaa0e7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7abf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f27 expref: 3415 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.882902:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f28000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.882905:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00000100:00100000:2.0:1713279306.882905:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:11855:x1796503281267264:12345-192.168.203.4@tcp:36:touch.0 Request processed in 164us (203us total) trans 4295183770 rc 0/0 00010000:00010000:0.0:1713279306.882908:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689440/0xfc4b8e114edaa0e7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7abf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f27 expref: 3415 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.882910:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00000100:00100000:2.0:1713279306.882911:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785400 00010000:00010000:0.0:1713279306.882914:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7abf:0x0].0x0 (ffff8800938abf00) 00010000:00010000:0.0:1713279306.882916:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1713279306.882917:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e689440, rc 0) 00010000:00010000:1.0:1713279306.882918:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x83dc:0x0].0x0 (ffff88008f645500) 00010000:00010000:1.0:1713279306.882920:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1713279306.882922:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.882925:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f28000/0xfc4b8e114edaa007 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x83dc:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00000100:00100000:0.0:1713279306.882929:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3414:11374:x1796503281267328:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 51us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.882933:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785401 00010000:00010000:1.0:1713279306.882939:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114edaa0ee lrc: 3/0,1 mode: --/PW res: [0x200000403:0x874f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.882943:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114edaa0ee lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x874f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.882950:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114edaa0ee lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x874f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.882957:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114edaa0f5 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.882960:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114edaa0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.882963:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114edaa0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.882968:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c90d80/0xfc4b8e114edaa0fc lrc: 3/0,1 mode: --/PW res: [0x200000403:0x83dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.882970:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c90d80/0xfc4b8e114edaa0fc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.882973:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c90d80/0xfc4b8e114edaa0fc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00000004:00010000:1.0:1713279306.882976:0:6943:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880090a4f100 reply state ffff880095770000 transno 4295202765 ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114edaa0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.882980:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114edaa0f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x24d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.882983:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24d:0x0].0x0 (ffff880092a4cf00) 00010000:00010000:1.0:1713279306.882984:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.882985:0:6943:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:1.0:1713279306.882986:0:6943:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880090a4f100 reply state ffff880095770000 transno 4295202765 ns: mdt-lustre-MDT0000_UUID lock: ffff880130c90d80/0xfc4b8e114edaa0fc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.882990:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c90d80/0xfc4b8e114edaa0fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.882993:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x83dc:0x0].0x0 (ffff880092a4c300) 00010000:00010000:1.0:1713279306.882994:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.882995:0:6943:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00010000:1.0:1713279306.882998:0:6943:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880090a4f100 reply state ffff880095770000 transno 4295202765 ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114edaa0ee lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x874f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883001:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114edaa0ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x874f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883003:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x874f:0x0].0x0 (ffff880092a4c800) 00010000:00010000:1.0:1713279306.883004:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.883005:0:6943:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:1.0:1713279306.883008:0:6943:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda9ff9 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883011:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda9ff9 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883013:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda9ff9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883016:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda9ff9 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883018:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f29b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.883020:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda9ff9 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883023:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda9ff9 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883027:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x0 (ffff8801250c1b00) 00010000:00010000:1.0:1713279306.883028:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.883029:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda9ff9 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883032:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f29b00/0xfc4b8e114eda9ff9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00000004:00010000:1.0:1713279306.883038:0:6943:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880090a4f100 reply state ffff880095770000 transno 4295202765 ns: mdt-lustre-MDT0000_UUID lock: ffff880096f286c0/0xfc4b8e114edaa000 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883042:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f286c0/0xfc4b8e114edaa000 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883045:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x3131 (ffff8801250c1e00) 00010000:00010000:1.0:1713279306.883046:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.883047:0:6943:0:(service.c:188:ptlrpc_save_lock()) nlocks 3 00010000:00010000:1.0:1713279306.883048:0:6943:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b180/0xfc4b8e114eda9feb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883051:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b180/0xfc4b8e114eda9feb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883053:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b180/0xfc4b8e114eda9feb lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883056:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b180/0xfc4b8e114eda9feb lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883058:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f2b180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.883060:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b180/0xfc4b8e114eda9feb lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883062:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b180/0xfc4b8e114eda9feb lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883065:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x0 (ffff8801250c1800) 00010000:00010000:1.0:1713279306.883079:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.883080:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b180/0xfc4b8e114eda9feb lrc: 3/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883083:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b180/0xfc4b8e114eda9feb lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00000004:00010000:1.0:1713279306.883090:0:6943:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880090a4f100 reply state ffff880095770000 transno 4295202765 ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda9ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883094:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda9ff2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883097:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x3131 (ffff8801250c1900) 00010000:00010000:1.0:1713279306.883098:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.883098:0:6943:0:(service.c:188:ptlrpc_save_lock()) nlocks 4 00010000:00010000:1.0:1713279306.883101:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883104:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883107:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883109:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e7ba400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.883111:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883113:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000020 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713279306.883117:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.883118:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.883121:0:6943:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda9c48 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9c2c expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.883126:0:6943:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda9c48 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda9c2c expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.883130:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda9c48 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda9c2c expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.883134:0:6943:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda9df3 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9dec expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.883145:0:6943:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda9c48 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9c2c expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.883150:0:6943:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc9880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6943:1796503200056128:0@lo:105: 00000100:00100000:1.0:1713279306.883165:0:6943:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.883181:0:6943:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092abfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.883190:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281267136 00000100:00100000:1.0:1713279306.883192:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281267136 00000100:00100000:2.0:1713279306.883202:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200056128 00000100:00100000:2.0:1713279306.883206:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200056128 00000100:00100000:1.0:1713279306.883208:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223105 00000100:00100000:1.0:1713279306.883212:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3414:9807:x1796503281267136:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1713279306.883218:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.883228:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33451 00000100:00100000:0.0:1713279306.883233:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.883233:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6943:x1796503200056128:12345-0@lo:105: 00000100:00100000:0.0:1713279306.883240:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281267584 00010000:00010000:2.0:1713279306.883240:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.883242:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281267584 00010000:00010000:2.0:1713279306.883247:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.883252:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281267520 00000100:00100000:0.0:1713279306.883253:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281267520 00010000:00010000:2.0:1713279306.883254:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.883260:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785402 00010000:00010000:2.0:1713279306.883261:0:9213:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.883266:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3720:11711:x1796503281267584:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.883267:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.883268:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785403 00000100:00100000:1.0:1713279306.883268:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:9807:x1796503281267136:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 55us (825us total) trans 4295183771 rc 0/0 00000100:00100000:0.0:1713279306.883271:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:11204:x1796503281267520:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.883272:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223105 00010000:00010000:2.0:1713279306.883273:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.883274:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.883280:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.883281:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8d440/0xfc4b8e114edaa103 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f35 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.883293:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88008fd88240) 00000100:00100000:2.0:1713279306.883318:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6943:x1796503200056128:12345-0@lo:105: Request processed in 85us (151us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.883319:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.883323:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114edaa10a lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.883325:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114edaa111 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f2e expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.883325:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33451 00000100:00100000:1.0:1713279306.883329:0:6943:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc9880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6943:1796503200056128:0@lo:105: 00010000:00010000:3.0:1713279306.883329:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114edaa10a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.883333:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114edaa10a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.883336:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.883339:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963b9680/0xfc4b8e114edaa118 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.883340:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.883342:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114eda9c02 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.883342:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800963b9680/0xfc4b8e114edaa118 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.883345:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114edaa11f lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.883345:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800963b9680/0xfc4b8e114edaa118 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.883347:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.883353:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114edaa11f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1713279306.883353:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:0.0:1713279306.883357:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114edaa11f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.883358:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114edaa10a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000004:00080000:2.0:1713279306.883359:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1713279306.883361:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaa126 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.883361:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114edaa10a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.883363:0:6943:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:10814:x1796503281257728:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 12348us (12397us total) trans 4295202765 rc 0/0 00010000:00010000:3.0:1713279306.883364:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114edaa10a lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.883365:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaa126 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1713279306.883366:0:6943:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14354 00010000:00010000:0.0:1713279306.883368:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaa126 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.883368:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114edaa10a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.883370:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800902ab840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.883372:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114edaa10a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.883376:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114edaa10a lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.883378:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114edaa11f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.883380:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88007f2ad700) 00010000:00010000:0.0:1713279306.883381:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114edaa11f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.883382:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.883383:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114edaa10a lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.883384:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114edaa11f lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.883386:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800902ab840/0xfc4b8e114edaa10a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.883387:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114edaa11f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.883390:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.883391:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114edaa11f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.883391:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963b9680/0xfc4b8e114edaa118 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.883394:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114edaa11f lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.883394:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800963b9680/0xfc4b8e114edaa118 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.883395:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaa12d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.883397:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800963b9680/0xfc4b8e114edaa118 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.883400:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:3.0:1713279306.883400:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800963b9680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.883401:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800963b9680/0xfc4b8e114edaa118 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.883402:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.883403:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114edaa11f lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.883403:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaa12d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.883404:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800963b9680/0xfc4b8e114edaa118 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.883406:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689d40/0xfc4b8e114edaa11f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1713279306.883406:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.883407:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880096da6500) 00010000:00010000:3.0:1713279306.883408:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.883409:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaa12d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.883409:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800963b9680/0xfc4b8e114edaa118 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.883436:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114edaa134 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.883436:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800963b9680/0xfc4b8e114edaa118 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.883442:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114edaa134 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.883446:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114edaa134 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.883452:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8d440/0xfc4b8e114edaa103 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f35 expref: 3721 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.883454:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0240/0xfc4b8e114edaa13b lrc: 3/0,1 mode: --/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.883457:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0240/0xfc4b8e114edaa13b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.883460:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0240/0xfc4b8e114edaa13b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.883460:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8d440/0xfc4b8e114edaa103 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f35 expref: 3721 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.883469:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bf8d440, rc 0) 00010000:00010000:0.0:1713279306.883493:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaa126 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.883497:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaa126 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.883500:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaa126 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.883502:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.883505:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0240/0xfc4b8e114edaa13b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.883508:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0240/0xfc4b8e114edaa13b lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.883512:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0240/0xfc4b8e114edaa13b lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.883514:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b0240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.883516:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0240/0xfc4b8e114edaa13b lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.883518:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0240/0xfc4b8e114edaa13b lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00000100:00100000:1.0:1713279306.883521:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.883523:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76b7:0x0].0x0 (ffff880096b8e600) 00010000:00010000:2.0:1713279306.883524:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.883526:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0240/0xfc4b8e114edaa13b lrc: 2/0,0 mode: --/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.883528:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0240/0xfc4b8e114edaa13b lrc: 0/0,0 mode: --/EX res: [0x240000403:0x76b7:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713279306.883536:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281267712 00010000:00010000:2.0:1713279306.883537:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaa12d lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.883540:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaa12d lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713279306.883540:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281267712 00010000:00010000:0.0:1713279306.883541:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaa126 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.883543:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaa12d lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.883545:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaa126 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.883545:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaa12d lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.883548:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800919a0000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.883549:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff88012d397500) 00010000:00010000:2.0:1713279306.883549:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaa12d lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.883550:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.883552:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaa126 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.883552:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaa12d lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.883555:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaa126 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.883555:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:2.0:1713279306.883556:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.883557:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaa12d lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:1.0:1713279306.883558:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.883560:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaa12d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713279306.883562:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281267840 00010000:00010000:2.0:1713279306.883563:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114edaa134 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713279306.883564:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281267840 00010000:00010000:2.0:1713279306.883566:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114edaa134 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00000100:00100000:1.0:1713279306.883568:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785404 00010000:00010000:2.0:1713279306.883568:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114edaa134 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.883570:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114edaa111 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f2e expref: 3716 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.883571:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b21c0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.883572:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281267712:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.883573:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114edaa134 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.883575:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68aac0/0xfc4b8e114edaa111 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f2e expref: 3716 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.883575:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114edaa134 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713279306.883576:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785405 00010000:00010000:1.0:1713279306.883578:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.883578:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff880096b8e700) 00010000:00010000:0.0:1713279306.883579:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68aac0, rc 0) 00010000:00010000:2.0:1713279306.883579:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.883579:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:12001:x1796503281267840:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.883581:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114edaa134 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.883583:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b21c0/0xfc4b8e114edaa134 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.883585:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93cc0/0xfc4b8e114edaa142 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f3c expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.883586:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.883588:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.883591:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edaa149 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f43 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.883592:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.883595:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:11204:x1796503281267520:12345-192.168.203.4@tcp:101:touch.0 Request processed in 323us (361us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.883595:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.883598:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785403 00010000:00010000:2.0:1713279306.883602:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000004:00020000:2.0:1713279306.883603:0:15514:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0001: migrate [0x240000402:0x1:0x0]/0 failed: rc = -16 00010000:00010000:1.0:1713279306.883613:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114edaa150 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.883620:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114edaa150 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.883622:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:385c4b71-808c-40cf-91de-b076b668d13f+3655:11879:x1796503281258112:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 12459us (12640us total) trans 0 rc -16/-16 00010000:00010000:1.0:1713279306.883626:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114edaa150 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.883626:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14355 00010000:00010000:3.0:1713279306.883626:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d29440/0xfc4b8e114edaa157 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.883631:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d29440/0xfc4b8e114edaa157 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.883635:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114edaa15e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.883636:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d29440/0xfc4b8e114edaa157 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.883640:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114edaa15e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.883642:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114edaa165 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.883645:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114edaa165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.883649:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114edaa15e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.883649:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114edaa165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.883664:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114edaa150 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.883665:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943f3600/0xfc4b8e114edaa16c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.883669:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114edaa150 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.883670:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800943f3600/0xfc4b8e114edaa16c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.883674:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114edaa150 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.883674:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800943f3600/0xfc4b8e114edaa16c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00000004:00200000:3.0:1713279306.883677:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8430:0x0]: returning size 3214 00010000:00010000:1.0:1713279306.883679:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114edaa150 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.883683:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880130c90240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.883685:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114edaa150 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.883690:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114edaa150 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.883698:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880092a4c400) 00010000:00010000:3.0:1713279306.883699:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d29440/0xfc4b8e114edaa157 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.883700:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.883702:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114edaa150 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.883702:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d29440/0xfc4b8e114edaa157 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.883705:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d29440/0xfc4b8e114edaa157 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.883706:0:8071:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713279306.883707:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130c90240/0xfc4b8e114edaa150 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.883708:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d29440/0xfc4b8e114edaa157 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.883709:0:8071:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.883711:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091d29440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.883712:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d29440/0xfc4b8e114edaa157 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.883713:0:8071:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd88240 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:1.0:1713279306.883715:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114edaa15e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.883715:0:8071:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.883715:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d29440/0xfc4b8e114edaa157 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.883720:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114edaa15e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00000004:00010000:2.0:1713279306.883720:0:8071:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.883722:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.883723:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.883725:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114edaa15e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.883725:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d29440/0xfc4b8e114edaa157 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.883728:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d29440/0xfc4b8e114edaa157 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.883729:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ef180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.883730:0:8071:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.883731:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114edaa15e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.883732:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114edaa165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.883734:0:8071:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.883735:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114edaa165 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.883736:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114edaa15e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.883738:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114edaa165 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.883741:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff880092a4c500) 00010000:00010000:2.0:1713279306.883741:0:8071:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.883741:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801312c58c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.883742:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114edaa165 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.883743:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.883745:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114edaa15e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.883745:0:8071:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fd88240/0xfc4b8e114eda9c2c lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9c48 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.883745:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114edaa165 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.883747:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200056192:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.883748:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x38 (ffff88008ad67b00) 00010000:00010000:3.0:1713279306.883749:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.883750:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ef180/0xfc4b8e114edaa15e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.883750:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.883750:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.883750:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114edaa165 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.883751:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.883753:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312c58c0/0xfc4b8e114edaa165 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00000100:00100000:0.0:1713279306.883762:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.883767:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93cc0/0xfc4b8e114edaa142 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f3c expref: 3654 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.883767:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edaa149 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f43 expref: 3717 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.883772:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130c93cc0/0xfc4b8e114edaa142 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f3c expref: 3654 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.883772:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200056192 00000100:00100000:2.0:1713279306.883774:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200056192 00010000:00010000:3.0:1713279306.883774:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943f3600/0xfc4b8e114edaa16c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f43 expref: 3716 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.883777:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c93cc0, rc 0) 00010000:00010000:3.0:1713279306.883778:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8430:0x0].0x0 (ffff8800920e4400) 00010000:00010000:3.0:1713279306.883779:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1713279306.883780:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943f3600, rc 0) 00010000:00010000:2.0:1713279306.883781:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda9c48 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9c2c expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.883790:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196577 00000100:00100000:1.0:1713279306.883791:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3653:11912:x1796503281267712:12345-192.168.203.4@tcp:101:touch.0 Request processed in 219us (385us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.883793:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+54:3492:x1796503200056192:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.883796:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785404 00010000:00010000:2.0:1713279306.883797:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.883797:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:12001:x1796503281267840:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 216us (275us total) trans 4295202766 rc 0/0 00010000:00010000:2.0:1713279306.883800:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda9c48 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda9c2c expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.883801:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785405 00010000:00010000:2.0:1713279306.883807:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114eda9c48 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda9c2c expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.883808:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281267904 00000100:00100000:1.0:1713279306.883810:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281267904 00010000:00010000:2.0:1713279306.883812:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:2.0:1713279306.883814:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda9df3 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9dec expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.883818:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3720:11711:x1796503281267584:12345-192.168.203.4@tcp:101:touch.0 Request processed in 553us (600us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.883819:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda9df3 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda9dec expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.883820:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110557 00000100:00100000:3.0:1713279306.883822:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785402 00000100:00100000:1.0:1713279306.883823:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+100:1956:x1796503281267904:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:2.0:1713279306.883823:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda9df3 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda9dec expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.883827:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda9ee8 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9eb7 expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.883836:0:6916:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda9df3 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9dec expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713279306.883838:0:11415:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000400:0x1048:0x0] initial LVB size: 0, mtime: 0x661e9145, atime: 0x661e9145, ctime: 0x661e9145, blocks: 0x0 00000100:00100000:2.0:1713279306.883841:0:6916:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099c2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6916:1796503200056256:0@lo:105: 00010000:00010000:1.0:1713279306.883842:0:11415:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800936ee880/0xfc4b8e114edaa17a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1048:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.883846:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.883847:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.883849:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936ee880/0xfc4b8e114edaa17a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1048:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.883854:0:11415:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936ee880/0xfc4b8e114edaa17a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1048:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.883857:0:6916:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.883860:0:11415:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800936ee880/0xfc4b8e114edaa17a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1048:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.883863:0:11415:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800936ee880/0xfc4b8e114edaa17a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1048:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.883864:0:6916:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009606c900 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.883867:0:11415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800936ee880/0xfc4b8e114edaa17a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1048:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.883871:0:11415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ee880 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:1.0:1713279306.883872:0:11415:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800936ee880/0xfc4b8e114edaa17a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1048:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.883874:0:9213:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1713279306.883876:0:11415:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800936ee880/0xfc4b8e114edaa17a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1048:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.883878:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200056256 00000100:00100000:2.0:1713279306.883880:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200056256 00010000:00010000:1.0:1713279306.883882:0:11415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800936ee880/0xfc4b8e114edaa17a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1048:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.883886:0:11415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936ee880/0xfc4b8e114edaa17a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1048:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.883891:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.883895:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33452 00000100:00100000:2.0:1713279306.883897:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f486c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6916:x1796503200056256:12345-0@lo:105: 00000100:00100000:0.0:1713279306.883901:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281267968 00010000:00010000:2.0:1713279306.883902:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.883904:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281267968 00000100:00100000:1.0:1713279306.883906:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:1956:x1796503281267904:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 82us (348us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.883906:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.883910:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110557 00010000:00010000:2.0:1713279306.883910:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.883913:0:9213:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.883916:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.883917:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110558 00000100:00100000:1.0:1713279306.883919:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+100:1957:x1796503281267968:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:2.0:1713279306.883920:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.883923:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.883930:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88012d320b40) 00000100:00100000:2.0:1713279306.883945:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f486c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6916:x1796503200056256:12345-0@lo:105: Request processed in 46us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.883948:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33452 00000100:00100000:3.0:1713279306.883957:0:6916:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099c2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6916:1796503200056256:0@lo:105: 00010000:00010000:3.0:1713279306.883964:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.883970:0:15502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.883972:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:1957:x1796503281267968:12345-192.168.203.4@tcp:2:touch.0 Request processed in 51us (83us total) trans 4295010136 rc 0/0 00010000:00010000:2.0:1713279306.883974:0:15502:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.883976:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110558 00000100:00100000:3.0:1713279306.883979:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+53:3492:x1796503200056192:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (217us total) trans 0 rc 0/0 00000004:00080000:2.0:1713279306.883983:0:15502:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1713279306.883984:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196577 00000100:00100000:0.0:1713279306.883989:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200056192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.884027:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114edaa181 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x264:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15502 initiator: MDT0 00010000:00010000:2.0:1713279306.884032:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114edaa181 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.884036:0:15502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114edaa181 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.884041:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114edaa188 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x264:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15502 initiator: MDT0 00010000:00010000:2.0:1713279306.884044:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114edaa188 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x264:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.884047:0:15502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114edaa188 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x264:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.884051:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 3/0,1 mode: --/CW res: [0x240000400:0x242:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15502 initiator: MDT0 00010000:00010000:2.0:1713279306.884056:0:15502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013585cd80/0xfc4b8e114eda8741 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175851 expref: 3414 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.884060:0:15502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 4/0,1 mode: --/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.884084:0:15502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013585cd80/0xfc4b8e114eda8741 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175851 expref: 3414 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.884090:0:15502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013585cd80/0xfc4b8e114eda8741 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175851 expref: 3414 pid: 15479 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.884096:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099c2e300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200056320:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.884118:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ffbdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.884195:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.884211:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281268096 00000100:00100000:3.0:1713279306.884215:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281268096 00000100:00100000:3.0:1713279306.884234:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785406 00000100:00100000:3.0:1713279306.884238:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:10814:x1796503281268096:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.884248:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.884255:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114edaa196 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f4a expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.884279:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114edaa19d lrc: 3/1,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884283:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114edaa19d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884287:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114edaa19d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884291:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaa1a4 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884294:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaa1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884297:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaa1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884310:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114edaa19d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884313:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114edaa19d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884317:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114edaa19d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884319:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114edaa19d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884322:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801312f6640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.884323:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114edaa19d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884329:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114edaa19d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884333:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x0 (ffff88011f3ebc00) 00010000:00010000:3.0:1713279306.884334:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.884335:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114edaa19d lrc: 3/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884338:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312f6640/0xfc4b8e114edaa19d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884343:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaa1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884346:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaa1a4 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884348:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaa1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884351:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d3218c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.884352:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaa1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884355:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaa1a4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884358:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x3131 (ffff8801250c1e00) 00010000:00010000:3.0:1713279306.884359:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.884360:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaa1a4 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884363:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaa1a4 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.884373:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114edaa196 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f4a expref: 3717 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.884377:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fef8b40/0xfc4b8e114edaa196 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f4a expref: 3717 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.884383:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fef8b40, rc 0) 00000100:00100000:3.0:1713279306.884407:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:10814:x1796503281268096:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 168us (211us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.884410:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785406 00000100:00100000:0.0:1713279306.884486:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.884496:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281268224 00000100:00100000:3.0:1713279306.884499:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281268224 00000100:00100000:0.0:1713279306.884503:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.884514:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281268352 00000100:00100000:3.0:1713279306.884516:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281268352 00000100:00100000:1.0:1713279306.884521:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785407 00000100:00100000:1.0:1713279306.884524:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3653:11879:x1796503281268224:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.884532:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.884532:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785408 00000100:00100000:3.0:1713279306.884537:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:11204:x1796503281268352:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.884538:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ec900/0xfc4b8e114edaa1ab lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f51 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.884544:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.884552:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321d40/0xfc4b8e114edaa1b2 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f58 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.884558:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114edaa1b9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.884563:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114edaa1b9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.884569:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114edaa1b9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.884574:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114edaa1c0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.884577:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114edaa1c0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.884580:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114edaa1c0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.884598:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaa1c7 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.884605:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaa1c7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.884612:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaa1c7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.884621:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaa1ce lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.884624:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaa1ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.884628:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaa1ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000004:00200000:1.0:1713279306.884629:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76b7:0x0]: returning size 4096 00000100:00100000:0.0:1713279306.884635:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00200000:3.0:1713279306.884638:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:3.0:1713279306.884643:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaa1c7 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.884646:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaa1c7 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.884648:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaa1c7 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00000100:00100000:2.0:1713279306.884649:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281268480 00010000:00010000:1.0:1713279306.884650:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114edaa1b9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.884651:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaa1c7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00000100:00100000:2.0:1713279306.884653:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281268480 00010000:00010000:3.0:1713279306.884654:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d322400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.884655:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114edaa1b9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.884655:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaa1c7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.884658:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaa1c7 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.884660:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114edaa1b9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.884662:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00000100:00100000:0.0:1713279306.884663:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.884663:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.884665:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114edaa1b9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.884665:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaa1c7 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:2.0:1713279306.884668:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281268608 00010000:00010000:1.0:1713279306.884669:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ecd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.884670:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaa1c7 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:2.0:1713279306.884671:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281268608 00010000:00010000:1.0:1713279306.884672:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114edaa1b9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.884675:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785409 00010000:00010000:3.0:1713279306.884675:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaa1ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.884677:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114edaa1b9 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.884678:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3656:11912:x1796503281268480:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.884678:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaa1ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.884681:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaa1ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.884684:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.884684:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00000100:00100000:2.0:1713279306.884684:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785410 00010000:00010000:3.0:1713279306.884684:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.884686:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.884686:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaa1ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.884688:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaa1ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.884689:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114edaa1b9 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.884689:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:11981:x1796503281268608:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.884690:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa1dc lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f5f expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.884691:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88011f3eb900) 00010000:00010000:3.0:1713279306.884692:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.884693:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ecd80/0xfc4b8e114edaa1b9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.884694:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaa1ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.884696:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaa1ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.884697:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.884702:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114edaa1c0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.884705:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869200/0xfc4b8e114edaa1e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x119:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f66 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.884707:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114edaa1c0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.884710:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321d40/0xfc4b8e114edaa1b2 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f58 expref: 3416 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.884712:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114edaa1c0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.884714:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321d40/0xfc4b8e114edaa1b2 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f58 expref: 3416 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.884717:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ed8c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.884719:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114edaa1c0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.884720:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d321d40, rc 0) 00010000:00010000:0.0:1713279306.884723:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaa1ea lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.884724:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114edaa1c0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.884730:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaa1ea lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.884730:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff880092a4c100) 00010000:00010000:1.0:1713279306.884732:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.884733:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114edaa1f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x119:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.884734:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaa1ea lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.884734:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114edaa1c0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.884738:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:11204:x1796503281268352:12345-192.168.203.4@tcp:101:touch.0 Request processed in 201us (234us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.884739:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ed8c0/0xfc4b8e114edaa1c0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.884740:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114edaa1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.884742:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785408 00010000:00010000:2.0:1713279306.884747:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114edaa1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.884757:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114edaa1f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x119:0x0].0x3032 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.884762:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ec900/0xfc4b8e114edaa1ab lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f51 expref: 3657 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.884763:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114edaa1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.884768:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114edaa1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.884769:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800936ec900/0xfc4b8e114edaa1ab lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f51 expref: 3657 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.884781:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ec900, rc 0) 00010000:00010000:0.0:1713279306.884788:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaa1ff lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.884792:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaa1ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.884796:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaa1ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.884799:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3656:11879:x1796503281268224:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 273us (312us total) trans 4295183772 rc 301/301 00000004:00200000:0.0:1713279306.884805:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00000100:00100000:1.0:1713279306.884805:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785407 00010000:00010000:0.0:1713279306.884811:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaa1ea lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.884814:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaa1ea lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.884815:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa206 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8290:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.884817:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaa1ea lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.884820:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaa1ea lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.884822:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa206 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8290:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.884823:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.884828:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa206 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8290:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000004:00200000:2.0:1713279306.884834:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8290:0x0]: returning size 0 00000100:00100000:1.0:1713279306.884856:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.884858:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaa1ea lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.884860:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114edaa1f1 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.884862:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaa1ea lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.884866:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114edaa1f1 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.884867:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281268672 00000100:00100000:3.0:1713279306.884869:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281268672 00010000:00010000:0.0:1713279306.884870:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880095863300) 00010000:00010000:0.0:1713279306.884871:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.884871:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114edaa1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.884873:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaa1ea lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.884876:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaa1ea lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.884876:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114edaa1f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.884876:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013585cd80/0xfc4b8e114eda8741 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175851 expref: 3415 pid: 15479 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.884880:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c869f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.884881:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaa1ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.884883:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114edaa1f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.884884:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaa1ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.884885:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.884885:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196578 00010000:00010000:2.0:1713279306.884888:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114edaa1f1 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.884888:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:1956:x1796503281268672:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.884892:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.884895:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88013585cd80/0xfc4b8e114eda8741 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175851 expref: 3415 pid: 15479 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.884896:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x119:0x0].0x0 (ffff88009228ea00) 00010000:00010000:2.0:1713279306.884898:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.884900:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88013585cd80/0xfc4b8e114eda8741 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x242:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175851 expref: 3415 pid: 15479 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.884901:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114edaa1f1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.884906:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x242:0x0].0x0 (ffff880130675b00) 00010000:00010000:3.0:1713279306.884908:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 3/0,1 mode: --/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.884909:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869f80/0xfc4b8e114edaa1f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x119:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.884912:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.884915:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.884916:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114edaa1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.884921:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaa1ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.884921:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114edaa1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.884923:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.884924:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e6886c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.884925:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114edaa1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.884926:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaa1ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.884929:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaa1ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.884929:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f557840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.884931:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114edaa1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.884933:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880095863700) 00010000:00010000:0.0:1713279306.884934:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.884934:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:1956:x1796503281268672:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 45us (78us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.884935:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaa1ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.884935:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.884936:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114edaa1f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x119:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.884937:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196578 00010000:00010000:0.0:1713279306.884938:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaa1ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.884942:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281268736 00010000:00010000:2.0:1713279306.884943:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x119:0x0].0x3032 (ffff880096b8ef00) 00000100:00100000:3.0:1713279306.884943:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281268736 00010000:00010000:2.0:1713279306.884946:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.884948:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114edaa1f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x119:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.884951:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147270 00010000:00010000:0.0:1713279306.884953:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa1dc lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f5f expref: 3655 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.884953:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f557840/0xfc4b8e114edaa1f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x119:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.884954:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3719:1956:x1796503281268736:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.884958:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa1dc lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f5f expref: 3655 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.884958:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.884962:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943f3600/0xfc4b8e114edaa16c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f43 expref: 3719 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.884963:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68a1c0, rc 0) 00010000:00010000:3.0:1713279306.884967:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8430:0x0].0x0 (ffff8800920e4400) 00010000:00010000:3.0:1713279306.884969:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.884975:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869200/0xfc4b8e114edaa1e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x119:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f66 expref: 3719 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.884978:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3719:1956:x1796503281268736:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 23us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.884981:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147270 00010000:00010000:2.0:1713279306.884985:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa206 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8290:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f66 expref: 3718 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.884993:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.884995:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8290:0x0].0x0 (ffff8800824f1800) 00010000:00010000:2.0:1713279306.884997:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.885000:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf7cc0, rc 0) 00000100:00100000:1.0:1713279306.885004:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281268992 00000100:00100000:1.0:1713279306.885007:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281268992 00000100:00100000:2.0:1713279306.885010:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281268864 00000100:00100000:2.0:1713279306.885013:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281268864 00000100:00100000:0.0:1713279306.885018:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281268480:12345-192.168.203.4@tcp:101:touch.0 Request processed in 339us (382us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.885021:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785411 00000100:00100000:0.0:1713279306.885025:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785409 00000100:00100000:1.0:1713279306.885026:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:10814:x1796503281268992:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:2.0:1713279306.885030:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14360 00010000:00010000:1.0:1713279306.885034:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.885035:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:11374:x1796503281268864:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:1.0:1713279306.885041:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee640/0xfc4b8e114edaa214 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f6d expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.885044:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.885063:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936edf80/0xfc4b8e114edaa222 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885064:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713279306.885065:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.885082:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936edf80/0xfc4b8e114edaa222 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.885087:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936edf80/0xfc4b8e114edaa222 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885087:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.885092:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114edaa229 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x24a:0x0].0x3131 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885094:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.885096:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114edaa229 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.885099:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114edaa229 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.885105:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099c2ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200056384:0@lo:101:mdt_io00_007.0 00000100:00100000:2.0:1713279306.885124:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:1.0:1713279306.885140:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x874f:0x0]: returning size 4096 00000100:00100000:0.0:1713279306.885143:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200056384 00000100:00100000:2.0:1713279306.885143:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a0e540 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.885146:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200056384 00000100:00100000:0.0:1713279306.885158:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98890 00010000:00010000:1.0:1713279306.885159:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936edf80/0xfc4b8e114edaa222 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.885161:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+53:15514:x1796503200056384:12345-0@lo:101:mdt_io00_007.0 00010000:00010000:2.0:1713279306.885161:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013585cd80/0xfc4b8e114eda8741 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x242:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175851 expref: 3415 pid: 15479 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.885162:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936edf80/0xfc4b8e114edaa222 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.885165:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936edf80/0xfc4b8e114edaa222 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.885167:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.885168:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936edf80/0xfc4b8e114edaa222 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.885170:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099c2e300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200056320:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.885171:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936edf80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.885172:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b840/0xfc4b8e114edaa237 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114edaa21b expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.885172:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936edf80/0xfc4b8e114edaa222 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.885175:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936edf80/0xfc4b8e114edaa222 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885178:0:15502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.885180:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.885180:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x0 (ffff880092a4ca00) 00010000:00010000:1.0:1713279306.885181:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.885182:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936edf80/0xfc4b8e114edaa222 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.885184:0:15516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b840/0xfc4b8e114edaa237 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114edaa21b expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.885184:0:15502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.885185:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936edf80/0xfc4b8e114edaa222 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.885190:0:15516:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.885190:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114edaa229 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885191:0:15502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.885195:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b840/0xfc4b8e114edaa237 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa21b expref: 54 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.885195:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114edaa229 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.885198:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114edaa229 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.885201:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936efcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.885201:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11440/0xfc4b8e114edaa23e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x242:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15502 initiator: MDT0 00010000:00010000:0.0:1713279306.885202:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.885202:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114edaa229 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.885204:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.885205:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114edaa229 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.885206:0:15516:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda9ee8 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9eb7 expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.885207:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11440/0xfc4b8e114edaa23e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.885208:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x3131 (ffff8801250c1900) 00010000:00010000:0.0:1713279306.885209:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68b840, rc 0) 00010000:00010000:1.0:1713279306.885209:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.885210:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114edaa229 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.885212:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936efcc0/0xfc4b8e114edaa229 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885214:0:15502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11440/0xfc4b8e114edaa23e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.885225:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee640/0xfc4b8e114edaa214 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x24a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f6d expref: 3720 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.885229:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ee640/0xfc4b8e114edaa214 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x24a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f6d expref: 3720 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.885233:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+54:15514:x1796503200056384:12345-0@lo:101:mdt_io00_007.0 Request processed in 71us (109us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.885233:0:15502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15502 initiator: MDT0 00010000:00010000:1.0:1713279306.885235:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ee640, rc 0) 00000100:00100000:0.0:1713279306.885236:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98890 00010000:00010000:2.0:1713279306.885242:0:15502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800966fe880/0xfc4b8e114eccdab5 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39133bd4 expref: 3653 pid: 6930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.885248:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3719:10814:x1796503281268992:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 222us (256us total) trans 4295202768 rc 301/301 00010000:00010000:2.0:1713279306.885249:0:15502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114ecedcfd lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913d4d8 expref: 3414 pid: 15469 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.885251:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785411 00010000:00010000:2.0:1713279306.885256:0:15502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880092542640/0xfc4b8e114eda9c1e lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x6c09:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dfa expref: 3414 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.885258:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099c2ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200056384:0@lo:101:mdt_io00_007.0 00000100:00100000:0.0:1713279306.885260:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.885262:0:15502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 6/0,1 mode: --/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.885265:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.885270:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281269184 00010000:00010000:3.0:1713279306.885270:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.885272:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281269184 00010000:00010000:2.0:1713279306.885276:0:15502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880092542640/0xfc4b8e114eda9c1e lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6c09:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dfa expref: 3414 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.885282:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110559 00000100:00100000:1.0:1713279306.885285:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:12001:x1796503281269184:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.885286:0:15502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880092542640/0xfc4b8e114eda9c1e lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x6c09:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dfa expref: 3414 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.885290:0:11415:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.885295:0:11415:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936ed200/0xfc4b8e114edaa24c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f74 expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.885295:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099c2e300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200056448:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.885304:0:11415:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda80f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756c2 expref: 84 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.885308:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.885309:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.885311:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936ed200/0xfc4b8e114edaa24c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [28672->40959] (req 28672->40959) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f74 expref: 102 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.885320:0:15502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114ecedcfd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913d4d8 expref: 3414 pid: 15469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.885321:0:11415:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda80f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756c2 expref: 84 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.885326:0:11415:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda80f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756c2 expref: 84 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.885328:0:15502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114ecedcfd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913d4d8 expref: 3414 pid: 15469 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.885333:0:11415:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c160a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11415:1796503200056576:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.885336:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099c2c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200056512:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.885346:0:11415:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800929bd780 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.885355:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281269120 00010000:00010000:2.0:1713279306.885355:0:15502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800966fe880/0xfc4b8e114eccdab5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39133bd4 expref: 3653 pid: 6930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.885356:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281269120 00010000:00010000:2.0:1713279306.885360:0:15502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800966fe880/0xfc4b8e114eccdab5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39133bd4 expref: 3653 pid: 6930 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.885365:0:15502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200056640:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.885366:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223106 00000100:00100000:1.0:1713279306.885368:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:11855:x1796503281269120:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1713279306.885371:0:15502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a0ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.885383:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:11981:x1796503281268608:12345-192.168.203.4@tcp:101:touch.0 Request processed in 694us (719us total) trans 4295202767 rc 0/0 00000100:00100000:2.0:1713279306.885387:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785410 00000100:00100000:2.0:1713279306.885395:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281269312 00000100:00100000:2.0:1713279306.885397:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281269312 00000100:00100000:2.0:1713279306.885406:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785412 00000100:00100000:2.0:1713279306.885408:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3654:11711:x1796503281269312:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.885427:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3416:11855:x1796503281269120:12345-192.168.203.4@tcp:35:touch.0 Request processed in 42us (366us total) trans 4295183773 rc 0/0 00010000:00010000:2.0:1713279306.885429:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.885432:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223106 00010000:00010000:2.0:1713279306.885436:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12ac0/0xfc4b8e114edaa253 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f7b expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.885456:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114edaa25a lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.885461:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114edaa25a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885465:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114edaa25a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885470:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114edaa261 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.885473:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114edaa261 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.885474:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.885476:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.885476:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114edaa261 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885487:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114edaa25a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885490:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114edaa25a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885493:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114edaa25a lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885496:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114edaa25a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885499:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed51f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.885500:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114edaa25a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885504:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114edaa25a lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885508:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880135885d00) 00010000:00010000:2.0:1713279306.885509:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.885511:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114edaa25a lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885514:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114edaa25a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885518:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114edaa261 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885521:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114edaa261 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885523:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114edaa261 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885526:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076e1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.885527:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114edaa261 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.885529:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281269440 00010000:00010000:2.0:1713279306.885530:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114edaa261 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.885531:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281269440 00010000:00010000:2.0:1713279306.885533:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880135885c00) 00010000:00010000:2.0:1713279306.885534:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.885535:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114edaa261 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.885538:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e1c0/0xfc4b8e114edaa261 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.885541:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223107 00000100:00100000:1.0:1713279306.885544:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3656:11879:x1796503281269440:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1713279306.885546:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.885549:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12ac0/0xfc4b8e114edaa253 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f7b expref: 3656 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.885553:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd12ac0/0xfc4b8e114edaa253 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f7b expref: 3656 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.885556:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281269568 00000100:00100000:0.0:1713279306.885559:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281269568 00010000:00010000:2.0:1713279306.885560:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd12ac0, rc 0) 00000100:00100000:0.0:1713279306.885570:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281269696 00000100:00100000:2.0:1713279306.885570:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3655:11711:x1796503281269312:12345-192.168.203.4@tcp:101:touch.0 Request processed in 160us (310us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.885571:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281269696 00000100:00100000:2.0:1713279306.885573:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785412 00000100:00100000:0.0:1713279306.885579:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785413 00000100:00100000:2.0:1713279306.885582:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785414 00000100:00100000:0.0:1713279306.885583:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3719:11204:x1796503281269568:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.885585:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3719:12006:x1796503281269696:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.885588:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.885590:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.885593:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa268 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f82 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.885594:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edaa26f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f89 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.885596:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3655:11879:x1796503281269440:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 50us (120us total) trans 4295183774 rc 0/0 00000100:00100000:1.0:1713279306.885602:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223107 00010000:00010000:0.0:1713279306.885613:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa276 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.885617:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa276 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885620:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaa27d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.885624:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa276 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885625:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaa27d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.885629:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa284 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885629:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaa27d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.885632:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa284 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885634:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114edaa28b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.885635:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa284 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885638:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114edaa28b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.885641:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114edaa28b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.885646:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa276 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.885649:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa276 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.885652:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa276 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.885655:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa276 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.885658:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.885659:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa276 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.885662:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa276 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.885666:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:0.0:1713279306.885667:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.885668:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa276 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.885671:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa276 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000004:00200000:2.0:1713279306.885672:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.885676:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa284 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885677:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaa27d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.885679:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa284 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885680:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaa27d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.885682:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa284 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885683:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaa27d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.885684:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.885685:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa284 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885686:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaa27d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.885688:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa284 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885688:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ceacd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.885690:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaa27d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.885691:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880092ae7700) 00010000:00010000:0.0:1713279306.885692:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.885693:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa284 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885693:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaa27d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.885696:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa284 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.885697:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:2.0:1713279306.885698:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.885699:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaa27d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.885702:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaa27d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.885705:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa268 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f82 expref: 3721 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.885706:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114edaa28b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.885709:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa268 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f82 expref: 3721 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.885711:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114edaa28b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.885714:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68bcc0, rc 0) 00010000:00010000:2.0:1713279306.885714:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114edaa28b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.885716:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e8900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.885718:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114edaa28b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.885720:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114edaa28b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.885723:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff880089dc3900) 00010000:00010000:2.0:1713279306.885724:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.885725:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114edaa28b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.885728:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8900/0xfc4b8e114edaa28b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:0.0:1713279306.885729:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11204:x1796503281269568:12345-192.168.203.4@tcp:101:touch.0 Request processed in 146us (255us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.885732:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785413 00010000:00010000:2.0:1713279306.885738:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edaa26f lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f89 expref: 3719 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.885742:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edaa26f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f89 expref: 3719 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.885746:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013076d200, rc 0) 00000100:00100000:2.0:1713279306.885758:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:12006:x1796503281269696:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 172us (212us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.885762:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785414 00000100:00100000:0.0:1713279306.886583:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.886595:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.886602:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281269888 00000100:00100000:0.0:1713279306.886605:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281269760 00000100:00100000:2.0:1713279306.886606:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281269888 00000100:00100000:0.0:1713279306.886608:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281269760 00000100:00100000:2.0:1713279306.886626:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785415 00000100:00100000:0.0:1713279306.886631:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785416 00000100:00100000:2.0:1713279306.886632:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:10814:x1796503281269760:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:0.0:1713279306.886634:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3655:11912:x1796503281269888:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.886639:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.886641:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.886643:0:11415:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c160a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11415:1796503200056576:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.886645:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114edaa292 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f97 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.886648:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114edaa299 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x24d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f90 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.886649:0:15502:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880099c2e300 x1796503200056448) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880092542640/0xfc4b8e114eda9c1e lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x6c09:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dfa expref: 3415 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.886653:0:11415:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936ed200/0xfc4b8e114edaa24c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [28672->40959] (req 28672->40959) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f74 expref: 102 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.886660:0:11415:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936ed200, rc 0) 00010000:00010000:3.0:1713279306.886663:0:15502:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880092542640/0xfc4b8e114eda9c1e lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6c09:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dfa expref: 3415 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.886664:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa2a0 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.886669:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa2a0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.886671:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9440/0xfc4b8e114edaa2a7 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x24d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.886672:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092542640/0xfc4b8e114eda9c1e lrc: 0/0,0 mode: --/PW res: [0x240000403:0x6c09:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dfa expref: 3415 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.886673:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa2a0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.886674:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+102:12001:x1796503281269184:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 1388us (1608us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.886678:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa2ae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.886678:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9440/0xfc4b8e114edaa2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x24d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.886679:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110559 00000100:00100000:3.0:1713279306.886679:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099c2e300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200056448:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.886681:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa2ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.886684:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa2ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.886685:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9440/0xfc4b8e114edaa2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x24d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.886693:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa2a0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.886697:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa2a0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.886700:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa2a0 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.886702:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa2a0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000004:00200000:2.0:1713279306.886702:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x24d:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.886705:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68ba80 already unused, calling callback (ffffffffa0f0d730) 00000004:00200000:2.0:1713279306.886705:0:15480:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1713279306.886706:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa2a0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.886713:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099c2c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200056512:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.886721:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8fc0/0xfc4b8e114edaa299 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x24d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f90 expref: 3720 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.886732:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9440/0xfc4b8e114edaa2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x24d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f90 expref: 3719 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.886735:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.886738:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24d:0x0].0x0 (ffff880092a4cf00) 00010000:00010000:2.0:1713279306.886741:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1713279306.886742:0:15502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15502:1796503200056640:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.886743:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906e9440, rc 0) 00000100:00100000:1.0:1713279306.886749:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.886754:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa2a0 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.886755:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6c09:0x0].0x0 (ffff880122263f00) 00010000:00010000:3.0:1713279306.886759:0:15502:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.886760:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880131204d00) 00010000:00010000:0.0:1713279306.886761:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.886762:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa2a0 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.886763:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3719:10814:x1796503281269760:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 130us (168us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.886765:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa2a0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.886765:0:15502:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279306.886769:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.886770:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa2ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.886770:0:15502:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279306.886772:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785415 00010000:00010000:0.0:1713279306.886773:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa2ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.886775:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa2ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.886776:0:15502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.886778:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.886780:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa2ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.886783:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa2ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.886786:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff880092ae7500) 00010000:00010000:0.0:1713279306.886787:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.886788:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa2ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.886790:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281269952 00010000:00010000:0.0:1713279306.886791:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa2ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.886793:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281269952 00010000:00010000:0.0:1713279306.886803:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114edaa292 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f97 expref: 3656 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.886803:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda80f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756c2 expref: 85 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.886807:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114edaa292 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f97 expref: 3656 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.886812:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e6898c0, rc 0) 00000100:00100000:3.0:1713279306.886817:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281270016 00000100:00100000:3.0:1713279306.886819:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281270016 00000100:00100000:0.0:1713279306.886821:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281270080 00000100:00100000:0.0:1713279306.886822:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281270080 00010000:00010000:3.0:1713279306.886823:0:15492:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114ecedcfd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913d4d8 expref: 3415 pid: 15469 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.886827:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196579 00010000:00010000:0.0:1713279306.886829:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800966fe880/0xfc4b8e114eccdab5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39133bd4 expref: 3656 pid: 6930 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.886832:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+85:1955:x1796503281269952:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.886835:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196580 00000100:00100000:3.0:1713279306.886838:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:1957:x1796503281270016:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.886840:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.886843:0:15492:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.886844:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196581 00010000:00010000:3.0:1713279306.886846:0:15492:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114ecedcfd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913d4d8 expref: 3415 pid: 15469 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.886847:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:385c4b71-808c-40cf-91de-b076b668d13f+3656:1954:x1796503281270080:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.886849:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda80f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756c2 expref: 85 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.886851:0:15492:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114ecedcfd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913d4d8 expref: 3415 pid: 15469 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.886853:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.886856:0:6915:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800966fe880/0xfc4b8e114eccdab5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39133bd4 expref: 3656 pid: 6930 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.886858:0:15492:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114ecedcfd lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913d4d8 expref: 3415 pid: 15469 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.886859:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda80f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756c2 expref: 85 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.886861:0:6915:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800966fe880/0xfc4b8e114eccdab5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39133bd4 expref: 3656 pid: 6930 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.886865:0:15492:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6c09:0x0].0x0 (ffff880122263f00) 00010000:00010000:3.0:1713279306.886867:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.886871:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.886872:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801298ee880/0xfc4b8e114eda80f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391756c2 expref: 85 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.886874:0:15492:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.886876:0:15492:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.886888:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800966fe880/0xfc4b8e114eccdab5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6c09:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39133bd4 expref: 3656 pid: 6930 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.886892:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.886893:0:6915:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6c09:0x0].0x0 (ffff880122263f00) 00010000:00010000:2.0:1713279306.886894:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.886895:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.886898:0:6915:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.886898:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936ed200/0xfc4b8e114edaa24c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f74 expref: 101 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.886901:0:6915:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.886906:0:6916:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936ed200/0xfc4b8e114edaa24c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f74 expref: 101 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.886908:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.886909:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3414:1957:x1796503281270016:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 69us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.886913:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196580 00000100:00100000:0.0:1713279306.886920:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:385c4b71-808c-40cf-91de-b076b668d13f+3655:1954:x1796503281270080:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 72us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.886923:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196581 00010000:00010000:2.0:1713279306.886924:0:6916:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800936ed200/0xfc4b8e114edaa24c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f74 expref: 101 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.886928:0:15502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.886932:0:15502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279306.886933:0:6916:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121537b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200056704:192.168.203.4@tcp:105: 00000100:00100000:0.0:1713279306.886936:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281269888:12345-192.168.203.4@tcp:101:touch.0 Request processed in 302us (354us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.886940:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785416 00000100:00100000:0.0:1713279306.886949:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.886953:0:6916:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a0e840 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.886963:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.886977:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281270208 00000100:00100000:0.0:1713279306.886979:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.886980:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281270208 00000100:00100000:0.0:1713279306.886986:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281270336 00000100:00100000:0.0:1713279306.886988:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281270336 00000100:00100000:1.0:1713279306.886991:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281270464 00000100:00100000:1.0:1713279306.886993:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281270464 00000100:00100000:2.0:1713279306.886996:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785417 00000100:00100000:2.0:1713279306.887001:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:11855:x1796503281270208:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.887004:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785418 00000100:00100000:0.0:1713279306.887007:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3415:11204:x1796503281270336:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.887008:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785419 00010000:00010000:2.0:1713279306.887009:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.887011:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3720:11711:x1796503281270464:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.887016:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.887017:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114edaa2b5 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175f9e expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.887022:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114edaa2bc lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175fac expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.887027:0:15502:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008242f480 reply state ffff8800967c0000 transno 4295183775 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.887034:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.887038:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6c09:0x0].0x0 (ffff880122263f00) 00010000:00010000:3.0:1713279306.887039:0:15502:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1713279306.887041:0:15502:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.887043:0:15502:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.887044:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edaa2c3 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.887046:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.887050:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.887051:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edaa2c3 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.887053:0:15502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.887055:0:15502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c868480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.887057:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edaa2c3 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.887057:0:15502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.887059:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef840/0xfc4b8e114edaa2ca lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.887063:0:15502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.887064:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.887064:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef840/0xfc4b8e114edaa2ca lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.887066:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb3c0/0xfc4b8e114edaa2d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.887080:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x242:0x0].0x0 (ffff880130675b00) 00010000:00010000:0.0:1713279306.887081:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaa2d8 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175fa5 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.887082:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef840/0xfc4b8e114edaa2ca lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.887082:0:15502:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.887083:0:15502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 3/0,0 mode: --/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.887085:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb3c0/0xfc4b8e114edaa2d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.887087:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edaa18f lrc: 0/0,0 mode: --/CW res: [0x240000400:0x242:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.887089:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114edaa2df lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.887091:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb3c0/0xfc4b8e114edaa2d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.887093:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114edaa2df lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00000004:00010000:3.0:1713279306.887093:0:15502:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008242f480 reply state ffff8800967c0000 transno 4295183775 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11440/0xfc4b8e114edaa23e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.887096:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114edaa2df lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.887097:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11440/0xfc4b8e114edaa23e lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279306.887101:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x242:0x0].0x3131 (ffff880096b8e100) 00010000:00010000:3.0:1713279306.887102:0:15502:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.887103:0:15502:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:3.0:1713279306.887104:0:15502:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114edaa181 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00000004:00200000:1.0:1713279306.887106:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:3.0:1713279306.887107:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114edaa181 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.887111:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef840/0xfc4b8e114edaa2ca lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.887114:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef840/0xfc4b8e114edaa2ca lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.887119:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114edaa181 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.887120:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114edaa2e6 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.887121:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef840/0xfc4b8e114edaa2ca lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.887122:0:15502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114edaa181 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.887124:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114edaa2e6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.887124:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef840/0xfc4b8e114edaa2ca lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.887124:0:15502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800926b0480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.887126:0:15502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114edaa181 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.887127:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ef840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.887128:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114edaa2e6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.887129:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef840/0xfc4b8e114edaa2ca lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.887129:0:15502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114edaa181 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.887132:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef840/0xfc4b8e114edaa2ca lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.887134:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa2ed lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.887134:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x264:0x0].0x0 (ffff880096b8e200) 00010000:00010000:3.0:1713279306.887135:0:15502:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.887136:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880092a4cb00) 00010000:00010000:1.0:1713279306.887137:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.887137:0:15502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114edaa181 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.887138:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa2ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.887139:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef840/0xfc4b8e114edaa2ca lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.887141:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa2ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.887141:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef840/0xfc4b8e114edaa2ca lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.887142:0:15502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800926b0480/0xfc4b8e114edaa181 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x264:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279306.887146:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114edaa2f4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7d64:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.887147:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114edaa2df lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00000004:00200000:0.0:1713279306.887148:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:1.0:1713279306.887150:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114edaa2df lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00000004:00010000:3.0:1713279306.887150:0:15502:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008242f480 reply state ffff8800967c0000 transno 4295183775 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114edaa188 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x264:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279306.887153:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114edaa2e6 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.887153:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114edaa2df lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.887154:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114edaa2f4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7d64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.887155:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ef600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.887156:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114edaa2e6 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.887156:0:15502:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114edaa188 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279306.887157:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114edaa2df lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.887159:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114edaa2df lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.887160:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114edaa2f4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7d64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.887161:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114edaa2e6 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.887161:0:15502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x264:0x0].0x3131 (ffff880096b8ee00) 00010000:00010000:3.0:1713279306.887163:0:15502:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.887164:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114edaa2e6 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.887164:0:15502:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:1.0:1713279306.887165:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880092a4c700) 00010000:00010000:1.0:1713279306.887166:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:2.0:1713279306.887166:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7d64:0x0]: returning size 0 00010000:00010000:0.0:1713279306.887167:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800929098c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.887168:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114edaa2e6 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.887168:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114edaa2df lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.887170:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ef600/0xfc4b8e114edaa2df lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.887170:0:15502:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.887171:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114edaa2e6 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.887175:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:0.0:1713279306.887176:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.887176:0:15502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.887177:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114edaa2e6 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.887180:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800929098c0/0xfc4b8e114edaa2e6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.887182:0:15502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.887183:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114edaa2bc lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fac expref: 3721 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.887184:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa2ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.887187:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa2ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.887188:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936eed00/0xfc4b8e114edaa2bc lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fac expref: 3721 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.887190:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa2ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.887192:0:15502:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1713279306.887193:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f1d73c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.887193:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936eed00, rc 0) 00010000:00010000:0.0:1713279306.887194:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa2ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.887195:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edaa2c3 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.887201:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edaa2c3 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.887206:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edaa2c3 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.887208:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3720:11711:x1796503281270464:12345-192.168.203.4@tcp:101:touch.0 Request processed in 197us (229us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.887212:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785419 00010000:00010000:2.0:1713279306.887212:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edaa2c3 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.887216:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906ea640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.887219:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edaa2c3 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:3.0:1713279306.887221:0:15502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3420:11666:x1796503281261312:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 12043us (12095us total) trans 4295183775 rc 0/0 00010000:00010000:2.0:1713279306.887224:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edaa2c3 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00000100:00100000:3.0:1713279306.887228:0:15502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14356 00010000:00010000:2.0:1713279306.887231:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88008e8c9200) 00010000:00010000:2.0:1713279306.887233:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.887236:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa2ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.887236:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edaa2c3 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.887241:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff8800960e8d00) 00010000:00010000:2.0:1713279306.887241:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edaa2c3 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.887242:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.887243:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713279306.887244:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa2ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.887245:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.887246:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.887247:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa2ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.887248:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb3c0/0xfc4b8e114edaa2d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.887250:0:9214:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320b40 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:2.0:1713279306.887253:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb3c0/0xfc4b8e114edaa2d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.887253:0:9214:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.887257:0:9214:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.887259:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb3c0/0xfc4b8e114edaa2d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.887263:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaa2d8 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fa5 expref: 3419 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.887267:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaa2d8 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fa5 expref: 3419 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.887267:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906eb3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.887268:0:9214:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.887269:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb3c0/0xfc4b8e114edaa2d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.887271:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c24fcc0, rc 0) 00010000:00010000:3.0:1713279306.887271:0:9214:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713279306.887274:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb3c0/0xfc4b8e114edaa2d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.887280:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3531 (ffff88008e8c9000) 00010000:00010000:2.0:1713279306.887284:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.887286:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb3c0/0xfc4b8e114edaa2d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.887287:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3418:11204:x1796503281270336:12345-192.168.203.4@tcp:101:touch.0 Request processed in 279us (323us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.887287:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.887288:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281270592 00000100:00100000:0.0:1713279306.887291:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785418 00000100:00100000:1.0:1713279306.887291:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281270592 00010000:00010000:2.0:1713279306.887291:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb3c0/0xfc4b8e114edaa2d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.887291:0:9214:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d320b40/0xfc4b8e114eda9dec lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9df3 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.887297:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.887298:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.887299:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279306.887301:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713279306.887307:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200056768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.887308:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785420 00000100:00100000:1.0:1713279306.887313:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3719:11981:x1796503281270592:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1713279306.887314:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e9d40/0xfc4b8e114edaa2b5 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f9e expref: 3418 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.887322:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.887324:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114edaa2f4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7d64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f9e expref: 3417 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.887330:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d64:0x0].0x0 (ffff880096696c00) 00010000:00010000:2.0:1713279306.887332:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.887333:0:15485:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.887334:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200056768 00010000:00010000:2.0:1713279306.887335:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906e8b40, rc 0) 00000100:00100000:0.0:1713279306.887337:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200056768 00010000:00010000:1.0:1713279306.887342:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa206 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8290:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f66 expref: 3719 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.887343:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda9df3 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9dec expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.887351:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8290:0x0].0x0 (ffff8800824f1800) 00000100:00100000:0.0:1713279306.887352:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196582 00010000:00010000:1.0:1713279306.887354:0:15485:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.887355:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+54:3492:x1796503200056768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.887359:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.887362:0:6915:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda9df3 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda9dec expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.887362:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3417:11855:x1796503281270208:12345-192.168.203.4@tcp:101:touch.0 Request processed in 360us (410us total) trans 4295183776 rc 0/0 00000100:00100000:2.0:1713279306.887368:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785417 00010000:00010000:0.0:1713279306.887369:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076f840/0xfc4b8e114eda9df3 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda9dec expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.887375:0:6915:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:0.0:1713279306.887377:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda9ee8 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9eb7 expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.887381:0:6915:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda9ee8 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda9eb7 expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.887385:0:6915:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda9ee8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xfc4b8e114eda9eb7 expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.887389:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.887390:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114edaa302 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8290:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.887397:0:6915:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda9ee8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9eb7 expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.887397:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114edaa302 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8290:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.887402:0:6915:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6915:1796503200056832:0@lo:105: 00010000:00010000:1.0:1713279306.887404:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114edaa302 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8290:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000004:00010000:1.0:1713279306.887462:0:15485:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880131cd4e00 reply state ffff8800726cc000 transno 4295202769 ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114edaa302 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8290:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.887471:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114edaa302 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8290:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.887475:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8290:0x0].0x0 (ffff8800824f1800) 00010000:00010000:1.0:1713279306.887476:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.887478:0:15485:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713279306.887480:0:6915:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.887495:0:6915:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540780 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.887503:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:11981:x1796503281270592:12345-192.168.203.4@tcp:36:touch.0 Request processed in 190us (258us total) trans 4295202769 rc 0/0 00000100:00100000:1.0:1713279306.887507:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785420 00000100:00100000:3.0:1713279306.887507:0:9213:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200056832 00000100:00100000:3.0:1713279306.887510:0:9213:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200056832 00000100:00100000:2.0:1713279306.887514:0:6916:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121537b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200056704:192.168.203.4@tcp:105: 00000100:00100000:3.0:1713279306.887521:0:9213:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33453 00010000:00010000:2.0:1713279306.887523:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.887524:0:9213:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6915:x1796503200056832:12345-0@lo:105: 00010000:00010000:3.0:1713279306.887528:0:9213:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.887533:0:9213:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.887537:0:9213:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.887538:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+84:1955:x1796503281269952:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 704us (801us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.887541:0:9213:0:(ldlm_lockd.c:2096:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.887544:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196579 00010000:00010000:3.0:1713279306.887544:0:9213:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.887547:0:9213:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.887551:0:9213:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.887560:0:9213:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88012d323840) 00010000:00010000:0.0:1713279306.887567:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.887571:0:15525:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.887579:0:9213:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6915:x1796503200056832:12345-0@lo:105: Request processed in 55us (99us total) trans 0 rc 0/0 00000004:00080000:0.0:1713279306.887583:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1713279306.887583:0:9213:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33453 00000100:00100000:1.0:1713279306.887590:0:6915:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6915:1796503200056832:0@lo:105: 00010000:00010000:1.0:1713279306.887597:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.887603:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997fb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200056896:0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713279306.887612:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+53:3492:x1796503200056768:12345-0@lo:103:ldlm_bl.0 Request processed in 256us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.887616:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196582 00000100:00100000:0.0:1713279306.887619:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.887622:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200056768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.887626:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540780 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.887632:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200056896 00000100:00100000:0.0:1713279306.887634:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200056896 00000100:00100000:0.0:1713279306.887644:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98891 00000100:00100000:0.0:1713279306.887711:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+53:15525:x1796503200056896:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:2.0:1713279306.887727:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.887744:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.887745:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+53:15525:x1796503200056896:12345-0@lo:1000:mdt_io00_009.0 Request processed in 35us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.887749:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98891 00000100:00100000:2.0:1713279306.887764:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997fb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200056896:0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713279306.887768:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.887769:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281270784 00000100:00100000:3.0:1713279306.887771:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281270784 00000100:00100000:0.0:1713279306.887777:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281270912 00000100:00100000:1.0:1713279306.887777:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281270656 00000100:00100000:0.0:1713279306.887779:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281270912 00000100:00100000:1.0:1713279306.887780:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281270656 00000004:00080000:2.0:1713279306.887782:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x84a3:0x0] 00000100:00100000:3.0:1713279306.887783:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785421 00000100:00100000:3.0:1713279306.887786:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281270784:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.887792:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.887793:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785422 00000100:00100000:1.0:1713279306.887796:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3720:10814:x1796503281270656:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.887798:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114edaa309 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175fba expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.887800:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121535c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200056960:0@lo:1000:mdt_io00_009.0 00010000:00010000:1.0:1713279306.887801:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.887807:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114edaa310 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x83dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175fb3 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.887820:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.887824:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d507cc0/0xfc4b8e114edaa317 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.887828:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d507cc0/0xfc4b8e114edaa317 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.887829:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a0e540 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.887830:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223108 00010000:00010000:1.0:1713279306.887832:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d507cc0/0xfc4b8e114edaa317 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.887833:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3417:11666:x1796503281270912:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:3.0:1713279306.887833:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaa31e lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.887838:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaa31e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.887843:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaa31e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000004:00200000:1.0:1713279306.887844:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x83dc:0x0]: returning size 4096 00000004:00200000:1.0:1713279306.887846:0:15482:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1713279306.887848:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edaa325 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.887851:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edaa325 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.887854:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edaa325 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.887855:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ecb40/0xfc4b8e114edaa310 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fb3 expref: 3722 pid: 15482 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713279306.887861:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:1.0:1713279306.887863:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d507cc0/0xfc4b8e114edaa317 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x83dc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fb3 expref: 3721 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.887867:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x83dc:0x0].0x0 (ffff880092a4c300) 00010000:00010000:3.0:1713279306.887867:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaa31e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.887868:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1713279306.887870:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d507cc0, rc 0) 00010000:00010000:3.0:1713279306.887870:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaa31e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.887876:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaa31e lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.887879:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaa31e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.887881:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.887883:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaa31e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.887884:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:10814:x1796503281270656:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 88us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.887885:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3418:11666:x1796503281270912:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 51us (116us total) trans 4295183777 rc 0/0 00010000:00010000:3.0:1713279306.887886:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaa31e lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.887888:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785422 00000100:00100000:0.0:1713279306.887889:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223108 00010000:00010000:3.0:1713279306.887890:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880131eda200) 00010000:00010000:3.0:1713279306.887891:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.887892:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaa31e lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.887895:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaa31e lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.887899:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200056960 00010000:00010000:3.0:1713279306.887900:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edaa325 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.887901:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200056960 00010000:00010000:3.0:1713279306.887902:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edaa325 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.887905:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edaa325 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.887908:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.887909:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edaa325 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.887913:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.887915:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edaa325 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.887916:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98892 00010000:00010000:3.0:1713279306.887918:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880131eda600) 00000100:00100000:0.0:1713279306.887919:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+53:15525:x1796503200056960:12345-0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713279306.887919:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.887920:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edaa325 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.887923:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edaa325 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.887924:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281271040 00000100:00100000:1.0:1713279306.887926:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281271040 00000100:00100000:1.0:1713279306.887936:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785423 00010000:00010000:3.0:1713279306.887936:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114edaa309 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fba expref: 3656 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.887939:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3656:11711:x1796503281271040:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.887940:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114edaa309 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fba expref: 3656 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.887944:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.887946:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d321f80, rc 0) 00010000:00010000:1.0:1713279306.887951:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114edaa32c lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175fc1 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.887954:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+53:15525:x1796503200056960:12345-0@lo:1000:mdt_io00_009.0 Request processed in 35us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.887958:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98892 00000100:00100000:3.0:1713279306.887961:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3656:11912:x1796503281270784:12345-192.168.203.4@tcp:101:touch.0 Request processed in 174us (236us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.887965:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785421 00010000:00010000:1.0:1713279306.887970:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa333 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.887975:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa333 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.887978:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa333 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.887978:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121535c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200056960:0@lo:1000:mdt_io00_009.0 00010000:00010000:1.0:1713279306.887983:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa33a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.887987:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa33a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.887990:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa33a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888001:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa333 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888004:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa333 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888007:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa333 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888012:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa333 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888015:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008be61680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.888017:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa333 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888020:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa333 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888023:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880092a4c200) 00010000:00010000:1.0:1713279306.888025:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.888026:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa333 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888029:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa333 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888034:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa33a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888037:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa33a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888040:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa33a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888042:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093aba1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.888043:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa33a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888046:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa33a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888052:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880131204f00) 00010000:00010000:1.0:1713279306.888053:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.888055:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa33a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888057:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa33a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888079:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114edaa32c lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fc1 expref: 3655 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.888083:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114edaa32c lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fc1 expref: 3655 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.888089:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008be63600, rc 0) 00000100:00100000:1.0:1713279306.888104:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3654:11711:x1796503281271040:12345-192.168.203.4@tcp:101:touch.0 Request processed in 164us (194us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.888109:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785423 00000100:00100000:1.0:1713279306.888151:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.888157:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.888186:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281271104 00000100:00100000:1.0:1713279306.888188:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281271104 00000100:00100000:1.0:1713279306.888205:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110560 00000100:00100000:1.0:1713279306.888208:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+102:1957:x1796503281271104:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:0.0:1713279306.888221:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00002000:00010000:1.0:1713279306.888275:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb size from disk: 3214 -> 3214 00002000:00010000:1.0:1713279306.888277:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb mtime from disk: 1713279304 -> 1713279304 00002000:00010000:1.0:1713279306.888279:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb atime from disk: 1713279299 -> 1713279299 00002000:00010000:1.0:1713279306.888280:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb ctime from disk: 1713279304 -> 1713279306 00002000:00010000:1.0:1713279306.888281:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb blocks from disk: 0 -> 24 00000100:00100000:1.0:1713279306.888296:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+103:1957:x1796503281271104:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 88us (140us total) trans 4295010137 rc 0/0 00000100:00100000:1.0:1713279306.888301:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110560 00000100:00100000:1.0:1713279306.888311:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281271232 00000100:00100000:1.0:1713279306.888313:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281271232 00000100:00100000:1.0:1713279306.888321:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785424 00000100:00100000:1.0:1713279306.888323:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:11204:x1796503281271232:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.888325:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281271360 00010000:00010000:1.0:1713279306.888328:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.888328:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281271360 00010000:00010000:1.0:1713279306.888333:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3a80/0xfc4b8e114edaa341 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175fc8 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.888342:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785425 00000100:00100000:3.0:1713279306.888344:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3418:11855:x1796503281271360:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:1.0:1713279306.888352:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa348 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.888357:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa348 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.888358:0:15480:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.888360:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa348 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.888362:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121535c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057024:0@lo:403:mdt_io00_009.0 00010000:00010000:3.0:1713279306.888364:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114edaa2f4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7d64:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f9e expref: 3418 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.888376:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edaa34f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.888380:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edaa34f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.888381:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d64:0x0].0x0 (ffff880096696c00) 00010000:00010000:3.0:1713279306.888382:0:15480:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.888383:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edaa34f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.888390:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.888394:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa348 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.888397:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ffbdc00 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.888398:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa348 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.888401:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200057024 00010000:00010000:1.0:1713279306.888401:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa348 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00000100:00100000:0.0:1713279306.888403:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200057024 00010000:00010000:1.0:1713279306.888403:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa348 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.888406:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008dae2d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.888407:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa348 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.888408:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114edaa356 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7d64:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.888410:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa348 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.888427:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114edaa356 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d64:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888431:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:1.0:1713279306.888432:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.888432:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114edaa356 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d64:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888434:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa348 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.888436:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa348 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.888441:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edaa34f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.888444:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edaa34f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.888447:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edaa34f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.888450:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093693a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.888451:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edaa34f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.888455:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edaa34f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.888458:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff88012d397900) 00000004:00010000:3.0:1713279306.888458:0:15480:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800997f8380 reply state ffff88009602a000 transno 4295183778 ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114edaa356 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7d64:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888459:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.888460:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edaa34f lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.888462:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114edaa356 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7d64:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888463:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edaa34f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.888466:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d64:0x0].0x0 (ffff880096696c00) 00010000:00010000:3.0:1713279306.888467:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.888468:0:15480:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713279306.888474:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3a80/0xfc4b8e114edaa341 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fc8 expref: 3722 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.888478:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dae3a80/0xfc4b8e114edaa341 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fc8 expref: 3722 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.888480:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98893 00000100:00100000:0.0:1713279306.888482:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+53:15525:x1796503200057024:12345-0@lo:403:mdt_io00_009.0 00010000:00010000:1.0:1713279306.888482:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dae3a80, rc 0) 00000100:00100000:3.0:1713279306.888491:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3419:11855:x1796503281271360:12345-192.168.203.4@tcp:36:touch.0 Request processed in 145us (270us total) trans 4295183778 rc 0/0 00000100:00100000:1.0:1713279306.888495:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:11204:x1796503281271232:12345-192.168.203.4@tcp:101:touch.0 Request processed in 171us (344us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.888495:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785425 00000100:00100000:2.0:1713279306.888498:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.888499:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785424 00000100:00100000:3.0:1713279306.888505:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281271424 00000100:00100000:3.0:1713279306.888507:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281271424 00000100:00100000:3.0:1713279306.888516:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785426 00000100:00100000:3.0:1713279306.888519:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3419:11666:x1796503281271424:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:2.0:1713279306.888521:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.888524:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.888529:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d200/0xfc4b8e114edaa35d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175fcf expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.888544:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114edaa364 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.888548:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.888549:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114edaa364 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.888553:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114edaa364 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.888558:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281271552 00010000:00010000:3.0:1713279306.888558:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaa36b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.888560:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281271552 00010000:00010000:3.0:1713279306.888562:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaa36b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.888565:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaa36b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.888569:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281271616 00000100:00100000:1.0:1713279306.888570:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281271616 00000100:00100000:2.0:1713279306.888577:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785427 00000100:00100000:1.0:1713279306.888581:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785428 00000100:00100000:2.0:1713279306.888581:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:10814:x1796503281271552:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:1.0:1713279306.888583:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281271616:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.888585:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114edaa372 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.888587:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.888588:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114edaa372 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888589:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.888591:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114edaa372 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.888593:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114edaa379 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175fdd expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.888594:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114edaa380 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175fd6 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.888604:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114edaa379 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fdd expref: 3722 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.888613:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eba80/0xfc4b8e114edaa379 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x24a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fdd expref: 3722 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.888614:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edaa387 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:1.0:1713279306.888619:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edaa387 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.888619:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x0 (ffff88008c2e7f00) 00010000:00010000:1.0:1713279306.888622:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edaa387 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.888622:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.888623:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906eba80, rc 0) 00000004:00200000:3.0:1713279306.888625:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76b7:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.888627:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa38e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000004:00200000:3.0:1713279306.888627:0:15480:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:1.0:1713279306.888631:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa38e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000004:00010000:3.0:1713279306.888633:0:15480:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114edaa372 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888634:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa38e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.888637:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114edaa364 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.888640:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114edaa364 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.888643:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:10814:x1796503281271552:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 60us (120us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.888643:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114edaa364 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888644:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edaa387 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.888646:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114edaa364 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888647:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edaa387 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.888649:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edaa387 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.888649:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785427 00010000:00010000:3.0:1713279306.888649:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.888650:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114edaa364 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888652:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edaa387 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.888653:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114edaa364 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888655:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008245f840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.888657:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edaa387 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.888657:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:3.0:1713279306.888658:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.888660:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edaa387 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.888660:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114edaa364 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.888662:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e640/0xfc4b8e114edaa364 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888664:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880122e5f900) 00010000:00010000:1.0:1713279306.888665:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.888666:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edaa387 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.888667:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaa36b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888669:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edaa387 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.888669:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaa36b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.888672:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaa36b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888674:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa38e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.888675:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009435eac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.888677:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa38e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.888677:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaa36b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888680:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa38e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.888680:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaa36b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888683:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008245c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.888683:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff88008e766400) 00010000:00010000:1.0:1713279306.888684:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa38e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.888684:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.888686:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaa36b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888687:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa38e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.888688:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaa36b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.888690:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88009e5e1d00) 00010000:00010000:1.0:1713279306.888691:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.888692:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa38e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.888695:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.888697:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa38e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.888698:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d200/0xfc4b8e114edaa35d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fcf expref: 3421 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.888703:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091c04480/0xfc4b8e114edaa372 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76b7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fcf expref: 3420 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.888704:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281271744 00010000:00010000:3.0:1713279306.888706:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76b7:0x0].0x0 (ffff88008e766000) 00010000:00010000:1.0:1713279306.888707:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114edaa380 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fd6 expref: 3655 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.888707:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281271744 00010000:00010000:3.0:1713279306.888707:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1713279306.888709:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c04480, rc 0) 00010000:00010000:1.0:1713279306.888711:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114edaa380 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fd6 expref: 3655 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.888716:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093691440, rc 0) 00000100:00100000:2.0:1713279306.888718:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785429 00000100:00100000:2.0:1713279306.888720:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3720:11711:x1796503281271744:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.888722:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3420:11666:x1796503281271424:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 202us (224us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.888726:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.888726:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785426 00000100:00100000:1.0:1713279306.888729:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281271616:12345-192.168.203.4@tcp:101:touch.0 Request processed in 145us (181us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.888731:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114edaa395 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175fe4 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.888733:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785428 00010000:00010000:2.0:1713279306.888766:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edaa39c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888771:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edaa39c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888775:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edaa39c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888780:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edaa3a3 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888784:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edaa3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888801:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edaa3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00000004:00200000:2.0:1713279306.888809:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:2.0:1713279306.888813:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edaa39c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888816:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edaa39c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888819:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edaa39c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888822:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edaa39c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888825:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906eb600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.888826:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edaa39c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888829:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edaa39c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888833:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880131204400) 00010000:00010000:2.0:1713279306.888834:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.888836:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edaa39c lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888839:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edaa39c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888843:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edaa3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888848:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edaa3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888851:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edaa3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888854:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a064480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.888855:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edaa3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888858:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edaa3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888861:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88008e59ca00) 00010000:00010000:2.0:1713279306.888862:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.888863:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edaa3a3 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888866:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edaa3a3 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.888879:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114edaa395 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fe4 expref: 3721 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.888883:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114edaa395 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175fe4 expref: 3721 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.888888:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906e9680, rc 0) 00000100:00100000:2.0:1713279306.888903:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3720:11711:x1796503281271744:12345-192.168.203.4@tcp:101:touch.0 Request processed in 181us (207us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.888909:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785429 00000100:00100000:1.0:1713279306.889323:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.889349:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281272064 00000100:00100000:3.0:1713279306.889352:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281272064 00000100:00100000:3.0:1713279306.889364:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785430 00000100:00100000:3.0:1713279306.889366:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3420:11204:x1796503281272064:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.889374:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.889379:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a6f40/0xfc4b8e114edaa3aa lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ff2 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.889429:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114edaa3b1 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.889434:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114edaa3b1 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.889438:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114edaa3b1 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.889444:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114edaa3b8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.889447:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114edaa3b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.889450:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114edaa3b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00200000:3.0:1713279306.889459:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:3.0:1713279306.889463:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114edaa3b1 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.889466:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114edaa3b1 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.889469:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114edaa3b1 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.889470:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.889472:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114edaa3b1 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.889477:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a5b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.889479:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114edaa3b1 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.889482:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114edaa3b1 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.889486:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00000100:00100000:2.0:1713279306.889487:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.889487:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.889488:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114edaa3b1 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.889491:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a5b00/0xfc4b8e114edaa3b1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.889493:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281271936 00000100:00100000:2.0:1713279306.889495:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281271936 00010000:00010000:3.0:1713279306.889495:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114edaa3b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.889498:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114edaa3b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.889499:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281271872 00010000:00010000:3.0:1713279306.889501:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114edaa3b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.889503:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281271872 00010000:00010000:3.0:1713279306.889504:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a4d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.889505:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114edaa3b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.889506:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785431 00010000:00010000:3.0:1713279306.889508:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114edaa3b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.889509:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3422:11855:x1796503281271936:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.889511:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880082706d00) 00010000:00010000:3.0:1713279306.889512:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.889513:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114edaa3b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.889515:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.889516:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a4d80/0xfc4b8e114edaa3b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.889518:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223109 00010000:00010000:2.0:1713279306.889520:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11d40/0xfc4b8e114edaa3bf lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7d64:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175feb expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.889521:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:12001:x1796503281271872:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:3.0:1713279306.889528:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a6f40/0xfc4b8e114edaa3aa lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ff2 expref: 3423 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.889532:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4a6f40/0xfc4b8e114edaa3aa lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ff2 expref: 3423 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.889535:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11d40/0xfc4b8e114edaa3bf lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7d64:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175feb expref: 3423 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.889536:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4a6f40, rc 0) 00010000:00010000:2.0:1713279306.889541:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11d40/0xfc4b8e114edaa3bf lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7d64:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175feb expref: 3422 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.889548:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d64:0x0].0x0 (ffff880096696c00) 00010000:00010000:2.0:1713279306.889549:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1713279306.889551:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd11d40, rc 0) 00000100:00100000:3.0:1713279306.889552:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3422:11204:x1796503281272064:12345-192.168.203.4@tcp:101:touch.0 Request processed in 185us (231us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.889556:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785430 00000100:00100000:2.0:1713279306.889563:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3421:11855:x1796503281271936:12345-192.168.203.4@tcp:101:touch.0 Request processed in 53us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.889567:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785431 00000100:00100000:3.0:1713279306.889577:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.889579:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:12001:x1796503281271872:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 57us (109us total) trans 4295202770 rc 0/0 00000100:00100000:1.0:1713279306.889584:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223109 00000100:00100000:1.0:1713279306.889597:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281272128 00000100:00100000:1.0:1713279306.889599:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281272128 00000100:00100000:3.0:1713279306.889604:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.889616:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110561 00000100:00100000:1.0:1713279306.889619:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+87:1955:x1796503281272128:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1713279306.889619:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281272320 00000100:00100000:2.0:1713279306.889622:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281272320 00000100:00100000:2.0:1713279306.889636:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785432 00000100:00100000:2.0:1713279306.889639:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3421:11666:x1796503281272320:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.889644:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.889649:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114edaa3c6 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176000 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.889666:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114edaa3cd lrc: 3/1,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.889670:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114edaa3cd lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889685:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114edaa3cd lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.889690:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+88:1955:x1796503281272128:12345-192.168.203.4@tcp:2:touch.0 Request processed in 70us (112us total) trans 4295010192 rc 0/0 00010000:00010000:2.0:1713279306.889693:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114edaa3d4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00000100:00100000:1.0:1713279306.889694:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110561 00010000:00010000:2.0:1713279306.889699:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114edaa3d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889704:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114edaa3d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889724:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114edaa3cd lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889729:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114edaa3cd lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889734:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114edaa3cd lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889739:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114edaa3cd lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889744:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.889746:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114edaa3cd lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889755:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114edaa3cd lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889762:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff880092193400) 00010000:00010000:2.0:1713279306.889764:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.889767:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114edaa3cd lrc: 3/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889772:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10d80/0xfc4b8e114edaa3cd lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889780:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114edaa3d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889785:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114edaa3d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889790:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114edaa3d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889795:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd106c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.889797:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114edaa3d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00000100:00100000:0.0:1713279306.889802:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+53:15525:x1796503200057024:12345-0@lo:403:mdt_io00_009.0 Request processed in 1318us (1410us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.889802:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114edaa3d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00000100:00100000:0.0:1713279306.889807:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98893 00010000:00010000:2.0:1713279306.889808:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x3131 (ffff88008c2e7e00) 00010000:00010000:2.0:1713279306.889810:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.889812:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114edaa3d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279306.889812:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121535c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057024:0@lo:403:mdt_io00_009.0 00010000:00010000:2.0:1713279306.889817:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd106c0/0xfc4b8e114edaa3d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.889834:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114edaa3c6 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176000 expref: 3422 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.889842:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114edaa3c6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176000 expref: 3422 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.889849:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd121c0, rc 0) 00000100:00100000:2.0:1713279306.889870:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3421:11666:x1796503281272320:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 229us (264us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.889876:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785432 00000100:00100000:2.0:1713279306.889906:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.889915:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.889917:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281272256 00000100:00100000:2.0:1713279306.889919:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281272256 00000100:00100000:1.0:1713279306.889930:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281272512 00000100:00100000:1.0:1713279306.889933:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281272512 00000100:00100000:2.0:1713279306.889940:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785433 00000100:00100000:1.0:1713279306.889944:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223110 00000100:00100000:2.0:1713279306.889945:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281272256:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.889947:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130143050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:10814:x1796503281272512:12345-192.168.203.4@tcp:37:lfs.0 00010000:00010000:2.0:1713279306.889952:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.889956:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.889960:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114edaa3db lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39175ff9 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.889962:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281272448 00000100:00100000:0.0:1713279306.889964:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281272448 00000100:00100000:0.0:1713279306.889973:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785434 00000100:00100000:0.0:1713279306.889976:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3656:11711:x1796503281272448:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.889982:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.889988:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaa3e2 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176007 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.890001:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114edaa3e9 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.890008:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edaa3f0 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.890009:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114edaa3e9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.890012:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edaa3f0 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.890015:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114edaa3e9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.890016:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edaa3f0 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.890021:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa3f7 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.890024:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaa3fe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.890027:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa3f7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.890030:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa3f7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.890030:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaa3fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.890036:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaa3fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.890041:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edaa3f0 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.890044:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edaa3f0 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.890047:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edaa3f0 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00000004:00200000:2.0:1713279306.890047:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:0.0:1713279306.890050:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edaa3f0 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.890053:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012154d680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.890054:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edaa3f0 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.890054:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114edaa3e9 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.890057:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edaa3f0 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.890059:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114edaa3e9 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.890061:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff8800960e8600) 00010000:00010000:0.0:1713279306.890062:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.890064:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edaa3f0 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.890064:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114edaa3e9 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.890082:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edaa3f0 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.890084:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114edaa3e9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.890089:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012374c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.890092:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114edaa3e9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.890097:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114edaa3e9 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.890105:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880122e5f600) 00010000:00010000:2.0:1713279306.890107:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.890109:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114edaa3e9 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.890114:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114edaa3e9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.890126:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaa3fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.890130:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaa3fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.890135:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaa3fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.890140:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed0ba80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.890142:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaa3fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.890144:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa3f7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.890147:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaa3fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.890148:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa3f7 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.890151:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa3f7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.890163:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012154d200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.890163:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880091714100) 00010000:00010000:0.0:1713279306.890165:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa3f7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.890165:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.890168:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa3f7 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.890168:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaa3fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.890172:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff8800960e8900) 00010000:00010000:0.0:1713279306.890173:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.890173:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaa3fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.890174:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa3f7 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.890177:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa3f7 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.890190:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaa3e2 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176007 expref: 3657 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.890193:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114edaa3db lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ff9 expref: 3657 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.890194:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaa3e2 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176007 expref: 3657 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.890201:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114edaa3db lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ff9 expref: 3656 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.890210:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd10000, rc 0) 00000100:00100000:2.0:1713279306.890227:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3655:11912:x1796503281272256:12345-192.168.203.4@tcp:101:touch.0 Request processed in 281us (320us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.890233:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785433 00010000:00010000:0.0:1713279306.890234:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012154ef40, rc 0) 00000100:00100000:0.0:1713279306.890248:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3654:11711:x1796503281272448:12345-192.168.203.4@tcp:101:touch.0 Request processed in 271us (291us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.890252:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785434 00000100:00100000:2.0:1713279306.890267:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.890298:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.890308:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281272704 00000100:00100000:0.0:1713279306.890310:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281272704 00000100:00100000:0.0:1713279306.890321:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785435 00000100:00100000:3.0:1713279306.890323:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800900e1f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057088:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.890324:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:11204:x1796503281272704:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.890329:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.890334:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114edaa405 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917600e expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.890340:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.890348:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.890357:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200057088 00000100:00100000:2.0:1713279306.890361:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200057088 00000100:00100000:2.0:1713279306.890374:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98894 00000100:00100000:2.0:1713279306.890384:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+53:15525:x1796503200057088:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713279306.890398:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281272576 00000100:00100000:1.0:1713279306.890401:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281272576 00010000:00010000:0.0:1713279306.890407:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114edaa40c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.890426:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114edaa40c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1713279306.890426:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110562 00010000:00010000:0.0:1713279306.890430:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114edaa40c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1713279306.890430:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+88:1956:x1796503281272576:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1713279306.890433:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+53:15525:x1796503200057088:12345-0@lo:1000:mdt_io00_009.0 Request processed in 48us (92us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.890437:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaa413 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1713279306.890437:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98894 00010000:00010000:0.0:1713279306.890441:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaa413 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.890444:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaa413 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.890455:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114edaa40c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.890458:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114edaa40c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.890460:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114edaa40c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.890464:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114edaa40c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.890467:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c366880 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.890468:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.890469:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114edaa40c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.890471:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114edaa40c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.890475:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:0.0:1713279306.890476:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.890478:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114edaa40c lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1713279306.890478:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281272832 00010000:00010000:0.0:1713279306.890480:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114edaa40c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1713279306.890480:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281272832 00000100:00100000:3.0:1713279306.890484:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+89:1956:x1796503281272576:12345-192.168.203.4@tcp:2:touch.0 Request processed in 54us (218us total) trans 4295010193 rc 0/0 00010000:00010000:0.0:1713279306.890485:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaa413 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.890487:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaa413 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1713279306.890489:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110562 00000100:00100000:1.0:1713279306.890490:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223111 00010000:00010000:0.0:1713279306.890491:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaa413 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.890493:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131f3c480 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.890493:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:11981:x1796503281272832:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:0.0:1713279306.890494:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaa413 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.890497:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaa413 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.890502:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff8800960e8100) 00010000:00010000:0.0:1713279306.890504:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.890505:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaa413 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1713279306.890506:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800900e1f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057088:0@lo:1000:mdt_io00_009.0 00010000:00010000:0.0:1713279306.890507:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaa413 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.890520:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114edaa405 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917600e expref: 3728 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.890524:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114edaa405 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917600e expref: 3728 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.890528:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012154fa80, rc 0) 00010000:00010000:3.0:1713279306.890529:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.890533:0:15525:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15525 initiator: MDT1 00010000:00010000:3.0:1713279306.890537:0:15525:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15525 initiator: MDT1 00000100:00100000:1.0:1713279306.890540:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:11981:x1796503281272832:12345-192.168.203.4@tcp:35:touch.0 Request processed in 46us (72us total) trans 4295202771 rc 0/0 00000100:00100000:0.0:1713279306.890542:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:11204:x1796503281272704:12345-192.168.203.4@tcp:101:touch.0 Request processed in 218us (244us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.890543:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800900e1f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057152:0@lo:101:mdt_io00_009.0 00000100:00100000:1.0:1713279306.890544:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223111 00000100:00100000:0.0:1713279306.890546:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785435 00000100:00100000:3.0:1713279306.890556:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.890571:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.890583:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200057152 00000100:00100000:2.0:1713279306.890586:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200057152 00000100:00100000:2.0:1713279306.890596:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98895 00000100:00100000:2.0:1713279306.890599:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+53:15525:x1796503200057152:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:2.0:1713279306.890604:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.890610:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaa421 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114edaa41a expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.890619:0:15494:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda8fc2 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab2 expref: 3725 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.890624:0:15494:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaa421 lrc: 4/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114edaa41a expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.890634:0:15494:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda8fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab2 expref: 3725 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.890640:0:15494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda8fc2 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab2 expref: 3725 pid: 9221 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.890646:0:15494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:15494:1796503200057216:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.890662:0:15494:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ffbdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.891047:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130143050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:10814:x1796503281272512:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1099us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.891052:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223110 00000100:00100000:0.0:1713279306.891528:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.891552:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.891567:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281273024 00000100:00100000:2.0:1713279306.891571:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281273024 00000100:00100000:2.0:1713279306.891595:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785436 00000100:00100000:2.0:1713279306.891600:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3421:11666:x1796503281273024:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.891608:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.891616:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114edaa428 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x261:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917601c expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.891620:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281273408 00000100:00100000:3.0:1713279306.891625:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281273408 00010000:00010000:2.0:1713279306.891640:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa42f lrc: 3/1,0 mode: --/CR res: [0x240000400:0x261:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.891641:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223112 00010000:00010000:2.0:1713279306.891645:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa42f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.891645:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3423:11855:x1796503281273408:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:2.0:1713279306.891649:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa42f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.891650:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.891655:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114edaa436 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.891659:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114edaa436 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.891661:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281272960 00010000:00010000:2.0:1713279306.891664:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114edaa436 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.891666:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281272960 00000100:00100000:0.0:1713279306.891672:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.891681:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281273152 00000100:00100000:2.0:1713279306.891681:0:15494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:15494:1796503200057216:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.891682:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281273152 00010000:00010000:2.0:1713279306.891690:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaa421 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa41a expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.891691:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785437 00000100:00100000:1.0:1713279306.891694:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3720:11999:x1796503281272960:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.891694:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x0 (ffff880096e84a00) 00010000:00010000:2.0:1713279306.891696:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.891697:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.891698:0:15494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaa421 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa41a expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.891702:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.891702:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed098c0, rc 0) 00010000:00010000:1.0:1713279306.891703:0:15474:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:3.0:1713279306.891707:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3424:11855:x1796503281273408:12345-192.168.203.4@tcp:35:touch.0 Request processed in 61us (154us total) trans 4295183779 rc 0/0 00010000:00010000:1.0:1713279306.891712:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801222058c0/0xfc4b8e114eda9c17 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x84eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e01 expref: 3720 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.891712:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223112 00000100:00100000:2.0:1713279306.891718:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+54:15525:x1796503200057152:12345-0@lo:101:mdt_io00_009.0 Request processed in 1119us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.891722:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98895 00010000:00010000:1.0:1713279306.891725:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84eb:0x0].0x0 (ffff88012061ff00) 00010000:00010000:1.0:1713279306.891727:0:15474:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.891731:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.891731:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800900e1f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057152:0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713279306.891732:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008245cfc0/0xfc4b8e114edaa43d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x84eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176015 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.891734:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785438 00000100:00100000:2.0:1713279306.891736:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281273152:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.891739:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 4/0,1 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.891741:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.891744:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 4/0,1 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.891747:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.891747:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114edaa444 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176023 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.891753:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281273280 00000100:00100000:3.0:1713279306.891756:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281273280 00000100:00100000:3.0:1713279306.891764:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281273600 00010000:00010000:1.0:1713279306.891765:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114edaa44b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x84eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.891765:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114edaa452 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00000100:00100000:3.0:1713279306.891765:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281273600 00010000:00010000:2.0:1713279306.891769:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114edaa452 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.891770:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114edaa44b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x84eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1713279306.891771:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785439 00010000:00010000:2.0:1713279306.891773:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114edaa452 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.891774:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114edaa44b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x84eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1713279306.891774:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281273280:12345-192.168.203.4@tcp:101:touch.0 00000004:00200000:1.0:1713279306.891779:0:15474:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x84eb:0x0]: returning size 6184 00010000:00010000:3.0:1713279306.891779:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.891781:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa459 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.891784:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa459 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.891785:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114edaa460 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917602a expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.891787:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa459 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.891797:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114edaa452 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.891800:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114edaa452 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.891803:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114edaa452 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.891806:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114edaa452 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.891809:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf4fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.891810:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008245cfc0/0xfc4b8e114edaa43d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176015 expref: 3724 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.891811:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114edaa452 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.891814:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114edaa452 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.891817:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114edaa44b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x84eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176015 expref: 3723 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.891817:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88009bf9a000) 00010000:00010000:2.0:1713279306.891819:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.891820:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114edaa452 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.891821:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84eb:0x0].0x0 (ffff88012061ff00) 00010000:00010000:3.0:1713279306.891822:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114edaa46e lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.891823:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1713279306.891823:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4fc0/0xfc4b8e114edaa452 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.891824:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008245dd40, rc 0) 00010000:00010000:3.0:1713279306.891827:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114edaa46e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.891828:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa459 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.891831:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa459 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.891831:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114edaa46e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.891834:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa459 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.891837:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf5680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.891838:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa459 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.891838:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114edaa475 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.891841:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa459 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279306.891842:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114edaa475 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.891844:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff8800963cc400) 00010000:00010000:2.0:1713279306.891845:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.891845:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114edaa475 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.891846:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa459 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:2.0:1713279306.891848:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa459 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279306.891851:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3723:11999:x1796503281272960:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 156us (202us total) trans 4295202772 rc 0/0 00000004:00200000:3.0:1713279306.891853:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00000100:00100000:1.0:1713279306.891855:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785437 00010000:00010000:3.0:1713279306.891857:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114edaa46e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.891858:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114edaa444 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176023 expref: 3655 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.891860:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114edaa46e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.891862:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114edaa444 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176023 expref: 3655 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.891865:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785440 00010000:00010000:3.0:1713279306.891866:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114edaa46e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.891867:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf5d40, rc 0) 00000100:00100000:1.0:1713279306.891868:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3424:11204:x1796503281273600:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.891869:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114edaa46e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.891872:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a7180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.891873:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.891873:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114edaa46e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.891876:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114edaa46e lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.891878:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaa47c lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176031 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.891880:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281273152:12345-192.168.203.4@tcp:101:touch.0 Request processed in 142us (207us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.891881:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880082706400) 00010000:00010000:3.0:1713279306.891882:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.891884:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785438 00010000:00010000:3.0:1713279306.891884:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114edaa46e lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.891887:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a7180/0xfc4b8e114edaa46e lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.891891:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114edaa475 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.891894:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114edaa475 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.891897:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114edaa475 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.891899:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ce52640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.891901:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114edaa475 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.891906:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114edaa475 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.891910:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281273472 00010000:00010000:3.0:1713279306.891910:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880082706100) 00010000:00010000:3.0:1713279306.891911:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.891912:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114edaa475 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.891913:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281273472 00010000:00010000:3.0:1713279306.891914:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce52640/0xfc4b8e114edaa475 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.891920:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda8fc2 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab2 expref: 3724 pid: 9221 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.891921:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaa483 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.891926:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaa483 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.891928:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114edaa460 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917602a expref: 3722 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.891929:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaa483 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00000100:00100000:1.0:1713279306.891930:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196583 00000100:00100000:1.0:1713279306.891933:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:1957:x1796503281273472:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.891933:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4a4b40/0xfc4b8e114edaa460 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917602a expref: 3722 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.891934:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaa48a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.891937:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.891938:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaa48a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.891938:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4a4b40, rc 0) 00010000:00010000:1.0:1713279306.891940:0:6915:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda8fc2 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab2 expref: 3724 pid: 9221 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.891941:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaa48a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.891945:0:6915:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda8fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab2 expref: 3724 pid: 9221 timeout: 509 lvb_type: 0 00000004:00200000:2.0:1713279306.891949:0:15474:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:1.0:1713279306.891951:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114eda8fc2 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x24c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ab2 expref: 3724 pid: 9221 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.891954:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaa483 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00000100:00100000:3.0:1713279306.891954:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281273280:12345-192.168.203.4@tcp:101:touch.0 Request processed in 179us (223us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.891957:0:6915:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x0 (ffff880096e84a00) 00010000:00010000:2.0:1713279306.891957:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaa483 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00000100:00100000:3.0:1713279306.891958:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785439 00010000:00010000:1.0:1713279306.891960:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaa421 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa41a expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.891960:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaa483 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.891963:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaa483 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.891965:0:6915:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaa421 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114edaa41a expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.891965:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.891967:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaa483 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.891970:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaa483 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.891972:0:6915:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaa421 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114edaa41a expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.891974:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:2.0:1713279306.891975:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.891976:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaa483 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.891979:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaa483 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.891982:0:6915:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaa421 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa41a expref: 53 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.891988:0:6915:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6915:1796503200057280:0@lo:105: 00010000:00010000:2.0:1713279306.891992:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaa48a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.891995:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaa48a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.891998:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaa48a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.892000:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935beac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.892002:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaa48a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.892004:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaa48a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00000100:00100000:1.0:1713279306.892006:0:6915:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.892007:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88008d729700) 00010000:00010000:2.0:1713279306.892008:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.892009:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaa48a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.892012:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaa48a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000100:00100000:1.0:1713279306.892014:0:6915:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096e07780 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.892017:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200057280 00000100:00100000:3.0:1713279306.892019:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200057280 00010000:00010000:2.0:1713279306.892024:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaa47c lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176031 expref: 3425 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.892029:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaa47c lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176031 expref: 3425 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.892030:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33454 00000100:00100000:3.0:1713279306.892033:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6915:x1796503200057280:12345-0@lo:105: 00010000:00010000:2.0:1713279306.892034:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009181ef40, rc 0) 00010000:00010000:3.0:1713279306.892037:0:6913:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 5/0,1 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.892042:0:6913:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 5/0,1 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.892046:0:6913:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 5/0,1 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.892048:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3424:11204:x1796503281273600:12345-192.168.203.4@tcp:101:touch.0 Request processed in 179us (301us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.892050:0:6913:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.892052:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785440 00010000:00010000:3.0:1713279306.892053:0:6913:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.892057:0:6913:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.892064:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114edaa491 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.892064:0:6913:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88008f4a5f80) 00010000:00010000:2.0:1713279306.892083:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114edaa491 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.892087:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114edaa491 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.892103:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6915:x1796503200057280:12345-0@lo:105: Request processed in 69us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.892107:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33454 00010000:00010000:3.0:1713279306.892117:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.892121:0:15525:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713279306.892123:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76ef:0x0]: returning size 4096 00000004:00200000:2.0:1713279306.892125:0:15485:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:1.0:1713279306.892128:0:6915:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6915:1796503200057280:0@lo:105: 00000004:00080000:3.0:1713279306.892129:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24c:0x0] 00000004:00010000:2.0:1713279306.892130:0:15485:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114edaa491 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.892135:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.892135:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa42f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.892137:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa42f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.892139:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce51680/0xfc4b8e114edaa498 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15525 initiator: MDT0 00010000:00010000:2.0:1713279306.892140:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa42f lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.892142:0:15525:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce51680/0xfc4b8e114edaa498 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.892145:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa42f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.892149:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.892149:0:15525:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce51680/0xfc4b8e114edaa498 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15525 initiator: MDT1 00000100:00100000:1.0:1713279306.892151:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:1957:x1796503281273472:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 217us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.892152:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.892152:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa42f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.892156:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196583 00000100:00100000:3.0:1713279306.892156:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c00a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057344:0@lo:101:mdt_io00_009.0 00010000:00010000:2.0:1713279306.892157:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa42f lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.892164:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x0 (ffff8800908e1900) 00010000:00010000:2.0:1713279306.892166:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.892169:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa42f lrc: 3/0,0 mode: --/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.892169:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.892173:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa42f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.892175:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.892181:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114edaa436 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.892181:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200057344 00000100:00100000:3.0:1713279306.892183:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200057344 00000100:00100000:1.0:1713279306.892184:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.892186:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114edaa436 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.892191:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114edaa436 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.892194:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98896 00010000:00010000:2.0:1713279306.892195:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf6ac0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.892197:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+54:15525:x1796503200057344:12345-0@lo:101:mdt_io00_009.0 00000100:00100000:0.0:1713279306.892198:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281273664 00010000:00010000:2.0:1713279306.892198:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114edaa436 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.892201:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.892202:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281273664 00010000:00010000:2.0:1713279306.892203:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114edaa436 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.892207:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114edaa49f lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114edaa498 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.892213:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x3131 (ffff88008a21ee00) 00000100:00100000:0.0:1713279306.892214:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281273792 00000100:00100000:0.0:1713279306.892215:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281273792 00010000:00010000:2.0:1713279306.892215:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.892215:0:15516:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114edaa49f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114edaa498 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.892217:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114edaa436 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.892221:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114edaa49f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa498 expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.892222:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785441 00010000:00010000:2.0:1713279306.892222:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114edaa436 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x261:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.892224:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x3131 (ffff88009e5e1200) 00000100:00100000:0.0:1713279306.892225:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785442 00000100:00100000:1.0:1713279306.892225:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:10814:x1796503281273664:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.892226:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.892227:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce53a80, rc 0) 00000100:00100000:0.0:1713279306.892229:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3424:11855:x1796503281273792:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.892231:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.892238:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ed00/0xfc4b8e114edaa4a6 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x231:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176038 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.892240:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114edaa428 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917601c expref: 3425 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.892240:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200057344:12345-0@lo:101:mdt_io00_009.0 Request processed in 42us (70us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.892243:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98896 00010000:00010000:1.0:1713279306.892248:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ed00/0xfc4b8e114edaa4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176038 expref: 3724 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.892249:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114edaa491 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917601c expref: 3424 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.892254:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009181ed00/0xfc4b8e114edaa4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176038 expref: 3724 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.892255:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76ef:0x0].0x0 (ffff88008d729f00) 00000100:00100000:3.0:1713279306.892256:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c00a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057344:0@lo:101:mdt_io00_009.0 00010000:00010000:2.0:1713279306.892257:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713279306.892259:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ad686c0, rc 0) 00010000:00010000:1.0:1713279306.892261:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x0 (ffff880095863b00) 00010000:00010000:1.0:1713279306.892262:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.892263:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce51680/0xfc4b8e114edaa498 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaa49f expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.892264:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009181ed00, rc 0) 00010000:00010000:3.0:1713279306.892267:0:15525:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce51680/0xfc4b8e114edaa498 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa49f expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713279306.892273:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24c:0x0] 00000100:00100000:1.0:1713279306.892277:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:10814:x1796503281273664:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 52us (127us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.892279:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.892279:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaa4ad lrc: 3/0,1 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00000100:00100000:1.0:1713279306.892281:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785441 00000100:00100000:2.0:1713279306.892281:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3424:11666:x1796503281273024:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 680us (754us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.892282:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaa4ad lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:3.0:1713279306.892286:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaa4ad lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.892287:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009681cfc0/0xfc4b8e114edaa4b4 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917603f expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.892287:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785436 00010000:00010000:3.0:1713279306.892291:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114edaa4bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x233:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:3.0:1713279306.892294:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114edaa4bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:3.0:1713279306.892297:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114edaa4bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.892311:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114edaa4c2 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.892312:0:15525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7364:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15525 initiator: MDT0 00010000:00010000:0.0:1713279306.892317:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114edaa4c2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.892318:0:15525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda9dc9 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x7364:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e6a expref: 3653 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.892321:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114edaa4c2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.892321:0:15525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279306.892327:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114edaa4d0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.892330:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114edaa4d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.892332:0:15525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda9dc9 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7364:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e6a expref: 3653 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.892333:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114edaa4d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.892338:0:15525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda9dc9 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7364:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e6a expref: 3653 pid: 15752 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.892344:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c00a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001_UUID:15525:1796503200057408:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.892360:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.892367:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923406c0/0xfc4b8e114edaa4d7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x75a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.892372:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800923406c0/0xfc4b8e114edaa4d7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x75a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892375:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800923406c0/0xfc4b8e114edaa4d7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x75a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000004:00200000:0.0:1713279306.892382:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x75a8:0x0]: returning size 0 00010000:00010000:0.0:1713279306.892404:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114edaa4c2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892407:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114edaa4c2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892410:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114edaa4c2 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892439:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114edaa4c2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892442:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009681c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.892444:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114edaa4c2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892447:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114edaa4c2 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892452:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880097a5f200) 00010000:00010000:0.0:1713279306.892454:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.892455:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114edaa4c2 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892458:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114edaa4c2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892463:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114edaa4d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892466:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114edaa4d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892472:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114edaa4d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892475:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009681c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.892476:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114edaa4d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892479:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114edaa4d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892482:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3631 (ffff8800960e8c00) 00010000:00010000:0.0:1713279306.892483:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.892484:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114edaa4d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892487:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c900/0xfc4b8e114edaa4d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.892504:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009681cfc0/0xfc4b8e114edaa4b4 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917603f expref: 3426 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.892509:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923406c0/0xfc4b8e114edaa4d7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x75a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917603f expref: 3425 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.892513:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75a8:0x0].0x0 (ffff8800908e1000) 00010000:00010000:0.0:1713279306.892514:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713279306.892515:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923406c0, rc 0) 00000100:00100000:0.0:1713279306.892553:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3425:11855:x1796503281273792:12345-192.168.203.4@tcp:101:touch.0 Request processed in 323us (369us total) trans 4295183780 rc 0/0 00000100:00100000:0.0:1713279306.892558:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785442 00000100:00100000:0.0:1713279306.892678:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.892698:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.892711:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281273920 00000100:00100000:2.0:1713279306.892715:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281273920 00000100:00100000:1.0:1713279306.892718:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281274048 00000100:00100000:1.0:1713279306.892721:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281274048 00000100:00100000:2.0:1713279306.892738:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785443 00000100:00100000:1.0:1713279306.892742:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785444 00000100:00100000:2.0:1713279306.892743:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3655:11912:x1796503281273920:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.892745:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3655:11711:x1796503281274048:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.892754:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.892761:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.892762:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e7ba400/0xfc4b8e114edaa4e5 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176046 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.892767:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edaa4ec lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917604d expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.892787:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edaa4f3 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.892792:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edaa4f3 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.892796:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edaa4f3 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.892802:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edaa4fa lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.892805:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edaa4fa lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.892808:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaa501 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.892811:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edaa4fa lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.892815:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaa501 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.892821:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaa501 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.892823:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edaa4f3 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.892827:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edaa4f3 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.892829:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa508 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.892830:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edaa4f3 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.892833:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edaa4f3 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.892835:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.892835:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa508 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.892837:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edaa4f3 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.892840:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edaa4f3 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.892840:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa508 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.892842:0:15525:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880122c00a80 x1796503200057408) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda9dc9 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7364:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e6a expref: 3657 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.892844:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880095863200) 00010000:00010000:1.0:1713279306.892845:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.892846:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edaa4f3 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.892849:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edaa4f3 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.892849:0:15525:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda9dc9 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7364:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e6a expref: 3657 pid: 15752 timeout: 509 lvb_type: 0 00000004:00200000:2.0:1713279306.892851:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:1.0:1713279306.892854:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edaa4fa lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.892857:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edaa4fa lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.892858:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaa501 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.892858:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013076e880/0xfc4b8e114eda9dc9 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x7364:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e6a expref: 3657 pid: 15752 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.892861:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edaa4fa lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.892863:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ef180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.892863:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaa501 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.892864:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edaa4fa lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.892865:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c00a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001_UUID:15525:1796503200057408:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.892867:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edaa4fa lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.892868:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaa501 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.892870:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff88008d11ee00) 00010000:00010000:1.0:1713279306.892871:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.892871:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7364:0x0].0x0 (ffff88012bacd300) 00010000:00010000:1.0:1713279306.892873:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edaa4fa lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.892873:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaa501 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.892873:0:15525:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.892875:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edaa4fa lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.892877:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f2aac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.892877:0:15525:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.892880:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaa501 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.892880:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.892885:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaa501 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.892887:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edaa4ec lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917604d expref: 3656 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.892888:0:15525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.892891:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edaa4ec lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917604d expref: 3656 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.892892:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88008d729300) 00010000:00010000:3.0:1713279306.892892:0:15525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.892894:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.892895:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaa501 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.892895:0:15525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.892906:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009181c480, rc 0) 00010000:00010000:2.0:1713279306.892910:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaa501 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.892917:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa508 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.892922:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa508 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.892928:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa508 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.892931:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3655:11711:x1796503281274048:12345-192.168.203.4@tcp:101:touch.0 Request processed in 184us (232us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.892931:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f298c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.892933:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa508 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.892935:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785444 00010000:00010000:2.0:1713279306.892937:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa508 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.892937:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c00a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057472:0@lo:1000:mdt_io00_009.0 00010000:00010000:2.0:1713279306.892943:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff8800938ab700) 00010000:00010000:2.0:1713279306.892945:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.892947:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa508 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.892951:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaa508 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.892953:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.892960:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.892966:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200057472 00000100:00100000:3.0:1713279306.892968:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200057472 00010000:00010000:2.0:1713279306.892971:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e7ba400/0xfc4b8e114edaa4e5 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176046 expref: 3654 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.892978:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e7ba400/0xfc4b8e114edaa4e5 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176046 expref: 3654 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.892978:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98897 00000100:00100000:3.0:1713279306.892981:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200057472:12345-0@lo:1000:mdt_io00_009.0 00010000:00010000:2.0:1713279306.892985:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7ba400, rc 0) 00000100:00100000:2.0:1713279306.893006:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3653:11912:x1796503281273920:12345-192.168.203.4@tcp:101:touch.0 Request processed in 262us (327us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.893012:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785443 00000100:00100000:3.0:1713279306.893024:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200057472:12345-0@lo:1000:mdt_io00_009.0 Request processed in 43us (70us total) trans 0 rc -2/-2 00000100:00100000:3.0:1713279306.893028:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98897 00000100:00100000:3.0:1713279306.893042:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c00a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057472:0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713279306.893060:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c00a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057536:0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713279306.893087:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.893109:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.893124:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200057536 00000100:00100000:0.0:1713279306.893127:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200057536 00000100:00100000:0.0:1713279306.893139:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98898 00000100:00100000:0.0:1713279306.893142:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200057536:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.893174:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200057536:12345-0@lo:1000:mdt_io00_009.0 Request processed in 31us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.893177:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98898 00000100:00100000:3.0:1713279306.893180:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c00a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057536:0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713279306.893201:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c00a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057600:0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713279306.893252:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.893266:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.893267:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200057600 00000100:00100000:0.0:1713279306.893270:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200057600 00000100:00100000:1.0:1713279306.893273:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.893289:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.893290:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98899 00000100:00100000:0.0:1713279306.893293:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200057600:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713279306.893296:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281274176 00000100:00100000:1.0:1713279306.893298:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281274176 00000100:00100000:1.0:1713279306.893307:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281274432 00000100:00100000:1.0:1713279306.893308:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281274432 00000100:00100000:2.0:1713279306.893313:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785445 00000100:00100000:2.0:1713279306.893319:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3426:11666:x1796503281274176:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:1.0:1713279306.893321:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785446 00000100:00100000:1.0:1713279306.893323:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008acce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3426:11855:x1796503281274432:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:1.0:1713279306.893337:0:15752:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.893345:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800923406c0/0xfc4b8e114edaa4d7 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x75a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917603f expref: 3426 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.893348:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x261:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.893354:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75a8:0x0].0x0 (ffff8800908e1000) 00010000:00010000:1.0:1713279306.893356:0:15752:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.893356:0:15658:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114eda8908 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758d6 expref: 3425 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.893362:0:15658:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.893376:0:15658:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114eda8908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758d6 expref: 3425 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.893379:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edaa516 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x75a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.893385:0:15658:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114eda8908 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758d6 expref: 3425 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.893386:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edaa516 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x75a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.893393:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edaa516 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x75a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.893394:0:15658:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001_UUID:15658:1796503200057664:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.893428:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200057600:12345-0@lo:1000:mdt_io00_009.0 Request processed in 132us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.893430:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c00a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057600:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.893432:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98899 00000100:00100000:2.0:1713279306.893433:0:15658:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a0e840 going to sleep for 11 seconds 00000004:00010000:1.0:1713279306.893443:0:15752:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008acce300 reply state ffff880098164000 transno 4295183781 ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edaa516 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x75a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.893450:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edaa516 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x75a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.893453:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75a8:0x0].0x0 (ffff8800908e1000) 00010000:00010000:1.0:1713279306.893454:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.893456:0:15752:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713279306.893470:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.893474:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.893480:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008acce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3427:11855:x1796503281274432:12345-192.168.203.4@tcp:36:touch.0 Request processed in 155us (189us total) trans 4295183781 rc 0/0 00000100:00100000:0.0:1713279306.893485:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281274304 00000100:00100000:1.0:1713279306.893486:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785446 00000100:00100000:0.0:1713279306.893487:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281274304 00000100:00100000:1.0:1713279306.893495:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785447 00000100:00100000:1.0:1713279306.893498:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:11204:x1796503281274304:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.893503:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.893507:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114edaa51d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176054 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.893516:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c00a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057728:0@lo:1000:mdt_io00_009.0 00010000:00010000:1.0:1713279306.893526:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edaa524 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.893530:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.893531:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edaa524 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.893534:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edaa524 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.893536:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.893539:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200057728 00010000:00010000:1.0:1713279306.893539:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edaa52b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.893541:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200057728 00010000:00010000:1.0:1713279306.893542:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edaa52b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.893543:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281274496 00010000:00010000:1.0:1713279306.893545:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edaa52b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:3.0:1713279306.893545:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281274496 00000100:00100000:0.0:1713279306.893549:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98900 00000100:00100000:0.0:1713279306.893551:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200057728:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713279306.893562:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223113 00000100:00100000:3.0:1713279306.893565:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3726:10814:x1796503281274496:12345-192.168.203.4@tcp:37:lfs.0 00010000:00010000:1.0:1713279306.893569:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edaa524 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.893573:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edaa524 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.893576:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edaa524 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.893579:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edaa524 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.893582:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ecd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.893583:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edaa524 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.893584:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200057728:12345-0@lo:1000:mdt_io00_009.0 Request processed in 32us (53us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.893586:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edaa524 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.893587:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98900 00010000:00010000:1.0:1713279306.893590:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:1.0:1713279306.893591:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.893592:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edaa524 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.893595:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edaa524 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.893600:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edaa52b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.893603:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c00a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057728:0@lo:1000:mdt_io00_009.0 00010000:00010000:1.0:1713279306.893603:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edaa52b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.893606:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edaa52b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.893608:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ecfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.893609:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edaa52b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.893612:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edaa52b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.893618:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880129bec700) 00010000:00010000:1.0:1713279306.893619:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.893620:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edaa52b lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.893623:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edaa52b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.893624:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c36b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057792:0@lo:1000:mdt_io00_009.0 00010000:00010000:1.0:1713279306.893633:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114edaa51d lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176054 expref: 3726 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.893637:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114edaa51d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176054 expref: 3726 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.893638:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.893641:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ec000, rc 0) 00000100:00100000:0.0:1713279306.893644:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800965403c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.893649:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200057792 00000100:00100000:0.0:1713279306.893651:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200057792 00000100:00100000:1.0:1713279306.893657:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11204:x1796503281274304:12345-192.168.203.4@tcp:101:touch.0 Request processed in 158us (183us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.893659:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98901 00000100:00100000:1.0:1713279306.893661:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785447 00000100:00100000:0.0:1713279306.893662:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200057792:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.893684:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200057792:12345-0@lo:1000:mdt_io00_009.0 Request processed in 22us (46us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.893687:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98901 00000100:00100000:0.0:1713279306.893698:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c36b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057792:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.893726:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c36b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057856:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.893737:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.893742:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800965400c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.893747:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200057856 00000100:00100000:1.0:1713279306.893750:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200057856 00000100:00100000:1.0:1713279306.893760:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98902 00000100:00100000:1.0:1713279306.893763:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200057856:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713279306.893795:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15525:x1796503200057856:12345-0@lo:1000:mdt_io00_009.0 Request processed in 32us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.893799:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98902 00000100:00100000:0.0:1713279306.893802:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c36b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057856:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.893830:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c36b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057920:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713279306.893842:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.893848:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800965400c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.893851:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200057920 00000100:00100000:1.0:1713279306.893853:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200057920 00000100:00100000:1.0:1713279306.893861:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98903 00000100:00100000:1.0:1713279306.893864:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:15525:x1796503200057920:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713279306.893891:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:15525:x1796503200057920:12345-0@lo:1000:mdt_io00_009.0 Request processed in 26us (48us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.893894:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98903 00000100:00100000:0.0:1713279306.893941:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c36b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057920:0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713279306.894169:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.894187:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.894198:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281274624 00000100:00100000:3.0:1713279306.894201:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281274624 00000100:00100000:1.0:1713279306.894203:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.894206:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000040:00080000:0.0:1713279306.894216:0:15525:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x1c0:0x0].1546, 1264 off831560 00000100:00100000:1.0:1713279306.894220:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281274752 00000100:00100000:3.0:1713279306.894221:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785448 00000100:00100000:1.0:1713279306.894222:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281274752 00000100:00100000:3.0:1713279306.894224:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281274624:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.894230:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281275008 00000100:00100000:1.0:1713279306.894231:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281274880 00000100:00100000:3.0:1713279306.894231:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281275008 00000100:00100000:1.0:1713279306.894232:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281274880 00000100:00100000:2.0:1713279306.894235:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000040:00080000:0.0:1713279306.894242:0:15525:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xf8:0x0].2153, 1344 off1530040 00000100:00100000:3.0:1713279306.894244:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110563 00000100:00100000:3.0:1713279306.894246:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+89:1956:x1796503281275008:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:1.0:1713279306.894250:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281274944 00000100:00100000:1.0:1713279306.894252:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281274944 00000100:00100000:0.0:1713279306.894256:0:15525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c36b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057984:0@lo:1000:mdt_io00_009.0 00010000:00010000:1.0:1713279306.894258:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114eda8908 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758d6 expref: 3428 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.894264:0:15658:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001_UUID:15658:1796503200057664:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.894271:0:15525:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.894271:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196584 00000100:00100000:1.0:1713279306.894274:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3428:1957:x1796503281274944:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.894276:0:15658:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.894278:0:15525:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800965406c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.894279:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.894282:0:6915:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114eda8908 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758d6 expref: 3428 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.894288:0:6915:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114eda8908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758d6 expref: 3428 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.894289:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785449 00000100:00100000:0.0:1713279306.894293:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3428:12010:x1796503281274752:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.894295:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114eda8908 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758d6 expref: 3428 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.894298:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+90:1956:x1796503281275008:12345-192.168.203.4@tcp:2:touch.0 Request processed in 50us (94us total) trans 4295010194 rc 0/0 00010000:00010000:0.0:1713279306.894299:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.894301:0:6915:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x0 (ffff8800908e1900) 00000100:00100000:3.0:1713279306.894302:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110563 00010000:00010000:1.0:1713279306.894303:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.894305:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114edaa532 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176062 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.894307:0:6915:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.894310:0:6915:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.894313:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785450 00000100:00100000:3.0:1713279306.894315:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008acce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281274880:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.894317:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.894320:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.894329:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3428:1957:x1796503281274944:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 54us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.894332:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196584 00010000:00010000:3.0:1713279306.894336:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edaa539 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176069 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.894356:0:15658:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.894358:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaa540 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.894362:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.894363:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaa540 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.894367:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaa540 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.894372:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x76ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.894373:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaa54e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.894376:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaa54e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.894379:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaa54e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.894380:0:15658:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114edaa491 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917601c expref: 3427 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.894386:0:15658:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.894389:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaa540 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.894392:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaa540 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.894395:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaa540 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.894396:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114edaa555 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x758f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.894398:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaa540 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.894400:0:15658:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114edaa491 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917601c expref: 3427 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.894401:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.894402:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaa540 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.894403:0:15482:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda9422 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c09 expref: 3427 pid: 15471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.894408:0:15482:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114edaa555 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x758f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.894408:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaa540 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.894410:0:15658:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114edaa491 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917601c expref: 3427 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.894428:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012d397a00) 00010000:00010000:3.0:1713279306.894430:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.894431:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaa540 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000100:00100000:2.0:1713279306.894433:0:15658:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001_UUID:15658:1796503200058048:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.894435:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaa540 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.894440:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaa54e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.894442:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaa54e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.894446:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaa54e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.894448:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.894449:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaa54e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.894452:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaa54e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.894455:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88007f2ad700) 00000100:00100000:2.0:1713279306.894456:0:15658:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a0e840 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.894456:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.894457:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaa54e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.894460:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaa54e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.894473:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edaa539 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176069 expref: 3655 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.894477:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edaa539 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176069 expref: 3655 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.894482:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd6d00, rc 0) 00010000:00010000:0.0:1713279306.894492:0:15482:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda9422 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c09 expref: 3427 pid: 15471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.894496:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008acce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281274880:12345-192.168.203.4@tcp:101:touch.0 Request processed in 179us (293us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.894498:0:15482:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda9422 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c09 expref: 3427 pid: 15471 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.894500:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785450 00000100:00100000:0.0:1713279306.894504:0:15482:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135effb80 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0001_UUID:15482:1796503200058112:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.894509:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.894519:0:15482:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a840 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.894527:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200057984 00000100:00100000:0.0:1713279306.894529:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200057984 00000100:00100000:2.0:1713279306.894535:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.894540:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98904 00000100:00100000:0.0:1713279306.894543:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:15525:x1796503200057984:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713279306.894547:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281275136 00000100:00100000:1.0:1713279306.894550:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281275136 00000100:00100000:1.0:1713279306.894559:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281275264 00000100:00100000:1.0:1713279306.894561:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281275264 00000100:00100000:1.0:1713279306.894568:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785451 00000100:00100000:1.0:1713279306.894571:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3428:11204:x1796503281275136:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.894576:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.894581:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114edaa55c lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176070 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.894592:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:15525:x1796503200057984:12345-0@lo:1000:mdt_io00_009.0 Request processed in 48us (320us total) trans 4295010195 rc 0/0 00000100:00100000:0.0:1713279306.894599:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98904 00000100:00100000:0.0:1713279306.894627:0:15525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c36b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15525:1796503200057984:0@lo:1000:mdt_io00_009.0 00010000:00010000:1.0:1713279306.894628:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114edaa563 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000004:00080000:0.0:1713279306.894631:0:15525:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800965403c0 with version 32017 00010000:00010000:1.0:1713279306.894633:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114edaa563 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000004:00080000:0.0:1713279306.894638:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32017 rpc_version 32017 00010000:00010000:1.0:1713279306.894638:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114edaa563 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894645:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114edaa56a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.894648:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114edaa56a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000020:00100000:0.0:1713279306.894649:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1713279306.894651:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114edaa56a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.894652:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880135efc380 x1796503200058240/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000004:00200000:1.0:1713279306.894659:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00000100:00100000:0.0:1713279306.894660:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efc380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200058240:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1713279306.894663:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114edaa563 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894666:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114edaa563 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894669:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114edaa563 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894673:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114edaa563 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894675:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298eef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.894677:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114edaa563 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894680:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114edaa563 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894683:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:1.0:1713279306.894684:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.894686:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114edaa563 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894691:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298eef40/0xfc4b8e114edaa563 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894697:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114edaa56a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894699:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114edaa56a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894702:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114edaa56a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894705:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.894706:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114edaa56a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894709:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114edaa56a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894712:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880097a6be00) 00010000:00010000:1.0:1713279306.894713:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.894714:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114edaa56a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.894716:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec6c0/0xfc4b8e114edaa56a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.894729:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.894729:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114edaa55c lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176070 expref: 3429 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.894733:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114edaa55c lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176070 expref: 3429 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.894735:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a480 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.894741:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ed680, rc 0) 00000100:00100000:0.0:1713279306.894742:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200058240 00000100:00100000:0.0:1713279306.894744:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200058240 00000100:00100000:0.0:1713279306.894755:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98905 00000100:00100000:0.0:1713279306.894758:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:8074:x1796503200058240:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.894764:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3428:11204:x1796503281275136:12345-192.168.203.4@tcp:101:touch.0 Request processed in 192us (255us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.894768:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785451 00000100:00100000:1.0:1713279306.894776:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785452 00000100:00100000:1.0:1713279306.894779:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3722:12005:x1796503281275264:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.894784:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.894789:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114edaa571 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176077 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.894797:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.894814:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281275392 00000100:00100000:1.0:1713279306.894816:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281275392 00000100:00100000:1.0:1713279306.894826:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223114 00000100:00100000:1.0:1713279306.894828:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3428:11855:x1796503281275392:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:3.0:1713279306.894852:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:10814:x1796503281274496:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1286us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.894857:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223113 00010000:00010000:3.0:1713279306.894869:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.894873:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3429:11855:x1796503281275392:12345-192.168.203.4@tcp:35:touch.0 Request processed in 43us (77us total) trans 4295183783 rc 0/0 00010000:00010000:3.0:1713279306.894875:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114edaa578 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917605b expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.894878:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223114 00010000:00010000:1.0:1713279306.894903:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edaa57f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.894908:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edaa57f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.894908:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114edaa586 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.894912:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edaa57f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.894913:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114edaa586 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.894917:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114edaa586 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.894918:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edaa58d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.894922:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edaa58d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.894922:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edaa594 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.894925:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edaa594 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.894926:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edaa58d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.894929:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edaa594 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000004:00200000:3.0:1713279306.894936:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:3.0:1713279306.894940:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114edaa586 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.894943:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114edaa586 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.894946:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114edaa586 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.894949:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114edaa586 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.894952:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.894953:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114edaa586 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.894956:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114edaa586 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.894960:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88007f2ad800) 00010000:00010000:3.0:1713279306.894961:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.894962:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114edaa586 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000004:00200000:1.0:1713279306.894965:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7ccb:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.894965:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114edaa586 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.894969:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edaa57f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.894969:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edaa594 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.894972:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edaa57f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.894975:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edaa57f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.894975:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edaa594 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.894978:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edaa57f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.894978:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edaa594 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.894980:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298efa80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.894980:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.894981:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edaa594 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.894982:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edaa57f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.894984:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edaa594 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.894985:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edaa57f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.894987:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88007f2ad300) 00010000:00010000:1.0:1713279306.894988:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.894988:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.894989:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edaa594 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.894990:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.894991:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edaa57f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.894991:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edaa594 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.894994:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edaa57f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.895000:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edaa58d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.895003:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114edaa578 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917605b expref: 3724 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.895004:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edaa58d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.895007:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edaa58d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.895007:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114edaa578 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917605b expref: 3724 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.895009:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298edb00 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.895010:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+56:8074:x1796503200058240:12345-0@lo:1000:osp_up0-1.0 Request processed in 250us (280us total) trans 4295202773 rc 0/0 00010000:00010000:1.0:1713279306.895010:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edaa58d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.895012:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd7840, rc 0) 00010000:00010000:1.0:1713279306.895013:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edaa58d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.895016:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x30 (ffff880097a6b100) 00010000:00010000:1.0:1713279306.895017:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.895018:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edaa58d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.895020:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edaa58d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.895027:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3723:11711:x1796503281274624:12345-192.168.203.4@tcp:101:touch.0 Request processed in 802us (858us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.895030:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785448 00010000:00010000:1.0:1713279306.895032:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114edaa571 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176077 expref: 3723 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.895036:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114edaa571 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176077 expref: 3722 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.895039:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ec480, rc 0) 00000100:00100000:0.0:1713279306.895053:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98905 00000100:00100000:1.0:1713279306.895053:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3721:12005:x1796503281275264:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 273us (518us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.895057:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785452 00000100:00100000:0.0:1713279306.895095:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efc380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200058240:0@lo:1000:osp_up0-1.0 00000004:00010000:1.0:1713279306.895107:0:15525:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880096755500 reply state ffff8800967c3000 transno 4295183782 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.895113:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.895117:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7364:0x0].0x0 (ffff88012bacd300) 00010000:00010000:1.0:1713279306.895118:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1713279306.895119:0:15525:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713279306.895122:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaa4ad lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.895125:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaa4ad lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.895128:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaa4ad lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.895131:0:15525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaa4ad lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.895133:0:15525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd73c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.895135:0:15525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaa4ad lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00000100:00100000:2.0:1713279306.895136:0:15658:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001_UUID:15658:1796503200058048:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.895137:0:15525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaa4ad lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.895141:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880097a5f200) 00010000:00010000:1.0:1713279306.895142:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.895143:0:15525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaa4ad lrc: 3/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:2.0:1713279306.895146:0:15658:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.895148:0:15525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaa4ad lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00000004:00010000:1.0:1713279306.895155:0:15525:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880096755500 reply state ffff8800967c3000 transno 4295183782 ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114edaa4bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.895158:0:15525:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114edaa4bb lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:1.0:1713279306.895161:0:15525:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3131 (ffff880097a5fd00) 00010000:00010000:1.0:1713279306.895163:0:15525:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.895163:0:15525:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1713279306.895165:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24c:0x0] 00010000:00010000:1.0:1713279306.895181:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.895185:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.895188:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.895196:0:15525:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1713279306.895198:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24c:0x0] 00010000:00010000:1.0:1713279306.895200:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce51680/0xfc4b8e114edaa498 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaa49f expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.895200:0:6919:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713279306.895204:0:15525:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce51680/0xfc4b8e114edaa498 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaa49f expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.895204:0:6919:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.895208:0:6919:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f4a5f80 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.895211:0:6919:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.895215:0:6919:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.895227:0:6919:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.895230:0:6919:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.895239:0:6919:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 1/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.895241:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.895242:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f4a5f80/0xfc4b8e114edaa41a lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaa421 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.895243:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200058304:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1713279306.895244:0:15525:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x84a3:0x0] 00010000:00010000:1.0:1713279306.895248:0:15525:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.895249:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.895250:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.895251:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.895252:0:15525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.895256:0:15525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.895257:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.895262:0:15525:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1713279306.895267:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.895269:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281275520 00000100:00100000:3.0:1713279306.895272:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281275520 00010000:00010000:1.0:1713279306.895274:0:15544:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713279306.895276:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.895280:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323840 already unused, calling callback (ffffffffa0f0e520) 00000100:00100000:3.0:1713279306.895281:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281275712 00010000:00010000:1.0:1713279306.895282:0:15544:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.895282:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281275712 00000100:00100000:2.0:1713279306.895285:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200058304 00000004:00010000:1.0:1713279306.895286:0:15544:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.895288:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200058304 00000100:00100000:3.0:1713279306.895289:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785453 00000100:00100000:3.0:1713279306.895292:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:12016:x1796503281275520:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.895296:0:15544:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.895297:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.895298:0:15485:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1713279306.895299:0:15544:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713279306.895303:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147271 00010000:00010000:3.0:1713279306.895306:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012374cb40/0xfc4b8e114ed991ed lrc: 0/0,0 mode: --/PR res: [0x200000400:0x229:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39171529 expref: 3724 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.895307:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b25ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+56:3490:x1796503200058304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.895313:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x229:0x0].0x0 (ffff88009811e200) 00010000:00010000:1.0:1713279306.895314:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.895314:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.895315:0:15485:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.895318:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012d323840/0xfc4b8e114eda9eb7 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114eda9ee8 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.895322:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaa421 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114edaa41a expref: 56 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.895322:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200058368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.895324:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.895326:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.895326:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.895328:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.895332:0:6915:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x0 (ffff880096e84a00) 00010000:00010000:2.0:1713279306.895337:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.895338:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.895347:0:15525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:385c4b71-808c-40cf-91de-b076b668d13f+3655:11876:x1796503281263232:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 17388us (17481us total) trans 4295183782 rc 0/0 00000100:00100000:1.0:1713279306.895352:0:15525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14357 00000100:00100000:3.0:1713279306.895353:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281275584 00000100:00100000:3.0:1713279306.895354:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281275584 00000100:00100000:2.0:1713279306.895355:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b25ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+55:3490:x1796503200058304:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.895361:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147271 00010000:00010000:3.0:1713279306.895361:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114edaa491 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917601c expref: 3429 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.895364:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785454 00000100:00100000:1.0:1713279306.895367:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281275712:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.895370:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200058368 00000100:00100000:3.0:1713279306.895371:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200058368 00010000:00010000:1.0:1713279306.895372:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.895376:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda9ee8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xfc4b8e114eda9eb7 expref: 55 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.895378:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114edaa59b lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176085 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.895384:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196585 00000100:00100000:3.0:1713279306.895388:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196586 00000100:00100000:2.0:1713279306.895389:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3429:1955:x1796503281275584:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.895390:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+55:3491:x1796503200058368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.895394:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.895395:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.895397:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda9ee8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114eda9eb7 expref: 55 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.895400:0:6915:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114edaa491 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917601c expref: 3429 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.895403:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880089fe1680/0xfc4b8e114eda9ee8 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xfc4b8e114eda9eb7 expref: 55 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.895408:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.895409:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114edaa5a2 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.895409:0:6915:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114edaa491 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917601c expref: 3429 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.895429:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.895432:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114edaa5a2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.895434:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.895437:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114edaa5a2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.895437:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.895438:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ad686c0/0xfc4b8e114edaa491 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x76ef:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917601c expref: 3429 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.895440:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.895442:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efcc0/0xfc4b8e114edaa5a9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.895446:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efcc0/0xfc4b8e114edaa5a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.895446:0:6915:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76ef:0x0].0x0 (ffff88008d729f00) 00010000:00010000:1.0:1713279306.895450:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efcc0/0xfc4b8e114edaa5a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.895450:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.895452:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.895456:0:6915:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.895461:0:6915:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.895464:0:6942:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.895466:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+54:3491:x1796503200058368:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (127us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.895468:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.895469:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196586 00010000:00010000:2.0:1713279306.895472:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.895484:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200058368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.895488:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200058432:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1713279306.895488:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3428:1955:x1796503281275584:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 98us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.895494:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196585 00010000:00010000:3.0:1713279306.895496:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114edaa5b0 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x229:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917607e expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.895506:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.895520:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012984a480 going to sleep for 11 seconds 00000004:00200000:1.0:1713279306.895526:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:1.0:1713279306.895533:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114edaa5a2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.895533:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaa5b7 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x229:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.895536:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114edaa5a2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.895538:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaa5b7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x229:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.895540:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114edaa5a2 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.895542:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaa5b7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x229:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.895543:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114edaa5a2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.895545:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.895547:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114edaa5a2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.895547:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaa5be lrc: 3/1,0 mode: --/PR res: [0x200000400:0x229:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.895550:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114edaa5a2 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.895551:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaa5be lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x229:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.895554:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff8800938abd00) 00010000:00010000:1.0:1713279306.895555:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.895556:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114edaa5a2 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.895556:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaa5be lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x229:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.895559:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114edaa5a2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.895565:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efcc0/0xfc4b8e114edaa5a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.895568:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efcc0/0xfc4b8e114edaa5a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.895570:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efcc0/0xfc4b8e114edaa5a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.895573:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298efcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.895573:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6400/0xfc4b8e114edaa5c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7da5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.895574:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efcc0/0xfc4b8e114edaa5a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.895576:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6400/0xfc4b8e114edaa5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7da5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.895577:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efcc0/0xfc4b8e114edaa5a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.895580:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88008eba0f00) 00010000:00010000:3.0:1713279306.895580:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6400/0xfc4b8e114edaa5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7da5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.895581:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.895582:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efcc0/0xfc4b8e114edaa5a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000004:00200000:3.0:1713279306.895583:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7da5:0x0]: returning size 0 00010000:00010000:1.0:1713279306.895585:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efcc0/0xfc4b8e114edaa5a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.895588:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200058304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.895597:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200058432 00010000:00010000:1.0:1713279306.895598:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114edaa59b lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176085 expref: 3655 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.895600:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200058432 00010000:00010000:2.0:1713279306.895601:0:15658:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.895602:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef3c0/0xfc4b8e114edaa59b lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176085 expref: 3655 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.895603:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaa5b7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x229:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.895606:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaa5b7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x229:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.895607:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.895609:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaa5b7 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x229:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.895610:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ef3c0, rc 0) 00000100:00100000:0.0:1713279306.895613:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98906 00010000:00010000:3.0:1713279306.895613:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaa5b7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x229:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.895615:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+92:6942:x1796503200058432:12345-0@lo:1000:mdt_io00_001.0 00010000:00010000:3.0:1713279306.895615:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.895616:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaa5b7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x229:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.895619:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114edaa5d3 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x264:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.895619:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaa5b7 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x229:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.895623:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x229:0x0].0x0 (ffff88009811e200) 00000100:00100000:1.0:1713279306.895625:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281275712:12345-192.168.203.4@tcp:101:touch.0 Request processed in 257us (367us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.895625:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.895626:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114edaa5d3 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x264:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.895627:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaa5b7 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x229:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.895629:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785454 00010000:00010000:3.0:1713279306.895630:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaa5b7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x229:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.895632:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114edaa5d3 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x264:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.895634:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaa5be lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x229:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.895637:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaa5be lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x229:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.895640:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114edaa5da lrc: 3/0,1 mode: --/EX res: [0x240000400:0x242:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.895640:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaa5be lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x229:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.895643:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.895644:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaa5be lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x229:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.895645:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114edaa5da lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x242:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.895647:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaa5be lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x229:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.895650:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x229:0x0].0x35 (ffff880096da6800) 00010000:00010000:2.0:1713279306.895651:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114edaa5da lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x242:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.895651:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.895652:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaa5be lrc: 2/0,0 mode: --/PR res: [0x200000400:0x229:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.895655:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaa5be lrc: 0/0,0 mode: --/PR res: [0x200000400:0x229:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.895656:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+92:6942:x1796503200058432:12345-0@lo:1000:mdt_io00_001.0 Request processed in 40us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.895660:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98906 00000100:00100000:1.0:1713279306.895663:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200058432:0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1713279306.895664:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.895668:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114edaa5b0 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x229:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917607e expref: 3726 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.895669:0:15658:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.895673:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6400/0xfc4b8e114edaa5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7da5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917607e expref: 3725 pid: 15485 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713279306.895675:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x7d86:0x0] 00010000:00010000:2.0:1713279306.895675:0:15658:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.895677:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7da5:0x0].0x0 (ffff880096da6900) 00010000:00010000:3.0:1713279306.895678:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713279306.895679:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd6400, rc 0) 00000100:00100000:2.0:1713279306.895685:0:15658:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099668a80 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-mdtlov_UUID:15658:1796503200058496:0@lo:101:mdt00_029.0 00000100:00100000:1.0:1713279306.895686:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200058560:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1713279306.895692:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:12016:x1796503281275520:12345-192.168.203.4@tcp:101:touch.0 Request processed in 399us (452us total) trans 4295202774 rc 0/0 00000100:00100000:3.0:1713279306.895696:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785453 00000100:00100000:1.0:1713279306.895702:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.895710:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012984a000 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.895724:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200058560 00000100:00100000:0.0:1713279306.895726:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200058560 00000100:00100000:2.0:1713279306.895731:0:15658:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.895737:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200058496 00000100:00100000:0.0:1713279306.895739:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200058496 00000100:00100000:2.0:1713279306.895741:0:15658:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a0e540 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.895746:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98907 00000100:00100000:0.0:1713279306.895748:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+92:6942:x1796503200058560:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1713279306.895752:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98908 00000100:00100000:1.0:1713279306.895755:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+54:15658:x1796503200058496:12345-0@lo:101:mdt00_029.0 00010000:00010000:1.0:1713279306.895763:0:15580:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.895770:0:15580:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114edaa5e1 expref: -99 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.895779:0:15580:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175882 expref: 3724 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.895780:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+92:6942:x1796503200058560:12345-0@lo:1000:mdt_io00_001.0 Request processed in 30us (77us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.895783:0:15580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114edaa5e1 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.895784:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98907 00010000:00010000:1.0:1713279306.895793:0:15580:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175882 expref: 3724 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.895793:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200058560:0@lo:1000:mdt_io00_001.0 00010000:00010000:1.0:1713279306.895798:0:15580:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175882 expref: 3724 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.895799:0:15482:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135effb80 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0001_UUID:15482:1796503200058112:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.895804:0:15580:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008acced80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000_UUID:15580:1796503200058624:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.895820:0:15580:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096e07840 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.895861:0:15482:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114edaa555 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x758f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.895866:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.895873:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281275904 00000100:00100000:3.0:1713279306.895875:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281275904 00000100:00100000:1.0:1713279306.895877:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.895884:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.895885:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785455 00000100:00100000:3.0:1713279306.895888:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3428:11855:x1796503281275904:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.895893:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.895898:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd46c0/0xfc4b8e114edaa5ef lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917608c expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.895899:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.895914:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.895917:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114edaa5f6 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.895923:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114edaa5f6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.895927:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114edaa5f6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.895931:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.895936:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281276032 00000100:00100000:3.0:1713279306.895937:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281276032 00000100:00100000:3.0:1713279306.895944:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281276224 00000100:00100000:3.0:1713279306.895946:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281276224 00000100:00100000:0.0:1713279306.895950:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281276160 00000100:00100000:0.0:1713279306.895952:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281276160 00000100:00100000:3.0:1713279306.895952:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281276288 00000100:00100000:3.0:1713279306.895953:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281276288 00000100:00100000:1.0:1713279306.895961:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785456 00000100:00100000:1.0:1713279306.895964:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11204:x1796503281276032:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.895970:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.895970:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785457 00000100:00100000:3.0:1713279306.895972:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3430:10814:x1796503281276224:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.895975:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023cb40/0xfc4b8e114edaa5fd lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176093 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.895976:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.895981:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114edaa604 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x134:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391760a1 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.895988:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114edaa604 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760a1 expref: 3431 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.895993:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7600/0xfc4b8e114edaa604 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x134:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760a1 expref: 3431 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.895995:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114edaa60b lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.895997:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x0 (ffff880096da6200) 00010000:00010000:3.0:1713279306.895998:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.895999:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd7600, rc 0) 00010000:00010000:1.0:1713279306.896000:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114edaa60b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.896004:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114edaa60b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.896009:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023d680/0xfc4b8e114edaa612 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.896012:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023d680/0xfc4b8e114edaa612 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.896012:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3431:10814:x1796503281276224:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 39us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.896013:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785458 00010000:00010000:1.0:1713279306.896015:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023d680/0xfc4b8e114edaa612 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713279306.896016:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785457 00000100:00100000:0.0:1713279306.896017:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3655:11711:x1796503281276160:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.896022:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785459 00010000:00010000:0.0:1713279306.896023:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.896025:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3655:11876:x1796503281276288:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1713279306.896030:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092342ac0/0xfc4b8e114edaa619 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917609a expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.896031:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114edaa60b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.896034:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114edaa60b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.896037:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114edaa60b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.896038:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edaa620 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.896040:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114edaa60b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.896042:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edaa620 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.896043:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.896044:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114edaa60b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.896046:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edaa620 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.896047:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114edaa60b lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.896051:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:1.0:1713279306.896052:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.896053:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114edaa60b lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.896053:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaa627 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.896054:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114edaa62e lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.896056:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c000/0xfc4b8e114edaa60b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.896056:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaa627 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896059:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114edaa62e lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.896059:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaa627 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.896060:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023d680/0xfc4b8e114edaa612 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.896063:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023d680/0xfc4b8e114edaa612 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.896064:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114edaa62e lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.896081:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023d680/0xfc4b8e114edaa612 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.896084:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114edaa635 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.896096:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023d680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.896097:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023d680/0xfc4b8e114edaa612 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.896098:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114edaa635 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.896099:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaa63c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1713279306.896100:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023d680/0xfc4b8e114edaa612 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.896102:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114edaa635 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.896104:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880135caaa00) 00010000:00010000:3.0:1713279306.896104:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaa63c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.896105:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.896106:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023d680/0xfc4b8e114edaa612 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.896107:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaa63c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.896109:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023d680/0xfc4b8e114edaa612 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.896115:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114edaa62e lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896118:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114edaa62e lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.896119:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023cb40/0xfc4b8e114edaa5fd lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176093 expref: 3726 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.896121:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114edaa62e lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00000004:00010000:3.0:1713279306.896121:0:15474:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaa63c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896124:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114edaa62e lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.896124:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023cb40/0xfc4b8e114edaa5fd lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176093 expref: 3726 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.896125:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edaa620 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896127:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.896127:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023cb40, rc 0) 00010000:00010000:3.0:1713279306.896128:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edaa620 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896129:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114edaa62e lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.896131:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edaa620 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896132:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114edaa62e lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.896133:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edaa620 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.896136:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd61c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.896138:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff8800960e8500) 00010000:00010000:3.0:1713279306.896138:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edaa620 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896140:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.896140:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11204:x1796503281276032:12345-192.168.203.4@tcp:101:touch.0 Request processed in 176us (256us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.896141:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edaa620 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896142:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114edaa62e lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896144:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092342640/0xfc4b8e114edaa62e lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00000100:00100000:1.0:1713279306.896144:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785456 00010000:00010000:3.0:1713279306.896145:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880096da6400) 00010000:00010000:3.0:1713279306.896147:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.896148:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edaa620 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896149:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114edaa635 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.896151:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edaa620 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896152:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114edaa635 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896155:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114edaa635 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.896155:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaa627 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896157:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800923433c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.896158:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaa627 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896159:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114edaa635 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.896161:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaa627 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896162:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114edaa635 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.896164:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092920240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.896165:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff8800960e8b00) 00010000:00010000:3.0:1713279306.896165:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaa627 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896166:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.896167:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114edaa635 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.896168:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaa627 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896170:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800923433c0/0xfc4b8e114edaa635 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.896171:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x35 (ffff880091738a00) 00010000:00010000:3.0:1713279306.896172:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.896173:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaa627 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.896178:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaa627 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896182:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342ac0/0xfc4b8e114edaa619 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917609a expref: 3656 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.896183:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaa63c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.896186:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaa63c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896187:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092342ac0/0xfc4b8e114edaa619 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917609a expref: 3656 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.896189:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaa63c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.896191:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092342ac0, rc 0) 00010000:00010000:3.0:1713279306.896191:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.896192:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaa63c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.896195:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaa63c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.896198:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6ed2:0x0].0x0 (ffff8800939e3a00) 00010000:00010000:3.0:1713279306.896199:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.896200:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaa63c lrc: 2/0,0 mode: --/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.896203:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaa63c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000100:00100000:2.0:1713279306.896208:0:6942:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200058688:0@lo:403:mdt_io00_001.0 00000100:00100000:3.0:1713279306.896223:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3655:11876:x1796503281276288:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 197us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.896227:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785459 00000100:00100000:2.0:1713279306.896228:0:6942:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.896235:0:6942:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012984a480 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.896243:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaa643 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:2.0:1713279306.896244:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281275776 00000100:00100000:2.0:1713279306.896246:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281275776 00000100:00100000:0.0:1713279306.896250:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3654:11711:x1796503281276160:12345-192.168.203.4@tcp:101:touch.0 Request processed in 232us (335us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.896250:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaa643 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.896253:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaa643 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.896255:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785458 00010000:00010000:2.0:1713279306.896255:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda9422 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c09 expref: 3431 pid: 15471 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.896259:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.896263:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281276416 00000100:00100000:2.0:1713279306.896264:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196587 00000100:00100000:0.0:1713279306.896265:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281276416 00000100:00100000:2.0:1713279306.896267:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3431:1957:x1796503281275776:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.896272:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.896274:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785460 00010000:00010000:2.0:1713279306.896274:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda9422 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c09 expref: 3431 pid: 15471 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.896277:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281276416:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.896279:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda9422 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c09 expref: 3431 pid: 15471 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.896279:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa64a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x72a2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.896282:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.896283:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa64a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x72a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.896286:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114eda9422 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c09 expref: 3431 pid: 15471 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.896286:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa64a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x72a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.896287:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114edaa651 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391760a8 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713279306.896290:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x72a2:0x0]: returning size 0 00010000:00010000:2.0:1713279306.896291:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x758f:0x0].0x0 (ffff8800908e1600) 00010000:00010000:2.0:1713279306.896294:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114edaa555 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x758f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.896298:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114edaa555 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x758f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.896301:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114edaa555 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x758f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.896308:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.896308:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114edaa5f6 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.896311:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114edaa5f6 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.896314:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114edaa5f6 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.896317:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114edaa5f6 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.896320:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3431:1957:x1796503281275776:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 52us (442us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.896320:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.896321:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114edaa5f6 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.896324:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114edaa5f6 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.896326:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196587 00010000:00010000:3.0:1713279306.896328:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880096da6400) 00010000:00010000:3.0:1713279306.896329:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.896331:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114edaa5f6 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.896334:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114edaa5f6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.896335:0:15482:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114edaa555 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x758f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.896338:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114edaa555 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x758f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.896339:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaa643 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.896342:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaa643 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00000004:00200000:2.0:1713279306.896344:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x758f:0x0]: returning size 64588 00010000:00010000:3.0:1713279306.896345:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaa643 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.896347:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.896348:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaa643 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.896351:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaa643 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.896354:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3731 (ffff880094e7b100) 00010000:00010000:3.0:1713279306.896355:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.896356:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaa643 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.896358:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaa643 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.896372:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd46c0/0xfc4b8e114edaa5ef lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917608c expref: 3432 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.896378:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092343840/0xfc4b8e114edaa532 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176062 expref: 3432 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.896379:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114edaa666 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.896379:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa64a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x72a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917608c expref: 3432 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.896382:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x72a2:0x0].0x0 (ffff8800927b4000) 00010000:00010000:0.0:1713279306.896384:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114edaa666 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.896384:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.896385:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923421c0/0xfc4b8e114edaa555 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x758f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176062 expref: 3431 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.896385:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68ad00, rc 0) 00010000:00010000:2.0:1713279306.896388:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x758f:0x0].0x0 (ffff8800908e1600) 00010000:00010000:0.0:1713279306.896389:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114edaa666 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.896390:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1713279306.896391:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923421c0, rc 0) 00010000:00010000:0.0:1713279306.896394:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114edaa66d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.896397:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114edaa66d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896401:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114edaa66d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.896401:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3431:11855:x1796503281275904:12345-192.168.203.4@tcp:101:touch.0 Request processed in 513us (536us total) trans 4295183784 rc 0/0 00000100:00100000:2.0:1713279306.896404:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3431:12010:x1796503281274752:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 2110us (2215us total) trans 4295183785 rc 0/0 00000100:00100000:3.0:1713279306.896405:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785455 00000100:00100000:2.0:1713279306.896408:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785449 00010000:00010000:0.0:1713279306.896425:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114edaa666 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896429:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114edaa666 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896432:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114edaa666 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896435:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114edaa666 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00000100:00100000:1.0:1713279306.896435:0:15580:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008acced80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000_UUID:15580:1796503200058624:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.896438:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092343cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.896439:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114edaa666 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896442:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114edaa666 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896446:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff8800960e8000) 00010000:00010000:1.0:1713279306.896447:0:15580:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa5e1 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.896448:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.896449:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114edaa666 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896452:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092343cc0/0xfc4b8e114edaa666 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896456:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114edaa66d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896459:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114edaa66d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00000004:00010000:1.0:1713279306.896465:0:15580:0:(mdt_lvb.c:110:mdt_dom_disk_lvbo_update()) res: [0x200000401:0x140:0x0] updating lvb size from disk: 0 -> 4096 00000004:00010000:1.0:1713279306.896468:0:15580:0:(mdt_lvb.c:117:mdt_dom_disk_lvbo_update()) res: [0x200000401:0x140:0x0] updating lvb mtime from disk: 0 -> 1713279304 00000004:00010000:1.0:1713279306.896470:0:15580:0:(mdt_lvb.c:123:mdt_dom_disk_lvbo_update()) res: [0x200000401:0x140:0x0] updating lvb atime from disk: 0 -> 1713279304 00000004:00010000:1.0:1713279306.896472:0:15580:0:(mdt_lvb.c:129:mdt_dom_disk_lvbo_update()) res: [0x200000401:0x140:0x0] updating lvb ctime from disk: 0 -> 1713279304 00000004:00010000:1.0:1713279306.896474:0:15580:0:(mdt_lvb.c:135:mdt_dom_disk_lvbo_update()) res: [0x200000401:0x140:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00010000:00010000:1.0:1713279306.896479:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x140:0x0].0x0 (ffff88008e4c3e00) 00010000:00010000:1.0:1713279306.896480:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:1.0:1713279306.896483:0:15580:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa5e1 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.896490:0:15580:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa5e1 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.896495:0:15580:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa5e1 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.896501:0:15580:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa5e1 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.896504:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114edaa66d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896507:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092340fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.896507:0:15580:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa5e1 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.896509:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114edaa66d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896512:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114edaa66d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.896513:0:15580:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa5e1 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.896517:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff8800960e8800) 00010000:00010000:0.0:1713279306.896518:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.896518:0:15580:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa5e1 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.896520:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114edaa66d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.896523:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092340fc0/0xfc4b8e114edaa66d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.896527:0:15580:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134971f80, rc 0) 00010000:00010000:0.0:1713279306.896536:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114edaa651 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760a8 expref: 3655 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.896540:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092342f40/0xfc4b8e114edaa651 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760a8 expref: 3655 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.896545:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092342f40, rc 0) 00000100:00100000:1.0:1713279306.896550:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+55:15658:x1796503200058496:12345-0@lo:101:mdt00_029.0 Request processed in 793us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.896555:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98908 00000100:00100000:0.0:1713279306.896559:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3654:11912:x1796503281276416:12345-192.168.203.4@tcp:101:touch.0 Request processed in 281us (300us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.896559:0:15658:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099668a80 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-mdtlov_UUID:15658:1796503200058496:0@lo:101:mdt00_029.0 00000100:00100000:0.0:1713279306.896563:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785460 00010000:00010000:2.0:1713279306.896565:0:15658:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.896566:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200058688 00000100:00100000:1.0:1713279306.896569:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200058688 00010000:00010000:2.0:1713279306.896569:0:15658:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.896582:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98909 00000100:00100000:1.0:1713279306.896585:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+92:6942:x1796503200058688:12345-0@lo:403:mdt_io00_001.0 00000100:00100000:0.0:1713279306.896716:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.896725:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281276480 00000100:00100000:2.0:1713279306.896727:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281276480 00000100:00100000:0.0:1713279306.896732:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.896734:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175882 expref: 3725 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.896740:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281276608 00000100:00100000:0.0:1713279306.896742:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281276608 00000100:00100000:2.0:1713279306.896748:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196588 00000100:00100000:2.0:1713279306.896751:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:1956:x1796503281276480:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.896756:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.896758:0:6915:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175882 expref: 3725 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.896764:0:6915:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175882 expref: 3725 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.896770:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114eda87b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x140:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175882 expref: 3725 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.896776:0:6915:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x140:0x0].0x0 (ffff88008e4c3e00) 00010000:00010000:2.0:1713279306.896778:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa5e1 expref: 54 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.896783:0:6915:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114edaa5e1 expref: 54 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.896787:0:6915:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114edaa5e1 expref: 54 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.896796:0:6915:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa5e1 expref: 54 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.896804:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785461 00000100:00100000:2.0:1713279306.896804:0:6915:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6915:1796503200058752:0@lo:105: 00000100:00100000:0.0:1713279306.896808:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3654:11876:x1796503281276608:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.896814:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.896816:0:6915:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.896820:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114edaa674 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391760af expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.896822:0:6915:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a0e540 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.896835:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200058752 00000100:00100000:3.0:1713279306.896838:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200058752 00000100:00100000:3.0:1713279306.896849:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33455 00000100:00100000:3.0:1713279306.896852:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6915:x1796503200058752:12345-0@lo:105: 00010000:00010000:3.0:1713279306.896856:0:6913:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.896861:0:6913:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.896865:0:6913:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.896868:0:6913:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.896872:0:6913:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.896879:0:6913:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.896886:0:6913:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800906e8900) 00010000:00010000:2.0:1713279306.896891:0:15658:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.896903:0:15658:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.896912:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114edaa67b lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6ed2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.896918:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114edaa67b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6ed2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00000100:00100000:3.0:1713279306.896918:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6915:x1796503200058752:12345-0@lo:105: Request processed in 65us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.896920:0:6915:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6915:1796503200058752:0@lo:105: 00000100:00100000:3.0:1713279306.896921:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33455 00010000:00010000:0.0:1713279306.896922:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114edaa67b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6ed2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.896925:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1713279306.896926:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x6ed2:0x0]: returning size 2490368 00000100:00100000:2.0:1713279306.896935:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:1956:x1796503281276480:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 182us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.896940:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196588 00010000:00010000:0.0:1713279306.896955:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092341d40/0xfc4b8e114edaa674 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760af expref: 3657 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.896962:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114edaa67b lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6ed2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760af expref: 3656 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.896965:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6ed2:0x0].0x0 (ffff8800939e3a00) 00010000:00010000:0.0:1713279306.896967:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1713279306.896968:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092340d80, rc 0) 00000100:00100000:0.0:1713279306.896990:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3656:11876:x1796503281276608:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 182us (258us total) trans 4295183786 rc 0/0 00000100:00100000:0.0:1713279306.896994:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785461 00000100:00100000:0.0:1713279306.897020:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.897050:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.897058:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281276736 00000100:00100000:0.0:1713279306.897060:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281276736 00000100:00100000:0.0:1713279306.897084:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785462 00000100:00100000:0.0:1713279306.897087:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3430:11204:x1796503281276736:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.897092:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.897107:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114edaa689 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391760b6 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.897142:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edaa690 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897147:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edaa690 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897151:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edaa690 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897156:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edaa697 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897160:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edaa697 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897163:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edaa697 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00000004:00200000:0.0:1713279306.897170:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:0.0:1713279306.897175:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edaa690 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897178:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edaa690 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897181:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edaa690 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897184:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edaa690 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897187:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baba80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.897188:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edaa690 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897191:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edaa690 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897195:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:0.0:1713279306.897196:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.897197:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edaa690 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897200:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edaa690 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897205:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edaa697 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897207:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edaa697 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897210:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edaa697 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897213:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baaf40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.897214:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edaa697 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897219:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edaa697 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897223:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880097e7b600) 00010000:00010000:0.0:1713279306.897224:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.897225:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edaa697 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897228:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edaa697 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.897239:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114edaa689 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760b6 expref: 3431 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.897243:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114edaa689 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760b6 expref: 3431 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.897247:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e35f80, rc 0) 00000100:00100000:0.0:1713279306.897259:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3430:11204:x1796503281276736:12345-192.168.203.4@tcp:101:touch.0 Request processed in 171us (208us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.897262:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785462 00000100:00100000:0.0:1713279306.897289:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.897297:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281276864 00000100:00100000:0.0:1713279306.897299:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281276864 00000100:00100000:0.0:1713279306.897308:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785463 00000100:00100000:0.0:1713279306.897311:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281276864:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.897316:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.897321:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114edaa69e lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391760bd expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.897355:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edaa6a5 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897359:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edaa6a5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897363:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edaa6a5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897368:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edaa6ac lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897372:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edaa6ac lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897375:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edaa6ac lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000004:00200000:0.0:1713279306.897382:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:0.0:1713279306.897386:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edaa6a5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897388:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edaa6a5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897391:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edaa6a5 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897394:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edaa6a5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897397:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.897398:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edaa6a5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897402:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edaa6a5 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897406:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8800908e1e00) 00010000:00010000:0.0:1713279306.897407:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.897408:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edaa6a5 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897425:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edaa6a5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897430:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edaa6ac lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897433:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edaa6ac lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897436:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edaa6ac lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897438:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba98c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.897440:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edaa6ac lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897442:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edaa6ac lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897446:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff8800939e3500) 00010000:00010000:0.0:1713279306.897447:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.897448:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edaa6ac lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897450:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edaa6ac lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.897463:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114edaa69e lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760bd expref: 3722 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.897468:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114edaa69e lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760bd expref: 3722 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.897473:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baa400, rc 0) 00000100:00100000:0.0:1713279306.897485:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281276864:12345-192.168.203.4@tcp:101:touch.0 Request processed in 173us (195us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.897488:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785463 00000100:00100000:2.0:1713279306.897504:0:15658:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669c00 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-mdtlov_UUID:15658:1796503200058816:0@lo:403:mdt00_029.0 00000100:00100000:2.0:1713279306.897526:0:15658:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.897535:0:15658:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a0e540 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.897537:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200058816 00000100:00100000:0.0:1713279306.897539:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200058816 00000100:00100000:0.0:1713279306.897549:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98910 00000100:00100000:0.0:1713279306.897551:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15658:x1796503200058816:12345-0@lo:403:mdt00_029.0 00000100:00100000:1.0:1713279306.897809:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+92:6942:x1796503200058688:12345-0@lo:403:mdt_io00_001.0 Request processed in 1222us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.897814:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98909 00000100:00100000:1.0:1713279306.897829:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281276928 00000100:00100000:1.0:1713279306.897831:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281276928 00000100:00100000:1.0:1713279306.897841:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223115 00000100:00100000:1.0:1713279306.897843:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130144050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3430:10814:x1796503281276928:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:3.0:1713279306.897877:0:6942:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:6942:1796503200058688:0@lo:403:mdt_io00_001.0 00010000:00010000:3.0:1713279306.898354:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa6b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898361:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa6b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898366:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa6b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898371:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114edaa6ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x14f:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898375:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114edaa6ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898378:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114edaa6ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898383:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013597cd80/0xfc4b8e114edaa6c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x148:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898386:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013597cd80/0xfc4b8e114edaa6c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898392:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013597cd80/0xfc4b8e114edaa6c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898397:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114edaa6c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x148:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898400:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114edaa6c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898403:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114edaa6c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898434:0:6942:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114edaa6cf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8272:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898438:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114edaa6cf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8272:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898441:0:6942:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114edaa6cf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8272:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00000004:00010000:3.0:1713279306.898525:0:6942:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009089d180 reply state ffff8800726ce000 transno 4295202775 ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114edaa6cf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8272:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898531:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114edaa6cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8272:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898535:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8272:0x0].0x0 (ffff880089dc2800) 00010000:00010000:3.0:1713279306.898536:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1713279306.898538:0:6942:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.898540:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013597cd80/0xfc4b8e114edaa6c1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898544:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013597cd80/0xfc4b8e114edaa6c1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898547:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013597cd80/0xfc4b8e114edaa6c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898550:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013597cd80/0xfc4b8e114edaa6c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898553:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013597cd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.898554:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013597cd80/0xfc4b8e114edaa6c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898557:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013597cd80/0xfc4b8e114edaa6c1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898561:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x0 (ffff880091b34100) 00010000:00010000:3.0:1713279306.898562:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.898564:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013597cd80/0xfc4b8e114edaa6c1 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898567:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013597cd80/0xfc4b8e114edaa6c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00000004:00010000:3.0:1713279306.898571:0:6942:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009089d180 reply state ffff8800726ce000 transno 4295202775 ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114edaa6c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898574:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114edaa6c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898577:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x3431 (ffff880089dc2200) 00010000:00010000:3.0:1713279306.898579:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.898580:0:6942:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:3.0:1713279306.898581:0:6942:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa6b3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898586:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa6b3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898589:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa6b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898592:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa6b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898594:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68b600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.898595:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa6b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898598:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa6b3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898601:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x0 (ffff880089dc2100) 00010000:00010000:3.0:1713279306.898602:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.898603:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa6b3 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898606:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaa6b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00000004:00010000:3.0:1713279306.898611:0:6942:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009089d180 reply state ffff8800726ce000 transno 4295202775 ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114edaa6ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898614:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114edaa6ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898617:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x3431 (ffff880089dc2900) 00010000:00010000:3.0:1713279306.898618:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.898619:0:6942:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000004:00080000:3.0:1713279306.898621:0:6942:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x7d86:0x0] 00010000:00010000:3.0:1713279306.898624:0:6942:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898627:0:6942:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898630:0:6942:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898632:0:6942:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.898634:0:6942:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898636:0:6942:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898639:0:6942:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:3.0:1713279306.898640:0:6942:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.898642:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00010000:00010000:3.0:1713279306.898645:0:6942:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290400000020 pid: 15534 initiator: MDT0 00010000:00010000:3.0:1713279306.898648:0:6942:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290400000020 pid: 15534 initiator: MDT0 00010000:00010000:3.0:1713279306.898652:0:6942:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b840/0xfc4b8e114edaa237 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa21b expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.898673:0:6942:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6942 initiator: MDT0 00010000:00010000:3.0:1713279306.898676:0:6942:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114eda9fb3 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6942 initiator: MDT0 00010000:00010000:1.0:1713279306.898689:0:15534:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.898694:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00000100:00100000:3.0:1713279306.898711:0:6942:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:385c4b71-808c-40cf-91de-b076b668d13f+3722:11854:x1796503281264640:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 19093us (19150us total) trans 4295202775 rc 0/0 00000100:00100000:0.0:1713279306.898712:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15658:x1796503200058816:12345-0@lo:403:mdt00_029.0 Request processed in 1158us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.898714:0:15658:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669c00 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-mdtlov_UUID:15658:1796503200058816:0@lo:403:mdt00_029.0 00000100:00100000:0.0:1713279306.898716:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98910 00000100:00100000:3.0:1713279306.898716:0:6942:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14358 00010000:00010000:1.0:1713279306.898749:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edaa6d6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.898754:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edaa6d6 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.898758:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edaa6d6 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.898764:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edaa6dd lrc: 3/0,1 mode: --/PW res: [0x200000400:0x235:0x0].0x3032 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.898767:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edaa6dd lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.898770:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edaa6dd lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.898782:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.898788:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801333158c0/0xfc4b8e114ed9e7ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172cc9 expref: 3721 pid: 15469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.898792:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009224df80/0xfc4b8e114ed9f3f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173026 expref: 3723 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.898796:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114eda9f97 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7f44:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ed3 expref: 3721 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.898799:0:15534:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 6/0,1 mode: --/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.898811:0:15534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114eda9f97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f44:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ed3 expref: 3721 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.898817:0:15534:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114eda9f97 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7f44:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ed3 expref: 3721 pid: 15474 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.898822:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e524000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200058880:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.898844:0:15534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009224df80/0xfc4b8e114ed9f3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173026 expref: 3723 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.898849:0:15534:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009224df80/0xfc4b8e114ed9f3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173026 expref: 3723 pid: 15475 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.898853:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e524a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200058944:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.898863:0:15534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801333158c0/0xfc4b8e114ed9e7ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172cc9 expref: 3721 pid: 15469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.898867:0:15534:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801333158c0/0xfc4b8e114ed9e7ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172cc9 expref: 3721 pid: 15469 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.898871:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e525f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200059008:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.898878:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096e07840 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.899147:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130144050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3430:10814:x1796503281276928:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1301us (2126us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.899152:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223115 00000040:00080000:2.0:1713279306.899264:0:15658:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x1c0:0x0].1547, 520 off832080 00000040:00080000:2.0:1713279306.899340:0:15658:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xf8:0x0].2154, 600 off1530640 00000004:00080000:2.0:1713279306.899345:0:15658:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091a0e540 with version 32018 00000004:00080000:0.0:1713279306.899372:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32018 rpc_version 32018 00000020:00100000:0.0:1713279306.899382:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279306.899386:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880135efc700 x1796503200059136/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279306.899481:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efc700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200059136:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279306.899499:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.899501:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.899505:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096540000 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.899513:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281277248 00000100:00100000:0.0:1713279306.899516:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281277248 00000100:00100000:2.0:1713279306.899518:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.899539:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281277056 00000100:00100000:0.0:1713279306.899541:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281277056 00000100:00100000:1.0:1713279306.899541:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.899541:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.899550:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281277504 00000100:00100000:0.0:1713279306.899551:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281277504 00000100:00100000:2.0:1713279306.899555:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.899559:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785464 00000100:00100000:0.0:1713279306.899562:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:11204:x1796503281277248:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.899569:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.899569:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281277184 00000100:00100000:2.0:1713279306.899569:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.899572:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281277184 00010000:00010000:0.0:1713279306.899575:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114edaa6eb lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391760c4 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.899586:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281277312 00000100:00100000:1.0:1713279306.899587:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281277312 00010000:00010000:0.0:1713279306.899595:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114edaa6f2 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:3.0:1713279306.899597:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110564 00010000:00010000:0.0:1713279306.899599:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114edaa6f2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.899603:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114edaa6f2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:1.0:1713279306.899603:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110565 00000100:00100000:3.0:1713279306.899603:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+84:1956:x1796503281277184:12345-192.168.203.4@tcp:1:lfs.0 00000100:00100000:1.0:1713279306.899607:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+90:1957:x1796503281277312:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:3.0:1713279306.899623:0:15506:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800963b9680/0xfc4b8e114edaa700 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.899633:0:15506:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092725440/0xfc4b8e114ecc29a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913073f expref: 102 pid: 15556 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.899638:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.899639:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.899640:0:15506:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800963b9680/0xfc4b8e114edaa700 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.899652:0:15506:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092725440/0xfc4b8e114ecc29a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x50000080000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913073f expref: 102 pid: 15556 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.899658:0:15506:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092725440/0xfc4b8e114ecc29a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x70000480000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913073f expref: 102 pid: 15556 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.899664:0:15506:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15506:1796503200059200:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.899673:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edaa6f9 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.899678:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edaa6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.899682:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edaa6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:3.0:1713279306.899684:0:15506:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.899693:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281277440 00010000:00010000:0.0:1713279306.899695:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114edaa6f2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:3.0:1713279306.899695:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281277440 00010000:00010000:0.0:1713279306.899699:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114edaa6f2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.899701:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.899702:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114edaa6f2 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.899705:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114edaa6f2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00000100:00100000:3.0:1713279306.899706:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281277632 00010000:00010000:0.0:1713279306.899708:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8900 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.899708:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281277632 00010000:00010000:0.0:1713279306.899709:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114edaa6f2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.899712:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114edaa6f2 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.899716:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00000100:00100000:3.0:1713279306.899716:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785465 00010000:00010000:0.0:1713279306.899717:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.899719:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114edaa6f2 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:3.0:1713279306.899719:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3431:11855:x1796503281277056:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1713279306.899721:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8900/0xfc4b8e114edaa6f2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.899726:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edaa6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.899728:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edaa6f9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.899731:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edaa6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.899732:0:15482:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.899734:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091bab180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.899736:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edaa6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.899739:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edaa6f9 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00002000:00010000:1.0:1713279306.899739:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb size from disk: 64588 -> 64588 00010000:00010000:3.0:1713279306.899739:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114edaa64a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x72a2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917608c expref: 3431 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.899742:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880094168500) 00002000:00010000:1.0:1713279306.899742:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00010000:00010000:0.0:1713279306.899743:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:1.0:1713279306.899743:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00010000:00010000:0.0:1713279306.899744:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edaa6f9 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00002000:00010000:1.0:1713279306.899745:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.899746:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb blocks from disk: 128 -> 96 00010000:00010000:0.0:1713279306.899747:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edaa6f9 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.899747:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x72a2:0x0].0x0 (ffff8800927b4000) 00010000:00010000:3.0:1713279306.899748:0:15482:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.899750:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.899758:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281277696 00010000:00010000:0.0:1713279306.899759:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114edaa6eb lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760c4 expref: 3725 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.899761:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281277696 00010000:00010000:0.0:1713279306.899763:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab600/0xfc4b8e114edaa6eb lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760c4 expref: 3726 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.899763:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+91:1957:x1796503281277312:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 155us (207us total) trans 4295010196 rc 0/0 00010000:00010000:0.0:1713279306.899766:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bab600, rc 0) 00000100:00100000:1.0:1713279306.899767:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110565 00010000:00010000:2.0:1713279306.899770:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009224df80/0xfc4b8e114ed9f3f4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173026 expref: 3725 pid: 15475 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.899770:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114edaa707 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x72a2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.899786:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114edaa707 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.899789:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11204:x1796503281277248:12345-192.168.203.4@tcp:101:touch.0 Request processed in 226us (290us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.899790:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114edaa707 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00000100:00100000:2.0:1713279306.899792:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196589 00000100:00100000:0.0:1713279306.899793:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785464 00000100:00100000:2.0:1713279306.899795:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:1955:x1796503281277696:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.899796:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785466 00000100:00100000:1.0:1713279306.899799:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3657:11711:x1796503281277504:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.899800:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.899802:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785467 00010000:00010000:2.0:1713279306.899803:0:6915:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009224df80/0xfc4b8e114ed9f3f4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173026 expref: 3724 pid: 15475 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.899804:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3722:11854:x1796503281277440:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:1.0:1713279306.899805:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.899808:0:6915:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009224df80/0xfc4b8e114ed9f3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173026 expref: 3724 pid: 15475 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.899811:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114edaa70e lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391760cb expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.899816:0:6915:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f44:0x0].0x0 (ffff880131200b00) 00010000:00010000:0.0:1713279306.899818:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edaa715 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x148:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.899818:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00000004:00010000:3.0:1713279306.899820:0:15482:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009966ad80 reply state ffff8800981d9000 transno 4295183788 ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114edaa707 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.899821:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.899823:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edaa715 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.899825:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:3.0:1713279306.899825:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114edaa707 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.899827:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edaa715 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.899828:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.899828:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x72a2:0x0].0x0 (ffff8800927b4000) 00010000:00010000:3.0:1713279306.899829:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.899830:0:15482:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.899833:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edaa723 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x148:0x0].0x3032 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.899834:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edaa71c lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.899836:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edaa723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.899839:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edaa723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.899839:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edaa71c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.899839:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:1955:x1796503281277696:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 43us (89us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.899843:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edaa71c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.899844:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196589 00010000:00010000:1.0:1713279306.899849:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edaa72a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.899853:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edaa72a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.899855:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3432:11855:x1796503281277056:12345-192.168.203.4@tcp:36:touch.0 Request processed in 134us (336us total) trans 4295183788 rc 0/0 00010000:00010000:1.0:1713279306.899856:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edaa72a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.899859:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114edaa731 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x847f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00000100:00100000:3.0:1713279306.899859:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785465 00010000:00010000:0.0:1713279306.899863:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114edaa731 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.899866:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.899867:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114edaa731 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00000100:00100000:3.0:1713279306.899868:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785468 00010000:00010000:1.0:1713279306.899869:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edaa71c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:3.0:1713279306.899871:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3658:11912:x1796503281277632:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.899873:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edaa71c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00000100:00100000:2.0:1713279306.899873:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281277760 00000100:00100000:2.0:1713279306.899875:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281277760 00010000:00010000:3.0:1713279306.899876:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.899878:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edaa71c lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00000004:00010000:0.0:1713279306.899880:0:15749:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114edaa731 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.899881:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edaa71c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.899882:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801333158c0/0xfc4b8e114ed9e7ad lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172cc9 expref: 3723 pid: 15469 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.899882:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114edaa738 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391760d2 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.899884:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edaa715 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.899884:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.899885:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edaa71c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.899887:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edaa715 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.899888:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edaa71c lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.899890:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edaa715 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.899890:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196590 00000100:00100000:2.0:1713279306.899892:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3723:1956:x1796503281277760:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.899893:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edaa715 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.899893:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff8800960e8f00) 00010000:00010000:1.0:1713279306.899894:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.899896:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.899896:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edaa71c lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.899896:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.899897:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edaa715 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.899899:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edaa71c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.899899:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801333158c0/0xfc4b8e114ed9e7ad lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172cc9 expref: 3723 pid: 15469 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.899900:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edaa715 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.899903:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801333158c0/0xfc4b8e114ed9e7ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172cc9 expref: 3723 pid: 15469 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.899904:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x0 (ffff880091b34100) 00010000:00010000:1.0:1713279306.899904:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edaa72a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.899905:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.899906:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edaa72a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.899907:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edaa715 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.899909:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edaa715 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:2.0:1713279306.899909:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f44:0x0].0x0 (ffff880131200b00) 00010000:00010000:1.0:1713279306.899910:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edaa72a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.899911:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.899912:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023cfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.899913:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edaa723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.899914:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edaa72a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.899914:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.899916:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edaa723 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.899916:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaa73f lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.899917:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.899919:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edaa723 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.899919:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edaa72a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.899920:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.899920:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaa73f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.899922:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.899922:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff8800939e3e00) 00010000:00010000:0.0:1713279306.899923:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edaa723 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.899924:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.899925:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edaa72a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:3.0:1713279306.899925:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaa73f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.899926:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edaa723 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.899928:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edaa72a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.899929:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x3032 (ffff88007fdcae00) 00000100:00100000:2.0:1713279306.899929:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3723:1956:x1796503281277760:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 36us (63us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.899930:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.899931:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114edaa746 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.899932:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edaa723 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.899934:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114edaa746 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.899935:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edaa723 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00000100:00100000:2.0:1713279306.899935:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196590 00010000:00010000:3.0:1713279306.899937:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114edaa746 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.899940:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114edaa731 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.899940:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114edaa70e lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760cb expref: 3659 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.899943:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114edaa731 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT0 00000004:00200000:3.0:1713279306.899944:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:0.0:1713279306.899945:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114edaa731 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:1.0:1713279306.899945:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c480/0xfc4b8e114edaa70e lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760cb expref: 3659 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.899948:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091babcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.899949:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114edaa731 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.899949:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaa73f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.899950:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023c480, rc 0) 00010000:00010000:0.0:1713279306.899952:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114edaa731 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.899952:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaa73f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.899955:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x847f:0x0].0x0 (ffff88008d729200) 00010000:00010000:0.0:1713279306.899956:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.899956:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaa73f lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.899957:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114edaa731 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.899960:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114edaa731 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x847f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT0 00010000:00010000:3.0:1713279306.899961:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaa73f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.899963:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3658:11711:x1796503281277504:12345-192.168.203.4@tcp:101:touch.0 Request processed in 164us (425us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.899964:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096a2d680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.899966:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaa73f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00000100:00100000:1.0:1713279306.899967:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785466 00010000:00010000:3.0:1713279306.899969:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaa73f lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.899972:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff8800940a8800) 00010000:00010000:3.0:1713279306.899974:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.899975:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaa73f lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.899976:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3722:11854:x1796503281277440:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 170us (406us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.899978:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaa73f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.899979:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785467 00010000:00010000:3.0:1713279306.899983:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114edaa746 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.899985:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114edaa746 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.899989:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114edaa746 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.899991:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a0daac0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.899992:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200059136 00010000:00010000:3.0:1713279306.899992:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114edaa746 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.899993:0:15534:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff88012e524000 x1796503200058880) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114eda9f97 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7f44:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ed3 expref: 3721 pid: 15474 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.899994:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200059136 00010000:00010000:3.0:1713279306.899995:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114edaa746 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.900000:0:15534:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114eda9f97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7f44:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ed3 expref: 3721 pid: 15474 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.900001:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88012bac7400) 00010000:00010000:3.0:1713279306.900002:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.900003:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114edaa746 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.900004:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98911 00010000:00010000:3.0:1713279306.900006:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a0daac0/0xfc4b8e114edaa746 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000100:00100000:0.0:1713279306.900007:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:8074:x1796503200059136:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1713279306.900007:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d680/0xfc4b8e114eda9f97 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7f44:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ed3 expref: 3721 pid: 15474 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.900015:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e524000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200058880:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.900019:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114edaa738 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760d2 expref: 3657 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.900021:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009224df80/0xfc4b8e114ed9f3f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173026 expref: 3723 pid: 15475 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.900023:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2fcc0/0xfc4b8e114edaa738 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760d2 expref: 3657 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.900027:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e524a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200058944:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.900028:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096a2fcc0, rc 0) 00010000:00010000:1.0:1713279306.900032:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801333158c0/0xfc4b8e114ed9e7ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f44:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172cc9 expref: 3720 pid: 15469 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.900037:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e525f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200059008:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.900044:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3656:11912:x1796503281277632:12345-192.168.203.4@tcp:101:touch.0 Request processed in 172us (343us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.900046:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f44:0x0].0x0 (ffff880131200b00) 00010000:00010000:1.0:1713279306.900048:0:15534:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00000100:00100000:3.0:1713279306.900048:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785468 00010000:00010000:1.0:1713279306.900053:0:15534:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900056:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900061:0:15534:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900065:0:15534:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900085:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900127:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900131:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900134:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900137:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023dd40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.900138:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900141:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900145:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7f44:0x0].0x0 (ffff880131200b00) 00010000:00010000:1.0:1713279306.900146:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1713279306.900148:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900150:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edaa6e4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7f44:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900155:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edaa6d6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900158:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edaa6d6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900161:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edaa6d6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900164:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edaa6d6 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900166:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023e880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.900168:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edaa6d6 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900170:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edaa6d6 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900174:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff880135caa400) 00010000:00010000:1.0:1713279306.900175:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.900176:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edaa6d6 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900179:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edaa6d6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900184:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edaa6dd lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900187:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edaa6dd lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900190:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edaa6dd lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900192:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023ed00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.900193:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edaa6dd lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900196:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edaa6dd lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900199:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x3032 (ffff880135caa200) 00010000:00010000:1.0:1713279306.900200:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.900202:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edaa6dd lrc: 2/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00000100:00100000:2.0:1713279306.900204:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.900206:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edaa6dd lrc: 0/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900212:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900215:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900218:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.900221:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68a640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.900222:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15534 initiator: MDT0 00000100:00100000:0.0:1713279306.900223:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:8074:x1796503200059136:12345-0@lo:1000:osp_up0-1.0 Request processed in 213us (722us total) trans 4295202776 rc 0/0 00010000:00010000:1.0:1713279306.900224:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 15534 initiator: MDT0 00000100:00100000:0.0:1713279306.900227:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98911 00010000:00010000:1.0:1713279306.900228:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00010000:00010000:1.0:1713279306.900229:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.900231:0:15534:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b840/0xfc4b8e114edaa237 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa21b expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.900232:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281277824 00010000:00010000:1.0:1713279306.900235:0:15534:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b840/0xfc4b8e114edaa237 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114edaa21b expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.900236:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281277824 00010000:00010000:1.0:1713279306.900239:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b840/0xfc4b8e114edaa237 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114edaa21b expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.900248:0:15534:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b840/0xfc4b8e114edaa237 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa21b expref: 55 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.900251:0:15506:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15506:1796503200059200:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.900253:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efc700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200059136:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713279306.900257:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e525f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200059264:0@lo:105: 00010000:00010000:3.0:1713279306.900259:0:15506:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800963b9680/0xfc4b8e114edaa700 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.900263:0:15658:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880131cd7800 reply state ffff880089df7800 transno 4295183787 ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114edaa5d3 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x264:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.900270:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114edaa5d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.900272:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.900273:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x264:0x0].0x0 (ffff880093401d00) 00010000:00010000:2.0:1713279306.900275:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00000100:00100000:3.0:1713279306.900275:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785469 00000100:00100000:2.0:1713279306.900276:0:15658:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:2.0:1713279306.900278:0:15658:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880131cd7800 reply state ffff880089df7800 transno 4295183787 ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114edaa5da lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x242:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.900278:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:10814:x1796503281277824:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.900281:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114edaa5da lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.900285:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x242:0x0].0x0 (ffff880135885d00) 00010000:00010000:2.0:1713279306.900286:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00000100:00100000:3.0:1713279306.900286:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200059264 00000100:00100000:2.0:1713279306.900287:0:15658:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1713279306.900288:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096e07840 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.900288:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200059264 00010000:00010000:2.0:1713279306.900289:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.900293:0:15658:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.900299:0:15658:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880131cd7800 reply state ffff880089df7800 transno 4295183787 ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.900302:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.900303:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33456 00000100:00100000:3.0:1713279306.900305:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15534:x1796503200059264:12345-0@lo:105: 00010000:00010000:2.0:1713279306.900308:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76ef:0x0].0x0 (ffff88008d729f00) 00010000:00010000:2.0:1713279306.900309:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:3.0:1713279306.900309:0:6913:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.900310:0:15658:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000004:00010000:2.0:1713279306.900311:0:15658:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880131cd7800 reply state ffff880089df7800 transno 4295183787 ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.900314:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.900314:0:6913:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.900317:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x0 (ffff8800908e1900) 00010000:00010000:3.0:1713279306.900317:0:6913:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.900318:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.900318:0:15658:0:(service.c:188:ptlrpc_save_lock()) nlocks 3 00010000:00010000:3.0:1713279306.900321:0:6913:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.900325:0:6913:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.900328:0:6913:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.900336:0:6913:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8801237d9b00) 00000100:00100000:2.0:1713279306.900341:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3432:11666:x1796503281274176:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 7023us (7068us total) trans 4295183787 rc 0/0 00010000:00010000:0.0:1713279306.900344:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.900345:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785445 00010000:00010000:0.0:1713279306.900350:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.900355:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15534:x1796503200059264:12345-0@lo:105: Request processed in 49us (82us total) trans 0 rc 0/0 00000004:00080000:0.0:1713279306.900358:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1713279306.900358:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33456 00000100:00100000:1.0:1713279306.900362:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e525f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200059264:0@lo:105: 00010000:00010000:1.0:1713279306.900368:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15534 initiator: MDT0 00010000:00010000:3.0:1713279306.900370:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.900372:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a640/0xfc4b8e114edaa0c4 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15534 initiator: MDT0 00010000:00010000:3.0:1713279306.900376:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0d8480/0xfc4b8e114edaa74d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391760d9 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000004:00020000:1.0:1713279306.900377:0:15534:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200000402:0x7f51:0x0]/20 failed: rc = -114 00010000:00010000:3.0:1713279306.900395:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4ca400/0xfc4b8e114edaa754 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x874f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.900399:0:15534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_011:385c4b71-808c-40cf-91de-b076b668d13f+3719:11736:x1796503281267008:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 18083us (18111us total) trans 0 rc -114/-114 00010000:00010000:3.0:1713279306.900400:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4ca400/0xfc4b8e114edaa754 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x874f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.900403:0:15534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14359 00010000:00010000:3.0:1713279306.900404:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4ca400/0xfc4b8e114edaa754 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x874f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.900406:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edaa75b lrc: 3/0,1 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.900429:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edaa75b lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.900433:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edaa75b lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.900440:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114edaa762 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x260:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.900444:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114edaa762 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.900447:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114edaa762 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.900454:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edaa769 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.900457:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edaa769 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.900460:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edaa769 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.900465:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114edaa770 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25b:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.900468:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114edaa770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.900471:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114edaa770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.900482:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7abf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.900488:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688b40/0xfc4b8e114edaa0b6 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x7abf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f19 expref: 3431 pid: 15658 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713279306.900491:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x874f:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.900492:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000004:00200000:3.0:1713279306.900494:0:15473:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1713279306.900500:0:15473:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4ca400/0xfc4b8e114edaa754 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x874f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.900503:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688b40/0xfc4b8e114edaa0b6 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7abf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f19 expref: 3431 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.900508:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688b40/0xfc4b8e114edaa0b6 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7abf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f19 expref: 3431 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.900509:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a0d8480/0xfc4b8e114edaa74d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x231:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760d9 expref: 3725 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.900516:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4ca400/0xfc4b8e114edaa754 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x874f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760d9 expref: 3724 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.900517:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e909f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001_UUID:15514:1796503200059328:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.900520:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x874f:0x0].0x0 (ffff880092a4c800) 00010000:00010000:3.0:1713279306.900522:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713279306.900523:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a4ca400, rc 0) 00000100:00100000:0.0:1713279306.900535:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a840 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.900537:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:10814:x1796503281277824:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 258us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.900540:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785469 00000100:00100000:0.0:1713279306.900963:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.900979:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.900991:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.900998:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281278400 00000100:00100000:2.0:1713279306.900999:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281277888 00000100:00100000:0.0:1713279306.901000:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281278400 00000100:00100000:2.0:1713279306.901004:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281277888 00000100:00100000:1.0:1713279306.901012:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.901027:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110566 00000100:00100000:2.0:1713279306.901032:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+91:1957:x1796503281277888:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:3.0:1713279306.901040:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281278080 00000100:00100000:3.0:1713279306.901045:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281278080 00000100:00100000:0.0:1713279306.901053:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223116 00000100:00100000:0.0:1713279306.901056:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3432:12010:x1796503281278400:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:3.0:1713279306.901061:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281278272 00000100:00100000:3.0:1713279306.901062:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281278272 00000100:00100000:3.0:1713279306.901084:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785470 00000100:00100000:3.0:1713279306.901088:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3720:11711:x1796503281278080:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.901093:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785471 00010000:00010000:3.0:1713279306.901097:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.901098:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3720:11854:x1796503281278272:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1713279306.901104:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114edaa77e lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391760e7 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.901106:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.901113:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edaa785 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x847f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391760ee expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.901114:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+92:1957:x1796503281277888:12345-192.168.203.4@tcp:2:touch.0 Request processed in 80us (150us total) trans 4295010197 rc 0/0 00000100:00100000:2.0:1713279306.901120:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110566 00000100:00100000:0.0:1713279306.901138:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3433:12010:x1796503281278400:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 81us (146us total) trans 4295183789 rc 0/0 00000100:00100000:0.0:1713279306.901143:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223116 00010000:00010000:1.0:1713279306.901147:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114edaa793 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x847f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.901147:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009681cfc0/0xfc4b8e114edaa78c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.901153:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114edaa793 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x847f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.901153:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009681cfc0/0xfc4b8e114edaa78c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.901158:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114edaa793 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x847f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.901158:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009681cfc0/0xfc4b8e114edaa78c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000004:00200000:1.0:1713279306.901162:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x847f:0x0]: returning size 0 00000100:00100000:0.0:1713279306.901163:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.901163:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114edaa79a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.901167:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114edaa79a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.901170:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114edaa79a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.901176:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281278208 00000004:00200000:3.0:1713279306.901178:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00000100:00100000:2.0:1713279306.901180:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281278208 00010000:00010000:3.0:1713279306.901183:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009681cfc0/0xfc4b8e114edaa78c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.901186:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009681cfc0/0xfc4b8e114edaa78c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.901189:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009681cfc0/0xfc4b8e114edaa78c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.901192:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edaa785 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x847f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760ee expref: 3724 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.901192:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009681cfc0/0xfc4b8e114edaa78c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.901198:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785472 00010000:00010000:3.0:1713279306.901198:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009681cfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.901200:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114edaa793 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x847f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760ee expref: 3723 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.901200:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009681cfc0/0xfc4b8e114edaa78c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.901202:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3433:11204:x1796503281278208:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.901203:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009681cfc0/0xfc4b8e114edaa78c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.901204:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x847f:0x0].0x0 (ffff88008d729200) 00010000:00010000:1.0:1713279306.901206:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1713279306.901207:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023c6c0, rc 0) 00010000:00010000:3.0:1713279306.901207:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012bac7600) 00010000:00010000:3.0:1713279306.901208:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.901210:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.901210:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009681cfc0/0xfc4b8e114edaa78c lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.901213:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009681cfc0/0xfc4b8e114edaa78c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.901218:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114edaa7a8 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391760e0 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.901218:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114edaa79a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.901220:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114edaa79a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.901223:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3723:11854:x1796503281278272:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 125us (213us total) trans 4295202777 rc 0/0 00010000:00010000:3.0:1713279306.901223:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114edaa79a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.901226:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009681c900 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.901227:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785471 00010000:00010000:3.0:1713279306.901227:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114edaa79a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.901230:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114edaa79a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.901233:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88012bac7800) 00010000:00010000:3.0:1713279306.901234:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.901236:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114edaa79a lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.901239:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009681c900/0xfc4b8e114edaa79a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.901249:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.901253:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114edaa77e lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760e7 expref: 3722 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.901258:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a4c86c0/0xfc4b8e114edaa77e lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760e7 expref: 3722 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.901264:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114edaa7af lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.901264:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a4c86c0, rc 0) 00010000:00010000:2.0:1713279306.901272:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114edaa7af lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:0.0:1713279306.901277:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281278528 00010000:00010000:2.0:1713279306.901278:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114edaa7af lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:0.0:1713279306.901280:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281278528 00000100:00100000:3.0:1713279306.901280:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281278080:12345-192.168.203.4@tcp:101:touch.0 Request processed in 192us (299us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.901284:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785470 00010000:00010000:2.0:1713279306.901287:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa7b6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.901292:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa7b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:0.0:1713279306.901294:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785473 00000100:00100000:0.0:1713279306.901297:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3656:11912:x1796503281278528:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.901298:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa7b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.901302:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.901302:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.901307:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edaa7bd lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391760f5 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.901310:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281278656 00000004:00200000:2.0:1713279306.901312:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00000100:00100000:3.0:1713279306.901312:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281278656 00000100:00100000:1.0:1713279306.901317:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.901317:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114edaa7af lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.901321:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114edaa7af lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.901323:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785474 00010000:00010000:2.0:1713279306.901324:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114edaa7af lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.901326:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:11666:x1796503281278656:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.901327:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114edaa7af lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.901328:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edaa7c4 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.901329:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008245cfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.901331:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.901332:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114edaa7af lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.901334:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edaa7c4 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.901335:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114edaa7af lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.901336:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114edaa7cb lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391760fc expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.901338:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edaa7c4 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.901340:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:2.0:1713279306.901342:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.901343:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114edaa7af lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.901346:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114edaa7af lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.901351:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa7b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.901353:0:15514:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff88008e909f80 x1796503200059328) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688b40/0xfc4b8e114edaa0b6 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7abf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f19 expref: 3436 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.901353:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa7b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.901365:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c480/0xfc4b8e114edaa7d2 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1713279306.901366:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa7b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.901368:0:15514:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688b40/0xfc4b8e114edaa0b6 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7abf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f19 expref: 3436 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.901369:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008245c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.901370:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa7b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.901370:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c480/0xfc4b8e114edaa7d2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.901373:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa7b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.901374:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688b40/0xfc4b8e114edaa0b6 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x7abf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f19 expref: 3436 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.901374:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c480/0xfc4b8e114edaa7d2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.901376:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880096b8e600) 00010000:00010000:2.0:1713279306.901377:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.901378:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa7b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:0.0:1713279306.901380:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e909f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001_UUID:15514:1796503200059328:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.901380:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edaa7d9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x237:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.901383:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edaa7d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.901384:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edaa7b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.901386:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7abf:0x0].0x0 (ffff8800938abf00) 00010000:00010000:3.0:1713279306.901387:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edaa7d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.901388:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901392:0:15514:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901395:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.901397:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114edaa7a8 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760e0 expref: 3435 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.901400:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.901401:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8b40/0xfc4b8e114edaa7a8 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760e0 expref: 3435 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.901403:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901406:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713279306.901406:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906e8b40, rc 0) 00000004:00200000:3.0:1713279306.901429:0:15474:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x797c:0x0]: returning size 4096 00000100:00100000:2.0:1713279306.901437:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3434:11204:x1796503281278208:12345-192.168.203.4@tcp:101:touch.0 Request processed in 234us (273us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.901441:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785472 00010000:00010000:3.0:1713279306.901452:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c480/0xfc4b8e114edaa7d2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901456:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c480/0xfc4b8e114edaa7d2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901459:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c480/0xfc4b8e114edaa7d2 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901462:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c480/0xfc4b8e114edaa7d2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901464:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131f3c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.901466:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c480/0xfc4b8e114edaa7d2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901469:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c480/0xfc4b8e114edaa7d2 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901473:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff880092193400) 00010000:00010000:3.0:1713279306.901474:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.901476:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c480/0xfc4b8e114edaa7d2 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901482:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c480/0xfc4b8e114edaa7d2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901487:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edaa7d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901489:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edaa7d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901492:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edaa7d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901495:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c366880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.901496:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edaa7d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901499:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edaa7d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901502:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x30 (ffff880131204d00) 00010000:00010000:3.0:1713279306.901503:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.901504:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edaa7d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901507:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edaa7d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.901520:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114edaa7cb lrc: 1/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760fc expref: 3434 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.901524:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009681c480/0xfc4b8e114edaa7cb lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760fc expref: 3434 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.901531:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009681c480, rc 0) 00000100:00100000:3.0:1713279306.901557:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3434:11666:x1796503281278656:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 230us (254us total) trans 4295183790 rc 301/301 00000004:00010000:0.0:1713279306.901558:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880098cc9c00 reply state ffff880094155000 transno 4295183791 ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713279306.901561:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785474 00010000:00010000:0.0:1713279306.901565:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901568:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7abf:0x0].0x0 (ffff8800938abf00) 00010000:00010000:0.0:1713279306.901570:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1713279306.901571:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.901573:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edaa769 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901577:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edaa769 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901580:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edaa769 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901583:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edaa769 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901585:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baa1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.901587:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edaa769 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901590:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edaa769 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901593:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88008afd9900) 00010000:00010000:0.0:1713279306.901594:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.901596:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edaa769 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901601:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edaa769 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000004:00010000:0.0:1713279306.901605:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880098cc9c00 reply state ffff880094155000 transno 4295183791 ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114edaa770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901609:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114edaa770 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901612:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3031 (ffff880094169700) 00010000:00010000:0.0:1713279306.901613:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.901614:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1713279306.901615:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edaa75b lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901618:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edaa75b lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901620:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edaa75b lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901623:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edaa75b lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901625:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.901626:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edaa75b lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901629:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edaa75b lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901632:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88007fdca600) 00010000:00010000:0.0:1713279306.901633:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.901634:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edaa75b lrc: 3/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901637:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edaa75b lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000004:00010000:0.0:1713279306.901642:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880098cc9c00 reply state ffff880094155000 transno 4295183791 ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114edaa762 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x260:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901646:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114edaa762 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.901649:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x3031 (ffff880095455d00) 00010000:00010000:0.0:1713279306.901650:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.901651:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:0.0:1713279306.901653:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.901657:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.901660:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.901674:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1713279306.901690:0:6918:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.901694:0:6918:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.901698:0:6918:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801237d9b00 already unused, calling callback (ffffffffa0f0e520) 00000100:00100000:0.0:1713279306.901700:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3434:11374:x1796503281268864:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 16664us (16765us total) trans 4295183791 rc 0/0 00010000:00010000:3.0:1713279306.901700:0:6918:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.901704:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14360 00000004:00010000:3.0:1713279306.901704:0:6918:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.901715:0:6918:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.901719:0:6918:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.901734:0:6918:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.901738:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801237d9b00/0xfc4b8e114edaa21b lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaa237 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.901745:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.901745:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.901746:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279306.901752:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200059392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.901770:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.901781:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200059392 00000100:00100000:3.0:1713279306.901784:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200059392 00000100:00100000:3.0:1713279306.901796:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147272 00000100:00100000:3.0:1713279306.901798:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b48cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+56:3492:x1796503200059392:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.901801:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.901803:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.901807:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281278784 00010000:00010000:3.0:1713279306.901808:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b840/0xfc4b8e114edaa237 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114edaa21b expref: 56 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.901810:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281278784 00000100:00100000:2.0:1713279306.901812:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281278848 00010000:00010000:3.0:1713279306.901814:0:6915:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880090aa0d00) 00000100:00100000:2.0:1713279306.901815:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281278848 00000100:00100000:1.0:1713279306.901817:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.901817:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.901825:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223117 00000100:00100000:2.0:1713279306.901826:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110567 00000100:00100000:0.0:1713279306.901828:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3721:11736:x1796503281278784:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1713279306.901829:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281278848:12345-192.168.203.4@tcp:1:lfs.0 00000100:00100000:3.0:1713279306.901836:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b48cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+55:3492:x1796503200059392:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (65us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.901840:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147272 00002000:00010000:2.0:1713279306.901846:0:15783:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x118b:0x0] initial LVB size: 0, mtime: 0x661e9149, atime: 0x661e9149, ctime: 0x661e9149, blocks: 0x0 00010000:00010000:2.0:1713279306.901850:0:15783:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008245f840/0xfc4b8e114edaa7e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x118b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.901853:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3721:11736:x1796503281278784:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 25us (536us total) trans 0 rc -116/-116 00010000:00010000:2.0:1713279306.901855:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.901856:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713279306.901857:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223117 00000100:00100000:1.0:1713279306.901858:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.901858:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281278976 00010000:00010000:2.0:1713279306.901859:0:15783:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008245f840/0xfc4b8e114edaa7e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x118b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.901860:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281278976 00000100:00100000:0.0:1713279306.901863:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281279104 00000100:00100000:0.0:1713279306.901864:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281279104 00010000:00010000:2.0:1713279306.901868:0:15783:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008245f840/0xfc4b8e114edaa7e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x118b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.901868:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785475 00000100:00100000:3.0:1713279306.901870:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3658:11711:x1796503281278976:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.901873:0:15783:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008245f840/0xfc4b8e114edaa7e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x118b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.901876:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.901877:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223118 00010000:00010000:2.0:1713279306.901877:0:15783:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008245f840/0xfc4b8e114edaa7e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x118b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.901880:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3434:11855:x1796503281279104:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:2.0:1713279306.901881:0:15783:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008245f840/0xfc4b8e114edaa7e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x118b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.901881:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114edaa7ee lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176103 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.901884:0:15783:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008245f840 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:2.0:1713279306.901886:0:15783:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008245f840/0xfc4b8e114edaa7e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x118b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.901889:0:15783:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008245f840/0xfc4b8e114edaa7e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x118b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.901896:0:15783:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008245f840/0xfc4b8e114edaa7e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x118b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.901899:0:15783:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008245f840/0xfc4b8e114edaa7e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x118b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.901901:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaa7f5 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.901905:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaa7f5 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901909:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaa7f5 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901916:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa7fc lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.901920:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa7fc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.901921:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281278848:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 91us (121us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.901922:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa7fc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.901923:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:11855:x1796503281279104:12345-192.168.203.4@tcp:35:touch.0 Request processed in 42us (65us total) trans 4295183792 rc 0/0 00000100:00100000:2.0:1713279306.901925:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110567 00000100:00100000:0.0:1713279306.901927:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223118 00010000:00010000:3.0:1713279306.901934:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaa7f5 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901937:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaa7f5 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901939:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaa7f5 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.901940:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114edaa803 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.901940:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200059392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.901942:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaa7f5 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901945:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012154ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.901947:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaa7f5 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901950:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaa7f5 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901953:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880131204f00) 00010000:00010000:3.0:1713279306.901954:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.901956:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaa7f5 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901958:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaa7f5 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901963:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa7fc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901966:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa7fc lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901969:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa7fc lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901971:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012154d200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.901973:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa7fc lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901975:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa7fc lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901978:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880092ae7500) 00010000:00010000:3.0:1713279306.901979:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.901980:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa7fc lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.901983:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaa7fc lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.902003:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114edaa803 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.902004:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114edaa7ee lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176103 expref: 3659 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.902005:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.902007:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114edaa803 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.902008:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114edaa7ee lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176103 expref: 3659 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.902013:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012154fa80, rc 0) 00010000:00010000:0.0:1713279306.902018:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edaa7c4 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.902022:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edaa7c4 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.902025:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edaa7c4 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.902028:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edaa7c4 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.902029:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3658:11711:x1796503281278976:12345-192.168.203.4@tcp:101:touch.0 Request processed in 157us (211us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.902033:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8240 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.902033:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785475 00010000:00010000:0.0:1713279306.902034:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edaa7c4 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.902085:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edaa7c4 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.902090:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88008afd9900) 00010000:00010000:0.0:1713279306.902092:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.902093:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edaa7c4 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.902096:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edaa7c4 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.902102:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114edaa803 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.902102:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.902104:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114edaa803 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.902107:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114edaa803 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.902110:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.902111:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114edaa803 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.902114:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114edaa803 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.902117:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff880096b90f00) 00010000:00010000:0.0:1713279306.902118:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.902120:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114edaa803 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.902123:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baad00/0xfc4b8e114edaa803 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.902127:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281279296 00000100:00100000:3.0:1713279306.902130:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281279296 00010000:00010000:0.0:1713279306.902135:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edaa7bd lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760f5 expref: 3657 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.902138:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092725440/0xfc4b8e114ecc29a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x60000480000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913073f expref: 103 pid: 15556 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.902139:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edaa7bd lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760f5 expref: 3657 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.902144:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba86c0, rc 0) 00000100:00100000:3.0:1713279306.902148:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196591 00000100:00100000:3.0:1713279306.902150:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+103:1955:x1796503281279296:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.902155:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.902159:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3656:11912:x1796503281278528:12345-192.168.203.4@tcp:101:touch.0 Request processed in 861us (909us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.902162:0:6915:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092725440/0xfc4b8e114ecc29a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x60000480000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913073f expref: 103 pid: 15556 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.902163:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785473 00010000:00010000:3.0:1713279306.902167:0:6915:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092725440/0xfc4b8e114ecc29a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x50000480000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913073f expref: 103 pid: 15556 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.902173:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281279232 00000100:00100000:0.0:1713279306.902175:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281279232 00010000:00010000:3.0:1713279306.902176:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092725440/0xfc4b8e114ecc29a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x44801480000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913073f expref: 103 pid: 15556 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.902181:0:6915:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.902182:0:6915:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.902184:0:6915:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800963b9680/0xfc4b8e114edaa700 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.902188:0:6915:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800963b9680/0xfc4b8e114edaa700 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.902190:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223119 00000100:00100000:0.0:1713279306.902192:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008acced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3435:11666:x1796503281279232:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:3.0:1713279306.902197:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.902203:0:15506:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800963b9680/0xfc4b8e114edaa700 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.902208:0:15506:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800963b9680/0xfc4b8e114edaa700 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.902211:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+102:1955:x1796503281279296:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 59us (109us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.902215:0:15506:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800963b9680/0xfc4b8e114edaa700 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.902215:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196591 00010000:00010000:2.0:1713279306.902219:0:15506:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800963b9680/0xfc4b8e114edaa700 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.902223:0:15506:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800963b9680/0xfc4b8e114edaa700 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.902226:0:15506:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800963b9680 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:2.0:1713279306.902228:0:15506:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800963b9680/0xfc4b8e114edaa700 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.902231:0:15506:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800963b9680/0xfc4b8e114edaa700 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.902238:0:15506:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800963b9680/0xfc4b8e114edaa700 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.902239:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008acced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3436:11666:x1796503281279232:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 45us (234us total) trans 4295183793 rc 0/0 00000100:00100000:0.0:1713279306.902243:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223119 00010000:00010000:2.0:1713279306.902245:0:15506:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800963b9680/0xfc4b8e114edaa700 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xf84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.902268:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+84:1956:x1796503281277184:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 2666us (2727us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.902272:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110564 00000100:00100000:0.0:1713279306.902646:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.902663:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.902681:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.902685:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281279552 00000100:00100000:2.0:1713279306.902689:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281279552 00000100:00100000:2.0:1713279306.902707:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281279872 00000100:00100000:2.0:1713279306.902710:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281279872 00000100:00100000:2.0:1713279306.902722:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223120 00000100:00100000:2.0:1713279306.902726:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3436:11374:x1796503281279552:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1713279306.902730:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223121 00000100:00100000:1.0:1713279306.902735:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130144450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:10814:x1796503281279872:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:2.0:1713279306.902794:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3437:11374:x1796503281279552:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 66us (146us total) trans 4295183794 rc 0/0 00000100:00100000:2.0:1713279306.902800:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223120 00000100:00100000:1.0:1713279306.903151:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281279808 00000100:00100000:1.0:1713279306.903154:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281279808 00000100:00100000:1.0:1713279306.903173:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14361 00000100:00100000:1.0:1713279306.903177:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:385c4b71-808c-40cf-91de-b076b668d13f+3721:11854:x1796503281279808:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:1.0:1713279306.903197:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023eac0/0xfc4b8e114edaa80a lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.903203:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023eac0/0xfc4b8e114edaa80a lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.903208:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023eac0/0xfc4b8e114edaa80a lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:1.0:1713279306.903226:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df06300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000-mdtlov_UUID:15514:1796503200059456:0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.903245:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.903253:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096e07780 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.903256:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200059456 00000100:00100000:2.0:1713279306.903260:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200059456 00000100:00100000:2.0:1713279306.903274:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98912 00000100:00100000:2.0:1713279306.903279:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+92:15514:x1796503200059456:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:2.0:1713279306.903318:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+92:15514:x1796503200059456:12345-0@lo:1000:mdt_io00_007.0 Request processed in 39us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.903323:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df06300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000-mdtlov_UUID:15514:1796503200059456:0@lo:1000:mdt_io00_007.0 00000100:00100000:2.0:1713279306.903324:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98912 00000004:00080000:1.0:1713279306.903335:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x7d86:0x0] 00000100:00100000:1.0:1713279306.903347:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df06300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000-mdtlov_UUID:15514:1796503200059520:0@lo:1000:mdt_io00_007.0 00000100:00100000:0.0:1713279306.903353:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.903359:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.903362:0:15534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281280512 00000100:00100000:2.0:1713279306.903365:0:15534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281280512 00000100:00100000:0.0:1713279306.903368:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.903372:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096e070c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.903377:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.903377:0:15534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14362 00000100:00100000:2.0:1713279306.903381:0:15534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_011:385c4b71-808c-40cf-91de-b076b668d13f+3656:11876:x1796503281280512:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:0.0:1713279306.903386:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.903390:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281279680 00000100:00100000:1.0:1713279306.903392:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281279680 00000100:00100000:0.0:1713279306.903395:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.903403:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.903403:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281279424 00000100:00100000:1.0:1713279306.903404:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281279424 00010000:00010000:2.0:1713279306.903409:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.903425:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281280000 00000100:00100000:1.0:1713279306.903426:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281280000 00000100:00100000:0.0:1713279306.903432:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.903433:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281280128 00000100:00100000:1.0:1713279306.903434:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281280128 00000100:00100000:3.0:1713279306.903434:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200059520 00010000:00010000:2.0:1713279306.903436:0:15534:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15534 initiator: MDT1 00000100:00100000:3.0:1713279306.903438:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200059520 00000100:00100000:1.0:1713279306.903441:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281280256 00000100:00100000:1.0:1713279306.903442:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281280256 00010000:00010000:2.0:1713279306.903442:0:15534:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15534 initiator: MDT1 00000100:00100000:0.0:1713279306.903443:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281280384 00000100:00100000:0.0:1713279306.903446:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281280384 00000100:00100000:1.0:1713279306.903452:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785476 00000100:00100000:2.0:1713279306.903453:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd43b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200059584:0@lo:101:mdt_io00_011.0 00000100:00100000:3.0:1713279306.903453:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98913 00000100:00100000:1.0:1713279306.903455:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3723:11736:x1796503281279680:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:3.0:1713279306.903457:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+92:15514:x1796503200059520:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:0.0:1713279306.903461:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785477 00010000:00010000:1.0:1713279306.903461:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.903464:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3726:11204:x1796503281279424:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.903467:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114edaa818 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x7f21:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176111 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.903472:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.903473:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.903478:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114edaa81f lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917610a expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.903482:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a480 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.903495:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200059584 00000100:00100000:3.0:1713279306.903497:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+92:15514:x1796503200059520:12345-0@lo:1000:mdt_io00_007.0 Request processed in 40us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.903498:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200059584 00010000:00010000:1.0:1713279306.903499:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114edaa826 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x7f21:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:3.0:1713279306.903502:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98913 00010000:00010000:0.0:1713279306.903503:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edaa82d lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.903505:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114edaa826 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7f21:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.903508:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edaa82d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.903509:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114edaa826 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7f21:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00000100:00100000:3.0:1713279306.903510:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98914 00010000:00010000:0.0:1713279306.903512:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edaa82d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00000100:00100000:3.0:1713279306.903513:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+55:15534:x1796503200059584:12345-0@lo:101:mdt_io00_011.0 00000004:00200000:1.0:1713279306.903514:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7f21:0x0]: returning size 7429 00010000:00010000:3.0:1713279306.903518:0:15580:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.903519:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b46c0/0xfc4b8e114edaa834 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00000100:00100000:2.0:1713279306.903520:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785478 00010000:00010000:0.0:1713279306.903522:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b46c0/0xfc4b8e114edaa834 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00000100:00100000:2.0:1713279306.903525:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3438:11855:x1796503281280000:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.903525:0:15580:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114edaa842 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114edaa811 expref: -99 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.903526:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b46c0/0xfc4b8e114edaa834 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.903533:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.903534:0:15580:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023eac0/0xfc4b8e114edaa80a lrc: 2/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.903538:0:15580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114edaa842 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114edaa811 expref: 56 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.903539:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edaa82d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.903541:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114edaa849 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176118 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.903544:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023fcc0/0xfc4b8e114edaa818 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x7f21:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176111 expref: 3726 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.903545:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edaa82d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.903545:0:15580:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009023eac0/0xfc4b8e114edaa80a lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.903548:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edaa82d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.903550:0:15580:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114edaa842 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa811 expref: 56 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.903551:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edaa82d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.903552:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114edaa826 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x7f21:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176111 expref: 3725 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.903554:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.903554:0:15580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88013484fc00) 00010000:00010000:0.0:1713279306.903555:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edaa82d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.903556:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7f21:0x0].0x0 (ffff880096f32d00) 00010000:00010000:3.0:1713279306.903556:0:15580:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.903557:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1713279306.903558:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edaa82d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00010000:00010000:3.0:1713279306.903558:0:15580:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114edaa842 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa811 expref: 56 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.903559:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801251d5b00, rc 0) 00010000:00010000:0.0:1713279306.903562:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:3.0:1713279306.903562:0:15580:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012154d680, rc 0) 00010000:00010000:0.0:1713279306.903564:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.903565:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edaa82d lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:0.0:1713279306.903568:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edaa82d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.903568:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114edaa850 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.903573:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b46c0/0xfc4b8e114edaa834 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.903575:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114edaa850 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.903576:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b46c0/0xfc4b8e114edaa834 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT0 00000100:00100000:1.0:1713279306.903576:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3725:11736:x1796503281279680:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 120us (208us total) trans 4295202778 rc 0/0 00010000:00010000:0.0:1713279306.903579:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b46c0/0xfc4b8e114edaa834 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00000100:00100000:1.0:1713279306.903580:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785476 00010000:00010000:0.0:1713279306.903581:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b46c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.903583:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b46c0/0xfc4b8e114edaa834 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT0 00010000:00010000:2.0:1713279306.903583:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114edaa850 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.903586:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b46c0/0xfc4b8e114edaa834 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT0 00000100:00100000:3.0:1713279306.903587:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200059584:12345-0@lo:101:mdt_io00_011.0 Request processed in 73us (114us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.903589:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff88012bacd700) 00010000:00010000:0.0:1713279306.903590:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.903590:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785479 00000100:00100000:3.0:1713279306.903591:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98914 00010000:00010000:0.0:1713279306.903592:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b46c0/0xfc4b8e114edaa834 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00000100:00100000:1.0:1713279306.903593:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3657:11912:x1796503281280128:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.903594:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b46c0/0xfc4b8e114edaa834 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.903598:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.903603:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd43b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200059584:0@lo:101:mdt_io00_011.0 00010000:00010000:1.0:1713279306.903604:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114edaa857 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917611f expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.903606:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114edaa81f lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917610a expref: 3727 pid: 15481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.903607:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df06300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000-mdtlov_UUID:15514:1796503200059520:0@lo:1000:mdt_io00_007.0 00010000:00010000:0.0:1713279306.903611:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114edaa81f lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917610a expref: 3727 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.903611:0:15534:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.903615:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba8d80, rc 0) 00010000:00010000:2.0:1713279306.903618:0:15534:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.903629:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3726:11204:x1796503281279424:12345-192.168.203.4@tcp:101:touch.0 Request processed in 165us (251us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.903630:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa85e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:0.0:1713279306.903633:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785477 00010000:00010000:1.0:1713279306.903635:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17180/0xfc4b8e114edaa865 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.903637:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa85e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.903640:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17180/0xfc4b8e114edaa865 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00000100:00100000:0.0:1713279306.903643:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785480 00010000:00010000:2.0:1713279306.903643:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa85e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.903644:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17180/0xfc4b8e114edaa865 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00000100:00100000:0.0:1713279306.903645:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3439:11666:x1796503281280256:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1713279306.903649:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14d80/0xfc4b8e114edaa86c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.903651:0:15481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.903653:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14d80/0xfc4b8e114edaa86c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.903656:0:15481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114edaa873 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176126 expref: -99 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.903656:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14d80/0xfc4b8e114edaa86c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.903662:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114edaa850 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:1.0:1713279306.903663:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:2.0:1713279306.903667:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114edaa850 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.903668:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17180/0xfc4b8e114edaa865 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.903671:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17180/0xfc4b8e114edaa865 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.903672:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114edaa850 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.903674:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17180/0xfc4b8e114edaa865 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.903676:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaa87a lrc: 3/1,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.903677:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17180/0xfc4b8e114edaa865 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.903678:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114edaa850 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.903680:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaa87a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.903680:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe17180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.903682:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17180/0xfc4b8e114edaa865 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.903682:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008dae3a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.903684:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaa87a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.903685:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17180/0xfc4b8e114edaa865 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.903685:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114edaa850 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.903689:0:15481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114edaa881 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x237:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15481 initiator: MDT0 00010000:00010000:1.0:1713279306.903689:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880092139200) 00010000:00010000:1.0:1713279306.903690:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.903691:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114edaa850 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.903692:0:15481:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114edaa881 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.903692:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17180/0xfc4b8e114edaa865 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:0.0:1713279306.903695:0:15481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114edaa881 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.903695:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17180/0xfc4b8e114edaa865 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.903698:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880096b8e800) 00010000:00010000:1.0:1713279306.903701:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14d80/0xfc4b8e114edaa86c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.903701:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.903703:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114edaa850 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.903704:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14d80/0xfc4b8e114edaa86c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.903707:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14d80/0xfc4b8e114edaa86c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.903708:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114edaa850 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.903709:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe14d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.903711:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14d80/0xfc4b8e114edaa86c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.903713:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14d80/0xfc4b8e114edaa86c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT1 00010000:00010000:1.0:1713279306.903716:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88009254e400) 00010000:00010000:2.0:1713279306.903716:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa85e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.903717:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.903719:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14d80/0xfc4b8e114edaa86c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.903721:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa85e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.903724:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14d80/0xfc4b8e114edaa86c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT1 00010000:00010000:2.0:1713279306.903726:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa85e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.903730:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008dae2d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.903733:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa85e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.903736:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114edaa857 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917611f expref: 3658 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.903738:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa85e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.903740:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe146c0/0xfc4b8e114edaa857 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917611f expref: 3658 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.903744:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3831 (ffff880130675100) 00010000:00010000:1.0:1713279306.903746:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe146c0, rc 0) 00010000:00010000:2.0:1713279306.903746:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.903749:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa85e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.903753:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edaa85e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.903758:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3657:11912:x1796503281280128:12345-192.168.203.4@tcp:101:touch.0 Request processed in 164us (362us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.903762:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785479 00010000:00010000:2.0:1713279306.903769:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114edaa849 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176118 expref: 3440 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.903770:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785481 00000004:00200000:0.0:1713279306.903772:0:15481:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x797c:0x0]: returning size 4096 00000100:00100000:1.0:1713279306.903773:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3724:11711:x1796503281280384:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.903778:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.903781:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114edaa849 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176118 expref: 3440 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.903783:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114edaa88f lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917612d expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.903790:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093693a80, rc 0) 00010000:00010000:0.0:1713279306.903794:0:15481:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaa87a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.903797:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaa87a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.903800:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaa87a lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.903803:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaa87a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.903805:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b7180 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.903806:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3440:11855:x1796503281280000:12345-192.168.203.4@tcp:101:touch.0 Request processed in 281us (418us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.903807:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaa87a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.903810:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaa87a lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00000100:00100000:2.0:1713279306.903810:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785478 00010000:00010000:1.0:1713279306.903813:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114edaa896 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.903815:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff880092193400) 00010000:00010000:0.0:1713279306.903817:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.903817:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114edaa896 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.903818:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaa87a lrc: 3/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.903821:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaa87a lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.903821:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114edaa896 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.903826:0:15481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114edaa881 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.903826:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114edaa89d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.903829:0:15481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114edaa881 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.903830:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114edaa89d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.903832:0:15481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114edaa881 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.903833:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114edaa89d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.903835:0:15481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b61c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.903836:0:15481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114edaa881 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.903839:0:15481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114edaa881 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00000004:00200000:1.0:1713279306.903839:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:0.0:1713279306.903842:0:15481:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x30 (ffff88012bacd500) 00010000:00010000:0.0:1713279306.903843:0:15481:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.903843:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114edaa896 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.903844:0:15481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114edaa881 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279306.903846:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b61c0/0xfc4b8e114edaa881 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:1.0:1713279306.903846:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114edaa896 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.903849:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114edaa896 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.903852:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114edaa896 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.903854:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe16d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.903856:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114edaa896 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.903859:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114edaa896 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.903861:0:15481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114edaa873 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176126 expref: 3439 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.903862:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88008bf03500) 00010000:00010000:1.0:1713279306.903863:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.903865:0:15481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114edaa873 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176126 expref: 3439 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.903865:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114edaa896 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.903867:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16d00/0xfc4b8e114edaa896 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.903869:0:15481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801245b58c0, rc 0) 00010000:00010000:1.0:1713279306.903875:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114edaa89d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.903878:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114edaa89d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.903881:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114edaa89d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.903883:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3438:11666:x1796503281280256:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 237us (479us total) trans 4295183795 rc 301/301 00010000:00010000:1.0:1713279306.903883:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe14480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.903884:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114edaa89d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00000100:00100000:0.0:1713279306.903887:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785480 00010000:00010000:1.0:1713279306.903887:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114edaa89d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.903890:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff8800908e1b00) 00010000:00010000:1.0:1713279306.903891:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.903892:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114edaa89d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.903894:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe14480/0xfc4b8e114edaa89d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.903906:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114edaa88f lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917612d expref: 3725 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.903910:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe16880/0xfc4b8e114edaa88f lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917612d expref: 3725 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.903915:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe16880, rc 0) 00000100:00100000:1.0:1713279306.903930:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3724:11711:x1796503281280384:12345-192.168.203.4@tcp:101:touch.0 Request processed in 156us (497us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.903934:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785481 00000100:00100000:3.0:1713279306.903935:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000-mdtlov_UUID:15514:1796503200059648:0@lo:403:mdt_io00_007.0 00000100:00100000:3.0:1713279306.903952:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.903958:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.903963:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200059648 00000100:00100000:2.0:1713279306.903965:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200059648 00000100:00100000:2.0:1713279306.903977:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98915 00000100:00100000:2.0:1713279306.903980:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+92:15514:x1796503200059648:12345-0@lo:403:mdt_io00_007.0 00000100:00100000:0.0:1713279306.904277:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.904315:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130144450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:10814:x1796503281279872:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1579us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.904322:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223121 00000100:00100000:3.0:1713279306.904340:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281280640 00000100:00100000:3.0:1713279306.904345:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281280640 00000100:00100000:3.0:1713279306.904362:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785482 00000100:00100000:3.0:1713279306.904366:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:12017:x1796503281280640:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.904373:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.904380:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaa8a4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176134 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.904440:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa8ab lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904447:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa8ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904452:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa8ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904458:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaa8b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904462:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaa8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904465:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaa8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00200000:3.0:1713279306.904474:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8516:0x0]: returning size 1 00010000:00010000:3.0:1713279306.904481:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa8ab lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904484:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa8ab lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904487:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa8ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904490:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa8ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904493:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f1d73c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.904494:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa8ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904497:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa8ab lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904501:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.904503:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.904505:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa8ab lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904507:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaa8ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904515:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaa8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904518:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaa8b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904521:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaa8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904523:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800929098c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.904525:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaa8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904527:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaa8b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904530:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3931 (ffff880092ae7700) 00010000:00010000:3.0:1713279306.904531:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.904533:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaa8b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904535:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaa8b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904549:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaa8a4 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176134 expref: 3725 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.904553:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaa8a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176134 expref: 3725 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.904557:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c24fcc0, rc 0) 00000100:00100000:3.0:1713279306.904583:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:12017:x1796503281280640:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 216us (306us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.904588:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785482 00000100:00100000:0.0:1713279306.904688:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.904697:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281280960 00000100:00100000:3.0:1713279306.904700:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281280960 00000100:00100000:3.0:1713279306.904710:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785483 00000100:00100000:3.0:1713279306.904713:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3657:11912:x1796503281280960:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.904719:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.904724:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800966fe880/0xfc4b8e114edaa8b9 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917613b expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.904744:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114edaa8c0 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904748:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114edaa8c0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904752:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114edaa8c0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904758:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa8c7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.904761:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa8c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904764:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa8c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904774:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114edaa8c0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904777:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114edaa8c0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904780:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114edaa8c0 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904783:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114edaa8c0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904786:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e6898c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.904787:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114edaa8c0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904790:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114edaa8c0 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904794:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880095863700) 00000100:00100000:0.0:1713279306.904795:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.904795:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.904796:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114edaa8c0 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904799:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6898c0/0xfc4b8e114edaa8c0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904804:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa8c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904806:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa8c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904809:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa8c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904812:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.904813:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa8c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.904817:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281281088 00010000:00010000:3.0:1713279306.904818:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa8c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.904820:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281281088 00010000:00010000:3.0:1713279306.904822:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff880095863300) 00010000:00010000:3.0:1713279306.904823:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.904824:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa8c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.904826:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaa8c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.904833:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785484 00000100:00100000:1.0:1713279306.904836:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3438:11855:x1796503281281088:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.904837:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800966fe880/0xfc4b8e114edaa8b9 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917613b expref: 3658 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.904841:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800966fe880/0xfc4b8e114edaa8b9 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917613b expref: 3658 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.904843:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.904846:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800966fe880, rc 0) 00010000:00010000:1.0:1713279306.904850:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114edaa8ce lrc: 2/0,0 mode: --/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176142 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.904862:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3657:11912:x1796503281280960:12345-192.168.203.4@tcp:101:touch.0 Request processed in 147us (174us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.904866:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785483 00010000:00010000:1.0:1713279306.904888:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114edaa8d5 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.904893:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114edaa8d5 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904897:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114edaa8d5 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904901:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114edaa8dc lrc: 3/1,0 mode: --/PR res: [0x240000401:0x13a:0x0].0x3831 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.904905:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114edaa8dc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904908:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114edaa8dc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904924:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114edaa8e3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.904929:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114edaa8e3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904932:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114edaa8e3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00200000:1.0:1713279306.904936:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x71e6:0x0]: returning size 0 00010000:00010000:1.0:1713279306.904955:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114edaa8d5 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904958:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114edaa8d5 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904961:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114edaa8d5 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904964:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114edaa8d5 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904966:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe15b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.904968:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114edaa8d5 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904971:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114edaa8d5 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904974:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x13a:0x0].0x0 (ffff8800908e1400) 00010000:00010000:1.0:1713279306.904976:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.904977:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114edaa8d5 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904980:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15b00/0xfc4b8e114edaa8d5 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x13a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904987:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114edaa8dc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904990:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114edaa8dc lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904993:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114edaa8dc lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904995:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe16400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.904997:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114edaa8dc lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.904999:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114edaa8dc lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905002:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x13a:0x0].0x3831 (ffff880130675800) 00010000:00010000:1.0:1713279306.905003:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.905005:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114edaa8dc lrc: 2/0,0 mode: --/PR res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905007:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16400/0xfc4b8e114edaa8dc lrc: 0/0,0 mode: --/PR res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905020:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14fc0/0xfc4b8e114edaa8ce lrc: 0/0,0 mode: --/CW res: [0x240000401:0x13a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176142 expref: 3441 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.905027:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114edaa8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176142 expref: 3440 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.905030:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.905031:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71e6:0x0].0x0 (ffff880090bee600) 00010000:00010000:1.0:1713279306.905032:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.905033:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe15680, rc 0) 00000100:00100000:1.0:1713279306.905051:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3440:11855:x1796503281281088:12345-192.168.203.4@tcp:101:touch.0 Request processed in 214us (256us total) trans 4295183796 rc 0/0 00000100:00100000:0.0:1713279306.905053:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.905055:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785484 00000100:00100000:2.0:1713279306.905055:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+92:15514:x1796503200059648:12345-0@lo:403:mdt_io00_007.0 Request processed in 1072us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.905062:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281281216 00000100:00100000:1.0:1713279306.905064:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281281216 00000100:00100000:2.0:1713279306.905064:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98915 00000100:00100000:3.0:1713279306.905064:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000-mdtlov_UUID:15514:1796503200059648:0@lo:403:mdt_io00_007.0 00000100:00100000:2.0:1713279306.905092:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281280704 00000100:00100000:2.0:1713279306.905095:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281280704 00000100:00100000:1.0:1713279306.905097:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785485 00000100:00100000:1.0:1713279306.905100:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3657:11711:x1796503281281216:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.905105:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.905109:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110568 00010000:00010000:1.0:1713279306.905111:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114edaa8f1 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176149 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.905113:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+84:1957:x1796503281280704:12345-192.168.203.4@tcp:1:lfs.0 00000100:00100000:0.0:1713279306.905117:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.905129:0:15506:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa8f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.905135:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281280896 00000100:00100000:1.0:1713279306.905137:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281280896 00010000:00010000:2.0:1713279306.905140:0:15506:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800966fdf80/0xfc4b8e114ed9e013 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a84 expref: 84 pid: 15556 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713279306.905147:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223122 00010000:00010000:2.0:1713279306.905148:0:15506:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936edd40/0xfc4b8e114ed9f686 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173137 expref: 101 pid: 15539 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713279306.905149:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3440:11666:x1796503281280896:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:2.0:1713279306.905155:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.905156:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.905159:0:15506:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa8f8 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.905174:0:15506:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936edd40/0xfc4b8e114ed9f686 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173137 expref: 101 pid: 15539 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713279306.905184:0:15506:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936edd40/0xfc4b8e114ed9f686 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173137 expref: 101 pid: 15539 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.905193:0:15506:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f281880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15506:1796503200059712:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.905203:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3441:11666:x1796503281280896:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 52us (85us total) trans 4295183797 rc 0/0 00000100:00100000:1.0:1713279306.905207:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223122 00010000:00010000:2.0:1713279306.905217:0:15506:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800966fdf80/0xfc4b8e114ed9e013 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a84 expref: 84 pid: 15556 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713279306.905218:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114edaa8ff lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.905223:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114edaa8ff lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.905225:0:15506:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800966fdf80/0xfc4b8e114ed9e013 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a84 expref: 84 pid: 15556 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.905227:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114edaa8ff lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.905233:0:15506:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15506:1796503200059776:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.905235:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114edaa906 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.905238:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114edaa906 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905241:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114edaa906 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.905249:0:15506:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a480 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.905252:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114edaa8ff lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905255:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114edaa8ff lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905258:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114edaa8ff lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905261:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114edaa8ff lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905264:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe16f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.905265:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114edaa8ff lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905268:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114edaa8ff lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905271:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880096da6500) 00010000:00010000:1.0:1713279306.905273:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.905274:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114edaa8ff lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905277:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe16f40/0xfc4b8e114edaa8ff lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905282:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114edaa906 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905285:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114edaa906 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905288:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114edaa906 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905290:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe161c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.905291:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114edaa906 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905294:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114edaa906 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905297:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff8800935a6800) 00010000:00010000:1.0:1713279306.905298:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.905299:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114edaa906 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905302:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe161c0/0xfc4b8e114edaa906 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905312:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114edaa8f1 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176149 expref: 3658 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.905316:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17a80/0xfc4b8e114edaa8f1 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176149 expref: 3658 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.905321:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe17a80, rc 0) 00000100:00100000:1.0:1713279306.905336:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3657:11711:x1796503281281216:12345-192.168.203.4@tcp:101:touch.0 Request processed in 235us (306us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.905340:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785485 00010000:00010000:3.0:1713279306.905499:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa90d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.905505:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa90d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.905509:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa90d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.905517:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa914 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x14f:0x0].0x3032 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.905520:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.905523:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.905527:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa91b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x148:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.905530:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa91b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.905533:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa91b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.905538:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa922 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x148:0x0].0x3032 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.905541:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa922 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.905544:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa922 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.905555:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x847f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.905559:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114edaa793 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x847f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760ee expref: 3723 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.905563:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.905575:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114edaa793 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x847f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760ee expref: 3723 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.905580:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114edaa793 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x847f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760ee expref: 3723 pid: 15485 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.905586:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200059840:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.905612:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.905627:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.905657:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.905669:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281281344 00000100:00100000:1.0:1713279306.905672:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281281344 00000100:00100000:2.0:1713279306.905676:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281281472 00000100:00100000:2.0:1713279306.905680:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281281472 00000100:00100000:1.0:1713279306.905683:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785486 00000100:00100000:1.0:1713279306.905686:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3657:11912:x1796503281281344:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.905691:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.905697:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17cc0/0xfc4b8e114edaa930 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176150 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.905697:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785487 00000100:00100000:2.0:1713279306.905701:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3441:11204:x1796503281281472:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.905711:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.905719:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114edaa937 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176157 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.905727:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114edaa93e lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.905732:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114edaa93e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905736:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114edaa93e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905741:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114edaa945 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.905745:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114edaa945 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905748:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114edaa945 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00200000:1.0:1713279306.905754:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:1.0:1713279306.905760:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114edaa93e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.905762:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa94c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.905763:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114edaa93e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905766:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114edaa93e lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905769:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114edaa93e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.905770:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa94c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.905772:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe15f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.905773:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114edaa93e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905776:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114edaa93e lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.905777:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa94c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.905779:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880123701d00) 00010000:00010000:1.0:1713279306.905780:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.905782:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114edaa93e lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905784:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15f80/0xfc4b8e114edaa93e lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.905784:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa953 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.905788:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa953 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.905789:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114edaa945 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.905791:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa953 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.905792:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114edaa945 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905795:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114edaa945 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905797:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801222058c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.905799:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114edaa945 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000004:00200000:2.0:1713279306.905801:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:1.0:1713279306.905804:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114edaa945 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.905806:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa94c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.905807:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880123701600) 00010000:00010000:1.0:1713279306.905808:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.905809:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa94c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.905810:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114edaa945 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.905812:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801222058c0/0xfc4b8e114edaa945 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.905812:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa94c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.905815:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa94c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.905821:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008be61680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.905822:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa94c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.905824:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17cc0/0xfc4b8e114edaa930 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176150 expref: 3658 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.905825:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa94c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.905828:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe17cc0/0xfc4b8e114edaa930 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176150 expref: 3658 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.905829:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:2.0:1713279306.905831:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.905833:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe17cc0, rc 0) 00010000:00010000:2.0:1713279306.905833:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa94c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.905835:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008be61680/0xfc4b8e114edaa94c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.905840:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa953 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.905843:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa953 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.905846:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa953 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.905849:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf7cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.905850:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa953 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.905853:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa953 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.905856:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3657:11912:x1796503281281344:12345-192.168.203.4@tcp:101:touch.0 Request processed in 169us (230us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.905856:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880096b8e700) 00010000:00010000:2.0:1713279306.905857:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.905859:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa953 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.905860:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785486 00010000:00010000:2.0:1713279306.905862:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaa953 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.905875:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114edaa937 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176157 expref: 3442 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.905879:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008be63600/0xfc4b8e114edaa937 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176157 expref: 3442 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.905884:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008be63600, rc 0) 00000100:00100000:2.0:1713279306.905901:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3441:11204:x1796503281281472:12345-192.168.203.4@tcp:101:touch.0 Request processed in 200us (243us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.905905:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785487 00000100:00100000:2.0:1713279306.906352:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.906359:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.906370:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.906385:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.906393:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281281984 00000100:00100000:0.0:1713279306.906395:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281281984 00000100:00100000:2.0:1713279306.906395:0:15506:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f281880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15506:1796503200059712:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.906403:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281281664 00000100:00100000:0.0:1713279306.906405:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281282112 00000100:00100000:2.0:1713279306.906405:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281281664 00000100:00100000:0.0:1713279306.906407:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281282112 00000100:00100000:0.0:1713279306.906428:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785488 00000100:00100000:0.0:1713279306.906431:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:12017:x1796503281281984:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:3.0:1713279306.906431:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281281536 00000100:00100000:3.0:1713279306.906436:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281281536 00010000:00010000:0.0:1713279306.906438:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.906439:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785489 00010000:00010000:0.0:1713279306.906443:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542640/0xfc4b8e114edaa95a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917615e expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.906445:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3724:11711:x1796503281282112:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.906452:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223123 00010000:00010000:1.0:1713279306.906456:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.906457:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3726:10814:x1796503281281536:12345-192.168.203.4@tcp:37:lfs.0 00010000:00010000:1.0:1713279306.906463:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114edaa961 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176165 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.906473:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785490 00010000:00010000:0.0:1713279306.906475:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edaa968 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.906476:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3441:11855:x1796503281281664:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1713279306.906481:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edaa968 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.906485:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edaa968 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:2.0:1713279306.906488:0:15473:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00200000:0.0:1713279306.906489:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7abd:0x0]: returning size 42048 00010000:00010000:2.0:1713279306.906494:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe15680/0xfc4b8e114edaa8e3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x71e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176142 expref: 3441 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.906500:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71e6:0x0].0x0 (ffff880090bee600) 00010000:00010000:2.0:1713279306.906502:0:15473:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.906505:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114edaa976 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.906511:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114edaa976 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.906515:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114edaa976 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.906521:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114edaa97d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.906524:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114edaa97d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.906525:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114edaa984 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.906527:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114edaa97d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713279306.906529:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114edaa984 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.906533:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114edaa984 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00200000:1.0:1713279306.906535:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:1.0:1713279306.906540:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114edaa976 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.906543:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114edaa976 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.906546:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114edaa976 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.906550:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114edaa976 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.906552:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.906554:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114edaa976 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.906557:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114edaa976 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00000004:00010000:2.0:1713279306.906559:0:15473:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008be06d80 reply state ffff88009782e000 transno 4295183798 ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114edaa984 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.906564:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880123701000) 00010000:00010000:2.0:1713279306.906564:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114edaa984 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.906566:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.906567:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114edaa976 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.906568:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542640/0xfc4b8e114edaa95a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917615e expref: 3728 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.906568:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71e6:0x0].0x0 (ffff880090bee600) 00010000:00010000:2.0:1713279306.906569:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.906570:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205b00/0xfc4b8e114edaa976 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.906570:0:15473:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.906576:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edaa968 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917615e expref: 3727 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.906576:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114edaa97d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.906579:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114edaa97d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.906580:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7abd:0x0].0x0 (ffff88008c2e7d00) 00010000:00010000:0.0:1713279306.906581:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1713279306.906581:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114edaa97d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713279306.906583:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092540900, rc 0) 00010000:00010000:1.0:1713279306.906584:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122205680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.906585:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114edaa97d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.906588:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114edaa97d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.906592:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880123701e00) 00010000:00010000:1.0:1713279306.906593:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.906594:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114edaa97d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.906594:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3442:11855:x1796503281281664:12345-192.168.203.4@tcp:36:touch.0 Request processed in 117us (223us total) trans 4295183798 rc 0/0 00010000:00010000:1.0:1713279306.906596:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205680/0xfc4b8e114edaa97d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713279306.906597:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:12017:x1796503281281984:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 165us (239us total) trans 4295202779 rc 0/0 00000100:00100000:2.0:1713279306.906598:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785490 00000100:00100000:0.0:1713279306.906601:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785488 00010000:00010000:1.0:1713279306.906611:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114edaa961 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176165 expref: 3725 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.906616:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122205440/0xfc4b8e114edaa961 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176165 expref: 3725 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.906618:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.906621:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122205440, rc 0) 00000100:00100000:0.0:1713279306.906625:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.906626:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281281792 00000100:00100000:2.0:1713279306.906627:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281281792 00000100:00100000:2.0:1713279306.906636:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223124 00000100:00100000:1.0:1713279306.906637:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3725:11711:x1796503281282112:12345-192.168.203.4@tcp:101:touch.0 Request processed in 192us (251us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.906639:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3725:12004:x1796503281281792:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1713279306.906640:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281282496 00000100:00100000:1.0:1713279306.906641:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785489 00000100:00100000:0.0:1713279306.906642:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281282496 00000100:00100000:1.0:1713279306.906651:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785491 00000100:00100000:1.0:1713279306.906654:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3657:11912:x1796503281282496:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.906659:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.906664:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122207180/0xfc4b8e114edaa98b lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176173 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.906680:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3725:12004:x1796503281281792:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 40us (62us total) trans 4295202780 rc 0/0 00010000:00010000:1.0:1713279306.906683:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114edaa992 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.906684:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223124 00010000:00010000:1.0:1713279306.906687:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114edaa992 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.906690:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114edaa992 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713279306.906694:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.906696:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114edaa999 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713279306.906698:0:15506:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15506:1796503200059776:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.906699:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114edaa999 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713279306.906701:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281282624 00010000:00010000:1.0:1713279306.906702:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114edaa999 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713279306.906703:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281282624 00010000:00010000:2.0:1713279306.906708:0:15506:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa8f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.906712:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114edaa992 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713279306.906713:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785492 00010000:00010000:1.0:1713279306.906715:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114edaa992 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713279306.906716:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:11204:x1796503281282624:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.906718:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114edaa992 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.906721:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114edaa992 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.906722:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.906723:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800958d5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.906725:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114edaa992 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.906727:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edaa9a0 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917617a expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.906727:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114edaa992 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.906731:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880123701700) 00010000:00010000:1.0:1713279306.906732:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.906733:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114edaa992 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.906736:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d5440/0xfc4b8e114edaa992 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00000100:00100000:2.0:1713279306.906736:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.906741:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114edaa999 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00000100:00100000:2.0:1713279306.906743:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281282240 00010000:00010000:1.0:1713279306.906744:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114edaa999 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00000100:00100000:2.0:1713279306.906745:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281282240 00010000:00010000:1.0:1713279306.906746:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114edaa999 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.906750:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800958d6ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.906751:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114edaa999 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00000100:00100000:2.0:1713279306.906753:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223125 00010000:00010000:1.0:1713279306.906754:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114edaa999 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00000100:00100000:2.0:1713279306.906756:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3442:11666:x1796503281282240:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:1.0:1713279306.906757:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88012d2e5000) 00010000:00010000:1.0:1713279306.906758:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.906759:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114edaa999 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.906761:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800958d6ac0/0xfc4b8e114edaa999 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.906771:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880122207180/0xfc4b8e114edaa98b lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176173 expref: 3658 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.906775:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122207180/0xfc4b8e114edaa98b lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176173 expref: 3658 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.906780:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122207180, rc 0) 00010000:00010000:0.0:1713279306.906788:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaa9a7 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.906792:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3657:11912:x1796503281282496:12345-192.168.203.4@tcp:101:touch.0 Request processed in 137us (166us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.906793:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaa9a7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00000100:00100000:1.0:1713279306.906795:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785491 00010000:00010000:0.0:1713279306.906797:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaa9a7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.906802:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3443:11666:x1796503281282240:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 45us (65us total) trans 4295183799 rc 0/0 00010000:00010000:0.0:1713279306.906803:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaa9ae lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.906805:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223125 00010000:00010000:0.0:1713279306.906807:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaa9ae lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.906810:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaa9ae lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.906821:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaa9a7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.906824:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaa9a7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.906827:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaa9a7 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.906830:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaa9a7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.906833:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092541440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.906835:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaa9a7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.906838:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaa9a7 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.906842:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:0.0:1713279306.906843:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.906845:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaa9a7 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.906847:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaa9a7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.906852:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.906853:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaa9ae lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.906856:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaa9ae lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.906859:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaa9ae lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.906862:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092542880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.906863:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaa9ae lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.906863:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281282752 00010000:00010000:0.0:1713279306.906865:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaa9ae lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT0 00000100:00100000:3.0:1713279306.906866:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281282752 00010000:00010000:0.0:1713279306.906868:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff88011eea5000) 00010000:00010000:0.0:1713279306.906870:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.906871:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaa9ae lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00000100:00100000:2.0:1713279306.906871:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.906874:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaa9ae lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.906886:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edaa9a0 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917617a expref: 3729 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.906888:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281281856 00010000:00010000:0.0:1713279306.906890:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edaa9a0 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917617a expref: 3729 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.906890:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281281856 00010000:00010000:0.0:1713279306.906894:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092541b00, rc 0) 00010000:00010000:3.0:1713279306.906898:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936edd40/0xfc4b8e114ed9f686 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173137 expref: 102 pid: 15539 timeout: 509 lvb_type: 1 00000100:00100000:1.0:1713279306.906901:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785493 00000100:00100000:1.0:1713279306.906904:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3443:12032:x1796503281282752:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.906908:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:11204:x1796503281282624:12345-192.168.203.4@tcp:101:touch.0 Request processed in 191us (215us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.906909:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.906911:0:15484:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:0.0:1713279306.906912:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785492 00000100:00100000:3.0:1713279306.906913:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196592 00000100:00100000:3.0:1713279306.906917:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+102:1956:x1796503281281856:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.906919:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539b00/0xfc4b8e114ed9e9b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d78 expref: 3443 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.906922:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.906925:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x24f:0x0].0x0 (ffff880090beed00) 00000100:00100000:2.0:1713279306.906925:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.906927:0:15484:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.906929:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281282304 00010000:00010000:3.0:1713279306.906929:0:6915:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936edd40/0xfc4b8e114ed9f686 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173137 expref: 102 pid: 15539 timeout: 509 lvb_type: 1 00000100:00100000:2.0:1713279306.906931:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281282304 00010000:00010000:1.0:1713279306.906933:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092455d40/0xfc4b8e114edaa9b5 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x24f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176181 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.906935:0:6915:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936edd40/0xfc4b8e114ed9f686 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173137 expref: 102 pid: 15539 timeout: 509 lvb_type: 1 00010000:00010000:2.0:1713279306.906939:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800966fdf80/0xfc4b8e114ed9e013 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a84 expref: 85 pid: 15556 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.906944:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936edd40/0xfc4b8e114ed9f686 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173137 expref: 102 pid: 15539 timeout: 509 lvb_type: 1 00000100:00100000:0.0:1713279306.906947:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.906950:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196593 00010000:00010000:3.0:1713279306.906951:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.906952:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114edaa9bc lrc: 3/1,0 mode: --/CR res: [0x240000400:0x24f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.906954:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281282304:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.906956:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114edaa9bc lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x24f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.906960:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114edaa9bc lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x24f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.906960:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.906963:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:1956:x1796503281281856:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 46us (91us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.906965:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114edaa9c3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24f:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.906968:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114edaa9c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.906968:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800966fdf80/0xfc4b8e114ed9e013 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a84 expref: 85 pid: 15556 timeout: 509 lvb_type: 1 00000100:00100000:3.0:1713279306.906968:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196592 00010000:00010000:1.0:1713279306.906971:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114edaa9c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.906976:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800966fdf80/0xfc4b8e114ed9e013 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a84 expref: 85 pid: 15556 timeout: 509 lvb_type: 1 00010000:00010000:1.0:1713279306.906983:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114edaa9bc lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x24f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.906986:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114edaa9bc lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x24f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.906986:0:15514:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880090a4fb80 x1796503200059840) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114edaa793 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x847f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760ee expref: 3724 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.906989:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114edaa9bc lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x24f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.906989:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800966fdf80/0xfc4b8e114ed9e013 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172a84 expref: 85 pid: 15556 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1713279306.906992:0:15514:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114edaa793 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x847f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760ee expref: 3724 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.906993:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114edaa9bc lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x24f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.906996:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097887cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.906997:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114edaa9bc lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x24f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.906997:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.906999:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.906999:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c6c0/0xfc4b8e114edaa793 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x847f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760ee expref: 3724 pid: 15485 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.907000:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114edaa9bc lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x24f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.907001:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa8f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.907003:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x24f:0x0].0x0 (ffff88012ee68b00) 00010000:00010000:1.0:1713279306.907005:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.907005:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200059840:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.907006:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114edaa9bc lrc: 3/0,0 mode: --/CR res: [0x240000400:0x24f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.907008:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097887cc0/0xfc4b8e114edaa9bc lrc: 0/0,0 mode: --/CR res: [0x240000400:0x24f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.907009:0:6916:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa8f8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.907012:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x847f:0x0].0x0 (ffff88008d729200) 00010000:00010000:1.0:1713279306.907013:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114edaa9c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.907014:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.907015:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114edaa9c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.907018:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114edaa9c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.907019:0:15514:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.907020:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800978861c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.907022:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114edaa9c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.907022:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.907022:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.907025:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114edaa9c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.907030:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x24f:0x0].0x31 (ffff88012ee68400) 00010000:00010000:3.0:1713279306.907030:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.907031:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.907033:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114edaa9c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.907034:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.907035:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800978861c0/0xfc4b8e114edaa9c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.907037:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713279306.907039:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+84:1957:x1796503281282304:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 84us (114us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.907045:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092455d40/0xfc4b8e114edaa9b5 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x24f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176181 expref: 3443 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.907045:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196593 00010000:00010000:1.0:1713279306.907049:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092455d40/0xfc4b8e114edaa9b5 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x24f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176181 expref: 3443 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.907054:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092455d40, rc 0) 00010000:00010000:2.0:1713279306.907061:0:15506:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa8f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907082:0:15506:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa8f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.907084:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3442:12032:x1796503281282752:12345-192.168.203.4@tcp:101:touch.0 Request processed in 179us (231us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.907088:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785493 00010000:00010000:2.0:1713279306.907093:0:15506:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa8f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907099:0:15506:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa8f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907111:0:15506:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa8f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907116:0:15506:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093aba1c0 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:2.0:1713279306.907119:0:15506:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa8f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907126:0:15506:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa8f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907136:0:15506:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa8f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907142:0:15506:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093aba1c0/0xfc4b8e114edaa8f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.907149:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880099c2e300 reply state ffff880096e3a000 transno 4295202781 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907155:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907159:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x847f:0x0].0x0 (ffff88008d729200) 00010000:00010000:3.0:1713279306.907160:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1713279306.907162:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713279306.907164:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa91b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907167:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa91b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907170:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa91b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907173:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa91b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907176:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.907178:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa91b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713279306.907180:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281280704:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 2065us (2125us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.907183:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa91b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713279306.907186:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110568 00010000:00010000:3.0:1713279306.907187:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x0 (ffff880091b34100) 00010000:00010000:3.0:1713279306.907188:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.907190:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa91b lrc: 3/0,0 mode: --/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907192:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689680/0xfc4b8e114edaa91b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x148:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000004:00010000:3.0:1713279306.907197:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880099c2e300 reply state ffff880096e3a000 transno 4295202781 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa922 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713279306.907200:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281282368 00010000:00010000:3.0:1713279306.907200:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa922 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713279306.907203:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281282368 00010000:00010000:3.0:1713279306.907203:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x3032 (ffff88012cffdd00) 00010000:00010000:3.0:1713279306.907204:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.907205:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:3.0:1713279306.907206:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa90d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907209:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa90d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907212:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa90d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713279306.907215:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98916 00010000:00010000:3.0:1713279306.907215:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa90d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907217:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68ba80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.907219:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3442:1957:x1796503281282368:12345-192.168.203.4@tcp:63:ll_sa.0 00010000:00010000:3.0:1713279306.907219:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa90d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907222:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa90d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907225:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x0 (ffff88012d397500) 00010000:00010000:3.0:1713279306.907226:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.907227:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa90d lrc: 3/0,0 mode: --/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907230:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba80/0xfc4b8e114edaa90d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.907233:0:15542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:3.0:1713279306.907235:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880099c2e300 reply state ffff880096e3a000 transno 4295202781 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x14f:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907239:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa914 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.907240:0:15542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114edaa9ca lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917616c expref: -99 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.907241:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x3032 (ffff88012d397900) 00010000:00010000:3.0:1713279306.907242:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.907243:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000004:00080000:3.0:1713279306.907245:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x7d86:0x0] 00010000:00010000:3.0:1713279306.907249:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023eac0/0xfc4b8e114edaa80a lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907251:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023eac0/0xfc4b8e114edaa80a lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907254:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023eac0/0xfc4b8e114edaa80a lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907257:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023eac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.907258:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023eac0/0xfc4b8e114edaa80a lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.907259:0:15542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa9d1 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15542 initiator: MDT0 00010000:00010000:3.0:1713279306.907262:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023eac0/0xfc4b8e114edaa80a lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907265:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88013484fc00) 00010000:00010000:2.0:1713279306.907266:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa9d1 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15542 initiator: MDT1 00010000:00010000:3.0:1713279306.907266:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.907269:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114edaa842 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa811 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907272:0:15542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa9d1 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15542 initiator: MDT1 00010000:00010000:3.0:1713279306.907273:0:15514:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114edaa842 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114edaa811 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.907276:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114edaa842 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114edaa811 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907281:0:15542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114edaa9d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15542 initiator: MDT0 00010000:00010000:2.0:1713279306.907286:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114edaa9d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15542 initiator: MDT1 00010000:00010000:3.0:1713279306.907287:0:15514:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114edaa842 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa811 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907292:0:15542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114edaa9d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15542 initiator: MDT1 00000100:00100000:3.0:1713279306.907293:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200059904:0@lo:105: 00000100:00100000:3.0:1713279306.907308:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.907317:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0780 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.907321:0:15542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa9df lrc: 3/1,0 mode: --/PR res: [0x240000403:0x768b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15542 initiator: MDT0 00010000:00010000:2.0:1713279306.907325:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa9df lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x768b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15542 initiator: MDT1 00000100:00100000:3.0:1713279306.907326:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200059904 00000100:00100000:3.0:1713279306.907328:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200059904 00010000:00010000:2.0:1713279306.907329:0:15542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa9df lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x768b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15542 initiator: MDT1 00000100:00100000:3.0:1713279306.907347:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33457 00000100:00100000:3.0:1713279306.907349:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15514:x1796503200059904:12345-0@lo:105: 00010000:00010000:3.0:1713279306.907354:0:6913:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713279306.907356:0:15542:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x768b:0x0]: returning size 0 00000004:00200000:2.0:1713279306.907358:0:15542:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1713279306.907358:0:6913:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.907364:0:15542:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa9df lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x768b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15542 initiator: MDT1 00010000:00010000:3.0:1713279306.907366:0:6913:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907368:0:15542:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa9df lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x768b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15542 initiator: MDT1 00010000:00010000:3.0:1713279306.907369:0:6913:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907372:0:15542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa9d1 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15542 initiator: MDT1 00000100:00100000:0.0:1713279306.907373:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.907373:0:6913:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907375:0:15542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa9d1 lrc: 2/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15542 initiator: MDT1 00010000:00010000:3.0:1713279306.907376:0:6913:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907378:0:15542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa9d1 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15542 initiator: MDT1 00010000:00010000:2.0:1713279306.907381:0:15542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.907382:0:15542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa9d1 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15542 initiator: MDT1 00010000:00010000:2.0:1713279306.907387:0:15542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa9d1 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15542 initiator: MDT1 00010000:00010000:3.0:1713279306.907387:0:6913:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880093691440) 00000100:00100000:1.0:1713279306.907391:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281282880 00010000:00010000:2.0:1713279306.907391:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x0 (ffff880092193400) 00010000:00010000:2.0:1713279306.907392:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.907393:0:15542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa9d1 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15542 initiator: MDT1 00000100:00100000:1.0:1713279306.907394:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281282880 00010000:00010000:2.0:1713279306.907396:0:15542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5440/0xfc4b8e114edaa9d1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15542 initiator: MDT1 00010000:00010000:2.0:1713279306.907401:0:15542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114edaa9d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15542 initiator: MDT1 00000100:00100000:3.0:1713279306.907401:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15514:x1796503200059904:12345-0@lo:105: Request processed in 51us (92us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.907404:0:15542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114edaa9d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15542 initiator: MDT1 00000100:00100000:3.0:1713279306.907405:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33457 00000100:00100000:1.0:1713279306.907407:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785494 00010000:00010000:2.0:1713279306.907408:0:15542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114edaa9d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15542 initiator: MDT1 00000100:00100000:1.0:1713279306.907410:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b3cf9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3657:12026:x1796503281282880:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.907410:0:15542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf5d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.907424:0:15542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114edaa9d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15542 initiator: MDT1 00010000:00010000:1.0:1713279306.907428:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.907428:0:15542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114edaa9d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15542 initiator: MDT1 00010000:00010000:2.0:1713279306.907431:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x237:0x0].0x3531 (ffff880096b8e300) 00010000:00010000:2.0:1713279306.907433:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.907434:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114edaa9e6 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176188 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907434:0:15542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114edaa9d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15542 initiator: MDT1 00010000:00010000:2.0:1713279306.907436:0:15542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5d40/0xfc4b8e114edaa9d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15542 initiator: MDT1 00010000:00010000:2.0:1713279306.907448:0:15542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf6ac0/0xfc4b8e114edaa9ca lrc: 0/0,0 mode: --/CR res: [0x240000400:0x237:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917616c expref: 3444 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907453:0:15542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5680/0xfc4b8e114edaa9df lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x768b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917616c expref: 3443 pid: 15542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.907457:0:15542:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x768b:0x0].0x0 (ffff88007fdca900) 00010000:00010000:2.0:1713279306.907458:0:15542:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.907459:0:15542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf5680, rc 0) 00010000:00010000:2.0:1713279306.907469:0:15534:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.907470:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edaa9ed lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.907474:0:15534:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.907478:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edaa9ed lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000004:00080000:2.0:1713279306.907481:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1713279306.907482:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edaa9ed lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.907488:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edaa9f4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.907491:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edaa9f4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.907495:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edaa9f4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.907497:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be07b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200059968:0@lo:1000:mdt_io00_011.0 00000100:00100000:2.0:1713279306.907516:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.907531:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800976f9900 going to sleep for 11 seconds 00000004:00200000:1.0:1713279306.907536:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x700e:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.907541:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edaa9ed lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.907542:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200059968 00010000:00010000:1.0:1713279306.907544:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edaa9ed lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.907545:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200059968 00000100:00100000:2.0:1713279306.907545:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3443:1957:x1796503281282368:12345-192.168.203.4@tcp:63:ll_sa.0 Request processed in 325us (598us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.907547:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edaa9ed lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.907550:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edaa9ed lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.907550:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98916 00010000:00010000:1.0:1713279306.907552:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133314fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.907554:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edaa9ed lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.907557:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edaa9ed lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.907558:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98917 00000100:00100000:0.0:1713279306.907561:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200059968:12345-0@lo:1000:mdt_io00_011.0 00010000:00010000:1.0:1713279306.907563:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:1.0:1713279306.907565:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.907566:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edaa9ed lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.907569:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edaa9ed lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.907576:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edaa9f4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.907578:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edaa9f4 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.907581:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edaa9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.907584:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133315b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.907585:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edaa9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.907588:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edaa9f4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.907591:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x38 (ffff88007f23d400) 00010000:00010000:1.0:1713279306.907592:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.907593:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edaa9f4 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.907595:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200059968:12345-0@lo:1000:mdt_io00_011.0 Request processed in 33us (78us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.907596:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edaa9f4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.907599:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98917 00010000:00010000:1.0:1713279306.907607:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114edaa9e6 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176188 expref: 3658 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.907608:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be07b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200059968:0@lo:1000:mdt_io00_011.0 00010000:00010000:1.0:1713279306.907612:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095249d40/0xfc4b8e114edaa9e6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176188 expref: 3658 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.907617:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095249d40, rc 0) 00000004:00080000:2.0:1713279306.907620:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x84a3:0x0] 00000100:00100000:2.0:1713279306.907631:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be07b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060032:0@lo:1000:mdt_io00_011.0 00000100:00100000:1.0:1713279306.907635:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b3cf9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3657:12026:x1796503281282880:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 223us (262us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.907639:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785494 00000100:00100000:2.0:1713279306.907644:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.907650:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c199780 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.907653:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200060032 00000100:00100000:0.0:1713279306.907655:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200060032 00000100:00100000:0.0:1713279306.907664:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98918 00000100:00100000:0.0:1713279306.907667:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200060032:12345-0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.907698:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200060032:12345-0@lo:1000:mdt_io00_011.0 Request processed in 30us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.907701:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98918 00000100:00100000:2.0:1713279306.907707:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be07b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060032:0@lo:1000:mdt_io00_011.0 00000100:00100000:3.0:1713279306.907836:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3726:10814:x1796503281281536:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 1378us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.907841:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223123 00000100:00100000:3.0:1713279306.907856:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200059904:0@lo:105: 00000100:00100000:0.0:1713279306.907864:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.907864:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023eac0/0xfc4b8e114edaa80a lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.907867:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023eac0/0xfc4b8e114edaa80a lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713279306.907874:0:15482:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281283200 00000100:00100000:0.0:1713279306.907876:0:15482:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281283200 00000100:00100000:3.0:1713279306.907887:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:385c4b71-808c-40cf-91de-b076b668d13f+3725:11854:x1796503281279808:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 4709us (5223us total) trans 4295202781 rc 0/0 00000100:00100000:0.0:1713279306.907893:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785495 00000100:00100000:3.0:1713279306.907893:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14361 00000100:00100000:0.0:1713279306.907896:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3657:11711:x1796503281283200:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.907902:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.907908:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114edaa9fb lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917619d expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.907928:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edaaa02 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.907933:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edaaa02 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907937:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edaaa02 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907942:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edaaa09 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.907945:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edaaa09 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907949:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edaaa09 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907960:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edaaa02 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907964:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edaaa02 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907967:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edaaa02 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907970:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edaaa02 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907972:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925421c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.907974:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edaaa02 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907977:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edaaa02 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907980:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff8800940f8200) 00010000:00010000:0.0:1713279306.907982:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.907983:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edaaa02 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907986:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edaaa02 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907991:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edaaa09 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907993:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edaaa09 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907996:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edaaa09 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.907999:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.908001:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edaaa09 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.908004:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edaaa09 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.908007:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff8800940f8a00) 00010000:00010000:0.0:1713279306.908008:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.908010:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edaaa09 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.908012:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edaaa09 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.908022:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114edaa9fb lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917619d expref: 3658 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.908032:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be07b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060096:0@lo:403:mdt_io00_011.0 00000100:00100000:2.0:1713279306.908047:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.908053:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800976f9900 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.908081:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.908097:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.908104:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114edaa9fb lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917619d expref: 3658 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.908105:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.908109:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281283392 00010000:00010000:0.0:1713279306.908110:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092540240, rc 0) 00000100:00100000:3.0:1713279306.908111:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281283392 00000100:00100000:2.0:1713279306.908114:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.908122:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281283072 00000100:00100000:3.0:1713279306.908123:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281283072 00000100:00100000:0.0:1713279306.908125:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:385c4b71-808c-40cf-91de-b076b668d13f+3657:11711:x1796503281283200:12345-192.168.203.4@tcp:101:touch.0 Request processed in 227us (261us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.908128:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785495 00000100:00100000:3.0:1713279306.908131:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281283584 00000100:00100000:3.0:1713279306.908132:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281283584 00000100:00100000:1.0:1713279306.908136:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281283712 00000100:00100000:0.0:1713279306.908138:0:15482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785496 00000100:00100000:1.0:1713279306.908139:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281283712 00000100:00100000:0.0:1713279306.908140:0:15482:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3445:11204:x1796503281283392:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.908141:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785497 00000100:00100000:3.0:1713279306.908144:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3445:12013:x1796503281283072:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.908147:0:15482:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.908148:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.908150:0:15749:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.908151:0:15482:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114edaaa10 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391761a4 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.908151:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281283840 00000100:00100000:1.0:1713279306.908153:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281283840 00010000:00010000:3.0:1713279306.908155:0:15749:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaaa17 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176196 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.908159:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785498 00000100:00100000:2.0:1713279306.908164:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3447:12032:x1796503281283584:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.908167:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785499 00000100:00100000:1.0:1713279306.908170:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3657:11912:x1796503281283712:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.908172:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785500 00010000:00010000:1.0:1713279306.908175:0:15474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.908175:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3725:12004:x1796503281283840:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1713279306.908180:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.908181:0:15474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114edaaa1e lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391761b2 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.908186:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114edaaa25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391761b9 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.908187:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edaaa2c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:3.0:1713279306.908191:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaa33 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.908192:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edaaa2c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279306.908196:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edaaa2c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.908196:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaa33 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.908200:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaa33 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.908202:0:15482:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114edaaa3a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15482 initiator: MDT0 00010000:00010000:0.0:1713279306.908205:0:15482:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114edaaa3a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.908205:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114edaaa41 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.908208:0:15749:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaa48 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15749 initiator: MDT0 00010000:00010000:0.0:1713279306.908209:0:15482:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114edaaa3a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.908210:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114edaaa41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.908211:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114edaaa4f lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1713279306.908211:0:15749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaa48 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.908214:0:15749:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaa48 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.908215:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114edaaa4f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:2.0:1713279306.908215:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114edaaa41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000004:00200000:0.0:1713279306.908216:0:15482:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:1.0:1713279306.908219:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114edaaa4f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.908220:0:15482:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edaaa2c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.908220:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114edaaa56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.908223:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edaaa2c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.908224:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114edaaa56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.908225:0:15474:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114edaaa5d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1713279306.908226:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edaaa2c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:2.0:1713279306.908227:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114edaaa56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.908229:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edaaa2c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.908230:0:15474:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114edaaa5d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.908232:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fca86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.908233:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edaaa2c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.908233:0:15474:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114edaaa5d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.908237:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edaaa2c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00000004:00200000:1.0:1713279306.908240:0:15474:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:0.0:1713279306.908241:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:0.0:1713279306.908242:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.908243:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edaaa2c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00000004:00200000:3.0:1713279306.908243:0:15749:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7d86:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.908244:0:15474:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114edaaa4f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.908246:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edaaa2c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.908247:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114edaaa4f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.908248:0:15749:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaa33 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.908250:0:15482:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114edaaa3a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.908250:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114edaaa4f lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.908251:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaa33 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.908254:0:15482:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114edaaa3a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.908254:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114edaaa4f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.908254:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaa33 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.908256:0:15482:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114edaaa3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.908256:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d2d7a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.908257:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaa33 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.908258:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114edaaa4f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:0.0:1713279306.908259:0:15482:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f084d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.908260:0:15482:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114edaaa3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.908260:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.908261:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114edaaa4f lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.908261:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaa33 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.908263:0:15482:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114edaaa3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:1.0:1713279306.908264:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880089f68700) 00010000:00010000:3.0:1713279306.908264:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaa33 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.908265:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.908266:0:15482:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff8800934f8c00) 00010000:00010000:0.0:1713279306.908267:0:15482:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.908267:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114edaaa4f lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00000004:00200000:2.0:1713279306.908267:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00010000:00010000:0.0:1713279306.908268:0:15482:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114edaaa3a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.908268:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:1.0:1713279306.908269:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d7a80/0xfc4b8e114edaaa4f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.908269:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.908271:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f084d80/0xfc4b8e114edaaa3a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:3.0:1713279306.908271:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaa33 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:3.0:1713279306.908273:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaa33 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.908277:0:15474:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114edaaa5d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.908279:0:15749:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaa48 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.908280:0:15474:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114edaaa5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.908281:0:15749:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaa48 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.908282:0:15482:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114edaaa10 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761a4 expref: 3447 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.908283:0:15474:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114edaaa5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.908284:0:15749:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaa48 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.908286:0:15474:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094e34b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.908287:0:15482:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114edaaa10 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761a4 expref: 3447 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.908287:0:15474:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114edaaa5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.908289:0:15749:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68aac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.908290:0:15474:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114edaaa5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.908291:0:15749:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaa48 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15749 initiator: MDT1 00010000:00010000:0.0:1713279306.908292:0:15482:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925433c0, rc 0) 00010000:00010000:1.0:1713279306.908293:0:15474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880089f68800) 00010000:00010000:1.0:1713279306.908294:0:15474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.908294:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114edaaa41 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.908294:0:15749:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaa48 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15749 initiator: MDT1 00010000:00010000:1.0:1713279306.908295:0:15474:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114edaaa5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:1.0:1713279306.908297:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094e34b40/0xfc4b8e114edaaa5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT1 00010000:00010000:3.0:1713279306.908297:0:15749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3731 (ffff8800937cec00) 00010000:00010000:3.0:1713279306.908298:0:15749:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.908299:0:15749:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaa48 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00010000:00010000:2.0:1713279306.908300:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114edaaa41 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.908302:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaa48 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15749 initiator: MDT1 00000100:00100000:0.0:1713279306.908303:0:15482:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3446:11204:x1796503281283392:12345-192.168.203.4@tcp:101:touch.0 Request processed in 162us (222us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.908305:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114edaaa41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.908307:0:15482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785496 00010000:00010000:1.0:1713279306.908310:0:15474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114edaaa1e lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761b2 expref: 3658 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.908310:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114edaaa41 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.908313:0:15474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d2d58c0/0xfc4b8e114edaaa1e lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761b2 expref: 3658 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.908314:0:15749:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaaa17 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176196 expref: 3445 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.908315:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ad686c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.908318:0:15474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2d58c0, rc 0) 00010000:00010000:2.0:1713279306.908318:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114edaaa41 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.908318:0:15749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaaa17 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176196 expref: 3445 pid: 15749 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.908319:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200060096 00000100:00100000:0.0:1713279306.908321:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200060096 00010000:00010000:2.0:1713279306.908323:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114edaaa41 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.908323:0:15749:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e6886c0, rc 0) 00000100:00100000:0.0:1713279306.908330:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98919 00010000:00010000:2.0:1713279306.908330:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00000100:00100000:0.0:1713279306.908332:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200060096:12345-0@lo:403:mdt_io00_011.0 00000100:00100000:1.0:1713279306.908332:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3657:11912:x1796503281283712:12345-192.168.203.4@tcp:101:touch.0 Request processed in 162us (217us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.908333:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.908335:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114edaaa41 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713279306.908337:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785499 00000100:00100000:3.0:1713279306.908337:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3444:12013:x1796503281283072:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 192us (239us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.908340:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad686c0/0xfc4b8e114edaaa41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:3.0:1713279306.908341:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785497 00010000:00010000:2.0:1713279306.908348:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114edaaa56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.908353:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114edaaa56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.908358:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114edaaa56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.908362:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e7ba400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.908364:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114edaaa56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713279306.908365:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.908369:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114edaaa56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.908375:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff880096b8e400) 00010000:00010000:2.0:1713279306.908377:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.908379:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114edaaa56 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:3.0:1713279306.908381:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281282944 00010000:00010000:2.0:1713279306.908383:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7ba400/0xfc4b8e114edaaa56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:3.0:1713279306.908384:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281282944 00000100:00100000:1.0:1713279306.908391:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.908393:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785501 00000100:00100000:3.0:1713279306.908397:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3444:11855:x1796503281282944:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.908404:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114edaaa25 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761b9 expref: 3727 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.908405:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281283456 00000100:00100000:3.0:1713279306.908406:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281283456 00010000:00010000:2.0:1713279306.908428:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baf4fc0/0xfc4b8e114edaaa25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761b9 expref: 3728 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.908428:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14363 00000100:00100000:3.0:1713279306.908431:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:385c4b71-808c-40cf-91de-b076b668d13f+3728:11736:x1796503281283456:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:2.0:1713279306.908436:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf4fc0, rc 0) 00010000:00010000:3.0:1713279306.908443:0:15514:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.908451:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538d80/0xfc4b8e114ed9dd65 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917298f expref: 3727 pid: 6934 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.908454:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3727:12004:x1796503281283840:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 276us (304us total) trans 4295202782 rc 301/301 00010000:00010000:3.0:1713279306.908457:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7f21:0x0].0x0 (ffff880096f32d00) 00000100:00100000:2.0:1713279306.908459:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785500 00010000:00010000:3.0:1713279306.908459:0:15514:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.908463:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.908468:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114edaa842 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaa811 expref: 56 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.908472:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.908474:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.908476:0:15480:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1713279306.908480:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114edaa842 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114edaa811 expref: 56 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.908486:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982400/0xfc4b8e114eda9f3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x258:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175ec5 expref: 3444 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.908486:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200060160:0@lo:104: 00010000:00010000:2.0:1713279306.908493:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x258:0x0].0x0 (ffff880096eff800) 00010000:00010000:2.0:1713279306.908498:0:15480:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.908500:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.908505:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaaa72 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x258:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391761ab expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.908507:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0780 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.908514:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200060160 00000100:00100000:3.0:1713279306.908516:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200060160 00000100:00100000:3.0:1713279306.908533:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33458 00000100:00100000:3.0:1713279306.908535:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15514:x1796503200060160:12345-0@lo:104: 00010000:00010000:3.0:1713279306.908540:0:6913:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.908552:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaaa79 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x258:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.908561:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaaa79 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.908561:0:6913:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1713279306.908563:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15514:x1796503200060160:12345-0@lo:104: Request processed in 27us (63us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.908567:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaaa79 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.908567:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33458 00010000:00010000:2.0:1713279306.908580:0:8071:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1713279306.908582:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200060160:0@lo:104: 00010000:00010000:2.0:1713279306.908584:0:8071:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.908599:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.908601:0:8071:0:(ldlm_lockd.c:1968:ldlm_handle_bl_callback()) Lock ffff880093691440 is referenced, will be cancelled later 00010000:00010000:2.0:1713279306.908604:0:8071:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.908608:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.908610:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.908611:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.908612:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.908614:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114edaaa80 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x71e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917618f expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.908619:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaaa87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x258:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.908625:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaaa87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x258:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.908630:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114edaaa80 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x71e6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917618f expref: 3445 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.908631:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaaa87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x258:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.908636:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f7840/0xfc4b8e114edaaa80 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x71e6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917618f expref: 3445 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.908643:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71e6:0x0].0x0 (ffff880090bee600) 00010000:00010000:3.0:1713279306.908644:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713279306.908645:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801250f7840, rc 0) 00000100:00100000:3.0:1713279306.908655:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3445:11855:x1796503281282944:12345-192.168.203.4@tcp:101:touch.0 Request processed in 258us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.908659:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785501 00000100:00100000:2.0:1713279306.908680:0:15480:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd40380 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-mdtlov_UUID:15480:1796503200060224:0@lo:1000:mdt00_016.0 00000100:00100000:2.0:1713279306.908701:0:15480:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.908711:0:15480:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801205139c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.908713:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200060224 00000100:00100000:3.0:1713279306.908715:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200060224 00000100:00100000:3.0:1713279306.908727:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98920 00000100:00100000:3.0:1713279306.908729:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+57:15480:x1796503200060224:12345-0@lo:1000:mdt00_016.0 00000100:00100000:3.0:1713279306.908757:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+58:15480:x1796503200060224:12345-0@lo:1000:mdt00_016.0 Request processed in 28us (56us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.908761:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98920 00000100:00100000:2.0:1713279306.908767:0:15480:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd40380 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-mdtlov_UUID:15480:1796503200060224:0@lo:1000:mdt00_016.0 00000100:00100000:1.0:1713279306.908910:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00080000:2.0:1713279306.908930:0:15480:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x1085:0x0], index 1: 0 00000100:00100000:3.0:1713279306.908940:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281283904 00000100:00100000:3.0:1713279306.908943:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281283904 00000100:00100000:1.0:1713279306.908957:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.908962:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147273 00000100:00100000:3.0:1713279306.908965:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3726:1954:x1796503281283904:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.908969:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.908972:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281283968 00000100:00100000:2.0:1713279306.908975:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281283968 00010000:00010000:3.0:1713279306.908976:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edaa968 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917615e expref: 3726 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.908983:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7abd:0x0].0x0 (ffff88008c2e7d00) 00010000:00010000:3.0:1713279306.908985:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.908992:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110569 00000100:00100000:3.0:1713279306.908993:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:1954:x1796503281283904:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 28us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.908997:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+92:12017:x1796503281283968:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:3.0:1713279306.908997:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147273 00010000:00010000:2.0:1713279306.909005:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.909014:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaaa8e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391761c0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.909028:0:15506:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009181db00/0xfc4b8e114eda7b01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175533 expref: 84 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.909034:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.909036:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.909039:0:15506:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaaa8e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [20480->45055] (req 20480->45055) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761c0 expref: 93 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.909055:0:15506:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009181db00/0xfc4b8e114eda7b01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->36863) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175533 expref: 84 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.909065:0:15506:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009181db00/0xfc4b8e114eda7b01 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->36863) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175533 expref: 84 pid: 9197 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.909088:0:15506:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15506:1796503200060288:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.909105:0:15506:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801205139c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.909165:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaaa95 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7730:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.909173:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaaa95 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7730:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.909179:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaaa95 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7730:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.909201:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaaa79 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.909207:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaaa79 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.909212:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaaa79 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.909218:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaaa79 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.909222:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f2aac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.909225:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaaa79 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.909230:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaaa79 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.909237:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x258:0x0].0x0 (ffff88011eea5d00) 00010000:00010000:2.0:1713279306.909239:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.909242:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaaa79 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.909247:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2aac0/0xfc4b8e114edaaa79 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000004:00010000:2.0:1713279306.909256:0:15480:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008be06a00 reply state ffff88009386e000 transno 4295183800 ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaaa87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x258:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.909261:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaaa87 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x258:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.909266:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x258:0x0].0x31 (ffff88011eea5b00) 00010000:00010000:2.0:1713279306.909268:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.909269:0:15480:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.909280:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f298c0/0xfc4b8e114edaaa72 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x258:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761ab expref: 3446 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.909288:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaaa95 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7730:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761ab expref: 3445 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.909291:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7730:0x0].0x0 (ffff88011eea5800) 00010000:00010000:2.0:1713279306.909293:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.909294:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed0ba80, rc 0) 00000100:00100000:2.0:1713279306.909305:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3446:12032:x1796503281283584:12345-192.168.203.4@tcp:101:touch.0 Request processed in 1140us (1199us total) trans 4295183800 rc 0/0 00000100:00100000:2.0:1713279306.909308:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785498 00000100:00100000:0.0:1713279306.909524:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200060096:12345-0@lo:403:mdt_io00_011.0 Request processed in 1189us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.909528:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98919 00000100:00100000:2.0:1713279306.909533:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be07b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060096:0@lo:403:mdt_io00_011.0 00010000:00010000:2.0:1713279306.909940:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008a0daac0/0xfc4b8e114edaaaa3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.909945:0:15534:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008a0daac0/0xfc4b8e114edaaaa3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.909949:0:15534:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008a0daac0/0xfc4b8e114edaaaa3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15534 initiator: MDT1 00000100:00100000:2.0:1713279306.909955:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd40e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060352:0@lo:101:mdt_io00_011.0 00000100:00100000:2.0:1713279306.909969:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.909984:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800976f9900 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.909995:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200060352 00000100:00100000:0.0:1713279306.909998:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200060352 00000100:00100000:0.0:1713279306.910011:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98921 00000100:00100000:0.0:1713279306.910014:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200060352:12345-0@lo:101:mdt_io00_011.0 00010000:00010000:0.0:1713279306.910019:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.910026:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086400/0xfc4b8e114edaaaaa lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114edaaaa3 expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.910035:0:15494:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086400/0xfc4b8e114edaaaaa lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114edaaaa3 expref: 57 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.910041:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086400/0xfc4b8e114edaaaaa lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaaaa3 expref: 57 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.910045:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x0 (ffff880097910d00) 00010000:00010000:0.0:1713279306.910046:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.910048:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f086400, rc 0) 00000100:00100000:0.0:1713279306.910063:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15534:x1796503200060352:12345-0@lo:101:mdt_io00_011.0 Request processed in 48us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.910066:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98921 00000100:00100000:2.0:1713279306.910080:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd40e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060352:0@lo:101:mdt_io00_011.0 00010000:00010000:2.0:1713279306.910086:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008a0daac0/0xfc4b8e114edaaaa3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaaaaa expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.910091:0:15534:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008a0daac0/0xfc4b8e114edaaaa3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaaaaa expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.910097:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24c:0x0] 00010000:00010000:2.0:1713279306.910105:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096a2fcc0/0xfc4b8e114edaaab1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.910108:0:15534:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096a2fcc0/0xfc4b8e114edaaab1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.910112:0:15534:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096a2fcc0/0xfc4b8e114edaaab1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15534 initiator: MDT1 00000100:00100000:2.0:1713279306.910117:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd40e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060416:0@lo:101:mdt_io00_011.0 00000100:00100000:2.0:1713279306.910137:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.910143:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800976f9900 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.910146:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200060416 00000100:00100000:0.0:1713279306.910148:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200060416 00000100:00100000:0.0:1713279306.910156:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98922 00000100:00100000:0.0:1713279306.910159:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15534:x1796503200060416:12345-0@lo:101:mdt_io00_011.0 00010000:00010000:0.0:1713279306.910163:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.910168:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0873c0/0xfc4b8e114edaaab8 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114edaaab1 expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.910175:0:15494:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0873c0/0xfc4b8e114edaaab8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114edaaab1 expref: 58 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.910181:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0873c0/0xfc4b8e114edaaab8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaaab1 expref: 58 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.910184:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x35 (ffff880097910400) 00010000:00010000:0.0:1713279306.910185:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.910186:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f0873c0, rc 0) 00000100:00100000:0.0:1713279306.910199:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+58:15534:x1796503200060416:12345-0@lo:101:mdt_io00_011.0 Request processed in 40us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.910202:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98922 00000100:00100000:2.0:1713279306.910206:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd40e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060416:0@lo:101:mdt_io00_011.0 00010000:00010000:2.0:1713279306.910211:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096a2fcc0/0xfc4b8e114edaaab1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaaab8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.910216:0:15534:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096a2fcc0/0xfc4b8e114edaaab1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaaab8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713279306.910224:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24c:0x0] 00010000:00010000:2.0:1713279306.910233:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaaabf lrc: 3/0,1 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.910242:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaaabf lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.910249:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaaabf lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.910257:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114edaaac6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x233:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.910263:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114edaaac6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.910268:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114edaaac6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.910286:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6ed2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.910294:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114ecc268a lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913064a expref: 3445 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.910301:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114edaa67b lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x6ed2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760af expref: 3656 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.910308:0:15534:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 5/0,1 mode: --/EX res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.910322:0:15534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114edaa67b lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6ed2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760af expref: 3656 pid: 15749 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.910330:0:15534:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114edaa67b lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x6ed2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760af expref: 3656 pid: 15749 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.910344:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd40e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001_UUID:15534:1796503200060480:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.910379:0:15534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114ecc268a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913064a expref: 3445 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.910387:0:15534:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114ecc268a lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913064a expref: 3445 pid: 15476 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.910395:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd42d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001_UUID:15534:1796503200060544:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.910409:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800976f9900 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.910630:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.910694:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281284096 00000100:00100000:3.0:1713279306.910698:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281284096 00000100:00100000:3.0:1713279306.910717:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223126 00000100:00100000:3.0:1713279306.910721:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3657:11854:x1796503281284096:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.910786:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3658:11854:x1796503281284096:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 64us (156us total) trans 4295183801 rc 0/0 00000100:00100000:3.0:1713279306.910791:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223126 00000100:00100000:0.0:1713279306.910853:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.910880:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.910881:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281284224 00000100:00100000:2.0:1713279306.910885:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281284224 00000100:00100000:2.0:1713279306.910896:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281284352 00000100:00100000:2.0:1713279306.910898:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281284352 00000100:00100000:2.0:1713279306.910906:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785502 00000100:00100000:2.0:1713279306.910909:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3726:11711:x1796503281284224:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.910910:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785503 00000100:00100000:0.0:1713279306.910913:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11204:x1796503281284352:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.910915:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.910920:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.910921:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114edaaad4 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391761c7 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.910925:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0846c0/0xfc4b8e114edaaadb lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391761ce expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.910944:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edaaae2 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.910948:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edaaae2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.910952:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edaaae2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.910955:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaaae9 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.910958:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114edaaaf0 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.910960:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaaae9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.910964:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaaae9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.910972:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689f80/0xfc4b8e114edaaaf7 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.910976:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689f80/0xfc4b8e114edaaaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.910979:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689f80/0xfc4b8e114edaaaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000004:00200000:2.0:1713279306.910986:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:2.0:1713279306.910991:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaaae9 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.910993:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaaae9 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.910997:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaaae9 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.911000:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaaae9 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.911002:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68b600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.911004:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaaae9 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.911007:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaaae9 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.911008:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114edaaaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.911011:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880091738a00) 00010000:00010000:2.0:1713279306.911012:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.911013:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114edaaaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.911013:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaaae9 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.911018:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0xfc4b8e114edaaae9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.911023:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689f80/0xfc4b8e114edaaaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.911026:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edaaae2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.911026:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689f80/0xfc4b8e114edaaaf7 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.911029:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689f80/0xfc4b8e114edaaaf7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.911031:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edaaae2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.911032:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.911033:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689f80/0xfc4b8e114edaaaf7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.911034:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edaaae2 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.911036:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689f80/0xfc4b8e114edaaaf7 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.911037:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edaaae2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.911039:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880096da6400) 00010000:00010000:0.0:1713279306.911040:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f085b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.911040:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.911041:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edaaae2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.911041:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689f80/0xfc4b8e114edaaaf7 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.911044:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edaaae2 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.911044:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689f80/0xfc4b8e114edaaaf7 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.911048:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:0.0:1713279306.911049:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.911051:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edaaae2 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.911053:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edaaae2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.911056:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114edaaad4 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761c7 expref: 3727 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.911058:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114edaaaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.911060:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ad00/0xfc4b8e114edaaad4 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761c7 expref: 3727 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.911061:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114edaaaf0 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.911062:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.911064:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114edaaaf0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.911064:0:15506:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15506:1796503200060288:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.911079:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f192ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.911080:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114edaaaf0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.911081:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68ad00, rc 0) 00010000:00010000:0.0:1713279306.911083:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114edaaaf0 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.911087:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880097910a00) 00010000:00010000:0.0:1713279306.911088:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.911088:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaaa8e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [20480->45055] (req 20480->45055) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761c0 expref: 93 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.911090:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114edaaaf0 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.911092:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f192ac0/0xfc4b8e114edaaaf0 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.911096:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed098c0, rc 0) 00000100:00100000:2.0:1713279306.911098:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3726:11711:x1796503281284224:12345-192.168.203.4@tcp:101:touch.0 Request processed in 188us (246us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.911103:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785502 00000100:00100000:1.0:1713279306.911104:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.911118:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+93:12017:x1796503281283968:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 2112us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.911123:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110569 00000100:00100000:3.0:1713279306.911136:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281284416 00000100:00100000:3.0:1713279306.911138:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281284416 00000100:00100000:1.0:1713279306.911141:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.911145:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009181db00/0xfc4b8e114eda7b01 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->36863) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175533 expref: 85 pid: 9197 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.911153:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281284608 00000100:00100000:2.0:1713279306.911155:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281284608 00000100:00100000:3.0:1713279306.911156:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196594 00000100:00100000:3.0:1713279306.911159:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281284416:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.911163:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.911164:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110570 00000100:00100000:2.0:1713279306.911166:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+93:1956:x1796503281284608:12345-192.168.203.4@tcp:2:touch.0 00010000:00010000:3.0:1713279306.911170:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009181db00/0xfc4b8e114eda7b01 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->36863) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175533 expref: 85 pid: 9197 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.911174:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0846c0/0xfc4b8e114edaaadb lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761ce expref: 3726 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.911176:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009181db00/0xfc4b8e114eda7b01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->36863) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175533 expref: 85 pid: 9197 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.911179:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0846c0/0xfc4b8e114edaaadb lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761ce expref: 3726 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.911183:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f0846c0, rc 0) 00010000:00010000:3.0:1713279306.911185:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009181db00/0xfc4b8e114eda7b01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->36863) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175533 expref: 85 pid: 9197 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.911190:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.911192:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.911195:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaaa8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761c0 expref: 93 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.911197:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:11204:x1796503281284352:12345-192.168.203.4@tcp:101:touch.0 Request processed in 283us (316us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.911200:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaaa8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761c0 expref: 93 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.911201:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785503 00010000:00010000:3.0:1713279306.911211:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaaa8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761c0 expref: 94 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.911217:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6917:1796503200060608:192.168.203.4@tcp:105: 00000100:00100000:2.0:1713279306.911228:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+94:1956:x1796503281284608:12345-192.168.203.4@tcp:2:touch.0 Request processed in 60us (87us total) trans 4295010198 rc 0/0 00000100:00100000:3.0:1713279306.911231:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0600 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.911232:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110570 00000100:00100000:0.0:1713279306.911234:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.911238:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281284544 00000100:00100000:3.0:1713279306.911240:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281284544 00000100:00100000:1.0:1713279306.911243:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.911250:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223127 00010000:00010000:2.0:1713279306.911251:0:15534:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff88008bd40e00 x1796503200060480) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114edaa67b lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x6ed2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760af expref: 3657 pid: 15749 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.911253:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c569450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:10814:x1796503281284544:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:2.0:1713279306.911257:0:15534:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114edaa67b lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6ed2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760af expref: 3657 pid: 15749 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.911265:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092340d80/0xfc4b8e114edaa67b lrc: 0/0,0 mode: --/PW res: [0x240000403:0x6ed2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391760af expref: 3657 pid: 15749 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.911271:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd40e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001_UUID:15534:1796503200060480:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.911272:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281284864 00000100:00100000:0.0:1713279306.911274:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281284864 00000100:00100000:2.0:1713279306.911276:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd42d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001_UUID:15534:1796503200060544:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.911281:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.911282:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6ed2:0x0].0x0 (ffff8800939e3a00) 00010000:00010000:2.0:1713279306.911284:0:15534:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00000100:00100000:0.0:1713279306.911285:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281284928 00000100:00100000:0.0:1713279306.911286:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281284928 00010000:00010000:2.0:1713279306.911288:0:15534:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.911291:0:15534:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00000100:00100000:0.0:1713279306.911294:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785504 00010000:00010000:2.0:1713279306.911294:0:15534:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00000100:00100000:0.0:1713279306.911297:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3657:11912:x1796503281284864:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.911301:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281284672 00000100:00100000:3.0:1713279306.911302:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c569450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3726:10814:x1796503281284544:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 48us (199us total) trans 4295202783 rc 0/0 00010000:00010000:0.0:1713279306.911303:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.911303:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785505 00000100:00100000:2.0:1713279306.911303:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281284672 00000100:00100000:3.0:1713279306.911307:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223127 00010000:00010000:0.0:1713279306.911308:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114edaaafe lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391761d5 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.911308:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3447:12032:x1796503281284928:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1713279306.911309:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114ecc268a lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913064a expref: 3447 pid: 15476 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.911317:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196595 00000100:00100000:2.0:1713279306.911320:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096756d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3447:1956:x1796503281284672:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.911324:0:15658:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.911324:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.911326:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114edaab05 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.911326:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114ecc268a lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913064a expref: 3447 pid: 15476 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.911331:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114edaab05 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.911331:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114ecc268a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913064a expref: 3447 pid: 15476 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.911333:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edaaa95 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7730:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761ab expref: 3447 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.911334:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114edaab05 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.911337:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114ecc268a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6ed2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3913064a expref: 3447 pid: 15476 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.911339:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114edaab0c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.911341:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7730:0x0].0x0 (ffff88011eea5800) 00010000:00010000:2.0:1713279306.911341:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6ed2:0x0].0x0 (ffff8800939e3a00) 00010000:00010000:0.0:1713279306.911343:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114edaab0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.911343:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.911345:0:15658:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.911346:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114edaab0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.911346:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.911349:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.911355:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114edaab05 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.911356:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.911358:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114edaab05 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.911361:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114edaab05 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.911364:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114edaab05 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.911365:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096756d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3445:1956:x1796503281284672:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 44us (123us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.911365:0:15534:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.911366:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134926f40 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.911368:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196595 00010000:00010000:0.0:1713279306.911369:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114edaab05 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.911370:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaab13 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x7730:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.911371:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.911372:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114edaab05 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.911375:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaab13 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7730:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.911376:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880097910000) 00010000:00010000:0.0:1713279306.911377:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.911378:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114edaab05 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.911379:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaab13 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7730:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.911381:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134926f40/0xfc4b8e114edaab05 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.911385:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114edaab0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.911388:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114edaab0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.911391:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114edaab0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.911394:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134927180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.911395:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114edaab0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.911397:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114edaab0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.911400:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff880097910c00) 00010000:00010000:0.0:1713279306.911401:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.911403:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114edaab0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000004:00010000:1.0:1713279306.911407:0:15658:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880096756680 reply state ffff8800726b5000 transno 4295183802 ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaab13 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7730:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.911408:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134927180/0xfc4b8e114edaab0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.911434:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114edaaafe lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761d5 expref: 3658 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.911435:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaab13 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7730:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.911437:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060672:0@lo:1000:mdt_io00_011.0 00010000:00010000:0.0:1713279306.911438:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801349258c0/0xfc4b8e114edaaafe lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761d5 expref: 3658 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.911439:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7730:0x0].0x0 (ffff88012061fd00) 00010000:00010000:1.0:1713279306.911441:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.911442:0:15658:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713279306.911443:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801349258c0, rc 0) 00000100:00100000:0.0:1713279306.911456:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3657:11912:x1796503281284864:12345-192.168.203.4@tcp:101:touch.0 Request processed in 158us (222us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.911459:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785504 00000100:00100000:3.0:1713279306.911461:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.911469:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3446:12032:x1796503281284928:12345-192.168.203.4@tcp:36:touch.0 Request processed in 161us (186us total) trans 4295183802 rc 0/0 00000100:00100000:1.0:1713279306.911475:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785505 00000100:00100000:3.0:1713279306.911482:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.911483:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200060672 00000100:00100000:0.0:1713279306.911485:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200060672 00000100:00100000:0.0:1713279306.911493:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98923 00000100:00100000:0.0:1713279306.911496:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+58:15534:x1796503200060672:12345-0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.911603:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+58:15534:x1796503200060672:12345-0@lo:1000:mdt_io00_011.0 Request processed in 105us (141us total) trans 0 rc -2/-2 00000100:00100000:0.0:1713279306.911608:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98923 00000100:00100000:3.0:1713279306.911614:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060672:0@lo:1000:mdt_io00_011.0 00000100:00100000:3.0:1713279306.911635:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060736:0@lo:1000:mdt_io00_011.0 00000100:00100000:3.0:1713279306.911648:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.911654:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.911657:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200060736 00000100:00100000:0.0:1713279306.911659:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200060736 00000100:00100000:0.0:1713279306.911667:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98924 00000100:00100000:0.0:1713279306.911674:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+58:15534:x1796503200060736:12345-0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.911699:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+58:15534:x1796503200060736:12345-0@lo:1000:mdt_io00_011.0 Request processed in 24us (50us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.911712:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060736:0@lo:1000:mdt_io00_011.0 00000100:00100000:3.0:1713279306.911741:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060800:0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.911772:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98924 00000100:00100000:3.0:1713279306.911804:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.911812:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.911814:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200060800 00000100:00100000:0.0:1713279306.911816:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200060800 00000100:00100000:0.0:1713279306.911824:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98925 00000100:00100000:0.0:1713279306.911826:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+58:15534:x1796503200060800:12345-0@lo:1000:mdt_io00_011.0 00000100:00100000:1.0:1713279306.911860:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.911903:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281285056 00000100:00100000:2.0:1713279306.911907:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281285056 00000100:00100000:3.0:1713279306.911911:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6917:1796503200060608:192.168.203.4@tcp:105: 00010000:00010000:3.0:1713279306.911917:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.911924:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785506 00000100:00100000:2.0:1713279306.911928:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3657:11711:x1796503281285056:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.911931:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+84:1957:x1796503281284416:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 771us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.911934:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.911936:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.911936:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196594 00010000:00010000:2.0:1713279306.911944:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaab1a lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391761dc expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.911948:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+58:15534:x1796503200060800:12345-0@lo:1000:mdt_io00_011.0 Request processed in 119us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.911951:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98925 00000100:00100000:3.0:1713279306.911953:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060800:0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.911961:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281285184 00000100:00100000:0.0:1713279306.911963:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281285184 00000100:00100000:0.0:1713279306.911972:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785507 00010000:00010000:2.0:1713279306.911973:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaab21 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.911975:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3446:11204:x1796503281285184:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.911980:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.911980:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaab21 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.911983:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.911986:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114edaab28 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391761e3 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.911987:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaab21 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.911999:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281285248 00000100:00100000:2.0:1713279306.912002:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281285248 00000100:00100000:2.0:1713279306.912017:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110571 00000100:00100000:2.0:1713279306.912021:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+94:1956:x1796503281285248:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:3.0:1713279306.912049:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060864:0@lo:1000:mdt_io00_011.0 00000100:00100000:3.0:1713279306.912063:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.912081:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.912085:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c09c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.912086:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114edaab2f lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.912092:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114edaab2f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.912093:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281285376 00000100:00100000:1.0:1713279306.912095:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.912095:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281285376 00010000:00010000:0.0:1713279306.912096:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114edaab2f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912101:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114edaab36 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.912105:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114edaab36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.912105:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281285568 00000100:00100000:3.0:1713279306.912107:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281285568 00010000:00010000:0.0:1713279306.912108:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114edaab36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.912109:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.912114:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223128 00000004:00200000:0.0:1713279306.912117:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00000100:00100000:3.0:1713279306.912117:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3448:11855:x1796503281285376:12345-192.168.203.4@tcp:35:touch.0 00010000:00010000:0.0:1713279306.912121:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114edaab2f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912125:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114edaab2f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912128:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114edaab2f lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912131:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114edaab2f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00002000:00010000:2.0:1713279306.912174:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb size from disk: 42048 -> 42048 00000100:00100000:3.0:1713279306.912175:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3449:11855:x1796503281285376:12345-192.168.203.4@tcp:35:touch.0 Request processed in 57us (107us total) trans 4295183803 rc 0/0 00010000:00010000:0.0:1713279306.912177:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323840 already unused, calling callback (ffffffffa0f0d730) 00002000:00010000:2.0:1713279306.912178:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00010000:00010000:0.0:1713279306.912179:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114edaab2f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00002000:00010000:2.0:1713279306.912180:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00000100:00100000:3.0:1713279306.912181:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223128 00010000:00010000:0.0:1713279306.912182:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114edaab2f lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00002000:00010000:2.0:1713279306.912182:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.912184:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb blocks from disk: 72 -> 32 00010000:00010000:0.0:1713279306.912187:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:0.0:1713279306.912188:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.912189:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223129 00010000:00010000:0.0:1713279306.912190:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114edaab2f lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.912192:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3726:10814:x1796503281285568:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:0.0:1713279306.912193:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323840/0xfc4b8e114edaab2f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912198:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114edaab36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912201:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114edaab36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.912203:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.912205:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+95:1956:x1796503281285248:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 182us (220us total) trans 4295010199 rc 0/0 00010000:00010000:0.0:1713279306.912207:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114edaab36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912209:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.912211:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114edaab36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.912212:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110571 00010000:00010000:0.0:1713279306.912213:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114edaab36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912216:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880131200300) 00010000:00010000:0.0:1713279306.912217:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.912218:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114edaab36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912221:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321f80/0xfc4b8e114edaab36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.912233:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281285504 00010000:00010000:0.0:1713279306.912236:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114edaab28 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761e3 expref: 3448 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.912236:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281285504 00000100:00100000:3.0:1713279306.912237:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:10814:x1796503281285568:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 44us (140us total) trans 4295202784 rc 0/0 00010000:00010000:0.0:1713279306.912240:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e5f5200/0xfc4b8e114edaab28 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761e3 expref: 3449 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.912241:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223129 00010000:00010000:0.0:1713279306.912244:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e5f5200, rc 0) 00000100:00100000:3.0:1713279306.912255:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281285696 00000100:00100000:3.0:1713279306.912257:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281285696 00000100:00100000:0.0:1713279306.912258:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3448:11204:x1796503281285184:12345-192.168.203.4@tcp:101:touch.0 Request processed in 282us (325us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.912259:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785508 00000100:00100000:0.0:1713279306.912263:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785507 00000100:00100000:2.0:1713279306.912264:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3448:12032:x1796503281285504:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.912272:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785509 00010000:00010000:2.0:1713279306.912272:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.912275:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3659:11912:x1796503281285696:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.912280:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.912280:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114edaab3d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x7730:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391761ea expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.912286:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edaab44 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391761f1 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.912299:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114edaab3d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x7730:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761ea expref: 3448 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.912308:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880089fe1680/0xfc4b8e114edaab3d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x7730:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761ea expref: 3448 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.912315:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaab4b lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.912318:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7730:0x0].0x0 (ffff88012061fd00) 00010000:00010000:2.0:1713279306.912328:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1713279306.912330:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaab4b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.912330:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880089fe1680, rc 0) 00010000:00010000:0.0:1713279306.912334:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaab4b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912339:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edaab52 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.912343:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edaab52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912346:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edaab52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.912350:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3448:12032:x1796503281285504:12345-192.168.203.4@tcp:101:touch.0 Request processed in 84us (238us total) trans 0 rc 0/0 00000004:00200000:0.0:1713279306.912353:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00000100:00100000:2.0:1713279306.912356:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785508 00010000:00010000:0.0:1713279306.912358:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaab4b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912360:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaab4b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912363:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaab4b lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912366:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaab4b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912371:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.912373:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaab4b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912376:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaab4b lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.912377:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaab59 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.912379:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096a85600) 00010000:00010000:0.0:1713279306.912380:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.912382:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaab4b lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912384:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edaab4b lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.912384:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaab59 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.912389:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edaab52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.912390:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaab59 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.912392:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edaab52 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912395:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edaab52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912398:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.912399:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edaab52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912402:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edaab52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.912405:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880096e84a00) 00010000:00010000:0.0:1713279306.912406:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.912407:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edaab52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.912407:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaab21 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.912410:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edaab52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.912432:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaab21 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.912437:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaab21 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.912442:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaab21 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.912443:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edaab44 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761f1 expref: 3660 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.912447:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092920240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.912448:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edaab44 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761f1 expref: 3660 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.912450:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaab21 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.912453:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d323cc0, rc 0) 00010000:00010000:2.0:1713279306.912456:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaab21 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.912463:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880096da6800) 00010000:00010000:2.0:1713279306.912465:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.912467:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaab21 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.912468:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3659:11912:x1796503281285696:12345-192.168.203.4@tcp:101:touch.0 Request processed in 193us (266us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.912472:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785509 00010000:00010000:2.0:1713279306.912476:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092920240/0xfc4b8e114edaab21 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.912482:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200060864 00000100:00100000:0.0:1713279306.912484:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200060864 00010000:00010000:2.0:1713279306.912484:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaab59 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.912489:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaab59 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.912491:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98926 00010000:00010000:2.0:1713279306.912493:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaab59 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.912494:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+58:15534:x1796503200060864:12345-0@lo:1000:mdt_io00_011.0 00010000:00010000:2.0:1713279306.912498:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd73c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.912500:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaab59 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.912505:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaab59 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.912510:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880136671500) 00010000:00010000:2.0:1713279306.912513:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.912515:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaab59 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.912518:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+58:15534:x1796503200060864:12345-0@lo:1000:mdt_io00_011.0 Request processed in 23us (453us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.912519:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edaab59 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.912521:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98926 00000100:00100000:3.0:1713279306.912532:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060864:0@lo:1000:mdt_io00_011.0 00010000:00010000:2.0:1713279306.912537:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaab1a lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761dc expref: 3658 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.912544:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaab1a lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761dc expref: 3658 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.912557:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e689d40, rc 0) 00000100:00100000:2.0:1713279306.912576:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3657:11711:x1796503281285056:12345-192.168.203.4@tcp:101:touch.0 Request processed in 647us (718us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.912583:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785506 00000100:00100000:3.0:1713279306.912583:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060928:0@lo:1000:mdt_io00_011.0 00000100:00100000:3.0:1713279306.912605:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.912615:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.912617:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200060928 00000100:00100000:0.0:1713279306.912620:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200060928 00000100:00100000:0.0:1713279306.912631:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98927 00000100:00100000:0.0:1713279306.912633:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:15534:x1796503200060928:12345-0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.912667:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:15534:x1796503200060928:12345-0@lo:1000:mdt_io00_011.0 Request processed in 33us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.912672:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98927 00000100:00100000:3.0:1713279306.912677:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060928:0@lo:1000:mdt_io00_011.0 00000040:00080000:3.0:1713279306.912834:0:15534:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x1c0:0x0].1548, 1448 off833528 00000040:00080000:3.0:1713279306.912856:0:15534:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xf8:0x0].2155, 1528 off1532168 00000100:00100000:3.0:1713279306.912869:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060992:0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.912880:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.912884:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.912899:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801205139c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.912916:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200060992 00000100:00100000:2.0:1713279306.912919:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281285760 00000100:00100000:1.0:1713279306.912920:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200060992 00000100:00100000:2.0:1713279306.912922:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281285760 00000100:00100000:1.0:1713279306.912934:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98928 00000100:00100000:1.0:1713279306.912938:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:15534:x1796503200060992:12345-0@lo:1000:mdt_io00_011.0 00000100:00100000:2.0:1713279306.912939:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110572 00000100:00100000:2.0:1713279306.912944:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:1957:x1796503281285760:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:1.0:1713279306.912998:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:15534:x1796503200060992:12345-0@lo:1000:mdt_io00_011.0 Request processed in 59us (113us total) trans 4295010138 rc 0/0 00000100:00100000:0.0:1713279306.913001:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.913003:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98928 00000100:00100000:3.0:1713279306.913007:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200060992:0@lo:1000:mdt_io00_011.0 00000004:00080000:3.0:1713279306.913012:0:15534:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8801250c09c0 with version 32019 00000100:00100000:0.0:1713279306.913022:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00080000:0.0:1713279306.913030:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32019 rpc_version 32019 00000100:00100000:3.0:1713279306.913031:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281286016 00000100:00100000:3.0:1713279306.913034:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281286016 00000100:00100000:2.0:1713279306.913036:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+102:1957:x1796503281285760:12345-192.168.203.4@tcp:2:touch.0 Request processed in 90us (155us total) trans 4295010139 rc 0/0 00000100:00100000:2.0:1713279306.913042:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110572 00000020:00100000:0.0:1713279306.913044:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713279306.913046:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223130 00000100:00100000:0.0:1713279306.913047:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880090eb9c00 x1796503200061120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3456/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.913049:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3727:12017:x1796503281286016:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.913056:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281285888 00000100:00100000:0.0:1713279306.913057:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090eb9c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200061120:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1713279306.913059:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281285888 00000100:00100000:0.0:1713279306.913086:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.913090:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785510 00000100:00100000:2.0:1713279306.913095:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3729:11204:x1796503281285888:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.913100:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200061120 00010000:00010000:2.0:1713279306.913102:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.913103:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200061120 00010000:00010000:2.0:1713279306.913110:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114edaab60 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391761f8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.913115:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98929 00000100:00100000:3.0:1713279306.913126:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3730:12017:x1796503281286016:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 68us (95us total) trans 4295202785 rc 0/0 00000100:00100000:1.0:1713279306.913127:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+58:8074:x1796503200061120:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279306.913131:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223130 00000100:00100000:0.0:1713279306.913146:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f48f600 going to sleep for 11 seconds 00010000:00010000:2.0:1713279306.913147:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114edaab67 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913154:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114edaab67 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913161:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114edaab67 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913169:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114edaab6e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913174:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114edaab6e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.913180:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.913180:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114edaab6e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913195:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114edaab67 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913201:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114edaab67 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913206:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114edaab67 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913211:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114edaab67 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913216:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.913218:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114edaab67 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913223:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114edaab67 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913230:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:2.0:1713279306.913232:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.913235:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114edaab67 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913240:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114edaab67 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913248:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114edaab6e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913253:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114edaab6e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913259:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114edaab6e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913263:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd61c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.913265:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114edaab6e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913270:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114edaab6e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913276:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880136671800) 00010000:00010000:2.0:1713279306.913278:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.913280:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114edaab6e lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.913282:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.913285:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd61c0/0xfc4b8e114edaab6e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913302:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114edaab60 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761f8 expref: 3729 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.913308:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281286144 00010000:00010000:2.0:1713279306.913309:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114edaab60 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761f8 expref: 3729 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.913310:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281286144 00010000:00010000:2.0:1713279306.913316:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd46c0, rc 0) 00000100:00100000:3.0:1713279306.913320:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281286272 00000100:00100000:3.0:1713279306.913321:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281286272 00000100:00100000:3.0:1713279306.913328:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785511 00000100:00100000:3.0:1713279306.913331:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3658:11912:x1796503281286144:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.913336:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3728:11204:x1796503281285888:12345-192.168.203.4@tcp:101:touch.0 Request processed in 240us (334us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.913336:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.913342:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785510 00010000:00010000:3.0:1713279306.913343:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114edaab75 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391761ff expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.913353:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785512 00000100:00100000:2.0:1713279306.913367:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3726:11711:x1796503281286272:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.913374:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.913376:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114edaab7c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.913381:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114edaab83 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176206 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.913381:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114edaab7c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.913386:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114edaab7c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.913392:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114edaab8a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.913395:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114edaab8a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.913398:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114edaab8a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.913432:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114edaab7c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.913436:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114edaab7c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.913439:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaab91 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.913440:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114edaab7c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.913442:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114edaab7c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.913445:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801250f5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.913446:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaab91 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.913447:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114edaab7c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.913450:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114edaab7c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.913453:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaab91 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.913454:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880094168500) 00010000:00010000:3.0:1713279306.913456:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.913457:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114edaab7c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.913460:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaab98 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.913460:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f5440/0xfc4b8e114edaab7c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713279306.913463:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+59:8074:x1796503200061120:12345-0@lo:1000:osp_up0-1.0 Request processed in 344us (375us total) trans 4295202786 rc 0/0 00010000:00010000:2.0:1713279306.913466:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaab98 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.913466:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114edaab8a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713279306.913468:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98929 00010000:00010000:3.0:1713279306.913469:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114edaab8a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.913472:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaab98 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.913472:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114edaab8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.913475:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131e35f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.913476:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114edaab8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.913479:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114edaab8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.913482:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff8800908e1e00) 00010000:00010000:3.0:1713279306.913483:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:2.0:1713279306.913484:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:3.0:1713279306.913485:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114edaab8a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.913487:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131e35f80/0xfc4b8e114edaab8a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.913490:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaab91 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913495:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaab91 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.913500:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114edaab75 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761ff expref: 3659 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.913501:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaab91 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.913504:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250f6ac0/0xfc4b8e114edaab75 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761ff expref: 3659 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.913506:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaab91 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913510:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.913510:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801250f6ac0, rc 0) 00010000:00010000:2.0:1713279306.913513:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaab91 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.913518:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaab91 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.913520:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090eb9c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200061120:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1713279306.913524:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880136671300) 00010000:00010000:2.0:1713279306.913526:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.913527:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3658:11912:x1796503281286144:12345-192.168.203.4@tcp:101:touch.0 Request processed in 194us (347us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.913529:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaab91 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:3.0:1713279306.913531:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785511 00000004:00010000:1.0:1713279306.913532:0:15534:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880099c2ed80 reply state ffff88008f7cc000 transno 4295183804 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.913534:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edaab91 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.913540:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.913541:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaab98 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.913544:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6ed2:0x0].0x0 (ffff8800939e3a00) 00010000:00010000:1.0:1713279306.913546:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1713279306.913548:0:15534:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713279306.913548:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaab98 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.913551:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaaabf lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.913553:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaab98 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.913554:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaaabf lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.913557:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaaabf lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.913557:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.913559:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaab98 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.913561:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaaabf lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.913563:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096a2d680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.913565:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaaabf lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.913567:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaab98 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.913568:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaaabf lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.913572:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff880089dc2100) 00010000:00010000:1.0:1713279306.913573:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.913573:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880136671000) 00010000:00010000:1.0:1713279306.913575:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaaabf lrc: 3/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.913575:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.913577:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaab98 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.913578:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edaaabf lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279306.913582:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edaab98 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000004:00010000:1.0:1713279306.913585:0:15534:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880099c2ed80 reply state ffff88008f7cc000 transno 4295183804 ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114edaaac6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.913589:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114edaaac6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.913592:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x35 (ffff880094e7b100) 00010000:00010000:1.0:1713279306.913594:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.913594:0:15534:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1713279306.913596:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24c:0x0] 00010000:00010000:2.0:1713279306.913601:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114edaab83 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176206 expref: 3727 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.913608:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114edaab83 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176206 expref: 3727 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.913614:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008a0daac0/0xfc4b8e114edaaaa3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaaaaa expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.913615:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd7180, rc 0) 00010000:00010000:1.0:1713279306.913618:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008a0daac0/0xfc4b8e114edaaaa3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edaaaaa expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.913622:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008a0daac0/0xfc4b8e114edaaaa3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edaaaaa expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.913629:0:15534:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1713279306.913631:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24c:0x0] 00010000:00010000:1.0:1713279306.913633:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096a2fcc0/0xfc4b8e114edaaab1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaaab8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.913634:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713279306.913637:0:15534:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096a2fcc0/0xfc4b8e114edaaab1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaaab8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.913638:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008a0daac0/0xfc4b8e114edaaaa3 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114edaaaaa expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.913642:0:9214:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a0daac0 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:3.0:1713279306.913645:0:9214:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008a0daac0/0xfc4b8e114edaaaa3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114edaaaaa expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713279306.913650:0:9214:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008a0daac0/0xfc4b8e114edaaaa3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114edaaaaa expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.913662:0:9214:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008a0daac0/0xfc4b8e114edaaaa3 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaaaaa expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.913666:0:9214:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.913679:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008a0daac0/0xfc4b8e114edaaaa3 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaaaaa expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.913682:0:9214:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008a0daac0/0xfc4b8e114edaaaa3 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaaaaa expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.913686:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3726:11711:x1796503281286272:12345-192.168.203.4@tcp:101:touch.0 Request processed in 327us (403us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.913689:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.913690:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.913691:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279306.913693:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785512 00000100:00100000:3.0:1713279306.913695:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:1.0:1713279306.913696:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x84a3:0x0] 00010000:00010000:1.0:1713279306.913699:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.913700:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200061184:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.913703:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.913706:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.913713:0:15534:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1713279306.913718:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.913723:0:6919:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713279306.913728:0:6919:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.913729:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200061184 00000100:00100000:3.0:1713279306.913731:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200061184 00010000:00010000:2.0:1713279306.913734:0:6919:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093691440 already unused, calling callback (ffffffffa0f0e520) 00000100:00100000:1.0:1713279306.913737:0:15534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_011:385c4b71-808c-40cf-91de-b076b668d13f+3658:11876:x1796503281280512:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 10355us (10385us total) trans 4295183804 rc 0/0 00010000:00010000:2.0:1713279306.913738:0:6919:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.913741:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147274 00000100:00100000:1.0:1713279306.913742:0:15534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14362 00000100:00100000:3.0:1713279306.913744:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006dfc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+59:3492:x1796503200061184:12345-0@lo:103:ldlm_bl.0 00000004:00010000:2.0:1713279306.913748:0:6919:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.913749:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.913755:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086400/0xfc4b8e114edaaaaa lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114edaaaa3 expref: 59 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.913763:0:6919:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.913763:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x0 (ffff880097910d00) 00010000:00010000:3.0:1713279306.913766:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.913769:0:6919:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1713279306.913778:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006dfc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+58:3492:x1796503200061184:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (59us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.913780:0:6919:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.913782:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147274 00010000:00010000:2.0:1713279306.913786:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093691440/0xfc4b8e114edaa811 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114edaa842 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.913796:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.913798:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.913800:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279306.913800:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713279306.913804:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200061248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.913814:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.913825:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.913830:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200061248 00000100:00100000:2.0:1713279306.913833:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200061248 00000100:00100000:3.0:1713279306.913836:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200061184:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.913844:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114edaa842 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfc4b8e114edaa811 expref: 58 pid: 15580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.913845:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281286400 00000100:00100000:3.0:1713279306.913847:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281286400 00000100:00100000:3.0:1713279306.913857:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223131 00000100:00100000:2.0:1713279306.913859:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196596 00000100:00100000:3.0:1713279306.913859:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3448:12032:x1796503281286400:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1713279306.913863:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096756d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+58:3491:x1796503200061248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.913870:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.913928:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3449:12032:x1796503281286400:12345-192.168.203.4@tcp:35:touch.0 Request processed in 67us (103us total) trans 4295183805 rc 0/0 00000100:00100000:3.0:1713279306.913932:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223131 00000100:00100000:0.0:1713279306.914316:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.914359:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281286528 00000100:00100000:2.0:1713279306.914362:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281286528 00000100:00100000:2.0:1713279306.914379:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785513 00000100:00100000:2.0:1713279306.914384:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3658:11912:x1796503281286528:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.914394:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.914401:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114edaab9f lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917620d expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.914463:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edaaba6 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.914471:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edaaba6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914477:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edaaba6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914486:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114edaabad lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.914492:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114edaabad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914498:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114edaabad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000004:00200000:2.0:1713279306.914509:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:2.0:1713279306.914517:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edaaba6 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914522:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edaaba6 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.914523:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.914527:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edaaba6 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914532:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edaaba6 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.914537:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.914541:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.914543:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edaaba6 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914549:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edaaba6 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.914551:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281286656 00000100:00100000:0.0:1713279306.914553:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281286656 00010000:00010000:2.0:1713279306.914556:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880136671a00) 00010000:00010000:2.0:1713279306.914558:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.914561:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edaaba6 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.914563:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281286784 00000100:00100000:0.0:1713279306.914564:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281286784 00010000:00010000:2.0:1713279306.914566:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edaaba6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914574:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114edaabad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914579:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114edaabad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914584:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114edaabad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914588:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.914591:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114edaabad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914595:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114edaabad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914601:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880136671600) 00000100:00100000:3.0:1713279306.914602:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785514 00010000:00010000:2.0:1713279306.914603:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.914606:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114edaabad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.914608:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3661:11711:x1796503281286656:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.914611:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114edaabad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.914616:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.914617:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785515 00000100:00100000:0.0:1713279306.914620:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3661:11876:x1796503281286784:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1713279306.914624:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114edaabb4 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176214 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.914629:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114edaab9f lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917620d expref: 3661 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.914634:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114edaab9f lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917620d expref: 3662 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.914639:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd7840, rc 0) 00000100:00100000:1.0:1713279306.914647:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.914651:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321d40/0xfc4b8e114edaabc2 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.914651:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8f840/0xfc4b8e114edaabbb lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.914656:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321d40/0xfc4b8e114edaabc2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713279306.914657:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3661:11912:x1796503281286528:12345-192.168.203.4@tcp:101:touch.0 Request processed in 273us (341us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.914659:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8f840/0xfc4b8e114edaabbb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.914661:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321d40/0xfc4b8e114edaabc2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713279306.914661:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785513 00010000:00010000:3.0:1713279306.914663:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8f840/0xfc4b8e114edaabbb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.914666:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaabc9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x233:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713279306.914668:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281286848 00010000:00010000:0.0:1713279306.914669:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaabc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.914669:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114edaabd0 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.914670:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281286848 00010000:00010000:3.0:1713279306.914672:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114edaabd0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.914673:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaabc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.914675:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114edaabd0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.914686:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785516 00000100:00100000:2.0:1713279306.914688:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3449:11204:x1796503281286848:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.914690:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8f840/0xfc4b8e114edaabbb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.914693:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.914693:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8f840/0xfc4b8e114edaabbb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.914695:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaabd7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.914696:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8f840/0xfc4b8e114edaabbb lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.914698:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edaabde lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917621b expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.914699:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaabd7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.914699:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8f840/0xfc4b8e114edaabbb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.914702:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8f840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.914703:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaabd7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.914703:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8f840/0xfc4b8e114edaabbb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.914706:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8f840/0xfc4b8e114edaabbb lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.914713:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88008d7fc100) 00010000:00010000:3.0:1713279306.914715:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.914716:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8f840/0xfc4b8e114edaabbb lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000004:00010000:0.0:1713279306.914718:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaabd7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.914719:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8f840/0xfc4b8e114edaabbb lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.914722:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321d40/0xfc4b8e114edaabc2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.914724:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114edaabd0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.914725:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321d40/0xfc4b8e114edaabc2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.914727:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114edaabd0 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.914729:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321d40/0xfc4b8e114edaabc2 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.914730:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaabe5 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.914730:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114edaabd0 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.914732:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321d40/0xfc4b8e114edaabc2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.914732:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8d440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.914734:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaabe5 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.914734:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114edaabd0 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.914735:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.914737:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321d40/0xfc4b8e114edaabc2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.914737:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114edaabd0 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.914738:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaabe5 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.914740:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321d40/0xfc4b8e114edaabc2 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.914740:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880097622300) 00010000:00010000:3.0:1713279306.914741:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.914743:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114edaabd0 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.914744:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88007f389c00) 00010000:00010000:2.0:1713279306.914744:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaabec lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.914745:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.914745:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8d440/0xfc4b8e114edaabd0 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.914747:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321d40/0xfc4b8e114edaabc2 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.914748:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaabec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.914749:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321d40/0xfc4b8e114edaabc2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.914751:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaabec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.914756:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaabc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.914757:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114edaabb4 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176214 expref: 3660 pid: 15752 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713279306.914758:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:0.0:1713279306.914759:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaabc9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.914762:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaabc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.914762:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaabe5 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.914762:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8ef40/0xfc4b8e114edaabb4 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176214 expref: 3660 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.914765:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.914765:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaabe5 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.914766:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaabc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.914768:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaabc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.914768:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaabe5 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.914768:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bf8ef40, rc 0) 00010000:00010000:2.0:1713279306.914771:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaabe5 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.914772:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x36 (ffff88007f389800) 00010000:00010000:0.0:1713279306.914773:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.914773:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.914774:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaabc9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.914775:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaabe5 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.914777:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321b00/0xfc4b8e114edaabc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.914777:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaabe5 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914781:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:0.0:1713279306.914782:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaabd7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.914782:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.914784:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaabd7 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.914784:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaabe5 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.914787:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaabd7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.914788:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3659:11711:x1796503281286656:12345-192.168.203.4@tcp:101:touch.0 Request processed in 180us (265us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.914789:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d322400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.914789:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edaabe5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.914791:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaabd7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.914792:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785514 00010000:00010000:0.0:1713279306.914793:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaabd7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.914794:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaabec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.914796:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7831:0x0].0x0 (ffff88008bde0600) 00010000:00010000:0.0:1713279306.914797:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.914797:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaabec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.914799:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaabd7 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.914799:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaabec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.914801:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322400/0xfc4b8e114edaabd7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7831:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.914802:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6f40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.914803:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaabec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914806:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaabec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914809:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880136671e00) 00010000:00010000:2.0:1713279306.914810:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.914811:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaabec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.914814:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edaabec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.914823:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3658:11876:x1796503281286784:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 201us (284us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.914825:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edaabde lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917621b expref: 3450 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.914827:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785515 00010000:00010000:2.0:1713279306.914829:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edaabde lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917621b expref: 3450 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.914836:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd6d00, rc 0) 00000100:00100000:2.0:1713279306.914850:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3449:11204:x1796503281286848:12345-192.168.203.4@tcp:101:touch.0 Request processed in 161us (206us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.914854:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785516 00000001:00080000:1.0:1713279306.915157:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202786 is committed 00000001:00080000:1.0:1713279306.915187:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202785 is committed 00000001:00080000:1.0:1713279306.915192:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202782 is committed 00010000:00010000:0.0:1713279306.915207:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114edaa302 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8290:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915212:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114edaa302 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8290:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915216:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114edaa302 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8290:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915218:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800936ec000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.915220:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114edaa302 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8290:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915222:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114edaa302 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8290:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915228:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8290:0x0].0x0 (ffff8800824f1800) 00010000:00010000:0.0:1713279306.915229:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.915231:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114edaa302 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8290:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915233:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936ec000/0xfc4b8e114edaa302 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8290:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.915237:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda9ff2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915244:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda9ff2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915248:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda9ff2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915251:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f2b3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.915252:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda9ff2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915256:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda9ff2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915261:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x3131 (ffff8801250c1900) 00010000:00010000:2.0:1713279306.915263:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.915265:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda9ff2 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.915265:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d680/0xfc4b8e114edaa842 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfc4b8e114edaa811 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.915268:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f2b3c0/0xfc4b8e114eda9ff2 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x24a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.915272:0:6915:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88013484fc00) 00010000:00010000:3.0:1713279306.915274:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915278:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f286c0/0xfc4b8e114edaa000 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.915278:0:6915:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.915281:0:6915:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915283:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f286c0/0xfc4b8e114edaa000 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915286:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f286c0/0xfc4b8e114edaa000 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915289:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f286c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.915290:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f286c0/0xfc4b8e114edaa000 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713279306.915290:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.915293:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f286c0/0xfc4b8e114edaa000 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915296:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x231:0x0].0x3131 (ffff8801250c1e00) 00010000:00010000:2.0:1713279306.915298:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.915299:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f286c0/0xfc4b8e114edaa000 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915302:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f286c0/0xfc4b8e114edaa000 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x231:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00000100:00100000:3.0:1713279306.915309:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096756d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+54:3491:x1796503200061248:12345-0@lo:103:ldlm_bl.0 Request processed in 1446us (1494us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.915311:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114edaa0ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x874f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00000100:00100000:3.0:1713279306.915313:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196596 00010000:00010000:0.0:1713279306.915315:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915316:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114edaa0ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x874f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.915319:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915320:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114edaa0ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x874f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915324:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880130c93a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.915326:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114edaa0ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x874f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00000100:00100000:3.0:1713279306.915329:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200061248:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.915332:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114edaa0ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x874f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915338:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x874f:0x0].0x0 (ffff880092a4c800) 00010000:00010000:2.0:1713279306.915340:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.915343:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114edaa0ee lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x874f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915348:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c93a80/0xfc4b8e114edaa0ee lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x874f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915355:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c90d80/0xfc4b8e114edaa0fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915360:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c90d80/0xfc4b8e114edaa0fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915365:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130c90d80/0xfc4b8e114edaa0fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915369:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880130c90d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.915372:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c90d80/0xfc4b8e114edaa0fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915376:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c90d80/0xfc4b8e114edaa0fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.915382:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaabf3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915383:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x83dc:0x0].0x0 (ffff880092a4c300) 00010000:00010000:2.0:1713279306.915385:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.915387:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaabf3 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915387:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130c90d80/0xfc4b8e114edaa0fc lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.915391:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaabf3 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915392:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c90d80/0xfc4b8e114edaa0fc lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x83dc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.915396:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3221c0/0xfc4b8e114edaabfa lrc: 3/0,1 mode: --/PW res: [0x200000400:0x235:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915399:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114edaa0f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x24d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713279306.915400:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3221c0/0xfc4b8e114edaabfa lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.915402:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3221c0/0xfc4b8e114edaabfa lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915405:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114edaa0f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x24d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915409:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114edaa0f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x24d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915432:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880130c92640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.915435:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114edaa0f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x24d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915440:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114edaa0f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x24d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915447:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24d:0x0].0x0 (ffff880092a4cf00) 00010000:00010000:2.0:1713279306.915459:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.915461:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114edaa0f5 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x24d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915466:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c92640/0xfc4b8e114edaa0f5 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x24d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713279306.915477:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114edaa6ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.915482:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114edaa6ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.915487:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114edaa6ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.915491:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094669680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.915494:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114edaa6ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.915499:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114edaa6ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.915502:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915506:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x3431 (ffff880089dc2900) 00010000:00010000:2.0:1713279306.915508:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.915509:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013597df80/0xfc4b8e114ed9f53d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917308f expref: 3712 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.915510:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114edaa6ba lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x14f:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.915513:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114ed9e8a9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d2b expref: 3713 pid: 15488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.915515:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094669680/0xfc4b8e114edaa6ba lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x14f:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.915517:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad6aac0/0xfc4b8e114ed9f80e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391731b5 expref: 3712 pid: 15753 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.915519:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.915521:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114edaa826 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x7f21:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176111 expref: 3713 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.915524:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915524:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114edaa6c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.915529:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114edaa6c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.915530:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.915534:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114edaa6c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.915537:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114edaa826 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x7f21:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176111 expref: 3713 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.915538:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012068e400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.915540:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114edaa6c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.915541:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281286976 00010000:00010000:0.0:1713279306.915543:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114edaa826 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x7f21:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176111 expref: 3713 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.915543:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114edaa6c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.915543:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281286976 00010000:00010000:2.0:1713279306.915547:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x3431 (ffff880089dc2200) 00010000:00010000:2.0:1713279306.915548:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.915549:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095210000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200061312:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.915549:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114edaa6c8 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.915555:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012068e400/0xfc4b8e114edaa6c8 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x148:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00000100:00100000:3.0:1713279306.915555:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223132 00000100:00100000:3.0:1713279306.915558:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3714:12004:x1796503281286976:12345-192.168.203.4@tcp:35:lfs.0 00010000:00010000:2.0:1713279306.915561:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114edaa6cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8272:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.915564:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114edaa6cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8272:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.915567:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114edaa6cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8272:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.915569:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096b9ed00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.915570:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad6aac0/0xfc4b8e114ed9f80e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391731b5 expref: 3712 pid: 15753 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.915571:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114edaa6cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8272:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.915573:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114edaa6cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8272:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT0 00010000:00010000:0.0:1713279306.915575:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad6aac0/0xfc4b8e114ed9f80e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391731b5 expref: 3712 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.915577:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8272:0x0].0x0 (ffff880089dc2800) 00010000:00010000:2.0:1713279306.915578:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.915579:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114edaa6cf lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8272:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00000100:00100000:0.0:1713279306.915580:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095213480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200061376:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.915582:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b9ed00/0xfc4b8e114edaa6cf lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8272:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT0 00010000:00010000:2.0:1713279306.915588:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa914 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.915589:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114ed9e8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d2b expref: 3714 pid: 15488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.915591:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa914 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.915593:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114ed9e8a9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d2b expref: 3714 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.915596:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa914 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713279306.915598:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095213b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200061440:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.915599:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68bcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.915600:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa914 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915603:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa914 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x14f:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915606:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14f:0x0].0x3032 (ffff88012d397900) 00010000:00010000:2.0:1713279306.915607:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.915608:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa914 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x14f:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713279306.915610:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3714:12004:x1796503281286976:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 50us (91us total) trans 4295202787 rc 0/0 00010000:00010000:2.0:1713279306.915611:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edaa914 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x14f:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713279306.915614:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223132 00010000:00010000:2.0:1713279306.915616:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa922 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915619:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa922 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915622:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa922 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915624:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.915625:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa922 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915628:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa922 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915632:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x148:0x0].0x3032 (ffff88012cffdd00) 00010000:00010000:2.0:1713279306.915633:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.915635:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa922 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915639:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edaa922 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x148:0x0].0x3032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915648:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915653:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915658:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.915662:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68a1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.915663:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013597df80/0xfc4b8e114ed9f53d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917308f expref: 3712 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.915664:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.915668:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013597df80/0xfc4b8e114ed9f53d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917308f expref: 3712 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.915669:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713279306.915674:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095210a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200061504:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.915675:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x847f:0x0].0x0 (ffff88008d729200) 00010000:00010000:2.0:1713279306.915677:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1713279306.915679:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000100:00100000:1.0:1713279306.915680:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.915684:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edaa929 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x847f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713279306.915686:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f48f600 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.915760:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281287104 00000100:00100000:0.0:1713279306.915763:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281287104 00000100:00100000:1.0:1713279306.915769:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.915773:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.915783:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281287232 00000100:00100000:0.0:1713279306.915785:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281287232 00000100:00100000:0.0:1713279306.915789:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281287424 00000100:00100000:0.0:1713279306.915790:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281287424 00000100:00100000:0.0:1713279306.915798:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785517 00000100:00100000:2.0:1713279306.915799:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281287296 00000100:00100000:0.0:1713279306.915801:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3659:11912:x1796503281287104:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.915802:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785518 00000100:00100000:2.0:1713279306.915804:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281287296 00000100:00100000:3.0:1713279306.915805:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3713:11711:x1796503281287424:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.915807:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.915812:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114edaac08 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176222 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.915813:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.915819:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114edaac0f lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176230 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.915823:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110573 00000100:00100000:2.0:1713279306.915828:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+83:1955:x1796503281287296:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:0.0:1713279306.915833:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250a9200/0xfc4b8e114edaac16 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713279306.915837:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801250a9200/0xfc4b8e114edaac16 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.915841:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801250a9200/0xfc4b8e114edaac16 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.915846:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095070fc0/0xfc4b8e114edaac24 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.915846:0:15500:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaac1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.915850:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095070fc0/0xfc4b8e114edaac24 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.915853:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095070fc0/0xfc4b8e114edaac24 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.915857:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9dad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e55 expref: 83 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.915857:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaac2b lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.915862:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaac2b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915863:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250a9200/0xfc4b8e114edaac16 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.915863:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713279306.915865:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801250a9200/0xfc4b8e114edaac16 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.915865:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.915866:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaac2b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.915868:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaac1d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.915871:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801250a9200/0xfc4b8e114edaac16 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.915871:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edaac32 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915874:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801250a9200/0xfc4b8e114edaac16 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.915875:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edaac32 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915876:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801250a9200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.915878:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250a9200/0xfc4b8e114edaac16 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.915878:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edaac32 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915881:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801250a9200/0xfc4b8e114edaac16 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.915884:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880134856300) 00010000:00010000:2.0:1713279306.915885:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9dad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e55 expref: 83 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.915886:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:3.0:1713279306.915886:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:0.0:1713279306.915887:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801250a9200/0xfc4b8e114edaac16 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.915890:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801250a9200/0xfc4b8e114edaac16 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.915891:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaac2b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.915893:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9dad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e55 expref: 83 pid: 15783 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.915894:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaac2b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915895:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095070fc0/0xfc4b8e114edaac24 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.915897:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaac2b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915898:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095070fc0/0xfc4b8e114edaac24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.915900:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaac2b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915901:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095070fc0/0xfc4b8e114edaac24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.915903:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095070fc0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.915903:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:15500:1796503200061568:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.915903:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8cb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.915904:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaac2b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915905:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095070fc0/0xfc4b8e114edaac24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.915907:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaac2b lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.915911:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880097622200) 00010000:00010000:3.0:1713279306.915912:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.915913:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaac2b lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.915916:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8cb40/0xfc4b8e114edaac2b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.915921:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edaac32 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.915924:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edaac32 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:2.0:1713279306.915927:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800976f9900 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.915927:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edaac32 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.915932:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.915934:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edaac32 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.915937:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edaac32 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.915939:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880136671700) 00010000:00010000:3.0:1713279306.915941:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.915942:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edaac32 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.915944:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edaac32 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.915957:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095070fc0/0xfc4b8e114edaac24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.915957:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114edaac0f lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176230 expref: 3714 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.915961:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8dd40/0xfc4b8e114edaac0f lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176230 expref: 3714 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.915963:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff880134856900) 00010000:00010000:0.0:1713279306.915964:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.915966:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095070fc0/0xfc4b8e114edaac24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713279306.915966:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bf8dd40, rc 0) 00010000:00010000:0.0:1713279306.915969:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095070fc0/0xfc4b8e114edaac24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713279306.915982:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3713:11711:x1796503281287424:12345-192.168.203.4@tcp:101:touch.0 Request processed in 176us (209us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.915983:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114edaac08 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176222 expref: 3660 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.915986:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785518 00010000:00010000:0.0:1713279306.915987:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114edaac08 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176222 expref: 3660 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.915993:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d322640, rc 0) 00000100:00100000:0.0:1713279306.916009:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3659:11912:x1796503281287104:12345-192.168.203.4@tcp:101:touch.0 Request processed in 207us (480us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.916012:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785517 00000100:00100000:0.0:1713279306.916029:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785519 00000100:00100000:0.0:1713279306.916031:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3658:11876:x1796503281287232:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1713279306.916036:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.916103:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edaac39 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7831:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176229 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.916118:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.916132:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091d2b3c0/0xfc4b8e114edaac40 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7831:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.916137:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091d2b3c0/0xfc4b8e114edaac40 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7831:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.916141:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091d2b3c0/0xfc4b8e114edaac40 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7831:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:0.0:1713279306.916145:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7831:0x0]: returning size 0 00000100:00100000:2.0:1713279306.916146:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281287552 00000100:00100000:2.0:1713279306.916149:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281287552 00000100:00100000:2.0:1713279306.916168:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785520 00000100:00100000:2.0:1713279306.916171:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11204:x1796503281287552:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.916175:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edaac39 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7831:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176229 expref: 3661 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.916177:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.916182:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091d2b3c0/0xfc4b8e114edaac40 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7831:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176229 expref: 3660 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.916184:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5440/0xfc4b8e114edaac4e lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176237 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.916185:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7831:0x0].0x0 (ffff88008bde0600) 00010000:00010000:0.0:1713279306.916187:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1713279306.916188:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d2b3c0, rc 0) 00000100:00100000:0.0:1713279306.916203:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3660:11876:x1796503281287232:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 171us (524us total) trans 4295183806 rc 0/0 00010000:00010000:2.0:1713279306.916206:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5b00/0xfc4b8e114edaac55 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.916207:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785519 00010000:00010000:2.0:1713279306.916211:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5b00/0xfc4b8e114edaac55 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916215:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5b00/0xfc4b8e114edaac55 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916220:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114edaac5c lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916233:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114edaac5c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916237:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114edaac5c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916248:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5b00/0xfc4b8e114edaac55 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916251:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5b00/0xfc4b8e114edaac55 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916254:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5b00/0xfc4b8e114edaac55 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916257:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5b00/0xfc4b8e114edaac55 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916260:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094fe5b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.916261:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5b00/0xfc4b8e114edaac55 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916265:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5b00/0xfc4b8e114edaac55 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916269:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:2.0:1713279306.916270:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.916272:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5b00/0xfc4b8e114edaac55 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916274:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5b00/0xfc4b8e114edaac55 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916281:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114edaac5c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916285:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114edaac5c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916290:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114edaac5c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916293:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c9b5680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.916296:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114edaac5c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916301:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114edaac5c lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916307:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff88008da65700) 00010000:00010000:2.0:1713279306.916308:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.916310:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114edaac5c lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916315:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114edaac5c lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.916335:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5440/0xfc4b8e114edaac4e lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176237 expref: 3714 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.916342:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe5440/0xfc4b8e114edaac4e lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176237 expref: 3714 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.916350:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fe5440, rc 0) 00000100:00100000:2.0:1713279306.916380:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11204:x1796503281287552:12345-192.168.203.4@tcp:101:touch.0 Request processed in 207us (261us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.916386:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785520 00000100:00100000:0.0:1713279306.917470:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.917507:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.917522:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.917532:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.917536:0:15514:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880095210000 x1796503200061312) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114edaa826 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x7f21:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176111 expref: 3712 pid: 6929 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.917536:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281287744 00000100:00100000:3.0:1713279306.917541:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281287744 00000100:00100000:2.0:1713279306.917543:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.917544:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281287616 00010000:00010000:1.0:1713279306.917547:0:15514:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114edaa826 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x7f21:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176111 expref: 3712 pid: 6929 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.917548:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281287616 00010000:00010000:3.0:1713279306.917553:0:6915:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013597df80/0xfc4b8e114ed9f53d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917308f expref: 3714 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.917555:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281287680 00010000:00010000:1.0:1713279306.917556:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801251d5b00/0xfc4b8e114edaa826 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x7f21:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176111 expref: 3712 pid: 6929 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.917558:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad6aac0/0xfc4b8e114ed9f80e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391731b5 expref: 3714 pid: 15753 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.917558:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281287680 00000100:00100000:1.0:1713279306.917566:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095210000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200061312:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.917569:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114ed9e8a9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d2b expref: 3712 pid: 15488 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.917572:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095213480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200061376:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.917573:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196597 00000100:00100000:3.0:1713279306.917576:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:1956:x1796503281287744:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.917577:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095213b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200061440:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.917578:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196598 00000100:00100000:1.0:1713279306.917581:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095210a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15514:1796503200061504:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.917582:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3714:1954:x1796503281287616:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.917582:0:6915:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.917585:0:6915:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013597df80/0xfc4b8e114ed9f53d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917308f expref: 3714 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.917586:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196599 00010000:00010000:0.0:1713279306.917589:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713279306.917589:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3712:1954:x1796503281287680:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.917590:0:6915:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013597df80/0xfc4b8e114ed9f53d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917308f expref: 3714 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.917592:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad6aac0/0xfc4b8e114ed9f80e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391731b5 expref: 3714 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.917595:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.917598:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114ed9e8a9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d2b expref: 3712 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.917599:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7f21:0x0].0x0 (ffff880096f32d00) 00010000:00010000:1.0:1713279306.917602:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.917607:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.917610:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.917618:0:6915:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013597df80/0xfc4b8e114ed9f53d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917308f expref: 3714 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.917619:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad6aac0/0xfc4b8e114ed9f80e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391731b5 expref: 3714 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.917625:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114ed9e8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d2b expref: 3712 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.917633:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.917637:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ad6aac0/0xfc4b8e114ed9f80e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391731b5 expref: 3713 pid: 15753 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.917637:0:6915:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7f21:0x0].0x0 (ffff880096f32d00) 00010000:00010000:3.0:1713279306.917639:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.917644:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.917647:0:6915:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.917649:0:6915:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.917654:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114ed9e8a9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7f21:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39172d2b expref: 3712 pid: 15488 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.917660:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7f21:0x0].0x0 (ffff880096f32d00) 00010000:00010000:2.0:1713279306.917663:0:6916:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713279306.917666:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281287744:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 89us (161us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.917667:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.917670:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713279306.917670:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196597 00010000:00010000:2.0:1713279306.917682:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.917683:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281288128 00010000:00010000:0.0:1713279306.917684:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7f21:0x0].0x0 (ffff880096f32d00) 00010000:00010000:1.0:1713279306.917684:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713279306.917685:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281288128 00010000:00010000:0.0:1713279306.917687:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.917688:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713279306.917692:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281288256 00000100:00100000:3.0:1713279306.917693:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281288256 00000100:00100000:2.0:1713279306.917694:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+3711:1954:x1796503281287680:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 104us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.917698:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196599 00000100:00100000:3.0:1713279306.917700:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785521 00000100:00100000:0.0:1713279306.917702:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:1954:x1796503281287616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 119us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.917703:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3449:11204:x1796503281288128:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.917707:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196598 00010000:00010000:3.0:1713279306.917709:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.917714:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114edaac63 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176245 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.917723:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785522 00000100:00100000:0.0:1713279306.917726:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3660:11711:x1796503281288256:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.917728:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:15500:1796503200061568:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.917734:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.917734:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.917736:0:15500:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaac1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.917740:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edaac6a lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917624c expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.917741:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.917745:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.917747:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.917749:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.917752:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.917753:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114edaac71 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.917756:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7f21:0x0].0x0 (ffff880096f32d00) 00010000:00010000:1.0:1713279306.917758:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1713279306.917758:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.917758:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114edaac71 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.917759:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.917762:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323180/0xfc4b8e114edaac01 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x7f21:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.917762:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114edaac71 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.917768:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaabf3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.917768:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114edaac7f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.917771:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaabf3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713279306.917772:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281287808 00010000:00010000:3.0:1713279306.917772:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114edaac7f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.917773:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaabf3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713279306.917774:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281287808 00010000:00010000:3.0:1713279306.917775:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114edaac7f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.917776:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaabf3 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.917779:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d3218c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.917781:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9dad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e55 expref: 84 pid: 15783 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.917781:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaabf3 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00000004:00200000:3.0:1713279306.917783:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:1.0:1713279306.917784:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaabf3 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713279306.917784:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.917788:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x0 (ffff88007f389700) 00010000:00010000:3.0:1713279306.917788:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114edaac71 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.917789:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.917790:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaabf3 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713279306.917791:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196600 00010000:00010000:3.0:1713279306.917791:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114edaac71 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713279306.917792:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281287936 00010000:00010000:1.0:1713279306.917793:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3218c0/0xfc4b8e114edaabf3 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713279306.917794:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+84:1957:x1796503281287808:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.917794:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281287936 00010000:00010000:3.0:1713279306.917797:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114edaac71 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.917798:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.917799:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3221c0/0xfc4b8e114edaabfa lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x235:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.917800:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114edaac71 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.917802:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3221c0/0xfc4b8e114edaabfa lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.917802:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880123732400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.917804:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3221c0/0xfc4b8e114edaabfa lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713279306.917804:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110574 00010000:00010000:3.0:1713279306.917804:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114edaac71 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.917805:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9dad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e55 expref: 84 pid: 15783 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.917807:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d3221c0 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.917807:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+84:1956:x1796503281287936:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:3.0:1713279306.917807:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114edaac71 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.917808:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3221c0/0xfc4b8e114edaabfa lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.917810:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9dad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e55 expref: 84 pid: 15783 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.917811:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3221c0/0xfc4b8e114edaabfa lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x235:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.917811:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:3.0:1713279306.917812:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.917814:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x235:0x0].0x35 (ffff88007f389300) 00010000:00010000:3.0:1713279306.917814:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114edaac71 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.917816:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.917816:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880123732400/0xfc4b8e114edaac71 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.917817:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3221c0/0xfc4b8e114edaabfa lrc: 2/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.917819:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d4b3180/0xfc4b8e114eda9dad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175e55 expref: 84 pid: 15783 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.917821:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114edaac7f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.917822:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3221c0/0xfc4b8e114edaabfa lrc: 0/0,0 mode: --/PW res: [0x200000400:0x235:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.917824:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.917824:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114edaac7f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.917825:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1713279306.917825:0:15506:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0xfe5:0x0] initial LVB size: 0, mtime: 0x661e9149, atime: 0x661e9149, ctime: 0x661e9149, blocks: 0x0 00010000:00010000:0.0:1713279306.917827:0:15557:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaac1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.917827:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114edaac7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713279306.917828:0:15506:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edaac86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xfe5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.917829:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.917830:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942d680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.917831:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114edaac7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713279306.917832:0:15557:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaac1d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.917832:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.917833:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.917834:0:15506:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.917835:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.917836:0:15506:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edaac86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.917837:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114edaac7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.917838:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.917839:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.917840:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88008e735200) 00010000:00010000:0.0:1713279306.917841:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.917841:0:15506:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edaac86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.917841:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.917842:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713279306.917842:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114edaac7f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.917845:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88013484fc00) 00010000:00010000:3.0:1713279306.917845:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d680/0xfc4b8e114edaac7f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713279306.917846:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.917847:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.917847:0:15506:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edaac86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.917850:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688fc0/0xfc4b8e114edaaa6b lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713279306.917850:0:15506:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edaac86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xfe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.917851:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+83:1957:x1796503281287808:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 56us (93us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.917854:0:15506:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edaac86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xfe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.917855:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196600 00000004:00020000:1.0:1713279306.917855:0:15514:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200000402:0x7f51:0x0]/5 failed: rc = -114 00010000:00010000:2.0:1713279306.917858:0:15506:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c9b5200 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:3.0:1713279306.917858:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114edaac63 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176245 expref: 3450 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.917859:0:15506:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edaac86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xfe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.917862:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114edaac63 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176245 expref: 3450 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.917863:0:15506:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edaac86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xfe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.917864:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114edaac78 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.917875:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bf99680, rc 0) 00010000:00010000:0.0:1713279306.917879:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114edaac78 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.917880:0:15506:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edaac86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xfe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.917884:0:15506:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edaac86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xfe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.917885:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114edaac78 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.917887:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:385c4b71-808c-40cf-91de-b076b668d13f+3710:11736:x1796503281283456:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 9454us (9494us total) trans 0 rc -114/-114 00000100:00100000:3.0:1713279306.917889:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3449:11204:x1796503281288128:12345-192.168.203.4@tcp:101:touch.0 Request processed in 186us (421us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.917891:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114edaac8d lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.917892:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14363 00000100:00100000:3.0:1713279306.917893:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785521 00010000:00010000:0.0:1713279306.917894:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114edaac8d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.917898:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114edaac8d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.917904:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+84:1956:x1796503281287936:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 96us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.917908:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110574 00010000:00010000:0.0:1713279306.917912:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114edaac78 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.917915:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114edaac78 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.917918:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114edaac78 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.917920:0:15500:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaac1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.917921:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114edaac78 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.917924:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.917924:0:15500:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaac1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.917926:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114edaac78 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.917929:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114edaac78 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.917929:0:15500:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaac1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.917931:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.917932:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff8800940f8a00) 00010000:00010000:2.0:1713279306.917933:0:15500:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaac1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.917934:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.917936:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114edaac78 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.917937:0:15500:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaac1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.917939:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540900/0xfc4b8e114edaac78 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.917940:0:15500:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf7cc0 already unused, calling callback (ffffffffa085fb20) 00010000:00010000:2.0:1713279306.917942:0:15500:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaac1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.917943:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281288384 00010000:00010000:0.0:1713279306.917944:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114edaac8d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.917945:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281288384 00010000:00010000:0.0:1713279306.917946:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114edaac8d lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.917946:0:15500:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaac1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.917948:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.917949:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114edaac8d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.917952:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925433c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.917952:0:15500:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaac1d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.917953:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114edaac8d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.917956:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114edaac8d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.917957:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.917957:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281288000 00010000:00010000:2.0:1713279306.917958:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012baf7cc0/0xfc4b8e114edaac1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.917958:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281288000 00010000:00010000:0.0:1713279306.917959:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff88008afd9900) 00010000:00010000:0.0:1713279306.917960:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.917962:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114edaac8d lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.917964:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800925433c0/0xfc4b8e114edaac8d lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.917964:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281288512 00000100:00100000:3.0:1713279306.917965:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281288512 00000100:00100000:1.0:1713279306.917966:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.917972:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281288640 00000100:00100000:3.0:1713279306.917973:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281288640 00010000:00010000:0.0:1713279306.917976:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edaac6a lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917624c expref: 3663 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.917976:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785523 00000100:00100000:1.0:1713279306.917980:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3663:11912:x1796503281288384:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.917981:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edaac6a lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917624c expref: 3663 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.917984:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+82:1955:x1796503281287296:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 2154us (2213us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.917986:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fca86c0, rc 0) 00000100:00100000:3.0:1713279306.917988:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785524 00000100:00100000:2.0:1713279306.917990:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110573 00000100:00100000:1.0:1713279306.917991:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785525 00000100:00100000:3.0:1713279306.917991:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:12046:x1796503281288000:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:1.0:1713279306.917994:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3662:12020:x1796503281288512:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.917997:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.917998:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3662:11711:x1796503281288256:12345-192.168.203.4@tcp:101:touch.0 Request processed in 271us (508us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.918001:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.918002:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d200/0xfc4b8e114edaac94 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917623e expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.918003:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785522 00010000:00010000:1.0:1713279306.918007:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114edaac9b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917625a expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.918007:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785526 00000100:00100000:2.0:1713279306.918011:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3710:12009:x1796503281288640:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.918019:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.918027:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800966fe880/0xfc4b8e114edaaca2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176261 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.918035:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114edaaca9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.918040:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.918041:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114edaaca9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.918044:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800945521c0/0xfc4b8e114edaacb0 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713279306.918045:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114edaaca9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.918050:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800945521c0/0xfc4b8e114edaacb0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.918051:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114edaacb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.918054:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114edaacb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.918055:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800945521c0/0xfc4b8e114edaacb0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.918058:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114edaacb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.918061:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114edaacbe lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713279306.918064:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114edaacbe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713279306.918084:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114edaacbe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.918085:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaacc5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.918092:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaacc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.918096:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaacc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.918103:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaaccc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000004:00200000:3.0:1713279306.918105:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7e3b:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.918106:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaaccc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.918109:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaaccc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.918109:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114edaaca9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.918112:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114edaaca9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713279306.918115:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114edaaca9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00000004:00200000:1.0:1713279306.918116:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76b7:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.918118:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114edaaca9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.918121:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800945521c0/0xfc4b8e114edaacb0 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.918122:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.918123:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114edaaca9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.918124:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800945521c0/0xfc4b8e114edaacb0 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.918126:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114edaaca9 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.918127:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800945521c0/0xfc4b8e114edaacb0 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713279306.918130:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.918130:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800945521c0/0xfc4b8e114edaacb0 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.918131:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.918132:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.918133:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800945521c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.918134:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800945521c0/0xfc4b8e114edaacb0 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.918134:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114edaaca9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000004:00200000:2.0:1713279306.918135:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.918136:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942e640/0xfc4b8e114edaaca9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.918137:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800945521c0/0xfc4b8e114edaacb0 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.918140:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaacc5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.918141:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:3.0:1713279306.918141:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114edaacb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.918142:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281288768 00010000:00010000:1.0:1713279306.918142:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.918143:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaacc5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.918144:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800945521c0/0xfc4b8e114edaacb0 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.918144:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114edaacb7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.918145:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281288768 00010000:00010000:1.0:1713279306.918146:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800945521c0/0xfc4b8e114edaacb0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.918146:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaacc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.918147:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114edaacb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713279306.918149:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaacc5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.918149:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942c240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.918150:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114edaacb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.918151:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114edaacbe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.918152:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012c24fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.918153:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaacc5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.918153:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114edaacb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.918154:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114edaacbe lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.918156:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaacc5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.918156:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3831 (ffff88008e735d00) 00010000:00010000:1.0:1713279306.918157:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114edaacbe lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279306.918157:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.918159:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785527 00010000:00010000:3.0:1713279306.918159:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114edaacb7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713279306.918160:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e608b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.918160:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.918161:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114edaacbe lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.918161:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.918161:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c240/0xfc4b8e114edaacb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713279306.918162:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3712:12048:x1796503281288768:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.918163:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaacc5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.918164:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114edaacbe lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.918166:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edaacc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.918168:0:6929:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.918168:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff88008e720f00) 00010000:00010000:1.0:1713279306.918169:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.918170:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114edaacbe lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713279306.918173:0:6929:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114edaacd3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176268 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.918173:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e608b40/0xfc4b8e114edaacbe lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713279306.918173:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaaccc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.918173:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d200/0xfc4b8e114edaac94 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917623e expref: 3712 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.918176:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaaccc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.918177:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942d200/0xfc4b8e114edaac94 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917623e expref: 3712 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.918179:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaaccc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.918181:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800929098c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.918181:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942d200, rc 0) 00010000:00010000:2.0:1713279306.918182:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaaccc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.918185:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114edaac9b lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917625a expref: 3662 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.918185:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaaccc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.918188:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff88011eea4e00) 00010000:00010000:1.0:1713279306.918189:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094550fc0/0xfc4b8e114edaac9b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917625a expref: 3662 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.918189:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.918191:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaaccc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.918193:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094550fc0, rc 0) 00010000:00010000:2.0:1713279306.918193:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edaaccc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:3.0:1713279306.918195:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:12046:x1796503281288000:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 203us (245us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.918198:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785524 00000100:00100000:1.0:1713279306.918204:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3661:12020:x1796503281288512:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 209us (246us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.918205:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800966fe880/0xfc4b8e114edaaca2 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176261 expref: 3713 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.918208:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785525 00010000:00010000:0.0:1713279306.918209:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540480/0xfc4b8e114edaacda lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00010000:00010000:2.0:1713279306.918209:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800966fe880/0xfc4b8e114edaaca2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176261 expref: 3713 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.918213:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800966fe880, rc 0) 00010000:00010000:0.0:1713279306.918215:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092540480/0xfc4b8e114edaacda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.918219:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092540480/0xfc4b8e114edaacda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918221:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.918224:0:6929:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114edaace1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 00000100:00100000:2.0:1713279306.918224:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3712:12009:x1796503281288640:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 213us (257us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.918224:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281288896 00000100:00100000:3.0:1713279306.918226:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281288896 00010000:00010000:0.0:1713279306.918227:0:6929:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114edaace1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918227:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114edaace8 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176253 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.918228:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785526 00010000:00010000:0.0:1713279306.918231:0:6929:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114edaace1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00000100:00100000:3.0:1713279306.918235:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223133 00000100:00100000:3.0:1713279306.918238:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130144c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:12016:x1796503281288896:12345-192.168.203.4@tcp:35:touch.0 00000004:00200000:0.0:1713279306.918257:0:6929:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7f51:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.918257:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114edaacef lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.918261:0:6929:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540480/0xfc4b8e114edaacda lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918262:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114edaacef lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.918265:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540480/0xfc4b8e114edaacda lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918266:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114edaacef lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.918268:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092540480/0xfc4b8e114edaacda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:0.0:1713279306.918270:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092540480/0xfc4b8e114edaacda lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918272:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538d80/0xfc4b8e114edaacf6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.918273:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.918274:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092540480/0xfc4b8e114edaacda lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918275:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538d80/0xfc4b8e114edaacf6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.918277:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092540480/0xfc4b8e114edaacda lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918278:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538d80/0xfc4b8e114edaacf6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.918282:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00000100:00100000:3.0:1713279306.918282:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130144c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:12016:x1796503281288896:12345-192.168.203.4@tcp:35:touch.0 Request processed in 43us (152us total) trans 4295202788 rc 0/0 00010000:00010000:0.0:1713279306.918283:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.918284:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092540480/0xfc4b8e114edaacda lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00000004:00200000:1.0:1713279306.918285:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00000100:00100000:3.0:1713279306.918286:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223133 00010000:00010000:0.0:1713279306.918287:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092540480/0xfc4b8e114edaacda lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918290:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114edaacef lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.918292:0:6929:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114edaace1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918293:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114edaacef lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.918295:0:6929:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114edaace1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918296:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114edaacef lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.918299:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114edaacef lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.918300:0:6929:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114edaace1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918301:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800902ab840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.918303:0:6929:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925421c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.918303:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114edaacef lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.918304:0:6929:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114edaace1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918305:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114edaacef lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.918307:0:6929:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114edaace1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918309:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88012061fc00) 00010000:00010000:0.0:1713279306.918310:0:6929:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3631 (ffff8800958c9500) 00010000:00010000:0.0:1713279306.918311:0:6929:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.918311:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.918312:0:6929:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114edaace1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918312:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114edaacef lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.918315:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925421c0/0xfc4b8e114edaace1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 00010000:00010000:1.0:1713279306.918315:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800902ab840/0xfc4b8e114edaacef lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.918321:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538d80/0xfc4b8e114edaacf6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.918323:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538d80/0xfc4b8e114edaacf6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.918326:0:6929:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114edaacd3 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176268 expref: 3711 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.918326:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538d80/0xfc4b8e114edaacf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.918329:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c538d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.918330:0:6929:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092540240/0xfc4b8e114edaacd3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176268 expref: 3711 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.918330:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538d80/0xfc4b8e114edaacf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.918333:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538d80/0xfc4b8e114edaacf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.918334:0:6929:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092540240, rc 0) 00010000:00010000:1.0:1713279306.918336:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88012061f600) 00010000:00010000:1.0:1713279306.918337:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.918338:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538d80/0xfc4b8e114edaacf6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.918341:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538d80/0xfc4b8e114edaacf6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.918350:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3710:12048:x1796503281288768:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 186us (310us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.918352:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114edaace8 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176253 expref: 3661 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.918353:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785527 00010000:00010000:1.0:1713279306.918359:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e60a880/0xfc4b8e114edaace8 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176253 expref: 3661 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.918365:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e60a880, rc 0) 00000100:00100000:1.0:1713279306.918380:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3660:11912:x1796503281288384:12345-192.168.203.4@tcp:101:touch.0 Request processed in 401us (449us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.918384:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785523 00000100:00100000:0.0:1713279306.918740:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.918801:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281289024 00000100:00100000:3.0:1713279306.918805:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281289024 00000100:00100000:3.0:1713279306.918822:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223134 00000100:00100000:3.0:1713279306.918825:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3710:11736:x1796503281289024:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.918865:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3710:11736:x1796503281289024:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 39us (125us total) trans 0 rc -116/-116 00000100:00100000:3.0:1713279306.918870:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223134 00000100:00100000:2.0:1713279306.918970:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.918984:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281289152 00000100:00100000:1.0:1713279306.918988:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281289152 00000100:00100000:1.0:1713279306.919006:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14364 00000100:00100000:1.0:1713279306.919010:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:385c4b71-808c-40cf-91de-b076b668d13f+3660:11876:x1796503281289152:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:0.0:1713279306.919022:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.919032:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281289344 00000100:00100000:2.0:1713279306.919035:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281289344 00000100:00100000:0.0:1713279306.919037:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.919037:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.919043:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.919047:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713279306.919050:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281289408 00000100:00100000:2.0:1713279306.919052:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281289408 00000100:00100000:0.0:1713279306.919053:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785528 00000100:00100000:1.0:1713279306.919055:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121986300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200061632:0@lo:101:mdt_io00_007.0 00000100:00100000:0.0:1713279306.919056:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3710:11711:x1796503281289344:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.919059:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785529 00010000:00010000:0.0:1713279306.919062:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.919062:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11204:x1796503281289408:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.919080:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edaad04 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176276 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.919081:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.919087:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaad0b lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917626f expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.919090:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.919099:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800959c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.919107:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200061632 00000100:00100000:1.0:1713279306.919109:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200061632 00010000:00010000:2.0:1713279306.919109:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092725440/0xfc4b8e114edaad12 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.919113:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092725440/0xfc4b8e114edaad12 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.919117:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaad19 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.919117:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092725440/0xfc4b8e114edaad12 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.919119:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98930 00010000:00010000:0.0:1713279306.919122:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaad19 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.919122:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+54:15514:x1796503200061632:12345-0@lo:101:mdt_io00_007.0 00010000:00010000:2.0:1713279306.919123:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114edaad20 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.919126:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaad19 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.919127:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114edaad20 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.919130:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114edaad20 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.919131:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaad27 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.919131:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.919134:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaad27 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.919137:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaad27 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.919137:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53b3c0/0xfc4b8e114edaad2e lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114edaacfd expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.919141:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092725440/0xfc4b8e114edaad12 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.919144:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092725440/0xfc4b8e114edaad12 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000004:00200000:0.0:1713279306.919145:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:1.0:1713279306.919147:0:15494:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53b3c0/0xfc4b8e114edaad2e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114edaacfd expref: 55 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.919147:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092725440/0xfc4b8e114edaad12 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.919149:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaad19 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.919150:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092725440/0xfc4b8e114edaad12 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.919152:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaad19 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.919152:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53b3c0/0xfc4b8e114edaad2e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaacfd expref: 55 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.919153:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092725440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.919154:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092725440/0xfc4b8e114edaad12 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.919155:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaad19 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.919156:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880131200900) 00010000:00010000:1.0:1713279306.919157:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.919157:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092725440/0xfc4b8e114edaad12 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.919159:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaad19 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.919159:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c53b3c0, rc 0) 00010000:00010000:0.0:1713279306.919161:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092542880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.919161:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:2.0:1713279306.919162:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.919163:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaad19 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.919164:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092725440/0xfc4b8e114edaad12 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.919166:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaad19 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.919167:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092725440/0xfc4b8e114edaad12 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.919171:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114edaad20 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.919173:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15514:x1796503200061632:12345-0@lo:101:mdt_io00_007.0 Request processed in 50us (83us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.919174:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114edaad20 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.919177:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98930 00010000:00010000:2.0:1713279306.919177:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114edaad20 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.919180:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012154fa80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.919181:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114edaad20 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.919184:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114edaad20 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.919188:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880096b90f00) 00010000:00010000:2.0:1713279306.919189:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.919190:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114edaad20 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.919191:0:15514:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4295202786 gen 2 00010000:00010000:2.0:1713279306.919193:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154fa80/0xfc4b8e114edaad20 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000004:00080000:1.0:1713279306.919194:0:15514:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202773 committed transno 4295202786 00010000:00010000:2.0:1713279306.919203:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaad0b lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917626f expref: 3713 pid: 15484 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713279306.919207:0:15514:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202776 committed transno 4295202786 00010000:00010000:2.0:1713279306.919207:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d73c0/0xfc4b8e114edaad0b lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917626f expref: 3713 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.919211:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f1d73c0, rc 0) 00010000:00010000:0.0:1713279306.919226:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8800958c9700) 00010000:00010000:0.0:1713279306.919228:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.919230:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaad19 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000004:00080000:1.0:1713279306.919232:0:15514:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202786 committed transno 4295202786 00010000:00010000:0.0:1713279306.919233:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edaad19 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.919234:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11204:x1796503281289408:12345-192.168.203.4@tcp:101:touch.0 Request processed in 171us (196us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.919238:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaad27 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.919238:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785529 00010000:00010000:0.0:1713279306.919241:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaad27 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.919241:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121986300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200061632:0@lo:101:mdt_io00_007.0 00010000:00010000:0.0:1713279306.919244:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaad27 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.919246:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092541440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.919247:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaad2e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.919248:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaad27 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.919251:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaad27 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.919253:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaad2e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.919257:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff8800958c9300) 00010000:00010000:0.0:1713279306.919258:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:1.0:1713279306.919259:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1713279306.919260:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaad27 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.919261:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.919262:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edaad27 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.919271:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281289536 00000100:00100000:2.0:1713279306.919273:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281289536 00000100:00100000:1.0:1713279306.919276:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099c2c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200061696:0@lo:1000:mdt_io00_007.0 00010000:00010000:0.0:1713279306.919277:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edaad04 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176276 expref: 3711 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.919281:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edaad04 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176276 expref: 3711 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.919282:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785530 00000100:00100000:2.0:1713279306.919285:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3661:11912:x1796503281289536:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.919286:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092541b00, rc 0) 00000100:00100000:1.0:1713279306.919289:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713279306.919289:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.919295:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaad35 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917627d expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.919299:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3710:11711:x1796503281289344:12345-192.168.203.4@tcp:101:touch.0 Request processed in 243us (277us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.919303:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785528 00000100:00100000:1.0:1713279306.919306:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a0e540 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.919306:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200061696 00000100:00100000:3.0:1713279306.919309:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200061696 00010000:00010000:2.0:1713279306.919313:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaad3c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.919317:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaad3c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919321:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaad3c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.919322:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98931 00000100:00100000:3.0:1713279306.919325:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:15514:x1796503200061696:12345-0@lo:1000:mdt_io00_007.0 00010000:00010000:2.0:1713279306.919326:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edaad43 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.919329:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edaad43 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919332:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edaad43 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919341:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaad3c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919344:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaad3c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919347:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaad3c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919350:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaad3c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919353:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012154ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.919354:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaad3c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.919355:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:15514:x1796503200061696:12345-0@lo:1000:mdt_io00_007.0 Request processed in 30us (66us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.919359:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98931 00010000:00010000:2.0:1713279306.919360:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaad3c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919363:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88007fdca600) 00010000:00010000:2.0:1713279306.919364:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.919366:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaad3c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919368:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edaad3c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919373:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edaad43 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919375:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edaad43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919378:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edaad43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919380:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801237d9b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.919381:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edaad43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919384:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edaad43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919387:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88011eea4100) 00010000:00010000:2.0:1713279306.919389:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.919390:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edaad43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.919392:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edaad43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.919402:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099c2c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200061696:0@lo:1000:mdt_io00_007.0 00010000:00010000:2.0:1713279306.919402:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaad35 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917627d expref: 3662 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.919407:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d200/0xfc4b8e114edaad35 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917627d expref: 3662 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.919428:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012154d200, rc 0) 00000004:00080000:0.0:1713279306.919430:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x84a3:0x0] 00000100:00100000:0.0:1713279306.919445:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095210a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200061760:0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.919446:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.919450:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3661:11912:x1796503281289536:12345-192.168.203.4@tcp:101:touch.0 Request processed in 163us (188us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.919455:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785530 00000100:00100000:3.0:1713279306.919455:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281289664 00000100:00100000:3.0:1713279306.919458:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281289664 00000100:00100000:0.0:1713279306.919461:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.919467:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785531 00000100:00100000:2.0:1713279306.919481:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3710:12018:x1796503281289664:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:3.0:1713279306.919481:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200061760 00000100:00100000:0.0:1713279306.919482:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800959c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.919483:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200061760 00010000:00010000:2.0:1713279306.919488:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.919490:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98932 00000100:00100000:3.0:1713279306.919492:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:15514:x1796503200061760:12345-0@lo:1000:mdt_io00_007.0 00010000:00010000:2.0:1713279306.919495:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114edaad4a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176284 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.919523:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:15514:x1796503200061760:12345-0@lo:1000:mdt_io00_007.0 Request processed in 29us (61us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.919526:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98932 00000100:00100000:0.0:1713279306.919530:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095210a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200061760:0@lo:1000:mdt_io00_007.0 00010000:00010000:2.0:1713279306.919532:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaad51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x8235:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.919552:0:15484:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda863e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175812 expref: 3711 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.919559:0:15484:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda97f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cf7 expref: 3711 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.919566:0:15484:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaad51 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x8235:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.919583:0:15484:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda97f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cf7 expref: 3711 pid: 15481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.919591:0:15484:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda97f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cf7 expref: 3711 pid: 15481 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.919600:0:15484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be06300 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000_UUID:15484:1796503200061824:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.919639:0:15484:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda863e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175812 expref: 3711 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.919646:0:15484:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda863e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175812 expref: 3711 pid: 9221 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.919655:0:15484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000_UUID:15484:1796503200061888:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.919680:0:15484:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c199780 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.919711:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.919720:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281289792 00000100:00100000:3.0:1713279306.919723:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281289792 00000100:00100000:3.0:1713279306.919732:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223135 00000100:00100000:3.0:1713279306.919735:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3712:11736:x1796503281289792:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.919789:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3713:11736:x1796503281289792:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 52us (78us total) trans 4295202789 rc 0/0 00000100:00100000:3.0:1713279306.919793:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223135 00000100:00100000:1.0:1713279306.919957:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.919983:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281289920 00000100:00100000:3.0:1713279306.919985:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281289920 00000100:00100000:3.0:1713279306.919996:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785532 00000100:00100000:3.0:1713279306.920009:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3661:11711:x1796503281289920:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.920014:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.920021:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114edaad58 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917628b expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.920045:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d8c0/0xfc4b8e114edaad5f lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.920050:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d8c0/0xfc4b8e114edaad5f lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920054:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d8c0/0xfc4b8e114edaad5f lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920059:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942eac0/0xfc4b8e114edaad66 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.920063:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942eac0/0xfc4b8e114edaad66 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920087:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942eac0/0xfc4b8e114edaad66 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920100:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d8c0/0xfc4b8e114edaad5f lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920103:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d8c0/0xfc4b8e114edaad5f lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920106:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d8c0/0xfc4b8e114edaad5f lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920112:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d8c0/0xfc4b8e114edaad5f lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.920114:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095210a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200061952:0@lo:403:mdt_io00_007.0 00010000:00010000:3.0:1713279306.920115:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942d8c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.920117:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d8c0/0xfc4b8e114edaad5f lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920120:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d8c0/0xfc4b8e114edaad5f lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920124:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88008e735100) 00010000:00010000:3.0:1713279306.920126:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.920127:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d8c0/0xfc4b8e114edaad5f lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920130:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942d8c0/0xfc4b8e114edaad5f lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920135:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942eac0/0xfc4b8e114edaad66 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.920141:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.920141:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942eac0/0xfc4b8e114edaad66 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920144:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942eac0/0xfc4b8e114edaad66 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920146:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942eac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.920147:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942eac0/0xfc4b8e114edaad66 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920150:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942eac0/0xfc4b8e114edaad66 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.920155:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a0e540 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.920156:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff88008e735c00) 00010000:00010000:3.0:1713279306.920157:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.920159:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942eac0/0xfc4b8e114edaad66 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920162:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942eac0/0xfc4b8e114edaad66 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920174:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114edaad58 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917628b expref: 3662 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.920178:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cd80/0xfc4b8e114edaad58 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917628b expref: 3662 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.920181:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200061952 00010000:00010000:3.0:1713279306.920183:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942cd80, rc 0) 00000100:00100000:2.0:1713279306.920185:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200061952 00000100:00100000:3.0:1713279306.920200:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3661:11711:x1796503281289920:12345-192.168.203.4@tcp:101:touch.0 Request processed in 190us (244us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.920205:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785532 00000100:00100000:2.0:1713279306.920208:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98933 00000100:00100000:2.0:1713279306.920213:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:15514:x1796503200061952:12345-0@lo:403:mdt_io00_007.0 00000100:00100000:1.0:1713279306.920247:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.920258:0:15484:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be06300 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000_UUID:15484:1796503200061824:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.920265:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281290048 00000100:00100000:3.0:1713279306.920267:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281290048 00000100:00100000:3.0:1713279306.920276:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785533 00000100:00100000:3.0:1713279306.920278:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3661:11912:x1796503281290048:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.920284:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.920288:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.920289:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cb40/0xfc4b8e114edaad6d lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176292 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.920298:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281290112 00000100:00100000:0.0:1713279306.920301:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281290112 00010000:00010000:0.0:1713279306.920310:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda97f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cf7 expref: 3713 pid: 15481 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.920320:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196601 00010000:00010000:3.0:1713279306.920321:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114edaad74 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.920323:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3713:1957:x1796503281290112:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.920326:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114edaad74 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.920328:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.920330:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda97f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cf7 expref: 3713 pid: 15481 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.920330:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114edaad74 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.920335:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda97f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cf7 expref: 3713 pid: 15481 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.920335:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114edaad7b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.920338:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114edaad7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920341:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114edaad7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.920342:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114eda97f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cf7 expref: 3713 pid: 15481 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.920348:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8235:0x0].0x0 (ffff880096da6c00) 00000004:00200000:3.0:1713279306.920348:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:0.0:1713279306.920350:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaad51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x8235:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.920354:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaad51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x8235:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.920357:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.920369:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3712:1957:x1796503281290112:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 45us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.920373:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196601 00010000:00010000:3.0:1713279306.920375:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114edaad74 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920379:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114edaad74 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920382:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114edaad74 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920385:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114edaad74 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920387:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.920389:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114edaad74 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920391:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114edaad74 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920398:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880097910900) 00010000:00010000:3.0:1713279306.920400:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.920401:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114edaad74 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920404:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942ef40/0xfc4b8e114edaad74 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920409:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114edaad7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920430:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114edaad7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920433:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114edaad7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920436:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008942e400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.920437:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114edaad7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920440:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114edaad7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920443:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88011eea5000) 00010000:00010000:3.0:1713279306.920445:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.920446:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114edaad7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920449:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942e400/0xfc4b8e114edaad7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.920462:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cb40/0xfc4b8e114edaad6d lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176292 expref: 3662 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.920469:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008942cb40/0xfc4b8e114edaad6d lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176292 expref: 3662 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.920475:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942cb40, rc 0) 00000100:00100000:3.0:1713279306.920493:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3661:11912:x1796503281290048:12345-192.168.203.4@tcp:101:touch.0 Request processed in 214us (247us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.920497:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785533 00000100:00100000:1.0:1713279306.920513:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.920513:0:15484:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000_UUID:15484:1796503200061888:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.920522:0:15484:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaad51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x8235:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.920539:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281290176 00000100:00100000:0.0:1713279306.920542:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281290176 00010000:00010000:0.0:1713279306.920550:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda863e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175812 expref: 3712 pid: 9221 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.920559:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196602 00000100:00100000:0.0:1713279306.920562:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b25ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1954:x1796503281290176:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.920567:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.920569:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda863e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175812 expref: 3712 pid: 9221 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.920574:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda863e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175812 expref: 3712 pid: 9221 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.920581:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9818c0/0xfc4b8e114eda863e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175812 expref: 3712 pid: 9221 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.920587:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8235:0x0].0x0 (ffff880096da6c00) 00010000:00010000:0.0:1713279306.920589:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaad51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x8235:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.920593:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaad51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x8235:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.920595:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaad51 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x8235:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.920602:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.920608:0:15484:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaad51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x8235:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920611:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaad51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x8235:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.920614:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b25ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:1954:x1796503281290176:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 51us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.920617:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196602 00000004:00200000:3.0:1713279306.920617:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x8235:0x0]: returning size 12827 00010000:00010000:3.0:1713279306.920647:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c366880/0xfc4b8e114edaad4a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176284 expref: 3713 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.920653:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f3c480/0xfc4b8e114edaad51 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x8235:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176284 expref: 3712 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.920657:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8235:0x0].0x0 (ffff880096da6c00) 00010000:00010000:3.0:1713279306.920658:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1713279306.920660:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f3c480, rc 0) 00000100:00100000:3.0:1713279306.920675:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3712:12018:x1796503281289664:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 1194us (1231us total) trans 4295202790 rc 0/0 00000100:00100000:3.0:1713279306.920679:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785531 00000100:00100000:0.0:1713279306.920793:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.920803:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281290432 00000100:00100000:3.0:1713279306.920805:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281290432 00000100:00100000:0.0:1713279306.920809:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.920813:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281290304 00000100:00100000:3.0:1713279306.920814:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281290304 00000100:00100000:3.0:1713279306.920820:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785534 00000100:00100000:3.0:1713279306.920823:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3712:11711:x1796503281290432:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.920825:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785535 00010000:00010000:3.0:1713279306.920828:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.920829:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3661:12029:x1796503281290304:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.920833:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c480/0xfc4b8e114edaad89 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391762a0 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.920835:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.920842:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ad00/0xfc4b8e114edaad90 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176299 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.920868:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114edaad97 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920872:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114edaad97 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.920876:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaad9e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.920877:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114edaad97 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.920881:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaad9e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.920882:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edaada5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.920885:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaad9e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.920885:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edaada5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920889:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edaada5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.920891:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaadac lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.920895:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaadac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000004:00200000:3.0:1713279306.920896:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:1.0:1713279306.920898:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaadac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.920900:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114edaad97 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920903:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114edaad97 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920906:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114edaad97 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920909:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114edaad97 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920911:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009160a880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.920913:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114edaad97 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920916:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114edaad97 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.920917:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd8c0/0xfc4b8e114edaadb3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.920919:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8800937cef00) 00010000:00010000:3.0:1713279306.920920:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.920921:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd8c0/0xfc4b8e114edaadb3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.920922:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114edaad97 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920924:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009160a880/0xfc4b8e114edaad97 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.920925:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd8c0/0xfc4b8e114edaadb3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00200000:1.0:1713279306.920929:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x758f:0x0]: returning size 64588 00010000:00010000:3.0:1713279306.920929:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edaada5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920932:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edaada5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920942:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edaada5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920944:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.920946:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edaada5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920949:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edaada5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920952:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff8800937cec00) 00010000:00010000:3.0:1713279306.920953:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.920954:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edaada5 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.920957:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edaada5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.920959:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaad9e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.920963:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaad9e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.920966:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaad9e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.920969:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaad9e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.920969:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c480/0xfc4b8e114edaad89 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762a0 expref: 3713 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.920971:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935beac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.920973:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaad9e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.920973:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008942c480/0xfc4b8e114edaad89 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762a0 expref: 3713 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.920976:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaad9e lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.920977:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008942c480, rc 0) 00010000:00010000:1.0:1713279306.920980:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:1.0:1713279306.920982:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.920983:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaad9e lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.920989:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935beac0/0xfc4b8e114edaad9e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.920994:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3712:11711:x1796503281290432:12345-192.168.203.4@tcp:101:touch.0 Request processed in 169us (201us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.920995:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaadac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.920997:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaadac lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.920997:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785534 00010000:00010000:1.0:1713279306.921000:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaadac lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921003:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.921004:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaadac lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921007:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaadac lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921010:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3431 (ffff8800934f8c00) 00010000:00010000:1.0:1713279306.921011:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.921012:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaadac lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921015:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be400/0xfc4b8e114edaadac lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921030:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ad00/0xfc4b8e114edaad90 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176299 expref: 3664 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.921036:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd8c0/0xfc4b8e114edaadb3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x758f:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176299 expref: 3663 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.921043:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x758f:0x0].0x0 (ffff8800908e1600) 00010000:00010000:1.0:1713279306.921044:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1713279306.921046:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bd8c0, rc 0) 00000100:00100000:1.0:1713279306.921060:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3663:12029:x1796503281290304:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 231us (251us total) trans 4295183807 rc 0/0 00000100:00100000:1.0:1713279306.921065:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785535 00000100:00100000:0.0:1713279306.921098:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.921126:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.921136:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281290560 00000100:00100000:1.0:1713279306.921139:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281290560 00000100:00100000:1.0:1713279306.921149:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281290688 00000100:00100000:1.0:1713279306.921150:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281290688 00000100:00100000:3.0:1713279306.921155:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785536 00000100:00100000:3.0:1713279306.921158:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3712:12050:x1796503281290560:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:1.0:1713279306.921162:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785537 00010000:00010000:3.0:1713279306.921164:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.921165:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3663:11912:x1796503281290688:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.921170:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.921170:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981680/0xfc4b8e114edaadc1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391762a7 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.921175:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114edaadc8 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391762ae expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.921196:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114edaadcf lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.921200:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114edaadcf lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921203:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edaadd6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921204:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114edaadcf lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921208:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edaadd6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921209:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114edaaddd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.921212:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edaadd6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921213:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114edaaddd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921216:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114edaaddd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921217:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edaade4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.921221:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edaade4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.921224:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edaade4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921226:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114edaadcf lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921229:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114edaadcf lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921232:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114edaadcf lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921236:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114edaadcf lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921238:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bfa80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.921240:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114edaadcf lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921242:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114edaadcf lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921246:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88008c5c2000) 00010000:00010000:1.0:1713279306.921247:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:3.0:1713279306.921247:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7f51:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.921249:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114edaadcf lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921251:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bfa80/0xfc4b8e114edaadcf lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921252:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edaadd6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.921255:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edaadd6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921256:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114edaaddd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921258:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edaadd6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921259:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114edaaddd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921261:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edaadd6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921262:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114edaaddd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921264:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.921265:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bf180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.921265:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edaadd6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921266:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114edaaddd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921268:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edaadd6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921269:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114edaaddd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921272:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff8800934f8000) 00010000:00010000:1.0:1713279306.921273:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.921273:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:1.0:1713279306.921274:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114edaaddd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921274:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.921275:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edaadd6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921276:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf180/0xfc4b8e114edaaddd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921278:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edaadd6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.921283:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edaade4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921286:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114edaadc8 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762ae expref: 3664 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.921286:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edaade4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.921289:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edaade4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921290:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bcd80/0xfc4b8e114edaadc8 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762ae expref: 3664 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.921291:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.921293:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edaade4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921295:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bcd80, rc 0) 00010000:00010000:3.0:1713279306.921295:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edaade4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.921298:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3631 (ffff88007f157a00) 00010000:00010000:3.0:1713279306.921299:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.921301:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edaade4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.921303:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edaade4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.921311:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3663:11912:x1796503281290688:12345-192.168.203.4@tcp:101:touch.0 Request processed in 145us (184us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.921314:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981680/0xfc4b8e114edaadc1 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762a7 expref: 3713 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.921315:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785537 00010000:00010000:3.0:1713279306.921318:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981680/0xfc4b8e114edaadc1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762a7 expref: 3713 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.921322:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d981680, rc 0) 00000100:00100000:3.0:1713279306.921336:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3712:12050:x1796503281290560:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 177us (239us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.921340:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785536 00000100:00100000:2.0:1713279306.921546:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:15514:x1796503200061952:12345-0@lo:403:mdt_io00_007.0 Request processed in 1332us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.921551:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98933 00000100:00100000:0.0:1713279306.921595:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095210a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200061952:0@lo:403:mdt_io00_007.0 00000100:00100000:1.0:1713279306.921790:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.921814:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.921815:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.921825:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281290752 00000100:00100000:2.0:1713279306.921828:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281290752 00000100:00100000:2.0:1713279306.921842:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110575 00000100:00100000:2.0:1713279306.921847:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+82:1955:x1796503281290752:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:3.0:1713279306.921852:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281290880 00000100:00100000:3.0:1713279306.921856:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281290880 00000100:00100000:3.0:1713279306.921870:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281291136 00000100:00100000:3.0:1713279306.921871:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281291136 00000100:00100000:1.0:1713279306.921877:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785538 00000100:00100000:1.0:1713279306.921880:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3449:11204:x1796503281290880:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.921887:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785539 00010000:00010000:1.0:1713279306.921889:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.921891:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3663:11711:x1796503281291136:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.921894:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114edaadeb lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391762b5 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.921898:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.921905:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981440/0xfc4b8e114edaadf2 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391762bc expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.921929:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114edaadf9 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.921930:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114edaae00 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921933:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114edaadf9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921935:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114edaae00 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.921938:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114edaadf9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921940:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114edaae00 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.921943:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114edaae07 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.921946:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114edaae07 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921948:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114edaae0e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.921949:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114edaae07 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921951:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114edaae0e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00002000:00010000:2.0:1713279306.921953:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb size from disk: 12827 -> 52702 00010000:00010000:3.0:1713279306.921955:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114edaae0e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00002000:00010000:2.0:1713279306.921956:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00000004:00200000:1.0:1713279306.921957:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00002000:00010000:2.0:1713279306.921959:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:2.0:1713279306.921961:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00010000:00010000:1.0:1713279306.921962:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114edaadf9 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00002000:00010000:2.0:1713279306.921963:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb blocks from disk: 80 -> 104 00010000:00010000:1.0:1713279306.921966:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114edaadf9 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921967:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114edaae00 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.921969:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114edaadf9 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921970:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114edaae00 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.921973:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114edaae00 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.921974:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114edaadf9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921976:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114edaae00 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.921977:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bf3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.921978:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114edaadf9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921978:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.921980:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114edaae00 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.921981:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114edaadf9 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921983:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114edaae00 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.921985:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00000100:00100000:2.0:1713279306.921985:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+83:1955:x1796503281290752:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 136us (169us total) trans 4295010140 rc 0/0 00010000:00010000:1.0:1713279306.921986:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.921987:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114edaadf9 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921987:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880129b60a00) 00010000:00010000:3.0:1713279306.921989:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.921990:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bf3c0/0xfc4b8e114edaadf9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921990:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114edaae00 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.921991:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110575 00010000:00010000:3.0:1713279306.921993:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983600/0xfc4b8e114edaae00 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.921994:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114edaae07 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.921997:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114edaae07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.921999:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114edaae0e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922000:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114edaae07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.922002:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114edaae0e lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922003:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bc000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.922004:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114edaae07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.922006:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114edaae0e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922007:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114edaae07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.922008:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d9821c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.922009:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114edaae0e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922012:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff8800927e1400) 00010000:00010000:3.0:1713279306.922012:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114edaae0e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922014:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.922015:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114edaae07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.922015:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880129b60f00) 00010000:00010000:3.0:1713279306.922016:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.922017:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114edaae0e lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922018:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bc000/0xfc4b8e114edaae07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.922020:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9821c0/0xfc4b8e114edaae0e lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.922022:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.922029:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114edaadeb lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762b5 expref: 3450 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.922033:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935bd440/0xfc4b8e114edaadeb lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762b5 expref: 3450 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.922033:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981440/0xfc4b8e114edaadf2 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762bc expref: 3664 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.922034:0:15534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281291072 00010000:00010000:1.0:1713279306.922037:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bd440, rc 0) 00000100:00100000:2.0:1713279306.922037:0:15534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281291072 00010000:00010000:3.0:1713279306.922037:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981440/0xfc4b8e114edaadf2 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762bc expref: 3664 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.922042:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d981440, rc 0) 00000100:00100000:1.0:1713279306.922051:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3449:11204:x1796503281290880:12345-192.168.203.4@tcp:101:touch.0 Request processed in 170us (262us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.922055:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785538 00000100:00100000:2.0:1713279306.922062:0:15534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14365 00000100:00100000:2.0:1713279306.922078:0:15534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_011:385c4b71-808c-40cf-91de-b076b668d13f+3712:11999:x1796503281291072:12345-192.168.203.4@tcp:36:lfs.0 00000100:00100000:1.0:1713279306.922094:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.922094:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3663:11711:x1796503281291136:12345-192.168.203.4@tcp:101:touch.0 Request processed in 201us (279us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.922098:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785539 00000100:00100000:3.0:1713279306.922106:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281291264 00000100:00100000:3.0:1713279306.922108:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281291264 00010000:00010000:2.0:1713279306.922114:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00000100:00100000:3.0:1713279306.922117:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785540 00000100:00100000:3.0:1713279306.922119:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3449:12033:x1796503281291264:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.922123:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53b3c0/0xfc4b8e114edaad2e lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaacfd expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.922124:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.922127:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.922129:0:15534:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:3.0:1713279306.922130:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983840/0xfc4b8e114edaae1c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391762c3 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.922143:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.922143:0:15534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53b3c0/0xfc4b8e114edaad2e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfc4b8e114edaacfd expref: 54 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.922152:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281291392 00000100:00100000:2.0:1713279306.922152:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200062016:0@lo:104: 00000100:00100000:1.0:1713279306.922155:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281291392 00000100:00100000:1.0:1713279306.922164:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785541 00010000:00010000:3.0:1713279306.922165:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edaae23 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.922167:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3713:12021:x1796503281291392:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.922170:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edaae23 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922173:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.922174:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.922174:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edaae23 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922177:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114edaae2a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391762ca expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.922179:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edaae31 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.922182:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edaae31 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.922185:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c199780 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.922186:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edaae31 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.922195:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281291456 00000100:00100000:2.0:1713279306.922198:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281291456 00010000:00010000:0.0:1713279306.922201:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092542640/0xfc4b8e114edaae38 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713279306.922206:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092542640/0xfc4b8e114edaae38 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.922211:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092542640/0xfc4b8e114edaae38 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.922212:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114edaae3f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.922212:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110576 00000100:00100000:2.0:1713279306.922216:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+84:12029:x1796503281291456:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.922217:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114edaae3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.922218:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd43b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062080:0@lo:101:mdt_io00_007.0 00010000:00010000:1.0:1713279306.922221:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114edaae3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.922222:0:15783:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:3.0:1713279306.922225:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x700e:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.922226:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114edaae46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.922229:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114edaae46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.922230:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edaae23 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.922231:0:15783:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013076f840/0xfc4b8e114edaae4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391762d1 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.922232:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.922233:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114edaae46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.922233:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edaae23 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.922236:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edaae23 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.922239:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a0e540 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.922239:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edaae23 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000004:00200000:1.0:1713279306.922240:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8516:0x0]: returning size 1 00010000:00010000:3.0:1713279306.922242:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.922243:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edaae23 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922245:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114edaae3f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.922246:0:15783:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935bdf80/0xfc4b8e114eda27da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173f14 expref: 94 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.922246:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edaae23 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.922247:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200062080 00010000:00010000:1.0:1713279306.922248:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114edaae3f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.922249:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200062080 00010000:00010000:3.0:1713279306.922250:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:1.0:1713279306.922251:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114edaae3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.922251:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.922253:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.922253:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edaae23 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922254:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114edaae3f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.922254:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.922256:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edaae23 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922257:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935be1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.922257:0:15783:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013076f840/0xfc4b8e114edaae4d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [8192->36863] (req 8192->36863) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762d1 expref: 85 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.922258:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114edaae3f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.922259:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98934 00010000:00010000:3.0:1713279306.922260:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edaae31 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.922262:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:15514:x1796503200062080:12345-0@lo:101:mdt_io00_007.0 00010000:00010000:1.0:1713279306.922262:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114edaae3f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.922262:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edaae31 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.922265:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edaae31 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922266:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:0.0:1713279306.922267:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.922267:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.922268:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114edaae3f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.922268:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.922269:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edaae31 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922271:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935be1c0/0xfc4b8e114edaae3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.922271:0:15783:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935bdf80/0xfc4b8e114eda27da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173f14 expref: 94 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.922273:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b58c0/0xfc4b8e114edaae54 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114edaae38 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.922275:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114edaae46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.922275:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edaae31 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922278:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114edaae46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.922278:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x38 (ffff880129b60300) 00010000:00010000:3.0:1713279306.922279:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.922280:0:15783:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935bdf80/0xfc4b8e114eda27da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173f14 expref: 94 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.922280:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edaae31 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922281:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114edaae46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.922283:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800935bcfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.922283:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edaae31 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.922284:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114edaae46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.922287:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114edaae46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.922289:0:15783:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0000_UUID:15783:1796503200062144:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.922291:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3931 (ffff880096b8ed00) 00010000:00010000:1.0:1713279306.922292:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.922293:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114edaae46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.922294:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983840/0xfc4b8e114edaae1c lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762c3 expref: 3450 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.922296:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcfc0/0xfc4b8e114edaae46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.922298:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983840/0xfc4b8e114edaae1c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762c3 expref: 3450 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.922302:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d983840, rc 0) 00000100:00100000:2.0:1713279306.922306:0:15783:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ffbd180 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.922308:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114edaae2a lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762ca expref: 3714 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.922312:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bfcc0/0xfc4b8e114edaae2a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762ca expref: 3714 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.922316:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935bfcc0, rc 0) 00000100:00100000:3.0:1713279306.922319:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3449:12033:x1796503281291264:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 198us (224us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.922320:0:6913:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1713279306.922323:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785540 00000100:00100000:2.0:1713279306.922326:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200062016 00010000:00010000:0.0:1713279306.922327:0:15516:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b58c0/0xfc4b8e114edaae54 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114edaae38 expref: 56 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.922328:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200062016 00000100:00100000:1.0:1713279306.922329:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3713:12021:x1796503281291392:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 161us (186us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.922333:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b58c0/0xfc4b8e114edaae54 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaae38 expref: 56 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.922333:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785541 00010000:00010000:0.0:1713279306.922340:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x0 (ffff88009588c100) 00010000:00010000:0.0:1713279306.922341:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.922343:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801245b58c0, rc 0) 00000100:00100000:2.0:1713279306.922343:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33459 00000100:00100000:2.0:1713279306.922348:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095b25850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15534:x1796503200062016:12345-0@lo:104: 00010000:00010000:2.0:1713279306.922354:0:6913:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114edaad2e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.922359:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+56:15514:x1796503200062080:12345-0@lo:101:mdt_io00_007.0 Request processed in 97us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.922363:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98934 00000100:00100000:1.0:1713279306.922370:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd43b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062080:0@lo:101:mdt_io00_007.0 00010000:00010000:1.0:1713279306.922376:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092542640/0xfc4b8e114edaae38 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaae54 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.922381:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092542640/0xfc4b8e114edaae38 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaae54 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.922386:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200062016:0@lo:104: 00000004:00080000:1.0:1713279306.922389:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24c:0x0] 00010000:00010000:2.0:1713279306.922392:0:6913:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1713279306.922394:0:15534:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.922395:0:15544:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713279306.922397:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfc4b8e114edaad2e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.922397:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095b25850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15534:x1796503200062016:12345-0@lo:104: Request processed in 49us (223us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.922401:0:15544:0:(ldlm_lockd.c:1968:ldlm_handle_bl_callback()) Lock ffff88008c539b00 is referenced, will be cancelled later 00010000:00010000:1.0:1713279306.922403:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114edaad2e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.922403:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33459 00000100:00100000:0.0:1713279306.922405:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.922406:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.922407:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.922408:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.922432:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bc900/0xfc4b8e114edaae5b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.922435:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bc900/0xfc4b8e114edaae5b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.922439:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bc900/0xfc4b8e114edaae5b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00000100:00100000:1.0:1713279306.922446:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062208:0@lo:101:mdt_io00_007.0 00000100:00100000:1.0:1713279306.922459:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.922466:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097d1f180 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.922474:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281291584 00000100:00100000:1.0:1713279306.922476:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281291584 00000100:00100000:1.0:1713279306.922487:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785542 00000100:00100000:1.0:1713279306.922490:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3663:11912:x1796503281291584:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.922495:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.922500:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114edaae62 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391762d8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.922506:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200062208 00000100:00100000:0.0:1713279306.922509:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200062208 00000100:00100000:0.0:1713279306.922520:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98935 00000100:00100000:0.0:1713279306.922523:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+56:15514:x1796503200062208:12345-0@lo:101:mdt_io00_007.0 00000100:00100000:2.0:1713279306.922523:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.922528:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.922532:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114edaae69 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.922534:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114edaae70 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114edaae5b expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.922536:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114edaae69 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.922540:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114edaae69 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.922542:0:15516:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114edaae70 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114edaae5b expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.922546:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114edaae77 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.922547:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114edaae70 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edaae5b expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.922550:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114edaae77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.922551:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x36 (ffff88009588cf00) 00010000:00010000:0.0:1713279306.922552:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.922552:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281291712 00010000:00010000:0.0:1713279306.922553:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801245b61c0, rc 0) 00010000:00010000:1.0:1713279306.922553:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114edaae77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.922555:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281291712 00000004:00200000:1.0:1713279306.922559:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:1.0:1713279306.922564:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114edaae69 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.922566:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785543 00010000:00010000:1.0:1713279306.922567:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114edaae69 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.922569:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:12053:x1796503281291712:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:0.0:1713279306.922570:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+57:15514:x1796503200062208:12345-0@lo:101:mdt_io00_007.0 Request processed in 47us (110us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.922570:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114edaae69 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.922573:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114edaae69 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.922574:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98935 00010000:00010000:1.0:1713279306.922575:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008957c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.922576:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.922577:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114edaae69 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.922580:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114edaae69 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.922581:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981200/0xfc4b8e114edaae7e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391762df expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.922583:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096b8ec00) 00010000:00010000:1.0:1713279306.922584:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.922586:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114edaae69 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.922588:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062208:0@lo:101:mdt_io00_007.0 00010000:00010000:1.0:1713279306.922588:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008957c900/0xfc4b8e114edaae69 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.922594:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bc900/0xfc4b8e114edaae5b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaae70 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.922596:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114edaae77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279306.922599:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bc900/0xfc4b8e114edaae5b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaae70 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.922599:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114edaae77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.922601:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114edaae77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.922604:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801312f6640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.922605:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114edaae77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000004:00080000:0.0:1713279306.922606:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24c:0x0] 00010000:00010000:1.0:1713279306.922608:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114edaae77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.922611:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880096b8e700) 00010000:00010000:0.0:1713279306.922612:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaae85 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.922612:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.922613:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114edaae77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.922613:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114edaae8c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.922615:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaae85 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.922615:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801312f6640/0xfc4b8e114edaae77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.922617:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114edaae8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.922619:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaae85 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.922622:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114edaae8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.922624:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114edaae93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x233:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713279306.922635:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114edaae62 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762d8 expref: 3664 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.922637:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114edaae93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.922638:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edaae9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.922639:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800935be880/0xfc4b8e114edaae62 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762d8 expref: 3664 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.922640:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114edaae93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.922641:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edaae9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.922643:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935be880, rc 0) 00010000:00010000:3.0:1713279306.922645:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edaae9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.922652:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7831:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00000004:00200000:3.0:1713279306.922652:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8516:0x0]: returning size 1 00010000:00010000:0.0:1713279306.922657:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091d2b3c0/0xfc4b8e114edaac40 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x7831:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176229 expref: 3663 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.922657:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114edaae8c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.922659:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3663:11912:x1796503281291584:12345-192.168.203.4@tcp:101:touch.0 Request processed in 169us (255us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.922660:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.922660:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114edaae8c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.922663:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114edaae8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.922664:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785542 00010000:00010000:3.0:1713279306.922666:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114edaae8c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.922670:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880091d2b3c0/0xfc4b8e114edaac40 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7831:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176229 expref: 3662 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.922671:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.922673:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114edaae8c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.922676:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880091d2b3c0/0xfc4b8e114edaac40 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7831:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176229 expref: 3662 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.922676:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114edaae8c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.922680:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00000100:00100000:0.0:1713279306.922681:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095210a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001_UUID:15514:1796503200062272:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.922681:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.922682:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114edaae8c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.922685:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980240/0xfc4b8e114edaae8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.922689:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edaae9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.922692:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edaae9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.922695:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a0e540 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.922695:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edaae9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.922698:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d9833c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.922699:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edaae9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.922701:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edaae9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.922704:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3931 (ffff880129b60200) 00010000:00010000:3.0:1713279306.922705:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.922707:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edaae9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.922710:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edaae9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.922723:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981200/0xfc4b8e114edaae7e lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762df expref: 3712 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.922727:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981200/0xfc4b8e114edaae7e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762df expref: 3712 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.922731:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d981200, rc 0) 00000100:00100000:3.0:1713279306.922756:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:12053:x1796503281291712:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 185us (234us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.922760:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785543 00000100:00100000:0.0:1713279306.923103:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.923130:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.923140:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281291840 00000100:00100000:3.0:1713279306.923142:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281291840 00000100:00100000:3.0:1713279306.923158:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223136 00000100:00100000:2.0:1713279306.923159:0:15783:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0000_UUID:15783:1796503200062144:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.923161:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3713:12018:x1796503281291840:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:2.0:1713279306.923168:0:15783:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013076f840/0xfc4b8e114edaae4d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [8192->36863] (req 8192->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762d1 expref: 85 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.923175:0:15783:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013076f840, rc 0) 00000100:00100000:2.0:1713279306.923189:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+85:12029:x1796503281291456:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 973us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.923193:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110576 00000100:00100000:3.0:1713279306.923236:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3714:12018:x1796503281291840:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 73us (132us total) trans 4295202791 rc 0/0 00000100:00100000:3.0:1713279306.923240:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223136 00000100:00100000:3.0:1713279306.923250:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281291968 00000100:00100000:3.0:1713279306.923252:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281291968 00000100:00100000:3.0:1713279306.923261:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785544 00000100:00100000:3.0:1713279306.923264:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3714:11711:x1796503281291968:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.923269:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.923275:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edaaea8 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391762e6 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.923285:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.923310:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114edaaeaf lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.923311:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281292032 00010000:00010000:3.0:1713279306.923314:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114edaaeaf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.923316:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281292032 00010000:00010000:3.0:1713279306.923318:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114edaaeaf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.923324:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edaaeb6 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.923327:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edaaeb6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.923328:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935bdf80/0xfc4b8e114eda27da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173f14 expref: 95 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.923331:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edaaeb6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000004:00200000:3.0:1713279306.923338:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:3.0:1713279306.923342:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114edaaeaf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.923343:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196603 00010000:00010000:3.0:1713279306.923345:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114edaaeaf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.923347:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136052d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+95:1956:x1796503281292032:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.923348:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114edaaeaf lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.923351:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114edaaeaf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.923352:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.923353:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.923355:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114edaaeaf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.923358:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114edaaeaf lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.923360:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935bdf80/0xfc4b8e114eda27da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173f14 expref: 95 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.923362:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880129b60800) 00010000:00010000:3.0:1713279306.923364:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.923365:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114edaaeaf lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.923366:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935bdf80/0xfc4b8e114eda27da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173f14 expref: 95 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.923368:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114edaaeaf lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.923372:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edaaeb6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.923375:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edaaeb6 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.923376:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935bdf80/0xfc4b8e114eda27da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39173f14 expref: 95 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.923377:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edaaeb6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.923380:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.923381:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edaaeb6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.923382:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.923383:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.923384:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edaaeb6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.923387:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013076f840/0xfc4b8e114edaae4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762d1 expref: 84 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.923387:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880091b35500) 00010000:00010000:3.0:1713279306.923388:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.923389:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edaaeb6 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.923392:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013076f840/0xfc4b8e114edaae4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762d1 expref: 84 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.923394:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edaaeb6 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.923404:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013076f840/0xfc4b8e114edaae4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762d1 expref: 84 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.923407:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edaaea8 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762e6 expref: 3715 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.923410:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6917:1796503200062336:192.168.203.4@tcp:105: 00010000:00010000:3.0:1713279306.923427:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edaaea8 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762e6 expref: 3715 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.923433:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d980d80, rc 0) 00000100:00100000:1.0:1713279306.923453:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097d1f180 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.923455:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3714:11711:x1796503281291968:12345-192.168.203.4@tcp:101:touch.0 Request processed in 189us (325us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.923458:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785544 00000100:00100000:0.0:1713279306.923564:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.923586:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.923590:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281292160 00000100:00100000:3.0:1713279306.923592:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281292160 00000100:00100000:0.0:1713279306.923595:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281292288 00010000:00010000:1.0:1713279306.923596:0:15514:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880095210a80 x1796503200062272) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880091d2b3c0/0xfc4b8e114edaac40 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x7831:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176229 expref: 3662 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.923598:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281292288 00010000:00010000:1.0:1713279306.923604:0:15514:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091d2b3c0/0xfc4b8e114edaac40 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7831:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176229 expref: 3663 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.923604:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785545 00000100:00100000:3.0:1713279306.923607:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11204:x1796503281292160:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.923611:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785546 00010000:00010000:1.0:1713279306.923612:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091d2b3c0/0xfc4b8e114edaac40 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x7831:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176229 expref: 3663 pid: 15480 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.923612:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.923614:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3663:11912:x1796503281292288:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.923618:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095210a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001_UUID:15514:1796503200062272:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.923618:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114edaaebd lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391762ed expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.923620:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.923625:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114edaaec4 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391762f4 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.923626:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7831:0x0].0x0 (ffff88008bde0600) 00010000:00010000:1.0:1713279306.923628:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.923632:0:15514:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.923635:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.923637:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edaaecb lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.923641:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edaaecb lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.923642:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279306.923645:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaaed2 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.923645:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.923645:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edaaecb lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923649:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaaed2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.923650:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279306.923653:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114edaaed9 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923654:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaaed2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.923656:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114edaaed9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.923659:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114edaaed9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923662:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114edaaee0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.923665:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114edaaee0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.923668:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114edaaee0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.923670:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edaaecb lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.923673:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edaaecb lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.923675:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edaaecb lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923677:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaaed2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.923678:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edaaecb lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923680:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaaed2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.923681:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.923682:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edaaecb lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923683:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaaed2 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.923685:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edaaecb lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923686:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaaed2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.923689:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.923689:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:0.0:1713279306.923690:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaaed2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.923690:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062400:0@lo:1000:mdt_io00_007.0 00010000:00010000:3.0:1713279306.923690:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.923691:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edaaecb lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923693:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaaed2 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.923694:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edaaecb lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923697:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012cfc6a00) 00010000:00010000:0.0:1713279306.923698:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.923699:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114edaaed9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923700:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaaed2 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.923702:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114edaaed9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923703:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689f80/0xfc4b8e114edaaed2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.923706:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114edaaed9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000100:00100000:1.0:1713279306.923708:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.923708:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dca880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.923709:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114edaaee0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.923709:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114edaaed9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923712:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114edaaee0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.923712:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114edaaed9 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923715:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114edaaee0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.923715:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff880091b35d00) 00000100:00100000:1.0:1713279306.923716:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098f8b480 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.923716:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.923717:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114edaaed9 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923718:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68b600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.923719:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114edaaee0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.923720:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dca880/0xfc4b8e114edaaed9 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.923722:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114edaaee0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.923723:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200062400 00010000:00010000:0.0:1713279306.923725:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88012cfc6500) 00000100:00100000:1.0:1713279306.923725:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200062400 00010000:00010000:0.0:1713279306.923726:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.923727:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114edaaee0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.923729:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114edaaebd lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762ed expref: 3712 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.923730:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68b600/0xfc4b8e114edaaee0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.923733:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114edaaebd lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762ed expref: 3712 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.923737:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d9806c0, rc 0) 00010000:00010000:0.0:1713279306.923742:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114edaaec4 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762f4 expref: 3663 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.923743:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98936 00010000:00010000:0.0:1713279306.923746:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ad00/0xfc4b8e114edaaec4 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762f4 expref: 3663 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.923747:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15514:x1796503200062400:12345-0@lo:1000:mdt_io00_007.0 00010000:00010000:0.0:1713279306.923751:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68ad00, rc 0) 00000100:00100000:3.0:1713279306.923760:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11204:x1796503281292160:12345-192.168.203.4@tcp:101:touch.0 Request processed in 152us (196us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.923764:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785545 00000100:00100000:0.0:1713279306.923768:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3662:11912:x1796503281292288:12345-192.168.203.4@tcp:101:touch.0 Request processed in 153us (181us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.923773:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785546 00000100:00100000:1.0:1713279306.923794:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15514:x1796503200062400:12345-0@lo:1000:mdt_io00_007.0 Request processed in 46us (85us total) trans 0 rc -2/-2 00000100:00100000:1.0:1713279306.923798:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98936 00000100:00100000:0.0:1713279306.923803:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062400:0@lo:1000:mdt_io00_007.0 00000100:00100000:0.0:1713279306.923826:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062464:0@lo:1000:mdt_io00_007.0 00000100:00100000:0.0:1713279306.923841:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.923848:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120513b40 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.923851:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200062464 00000100:00100000:1.0:1713279306.923853:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200062464 00000100:00100000:1.0:1713279306.923865:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98937 00000100:00100000:1.0:1713279306.923867:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15514:x1796503200062464:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.923892:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15514:x1796503200062464:12345-0@lo:1000:mdt_io00_007.0 Request processed in 23us (50us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.923895:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98937 00000100:00100000:0.0:1713279306.923898:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062464:0@lo:1000:mdt_io00_007.0 00000100:00100000:0.0:1713279306.923978:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062528:0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.924018:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6917:1796503200062336:192.168.203.4@tcp:105: 00010000:00010000:1.0:1713279306.924024:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.924042:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.924049:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a0e540 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.924049:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136052d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+94:1956:x1796503281292032:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 702us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.924053:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196603 00000100:00100000:2.0:1713279306.924055:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200062528 00000100:00100000:2.0:1713279306.924059:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200062528 00000100:00100000:2.0:1713279306.924086:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98938 00000100:00100000:2.0:1713279306.924090:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac44a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15514:x1796503200062528:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:2.0:1713279306.924180:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac44a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15514:x1796503200062528:12345-0@lo:1000:mdt_io00_007.0 Request processed in 88us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.924187:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98938 00000100:00100000:0.0:1713279306.924254:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062528:0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.924289:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.924318:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281292416 00000100:00100000:1.0:1713279306.924321:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281292416 00000100:00100000:1.0:1713279306.924332:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785547 00000100:00100000:1.0:1713279306.924335:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3662:11711:x1796503281292416:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.924341:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.924347:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114edaaee7 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391762fb expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.924368:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114edaaeee lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.924373:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114edaaeee lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.924377:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114edaaeee lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.924382:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaaef5 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.924386:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaaef5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.924389:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaaef5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.924404:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114edaaeee lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.924408:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114edaaeee lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.924428:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062592:0@lo:1000:mdt_io00_007.0 00010000:00010000:1.0:1713279306.924431:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114edaaeee lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.924435:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.924437:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114edaaeee lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279306.924438:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.924441:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800943f3600 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.924444:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.924444:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114edaaeee lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.924445:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281292608 00000100:00100000:2.0:1713279306.924447:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281292608 00010000:00010000:1.0:1713279306.924450:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114edaaeee lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.924451:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098f8b480 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.924457:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880096b8e800) 00000100:00100000:0.0:1713279306.924458:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281292544 00000100:00100000:2.0:1713279306.924458:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110577 00010000:00010000:1.0:1713279306.924459:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.924460:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281292544 00000100:00100000:2.0:1713279306.924460:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281292608:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:1.0:1713279306.924462:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114edaaeee lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.924467:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800943f3600/0xfc4b8e114edaaeee lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:0.0:1713279306.924472:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785548 00000100:00100000:0.0:1713279306.924474:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281292544:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.924475:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaaef5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.924478:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaaef5 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.924480:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.924481:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaaef5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.924483:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009435eac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.924485:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaaef5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.924486:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaaefc lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176302 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.924488:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaaef5 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.924494:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880096b8e300) 00010000:00010000:1.0:1713279306.924495:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.924497:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaaef5 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.924499:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009435eac0/0xfc4b8e114edaaef5 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.924514:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114edaaee7 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762fb expref: 3665 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.924518:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fef8b40/0xfc4b8e114edaaee7 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762fb expref: 3665 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.924519:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaf03 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.924523:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fef8b40, rc 0) 00010000:00010000:0.0:1713279306.924524:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaf03 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.924528:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaf03 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.924533:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaf0a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.924536:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaf0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.924540:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaf0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00002000:00010000:2.0:1713279306.924545:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb size from disk: 64588 -> 64588 00000004:00200000:0.0:1713279306.924546:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00002000:00010000:2.0:1713279306.924547:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00000100:00100000:1.0:1713279306.924548:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3664:11711:x1796503281292416:12345-192.168.203.4@tcp:101:touch.0 Request processed in 211us (259us total) trans 0 rc 301/301 00002000:00010000:2.0:1713279306.924549:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:2.0:1713279306.924550:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.924551:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb blocks from disk: 96 -> 112 00010000:00010000:0.0:1713279306.924552:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaf03 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.924552:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785547 00010000:00010000:0.0:1713279306.924555:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaf03 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.924558:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaf03 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.924561:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaf03 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.924563:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68aac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.924565:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaf03 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.924565:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+86:1957:x1796503281292608:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 103us (131us total) trans 4295010200 rc 0/0 00010000:00010000:0.0:1713279306.924568:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaf03 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.924569:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110577 00010000:00010000:0.0:1713279306.924571:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff8800938abc00) 00010000:00010000:0.0:1713279306.924573:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.924575:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaf03 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.924578:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68aac0/0xfc4b8e114edaaf03 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.924578:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200062592 00000100:00100000:2.0:1713279306.924580:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200062592 00010000:00010000:0.0:1713279306.924583:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaf0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.924585:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaf0a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.924588:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaf0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.924589:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98939 00010000:00010000:0.0:1713279306.924591:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688480 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.924591:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15514:x1796503200062592:12345-0@lo:1000:mdt_io00_007.0 00010000:00010000:0.0:1713279306.924592:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaf0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.924595:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaf0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.924598:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff8800938ab700) 00010000:00010000:0.0:1713279306.924599:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.924600:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaf0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.924603:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e688480/0xfc4b8e114edaaf0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.924615:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaaefc lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176302 expref: 3663 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.924622:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e6886c0/0xfc4b8e114edaaefc lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176302 expref: 3663 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.924624:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15514:x1796503200062592:12345-0@lo:1000:mdt_io00_007.0 Request processed in 32us (179us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.924627:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e6886c0, rc 0) 00000100:00100000:2.0:1713279306.924627:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98939 00000100:00100000:1.0:1713279306.924634:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062592:0@lo:1000:mdt_io00_007.0 00000100:00100000:0.0:1713279306.924643:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3662:11912:x1796503281292544:12345-192.168.203.4@tcp:101:touch.0 Request processed in 168us (208us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.924647:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785548 00000100:00100000:1.0:1713279306.924656:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062656:0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.924669:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.924683:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097df83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.924695:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200062656 00000100:00100000:3.0:1713279306.924699:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200062656 00000100:00100000:3.0:1713279306.924717:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98940 00000100:00100000:3.0:1713279306.924721:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15514:x1796503200062656:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.924765:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15514:x1796503200062656:12345-0@lo:1000:mdt_io00_007.0 Request processed in 43us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.924769:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062656:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713279306.924771:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98940 00000100:00100000:1.0:1713279306.924807:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062720:0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.924820:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.924827:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009505ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.924830:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200062720 00000100:00100000:3.0:1713279306.924834:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200062720 00000100:00100000:3.0:1713279306.924845:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98941 00000100:00100000:3.0:1713279306.924847:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:15514:x1796503200062720:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:0.0:1713279306.924867:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.924876:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281292736 00000100:00100000:1.0:1713279306.924878:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281292736 00000100:00100000:3.0:1713279306.924883:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:15514:x1796503200062720:12345-0@lo:1000:mdt_io00_007.0 Request processed in 34us (61us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.924887:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98941 00000100:00100000:1.0:1713279306.924890:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785549 00000100:00100000:1.0:1713279306.924893:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3449:11204:x1796503281292736:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.924895:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062720:0@lo:1000:mdt_io00_007.0 00010000:00010000:1.0:1713279306.924900:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.924908:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40b40/0xfc4b8e114edaaf11 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176309 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.924951:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114edaaf18 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.924958:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114edaaf18 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.924964:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114edaaf18 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.924973:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114edaaf1f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.924978:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114edaaf1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.924983:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114edaaf1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000004:00200000:1.0:1713279306.924997:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:1.0:1713279306.925003:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114edaaf18 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.925007:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114edaaf18 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.925011:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114edaaf18 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.925016:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114edaaf18 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.925016:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.925020:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134a41f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.925022:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114edaaf18 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.925026:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114edaaf18 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.925032:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:1.0:1713279306.925035:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.925037:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114edaaf18 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.925041:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134a41f80/0xfc4b8e114edaaf18 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.925048:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114edaaf1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.925053:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114edaaf1f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.925058:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114edaaf1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.925062:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801312c58c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.925064:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114edaaf1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.925085:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114edaaf1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.925095:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88012cfc6800) 00010000:00010000:1.0:1713279306.925097:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.925100:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114edaaf1f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.925104:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801312c58c0/0xfc4b8e114edaaf1f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.925124:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40b40/0xfc4b8e114edaaf11 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176309 expref: 3450 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.925131:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134a40b40/0xfc4b8e114edaaf11 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176309 expref: 3450 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.925137:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134a40b40, rc 0) 00000100:00100000:1.0:1713279306.925163:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3449:11204:x1796503281292736:12345-192.168.203.4@tcp:101:touch.0 Request processed in 268us (295us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.925168:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785549 00000100:00100000:1.0:1713279306.925179:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281292864 00000100:00100000:1.0:1713279306.925181:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281292864 00000040:00080000:0.0:1713279306.925183:0:15514:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x1c0:0x0].1549, 1264 off834792 00000100:00100000:2.0:1713279306.925190:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.925204:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281292992 00000100:00100000:1.0:1713279306.925206:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281292992 00000040:00080000:0.0:1713279306.925208:0:15514:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xf8:0x0].2156, 1344 off1533512 00000100:00100000:1.0:1713279306.925219:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785550 00000100:00100000:0.0:1713279306.925221:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136050a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062784:0@lo:1000:mdt_io00_007.0 00000100:00100000:1.0:1713279306.925223:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:12053:x1796503281292864:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:3.0:1713279306.925227:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785551 00010000:00010000:1.0:1713279306.925230:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.925231:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3714:11711:x1796503281292992:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.925237:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.925237:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.925238:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114edaaf26 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176310 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.925244:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800959c2b40 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.925246:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114edaaf2d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176317 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.925248:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200062784 00000100:00100000:2.0:1713279306.925251:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200062784 00000100:00100000:2.0:1713279306.925263:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98942 00000100:00100000:2.0:1713279306.925266:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+16:15514:x1796503200062784:12345-0@lo:1000:mdt_io00_007.0 00010000:00010000:1.0:1713279306.925274:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd121c0/0xfc4b8e114edaaf34 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.925279:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd121c0/0xfc4b8e114edaaf34 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.925284:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd121c0/0xfc4b8e114edaaf34 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.925287:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114edaaf3b lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000004:00200000:1.0:1713279306.925288:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7abd:0x0]: returning size 42048 00010000:00010000:3.0:1713279306.925295:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114edaaf3b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.925300:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114edaaf3b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.925306:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114edaaf49 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.925309:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114edaaf49 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00000100:00100000:2.0:1713279306.925310:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+17:15514:x1796503200062784:12345-0@lo:1000:mdt_io00_007.0 Request processed in 43us (72us total) trans 4295010201 rc 0/0 00010000:00010000:3.0:1713279306.925312:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114edaaf49 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000100:00100000:2.0:1713279306.925314:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98942 00010000:00010000:1.0:1713279306.925319:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10000/0xfc4b8e114edaaf26 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176310 expref: 3714 pid: 15658 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713279306.925320:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:1.0:1713279306.925325:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd121c0/0xfc4b8e114edaaf34 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176310 expref: 3713 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.925325:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114edaaf3b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.925328:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114edaaf3b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.925329:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7abd:0x0].0x0 (ffff88008c2e7d00) 00010000:00010000:1.0:1713279306.925331:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1713279306.925331:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114edaaf3b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.925332:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd121c0, rc 0) 00010000:00010000:3.0:1713279306.925334:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114edaaf3b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.925337:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd88240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.925339:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114edaaf3b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.925342:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114edaaf3b lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.925349:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:12053:x1796503281292864:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 125us (333us total) trans 4295202792 rc 0/0 00010000:00010000:3.0:1713279306.925349:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012514d900) 00010000:00010000:3.0:1713279306.925350:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.925352:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785550 00010000:00010000:3.0:1713279306.925352:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114edaaf3b lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.925355:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88240/0xfc4b8e114edaaf3b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.925360:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114edaaf49 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.925363:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114edaaf49 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.925365:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114edaaf49 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00000100:00100000:0.0:1713279306.925367:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136050a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15514:1796503200062784:0@lo:1000:mdt_io00_007.0 00010000:00010000:3.0:1713279306.925368:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092345440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.925369:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114edaaf49 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00000100:00100000:2.0:1713279306.925371:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000004:00080000:0.0:1713279306.925372:0:15514:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880097df8180 with version 32020 00010000:00010000:3.0:1713279306.925372:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114edaaf49 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.925376:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88012514d600) 00000004:00080000:0.0:1713279306.925377:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32020 rpc_version 32020 00010000:00010000:3.0:1713279306.925377:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.925378:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114edaaf49 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.925381:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281293120 00010000:00010000:3.0:1713279306.925381:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092345440/0xfc4b8e114edaaf49 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.925383:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281293120 00000100:00100000:1.0:1713279306.925391:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785552 00000100:00100000:1.0:1713279306.925394:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3716:12021:x1796503281293120:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.925394:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114edaaf2d lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176317 expref: 3716 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.925398:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.925399:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.925399:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed51f80/0xfc4b8e114edaaf2d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176317 expref: 3716 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.925404:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114edaaf50 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917631e expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.925404:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed51f80, rc 0) 00000100:00100000:3.0:1713279306.925440:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3716:11711:x1796503281292992:12345-192.168.203.4@tcp:101:touch.0 Request processed in 209us (250us total) trans 0 rc 301/301 00000020:00100000:0.0:1713279306.925441:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713279306.925441:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281293248 00000100:00100000:2.0:1713279306.925444:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281293248 00000100:00100000:0.0:1713279306.925446:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880136051880 x1796503200062912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713279306.925446:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785551 00000100:00100000:0.0:1713279306.925454:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200062912:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1713279306.925454:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edaaf57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.925456:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785553 00000100:00100000:3.0:1713279306.925458:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3663:11912:x1796503281293248:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.925459:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edaaf57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925463:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edaaf57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.925464:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.925470:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.925470:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edaaf65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.925470:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edaaf5e lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176325 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.925473:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edaaf65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.925476:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a480 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.925476:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edaaf65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.925478:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200062912 00000100:00100000:2.0:1713279306.925480:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200062912 00000100:00100000:2.0:1713279306.925488:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98943 00010000:00010000:3.0:1713279306.925490:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edaaf6c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.925491:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaaf73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.925491:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+57:8074:x1796503200062912:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713279306.925494:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edaaf6c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.925495:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaaf73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925498:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaaf73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.925498:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edaaf6c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:0.0:1713279306.925500:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.925501:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaaf73 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925504:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ceacd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.925504:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114edaaf7a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.925505:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaaf73 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.925509:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114edaaf7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.925511:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaaf73 lrc: 4/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.925512:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114edaaf7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.925514:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7abd:0x0].0x0 (ffff88008c2e7d00) 00010000:00010000:1.0:1713279306.925516:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaaf73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925519:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edaaf73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000004:00200000:1.0:1713279306.925524:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7abd:0x0]: returning size 42048 00000100:00100000:3.0:1713279306.925524:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281293376 00000100:00100000:3.0:1713279306.925526:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281293376 00000100:00100000:3.0:1713279306.925544:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223137 00000100:00100000:3.0:1713279306.925546:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3665:12029:x1796503281293376:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:1.0:1713279306.925560:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edaaf57 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925563:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edaaf57 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925566:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edaaf57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925569:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edaaf57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925571:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd10d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.925572:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edaaf57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925575:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edaaf57 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925579:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.925580:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.925581:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edaaf57 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925585:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edaaf57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925589:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edaaf65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925592:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edaaf65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925595:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edaaf65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925597:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd12ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.925599:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edaaf65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925601:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edaaf65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925604:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x33 (ffff88009606b800) 00010000:00010000:1.0:1713279306.925605:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.925606:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3666:12029:x1796503281293376:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 58us (105us total) trans 4295183809 rc 0/0 00010000:00010000:1.0:1713279306.925607:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edaaf65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.925609:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edaaf65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.925610:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223137 00010000:00010000:1.0:1713279306.925622:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114edaaf50 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917631e expref: 3716 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.925624:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edaaf6c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.925626:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114edaaf50 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917631e expref: 3716 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.925627:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edaaf6c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.925631:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edaaf6c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.925634:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd106c0, rc 0) 00010000:00010000:3.0:1713279306.925634:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edaaf6c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.925637:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f557840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.925638:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edaaf6c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.925641:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edaaf6c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.925645:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012514d200) 00010000:00010000:3.0:1713279306.925647:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.925648:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3715:12021:x1796503281293120:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 253us (277us total) trans 4295202793 rc 301/301 00010000:00010000:3.0:1713279306.925648:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edaaf6c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.925652:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785552 00010000:00010000:3.0:1713279306.925653:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edaaf6c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.925659:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114edaaf7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.925662:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114edaaf7a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.925664:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114edaaf7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.925667:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013585ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.925668:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114edaaf7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.925671:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114edaaf7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.925674:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88012514de00) 00010000:00010000:3.0:1713279306.925675:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.925676:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114edaaf7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.925679:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114edaaf7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.925690:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edaaf5e lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176325 expref: 3665 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.925694:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edaaf5e lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176325 expref: 3665 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.925701:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f556ac0, rc 0) 00000100:00100000:2.0:1713279306.925712:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+58:8074:x1796503200062912:12345-0@lo:1000:osp_up0-1.0 Request processed in 220us (240us total) trans 4295202794 rc 0/0 00000100:00100000:3.0:1713279306.925713:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281293248:12345-192.168.203.4@tcp:101:touch.0 Request processed in 254us (315us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.925716:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785553 00000100:00100000:2.0:1713279306.925717:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98943 00000100:00100000:0.0:1713279306.925732:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200062912:0@lo:1000:osp_up0-1.0 00000004:00010000:1.0:1713279306.925745:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008be05c00 reply state ffff8800726b3000 transno 4295183808 ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.925751:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.925755:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7831:0x0].0x0 (ffff88008bde0600) 00010000:00010000:1.0:1713279306.925756:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1713279306.925758:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713279306.925760:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaae85 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.925763:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaae85 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.925766:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaae85 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.925769:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaae85 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.925771:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b7180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.925773:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaae85 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.925776:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaae85 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.925782:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x0 (ffff88009588c900) 00010000:00010000:1.0:1713279306.925783:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.925785:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaae85 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.925789:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edaae85 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x233:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000004:00010000:1.0:1713279306.925797:0:15514:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008be05c00 reply state ffff8800726b3000 transno 4295183808 ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114edaae93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.925804:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114edaae93 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279306.925808:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x36 (ffff88009588c500) 00010000:00010000:1.0:1713279306.925810:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.925811:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.925811:0:15514:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1713279306.925814:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24c:0x0] 00010000:00010000:1.0:1713279306.925835:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092542640/0xfc4b8e114edaae38 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edaae54 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.925838:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281293504 00000100:00100000:3.0:1713279306.925841:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281293504 00010000:00010000:1.0:1713279306.925842:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092542640/0xfc4b8e114edaae38 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edaae54 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.925848:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092542640/0xfc4b8e114edaae38 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edaae54 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.925854:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785554 00000100:00100000:3.0:1713279306.925857:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3449:12049:x1796503281293504:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.925862:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.925863:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1713279306.925866:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x24c:0x0] 00010000:00010000:1.0:1713279306.925868:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bc900/0xfc4b8e114edaae5b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaae70 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.925868:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013585cd80/0xfc4b8e114edaaf88 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917632c expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.925876:0:15514:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bc900/0xfc4b8e114edaae5b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edaae70 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.925877:0:6918:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713279306.925881:0:6918:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092542640/0xfc4b8e114edaae38 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114edaae54 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.925886:0:6918:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092542640 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:2.0:1713279306.925889:0:6918:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092542640/0xfc4b8e114edaae38 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114edaae54 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.925894:0:6918:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092542640/0xfc4b8e114edaae38 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114edaae54 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.925900:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaaf8f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x75e2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.925905:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaaf8f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x75e2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.925906:0:6918:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092542640/0xfc4b8e114edaae38 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaae54 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.925910:0:6918:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.925910:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaaf8f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x75e2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:3.0:1713279306.925914:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x75e2:0x0]: returning size 31037 00010000:00010000:2.0:1713279306.925924:0:6918:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092542640/0xfc4b8e114edaae38 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaae54 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.925928:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200062976:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.925931:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092542640/0xfc4b8e114edaae38 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaae54 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.925939:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.925940:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.925941:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279306.925943:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1713279306.925947:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x84a3:0x0] 00010000:00010000:1.0:1713279306.925952:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114edaad2e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.925956:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114edaad2e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.925960:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xfc4b8e114edaad2e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.925966:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1713279306.925968:0:8071:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713279306.925971:0:8071:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xfc4b8e114edaad2e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.925974:0:8071:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c539b00 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:2.0:1713279306.925976:0:8071:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfc4b8e114edaad2e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.925980:0:8071:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfc4b8e114edaad2e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.925984:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013585cd80/0xfc4b8e114edaaf88 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917632c expref: 3452 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.925989:0:8071:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114edaad2e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.925990:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:385c4b71-808c-40cf-91de-b076b668d13f+3664:11876:x1796503281289152:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 6979us (7019us total) trans 4295183808 rc 0/0 00000100:00100000:0.0:1713279306.925991:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200062976 00010000:00010000:3.0:1713279306.925991:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaaf8f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x75e2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917632c expref: 3451 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.925992:0:8071:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1713279306.925993:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14364 00000100:00100000:0.0:1713279306.925994:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200062976 00010000:00010000:3.0:1713279306.925996:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75e2:0x0].0x0 (ffff880092ae7200) 00010000:00010000:3.0:1713279306.925999:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713279306.926000:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919a0000, rc 0) 00010000:00010000:2.0:1713279306.926001:0:8071:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114edaad2e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.926006:0:8071:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008c539b00/0xfc4b8e114edaacfd lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfc4b8e114edaad2e expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.926007:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147275 00000100:00100000:3.0:1713279306.926009:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200063040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.926010:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+58:3491:x1796503200062976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.926013:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279306.926013:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.926014:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.926014:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713279306.926020:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b58c0/0xfc4b8e114edaae54 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x24c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114edaae38 expref: 58 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.926022:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279306.926027:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x0 (ffff88009588c100) 00010000:00010000:0.0:1713279306.926030:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.926038:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200063040 00000100:00100000:2.0:1713279306.926040:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200063040 00000100:00100000:0.0:1713279306.926047:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+58:3491:x1796503200062976:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (103us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.926048:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53b3c0/0xfc4b8e114edaad2e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfc4b8e114edaacfd expref: 58 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.926051:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147275 00000100:00100000:3.0:1713279306.926056:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200062976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.926058:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196604 00000100:00100000:2.0:1713279306.926086:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.926093:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3451:12049:x1796503281293504:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 234us (280us total) trans 4295183810 rc 0/0 00000100:00100000:2.0:1713279306.926095:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281293568 00000100:00100000:2.0:1713279306.926097:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281293568 00000100:00100000:3.0:1713279306.926099:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785554 00000100:00100000:2.0:1713279306.926107:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147276 00000100:00100000:0.0:1713279306.926108:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+57:3492:x1796503200063040:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.926110:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:1954:x1796503281293568:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.926114:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.926115:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.926121:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd121c0/0xfc4b8e114edaaf34 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176310 expref: 3713 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.926127:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7abd:0x0].0x0 (ffff88008c2e7d00) 00010000:00010000:2.0:1713279306.926129:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.926135:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.926140:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1954:x1796503281293568:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 29us (54us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.926144:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147276 00000100:00100000:3.0:1713279306.926191:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.926201:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281293888 00000100:00100000:2.0:1713279306.926204:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281293888 00000100:00100000:3.0:1713279306.926205:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281293824 00000100:00100000:3.0:1713279306.926208:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281293824 00000100:00100000:2.0:1713279306.926217:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110578 00000100:00100000:2.0:1713279306.926220:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+94:1955:x1796503281293888:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:3.0:1713279306.926229:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785555 00000100:00100000:3.0:1713279306.926231:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3664:11711:x1796503281293824:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.926237:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.926244:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114edaaf9d lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917633a expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.926265:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114edaafa4 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.926269:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114edaafa4 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.926273:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114edaafa4 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00002000:00010000:2.0:1713279306.926275:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb size from disk: 42048 -> 42048 00002000:00010000:2.0:1713279306.926276:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.926278:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:2.0:1713279306.926279:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00010000:00010000:3.0:1713279306.926279:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edaafab lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00002000:00010000:2.0:1713279306.926281:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb blocks from disk: 32 -> 40 00010000:00010000:3.0:1713279306.926282:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edaafab lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.926285:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edaafab lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.926293:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+95:1955:x1796503281293888:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 72us (102us total) trans 4295010202 rc 0/0 00000100:00100000:2.0:1713279306.926297:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110578 00010000:00010000:3.0:1713279306.926297:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114edaafa4 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.926300:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114edaafa4 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.926303:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114edaafa4 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.926306:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114edaafa4 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.926309:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.926310:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114edaafa4 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.926313:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114edaafa4 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.926317:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88012514d300) 00010000:00010000:3.0:1713279306.926318:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.926319:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114edaafa4 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.926322:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9f80/0xfc4b8e114edaafa4 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.926328:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edaafab lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.926331:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.926331:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edaafab lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.926334:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edaafab lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.926336:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.926338:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edaafab lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.926340:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edaafab lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00000100:00100000:0.0:1713279306.926342:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281294016 00010000:00010000:3.0:1713279306.926343:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff88012514df00) 00010000:00010000:3.0:1713279306.926344:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.926345:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281294016 00010000:00010000:3.0:1713279306.926346:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edaafab lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.926348:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edaafab lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.926352:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.926357:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281293696 00000100:00100000:0.0:1713279306.926358:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281293696 00010000:00010000:3.0:1713279306.926359:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114edaaf9d lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917633a expref: 3666 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.926363:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114edaaf9d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917633a expref: 3666 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.926366:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785556 00010000:00010000:3.0:1713279306.926368:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba8d80, rc 0) 00000100:00100000:0.0:1713279306.926369:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3665:11912:x1796503281294016:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.926371:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785557 00010000:00010000:0.0:1713279306.926375:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.926376:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3715:12044:x1796503281293696:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.926381:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114edaafb2 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176341 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.926384:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.926384:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3665:11711:x1796503281293824:12345-192.168.203.4@tcp:101:touch.0 Request processed in 151us (250us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.926388:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785555 00010000:00010000:1.0:1713279306.926392:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133315b00/0xfc4b8e114edaafb9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176333 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.926447:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133314fc0/0xfc4b8e114edaafc0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x8430:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.926458:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133314fc0/0xfc4b8e114edaafc0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x8430:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.926460:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114edaafc7 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.926463:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133314fc0/0xfc4b8e114edaafc0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x8430:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.926466:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114edaafc7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000004:00200000:1.0:1713279306.926468:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8430:0x0]: returning size 3214 00010000:00010000:0.0:1713279306.926470:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114edaafc7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.926476:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaafd5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.926479:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaafd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.926482:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaafd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00200000:0.0:1713279306.926489:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:0.0:1713279306.926494:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114edaafc7 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.926497:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114edaafc7 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.926498:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133315b00/0xfc4b8e114edaafb9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176333 expref: 3718 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.926500:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114edaafc7 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.926503:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114edaafc7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.926506:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.926507:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114edaafc7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.926507:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133314fc0/0xfc4b8e114edaafc0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x8430:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176333 expref: 3717 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.926510:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8430:0x0].0x0 (ffff8800920e4400) 00010000:00010000:0.0:1713279306.926511:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114edaafc7 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.926512:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1713279306.926513:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133314fc0, rc 0) 00010000:00010000:0.0:1713279306.926515:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880090beed00) 00010000:00010000:0.0:1713279306.926516:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.926518:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114edaafc7 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.926530:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3717:12044:x1796503281293696:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 154us (178us total) trans 4295202795 rc 0/0 00010000:00010000:0.0:1713279306.926533:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689680/0xfc4b8e114edaafc7 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.926533:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785557 00010000:00010000:0.0:1713279306.926538:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaafd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.926541:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaafd5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.926544:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaafd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.926546:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.926548:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaafd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.926550:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaafd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.926554:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880090beea00) 00010000:00010000:0.0:1713279306.926555:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.926556:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaafd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.926558:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689b00/0xfc4b8e114edaafd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.926572:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114edaafb2 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176341 expref: 3665 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.926576:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68ba80/0xfc4b8e114edaafb2 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176341 expref: 3665 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.926582:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68ba80, rc 0) 00000100:00100000:0.0:1713279306.926703:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281294016:12345-192.168.203.4@tcp:101:touch.0 Request processed in 331us (371us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.926707:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785556 00000001:00080000:2.0:1713279306.926842:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202794 is committed 00000001:00080000:2.0:1713279306.926847:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202793 is committed 00000001:00080000:2.0:1713279306.926851:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202792 is committed 00000100:00100000:0.0:1713279306.926883:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.926900:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c53b3c0/0xfc4b8e114edaad2e lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfc4b8e114edaacfd expref: 56 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.926906:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880131200900) 00010000:00010000:1.0:1713279306.926909:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.926912:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.926915:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.926924:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.926934:0:15534:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.926941:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+55:3492:x1796503200063040:12345-0@lo:103:ldlm_bl.0 Request processed in 880us (919us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.926941:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.926945:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196604 00000100:00100000:3.0:1713279306.926956:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200063040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.926972:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281294144 00000100:00100000:3.0:1713279306.926975:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281294144 00010000:00010000:2.0:1713279306.926978:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edaafdc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.926985:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edaafdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00000100:00100000:3.0:1713279306.926989:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223138 00010000:00010000:2.0:1713279306.926991:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edaafdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00000100:00100000:3.0:1713279306.926992:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3710:12053:x1796503281294144:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:2.0:1713279306.927001:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114edaafe3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.927005:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114edaafe3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.927011:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114edaafe3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00000100:00100000:0.0:1713279306.927023:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.927026:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.927032:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281294208 00000100:00100000:1.0:1713279306.927034:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281294208 00010000:00010000:2.0:1713279306.927037:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801222ccfc0/0xfc4b8e114ed8d8a5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x84eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916de48 expref: 3711 pid: 15486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.927043:0:15534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114edaa44b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x84eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176015 expref: 3711 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.927045:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147277 00000100:00100000:1.0:1713279306.927048:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3451:1954:x1796503281294208:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.927048:0:15534:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 5/0,1 mode: --/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.927052:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.927054:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:12053:x1796503281294144:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 60us (170us total) trans 4295202796 rc 0/0 00010000:00010000:1.0:1713279306.927058:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edaaf8f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x75e2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917632c expref: 3451 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.927058:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223138 00010000:00010000:2.0:1713279306.927061:0:15534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114edaa44b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x84eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176015 expref: 3711 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.927064:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75e2:0x0].0x0 (ffff880092ae7200) 00010000:00010000:1.0:1713279306.927065:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.927083:0:15534:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114edaa44b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x84eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176015 expref: 3711 pid: 15474 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.927091:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3450:1954:x1796503281294208:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 42us (68us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.927092:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200063104:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.927095:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147277 00000100:00100000:0.0:1713279306.927121:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.927125:0:15534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801222ccfc0/0xfc4b8e114ed8d8a5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x84eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916de48 expref: 3710 pid: 15486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.927132:0:15534:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801222ccfc0/0xfc4b8e114ed8d8a5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x84eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916de48 expref: 3710 pid: 15486 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.927138:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200063168:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.927146:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281294336 00000100:00100000:3.0:1713279306.927148:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281294336 00000100:00100000:2.0:1713279306.927150:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800966d7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.927159:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223139 00000100:00100000:3.0:1713279306.927161:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130143c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3712:11876:x1796503281294336:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.927210:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130143c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3713:11876:x1796503281294336:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 47us (99us total) trans 4295202797 rc 0/0 00000100:00100000:3.0:1713279306.927214:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223139 00000100:00100000:0.0:1713279306.927764:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.927778:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.927801:0:15534:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@ffff880090a4d880 x1796503200063104) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114edaa44b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x84eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176015 expref: 3712 pid: 15474 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.927810:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281294528 00010000:00010000:2.0:1713279306.927812:0:15534:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114edaa44b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x84eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176015 expref: 3712 pid: 15474 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.927814:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281294528 00010000:00010000:2.0:1713279306.927820:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008245dd40/0xfc4b8e114edaa44b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x84eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176015 expref: 3713 pid: 15474 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.927825:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200063104:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.927827:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281294464 00000100:00100000:1.0:1713279306.927828:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785558 00000100:00100000:1.0:1713279306.927830:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3712:11711:x1796503281294528:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:3.0:1713279306.927832:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281294464 00010000:00010000:1.0:1713279306.927837:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.927843:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801333158c0/0xfc4b8e114edaaff1 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176348 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.927847:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.927857:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147278 00000100:00100000:3.0:1713279306.927861:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+3713:1956:x1796503281294464:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.927863:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0000_UUID:15534:1796503200063168:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.927866:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281294656 00010000:00010000:3.0:1713279306.927866:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.927868:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281294656 00010000:00010000:2.0:1713279306.927871:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84eb:0x0].0x0 (ffff88012061ff00) 00010000:00010000:2.0:1713279306.927873:0:15534:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:3.0:1713279306.927875:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133314fc0/0xfc4b8e114edaafc0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x8430:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176333 expref: 3713 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.927877:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785559 00010000:00010000:2.0:1713279306.927877:0:15534:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.927879:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281294656:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.927880:0:15534:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.927883:0:15534:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.927885:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.927888:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8430:0x0].0x0 (ffff8800920e4400) 00010000:00010000:1.0:1713279306.927889:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114edaaff8 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917634f expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.927889:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.927896:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.927904:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281294784 00000100:00100000:2.0:1713279306.927907:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281294784 00000100:00100000:3.0:1713279306.927907:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+3712:1956:x1796503281294464:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 46us (144us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.927910:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edaafff lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000100:00100000:3.0:1713279306.927911:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147278 00010000:00010000:1.0:1713279306.927914:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edaafff lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927918:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edaafff lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.927918:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223140 00000100:00100000:2.0:1713279306.927921:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:5824:x1796503281294784:12345-192.168.203.4@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1713279306.927923:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114edab006 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.927927:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114edab006 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927930:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114edab006 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927940:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edaafff lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927943:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edaafff lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927946:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edaafff lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927951:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edaafff lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927954:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.927956:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edaafff lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927958:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edaafff lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927962:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012fbfe500) 00010000:00010000:1.0:1713279306.927963:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.927965:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edaafff lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927967:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edaafff lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927973:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114edab006 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927976:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114edab006 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927978:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114edab006 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.927979:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:5824:x1796503281294784:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 56us (83us total) trans 4295202798 rc 0/0 00010000:00010000:1.0:1713279306.927981:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.927982:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114edab006 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.927983:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223140 00010000:00010000:1.0:1713279306.927985:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114edab006 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927990:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88012fbfe200) 00010000:00010000:1.0:1713279306.927992:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.927993:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114edab006 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.927995:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114edab006 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.927998:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.928005:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281294848 00010000:00010000:1.0:1713279306.928006:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114edaaff8 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917634f expref: 3665 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.928007:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281294848 00010000:00010000:1.0:1713279306.928010:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114edaaff8 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917634f expref: 3665 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.928015:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023eac0, rc 0) 00000100:00100000:0.0:1713279306.928017:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.928019:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110579 00000100:00100000:2.0:1713279306.928022:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+95:12049:x1796503281294848:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:0.0:1713279306.928026:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281294976 00010000:00010000:2.0:1713279306.928026:0:15783:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.928028:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281294656:12345-192.168.203.4@tcp:101:touch.0 Request processed in 148us (182us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.928029:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281294976 00000100:00100000:1.0:1713279306.928032:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785559 00010000:00010000:2.0:1713279306.928032:0:15783:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013076cb40/0xfc4b8e114edab00d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x105a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176356 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.928040:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785560 00000100:00100000:1.0:1713279306.928042:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11204:x1796503281294976:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.928042:0:15783:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009181fa80/0xfc4b8e114ed9c405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x105a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391722c7 expref: 85 pid: 15539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.928046:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.928047:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.928047:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.928049:0:15783:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013076cb40/0xfc4b8e114edab00d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x105a:0x0].0x0 rrc: 3 type: EXT [24576->40959] (req 24576->40959) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176356 expref: 96 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.928051:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edab014 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917635d expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.928059:0:15783:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009181fa80/0xfc4b8e114ed9c405 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391722c7 expref: 85 pid: 15539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.928064:0:15783:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009181fa80/0xfc4b8e114ed9c405 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x105a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391722c7 expref: 85 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.928082:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edab01b lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000100:00100000:2.0:1713279306.928082:0:15783:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0000_UUID:15783:1796503200063232:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.928086:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edab01b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.928091:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edab01b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.928092:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.928096:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edab022 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000100:00100000:2.0:1713279306.928098:0:15783:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c213540 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.928100:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edab022 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000100:00100000:3.0:1713279306.928102:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281295040 00010000:00010000:1.0:1713279306.928103:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edab022 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000100:00100000:3.0:1713279306.928105:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281295040 00010000:00010000:1.0:1713279306.928114:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edab01b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.928117:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edab01b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00000100:00100000:3.0:1713279306.928118:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110580 00010000:00010000:1.0:1713279306.928120:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edab01b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00000100:00100000:3.0:1713279306.928120:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+83:12044:x1796503281295040:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.928123:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edab01b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.928125:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023ed00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.928126:0:15500:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.928127:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edab01b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.928130:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edab01b lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.928133:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:1.0:1713279306.928134:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.928134:0:15500:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091baad00/0xfc4b8e114edab029 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176364 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.928136:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edab01b lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.928139:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023ed00/0xfc4b8e114edab01b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.928144:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edab022 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.928144:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936ed200/0xfc4b8e114edaa24c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f74 expref: 101 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.928146:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edab022 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.928148:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.928149:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.928150:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edab022 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.928151:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091baad00/0xfc4b8e114edab029 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176364 expref: 84 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.928152:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023e880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.928153:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edab022 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.928156:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edab022 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.928159:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff88012fbfed00) 00010000:00010000:1.0:1713279306.928160:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.928161:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edab022 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.928161:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936ed200/0xfc4b8e114edaa24c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f74 expref: 101 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.928163:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023e880/0xfc4b8e114edab022 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.928167:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936ed200/0xfc4b8e114edaa24c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f74 expref: 101 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.928174:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edab014 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917635d expref: 3713 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.928177:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:15500:1796503200063296:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.928178:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edab014 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917635d expref: 3713 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.928182:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023db00, rc 0) 00000100:00100000:3.0:1713279306.928194:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.928196:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:11204:x1796503281294976:12345-192.168.203.4@tcp:101:touch.0 Request processed in 153us (178us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.928200:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785560 00010000:00010000:1.0:1713279306.928237:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab030 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928242:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab030 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928246:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab030 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928250:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c480/0xfc4b8e114edab037 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928254:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c480/0xfc4b8e114edab037 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928257:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c480/0xfc4b8e114edab037 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00200000:1.0:1713279306.928264:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:1.0:1713279306.928268:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab030 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928271:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab030 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928275:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab030 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928280:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab030 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928283:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023dd40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.928284:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab030 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928287:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab030 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928290:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012fbfee00) 00010000:00010000:1.0:1713279306.928291:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.928293:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab030 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928296:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab030 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928302:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c480/0xfc4b8e114edab037 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928307:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c480/0xfc4b8e114edab037 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928312:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c480/0xfc4b8e114edab037 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928316:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.928318:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c480/0xfc4b8e114edab037 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928323:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c480/0xfc4b8e114edab037 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928332:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880090bee800) 00010000:00010000:1.0:1713279306.928334:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.928337:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c480/0xfc4b8e114edab037 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928341:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c480/0xfc4b8e114edab037 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928360:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801333158c0/0xfc4b8e114edaaff1 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176348 expref: 3712 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.928367:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801333158c0/0xfc4b8e114edaaff1 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176348 expref: 3712 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.928377:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801333158c0, rc 0) 00000100:00100000:1.0:1713279306.928394:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3711:11711:x1796503281294528:12345-192.168.203.4@tcp:101:touch.0 Request processed in 563us (617us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.928398:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785558 00000100:00100000:3.0:1713279306.928551:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.928564:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281295232 00000100:00100000:0.0:1713279306.928567:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281295232 00000100:00100000:2.0:1713279306.928567:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.928576:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801222ccfc0/0xfc4b8e114ed8d8a5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x84eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916de48 expref: 3712 pid: 15486 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.928585:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196605 00000100:00100000:0.0:1713279306.928589:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1955:x1796503281295232:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.928595:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.928596:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281295168 00010000:00010000:0.0:1713279306.928597:0:15496:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801222ccfc0/0xfc4b8e114ed8d8a5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x84eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916de48 expref: 3712 pid: 15486 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.928599:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281295168 00000100:00100000:2.0:1713279306.928600:0:15783:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0000_UUID:15783:1796503200063232:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.928602:0:15496:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801222ccfc0/0xfc4b8e114ed8d8a5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x84eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916de48 expref: 3712 pid: 15486 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.928610:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801222ccfc0/0xfc4b8e114ed8d8a5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x84eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3916de48 expref: 3712 pid: 15486 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.928610:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785561 00000100:00100000:1.0:1713279306.928613:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281295168:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.928613:0:15783:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013076cb40/0xfc4b8e114edab00d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x105a:0x0].0x0 rrc: 3 type: EXT [24576->40959] (req 24576->40959) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176356 expref: 96 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.928616:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84eb:0x0].0x0 (ffff88012061ff00) 00010000:00010000:0.0:1713279306.928618:0:15496:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.928618:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.928622:0:15496:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15534 initiator: MDT0 00010000:00010000:2.0:1713279306.928622:0:15783:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013076cb40, rc 0) 00010000:00010000:1.0:1713279306.928624:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edab03e lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917636b expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.928625:0:15496:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.928632:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.928641:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+96:12049:x1796503281294848:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 617us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.928644:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:1955:x1796503281295232:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 55us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.928647:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110579 00000100:00100000:0.0:1713279306.928648:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196605 00010000:00010000:1.0:1713279306.928656:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab045 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928662:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab045 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.928666:0:15534:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.928666:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab045 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.928670:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.928672:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab04c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.928675:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab04c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.928678:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab04c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00200000:1.0:1713279306.928685:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:1.0:1713279306.928690:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab045 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.928693:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab045 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.928696:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab045 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.928699:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab045 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.928701:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.928703:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab045 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.928705:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab045 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.928709:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.928711:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88013484ff00) 00010000:00010000:1.0:1713279306.928712:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.928713:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.928714:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab045 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.928716:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.928717:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab045 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.928718:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.928720:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.928721:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab04c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.928723:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.928724:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab04c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.928727:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84eb:0x0].0x0 (ffff88012061ff00) 00010000:00010000:1.0:1713279306.928727:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab04c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.928728:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1713279306.928729:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023cb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.928730:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 2/0,0 mode: --/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.928731:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab04c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.928733:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edaafea lrc: 0/0,0 mode: --/EX res: [0x200000403:0x84eb:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.928734:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab04c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.928737:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edaafdc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.928737:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880134856300) 00010000:00010000:1.0:1713279306.928738:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.928739:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab04c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.928740:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edaafdc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.928742:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab04c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.928743:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edaafdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.928746:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edaafdc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.928749:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076d200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.928750:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edaafdc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.928753:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edaafdc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.928754:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edab03e lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917636b expref: 3665 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.928757:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:0.0:1713279306.928758:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.928758:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edab03e lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917636b expref: 3665 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.928760:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edaafdc lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.928762:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edaafdc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.928763:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023cfc0, rc 0) 00010000:00010000:0.0:1713279306.928766:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114edaafe3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.928769:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114edaafe3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT0 00000100:00100000:1.0:1713279306.928786:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281295168:12345-192.168.203.4@tcp:101:touch.0 Request processed in 172us (221us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.928790:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785561 00010000:00010000:0.0:1713279306.928836:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114edaafe3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.928839:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076e1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.928841:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114edaafe3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.928843:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114edaafe3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.928848:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff88007fcb8f00) 00010000:00010000:0.0:1713279306.928849:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.928850:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114edaafe3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.928855:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114edaafe3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00000100:00100000:2.0:1713279306.928856:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.928861:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:15500:1796503200063296:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.928864:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.928867:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.928870:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:3.0:1713279306.928871:0:15500:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091baad00/0xfc4b8e114edab029 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176364 expref: 84 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.928872:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076e880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.928873:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.928876:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT0 00010000:00010000:3.0:1713279306.928878:0:15500:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baad00, rc 0) 00010000:00010000:0.0:1713279306.928879:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880131200900) 00010000:00010000:0.0:1713279306.928880:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.928880:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281295488 00010000:00010000:0.0:1713279306.928881:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00000100:00100000:2.0:1713279306.928882:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.928883:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281295488 00010000:00010000:0.0:1713279306.928884:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e880/0xfc4b8e114edaae15 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT0 00000004:00020000:0.0:1713279306.928889:0:15534:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200000402:0x2:0x0]/6 failed: rc = -114 00000100:00100000:3.0:1713279306.928889:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+84:12044:x1796503281295040:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 768us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.928892:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785562 00000100:00100000:3.0:1713279306.928893:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110580 00000100:00100000:1.0:1713279306.928895:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3450:11204:x1796503281295488:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.928901:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.928906:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d680/0xfc4b8e114edab053 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176372 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.928909:0:15534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_011:385c4b71-808c-40cf-91de-b076b668d13f+3710:11999:x1796503281291072:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 6843us (6887us total) trans 0 rc -114/-114 00000100:00100000:0.0:1713279306.928913:0:15534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14365 00000100:00100000:0.0:1713279306.928925:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281295360 00000100:00100000:0.0:1713279306.928927:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281295360 00010000:00010000:1.0:1713279306.928936:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab05a lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000100:00100000:3.0:1713279306.928939:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.928941:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab05a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.928945:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab05a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.928954:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281295424 00000100:00100000:1.0:1713279306.928956:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281295424 00010000:00010000:1.0:1713279306.928963:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936ed200/0xfc4b8e114edaa24c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f74 expref: 102 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.928973:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009181fa80/0xfc4b8e114ed9c405 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x105a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391722c7 expref: 86 pid: 15539 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.928976:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196606 00000100:00100000:1.0:1713279306.928979:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+102:1957:x1796503281295424:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.928983:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.928985:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196607 00000100:00100000:0.0:1713279306.928989:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+86:1957:x1796503281295360:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.928989:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936ed200/0xfc4b8e114edaa24c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f74 expref: 102 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.928993:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.928994:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936ed200/0xfc4b8e114edaa24c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f74 expref: 102 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.929011:0:15496:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009181fa80/0xfc4b8e114ed9c405 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x105a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391722c7 expref: 86 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.929014:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936ed200/0xfc4b8e114edaa24c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->40959) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175f74 expref: 102 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.929017:0:15496:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009181fa80/0xfc4b8e114ed9c405 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391722c7 expref: 86 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.929020:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.929021:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713279306.929022:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.929024:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091baad00/0xfc4b8e114edab029 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176364 expref: 83 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.929026:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009181fa80/0xfc4b8e114ed9c405 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x105a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391722c7 expref: 86 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.929029:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091baad00/0xfc4b8e114edab029 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176364 expref: 83 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.929031:0:15496:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.929032:0:15496:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713279306.929032:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281295616 00000100:00100000:3.0:1713279306.929034:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281295616 00010000:00010000:0.0:1713279306.929035:0:15496:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013076cb40/0xfc4b8e114edab00d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x105a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176356 expref: 95 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.929040:0:15496:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013076cb40/0xfc4b8e114edab00d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176356 expref: 95 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.929040:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091baad00/0xfc4b8e114edab029 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176364 expref: 83 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.929045:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6917:1796503200063360:192.168.203.4@tcp:105: 00000100:00100000:3.0:1713279306.929045:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785563 00000100:00100000:3.0:1713279306.929048:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3664:11711:x1796503281295616:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.929051:0:15496:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013076cb40/0xfc4b8e114edab00d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176356 expref: 95 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.929054:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.929056:0:15496:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15496:1796503200063424:192.168.203.4@tcp:105: 00010000:00010000:3.0:1713279306.929061:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edab061 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176379 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.929062:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123727e40 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.929084:0:15496:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a240 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.929087:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edab068 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.929092:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edab068 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.929096:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edab068 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.929096:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edab06f lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929102:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edab06f lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000004:00200000:1.0:1713279306.929108:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:3.0:1713279306.929108:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edab06f lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.929112:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab05a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.929114:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab076 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:1.0:1713279306.929115:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab05a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.929117:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab076 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.929118:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab05a lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.929120:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab076 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.929121:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab05a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.929123:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.929125:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab05a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.929128:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab05a lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.929131:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:1.0:1713279306.929132:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.929132:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edab06f lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.929134:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab05a lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.929135:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edab06f lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.929136:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab05a lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.929139:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edab06f lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.929142:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edab068 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.929142:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edab06f lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929144:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.929145:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edab068 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.929146:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edab06f lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.929148:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edab068 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.929149:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edab06f lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.929151:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091d29440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.929152:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edab068 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.929153:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88012514d400) 00010000:00010000:1.0:1713279306.929155:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edab068 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.929155:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.929157:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edab06f lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.929158:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88007f389800) 00010000:00010000:1.0:1713279306.929159:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.929160:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edab068 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.929160:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9b00/0xfc4b8e114edab06f lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.929162:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edab068 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.929165:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab076 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929168:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab076 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929171:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab076 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929173:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baa1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.929174:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab076 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.929175:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d680/0xfc4b8e114edab053 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176372 expref: 3451 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.929177:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab076 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:1.0:1713279306.929179:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d680/0xfc4b8e114edab053 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176372 expref: 3451 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.929180:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff88012514d000) 00010000:00010000:3.0:1713279306.929181:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.929183:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023d680, rc 0) 00010000:00010000:3.0:1713279306.929183:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab076 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929185:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab076 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929197:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edab061 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176379 expref: 3665 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.929198:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3450:11204:x1796503281295488:12345-192.168.203.4@tcp:101:touch.0 Request processed in 302us (344us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.929201:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edab061 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176379 expref: 3665 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.929202:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785562 00010000:00010000:3.0:1713279306.929208:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba8240, rc 0) 00000100:00100000:3.0:1713279306.929224:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3664:11711:x1796503281295616:12345-192.168.203.4@tcp:101:touch.0 Request processed in 175us (203us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.929228:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785563 00000100:00100000:3.0:1713279306.929268:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.929277:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281295808 00000100:00100000:3.0:1713279306.929280:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281295808 00000100:00100000:2.0:1713279306.929283:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.929295:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281295680 00000100:00100000:3.0:1713279306.929297:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785564 00000100:00100000:0.0:1713279306.929298:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281295680 00000100:00100000:3.0:1713279306.929299:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3710:12058:x1796503281295808:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.929305:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.929309:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110581 00010000:00010000:3.0:1713279306.929310:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114edab07d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176387 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.929312:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+86:12021:x1796503281295680:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.929317:0:15500:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.929323:0:15500:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e6898c0/0xfc4b8e114edab084 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176380 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.929332:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaaa8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761c0 expref: 95 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.929336:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713279306.929337:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713279306.929339:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e6898c0/0xfc4b8e114edab084 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [4096->36863] (req 4096->36863) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176380 expref: 87 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.929344:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab08b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.929348:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaaa8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761c0 expref: 95 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.929349:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab08b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.929353:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaaa8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761c0 expref: 95 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.929353:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab08b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.929359:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200063488:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.929359:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab092 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929362:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab092 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929366:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab092 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.929373:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2ad80 going to sleep for 11 seconds 00000004:00200000:3.0:1713279306.929410:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x863c:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.929432:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab08b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929436:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab08b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929439:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab08b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929442:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab08b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929444:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.929446:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab08b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929449:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab08b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929453:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.929454:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.929456:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab08b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929458:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab08b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929463:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab092 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929466:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab092 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929471:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab092 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929474:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.929475:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab092 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929478:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab092 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929481:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3131 (ffff88012514da00) 00010000:00010000:3.0:1713279306.929482:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.929483:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab092 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929486:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab092 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929498:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114edab07d lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176387 expref: 3711 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.929502:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091babcc0/0xfc4b8e114edab07d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176387 expref: 3711 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.929505:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091babcc0, rc 0) 00000100:00100000:3.0:1713279306.929529:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3710:12058:x1796503281295808:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 228us (261us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.929532:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785564 00000100:00100000:0.0:1713279306.929731:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.929756:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281296064 00000100:00100000:2.0:1713279306.929759:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281296064 00000100:00100000:2.0:1713279306.929777:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223141 00000100:00100000:1.0:1713279306.929778:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.929781:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3710:11999:x1796503281296064:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1713279306.929792:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281296000 00000100:00100000:3.0:1713279306.929795:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281296000 00000100:00100000:1.0:1713279306.929796:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6917:1796503200063360:192.168.203.4@tcp:105: 00010000:00010000:1.0:1713279306.929802:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.929806:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785565 00000100:00100000:2.0:1713279306.929808:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:385c4b71-808c-40cf-91de-b076b668d13f+3710:11999:x1796503281296064:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 27us (78us total) trans 0 rc -116/-116 00000100:00100000:3.0:1713279306.929809:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281296000:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:2.0:1713279306.929813:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223141 00000100:00100000:1.0:1713279306.929814:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:1957:x1796503281295424:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 834us (874us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.929815:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.929818:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196606 00010000:00010000:3.0:1713279306.929820:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114edab099 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917638e expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.929840:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114edab0a0 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929844:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114edab0a0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929848:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114edab0a0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929853:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab0a7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.929857:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab0a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929860:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab0a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929869:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114edab0a0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929872:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114edab0a0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929875:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114edab0a0 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929878:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114edab0a0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929881:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091bab180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.929882:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114edab0a0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929886:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114edab0a0 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929889:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012514d700) 00010000:00010000:3.0:1713279306.929890:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.929892:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114edab0a0 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929894:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114edab0a0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929899:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab0a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929902:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab0a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929904:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab0a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929906:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.929908:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab0a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929911:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab0a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929914:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88012514dc00) 00010000:00010000:3.0:1713279306.929915:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.929917:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab0a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929920:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab0a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.929930:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114edab099 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917638e expref: 3665 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.929934:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114edab099 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917638e expref: 3665 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.929939:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bab600, rc 0) 00000100:00100000:0.0:1713279306.929957:0:15496:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15496:1796503200063424:192.168.203.4@tcp:105: 00010000:00010000:0.0:1713279306.929965:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.929967:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281296000:12345-192.168.203.4@tcp:101:touch.0 Request processed in 157us (190us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.929971:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785565 00000100:00100000:0.0:1713279306.929978:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+87:1957:x1796503281295360:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 988us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.929981:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.930008:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281296128 00000100:00100000:2.0:1713279306.930010:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281296128 00000100:00100000:1.0:1713279306.930013:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.930018:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaaa8e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761c0 expref: 96 pid: 15506 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.930022:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281296192 00000100:00100000:0.0:1713279306.930023:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196607 00000100:00100000:3.0:1713279306.930024:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281296192 00000100:00100000:2.0:1713279306.930031:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196608 00000100:00100000:2.0:1713279306.930034:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+97:1954:x1796503281296128:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.930034:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110582 00000100:00100000:3.0:1713279306.930037:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+97:1957:x1796503281296192:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:2.0:1713279306.930041:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.930044:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200063488:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.930046:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaaa8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761c0 expref: 97 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.930053:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaaa8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761c0 expref: 97 pid: 15506 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.930055:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.930058:0:15500:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e6898c0/0xfc4b8e114edab084 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [4096->36863] (req 4096->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176380 expref: 86 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.930062:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ed098c0/0xfc4b8e114edaaa8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391761c0 expref: 97 pid: 15506 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.930063:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.930064:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.930081:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e6898c0/0xfc4b8e114edab084 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176380 expref: 86 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.930081:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.930086:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e6898c0/0xfc4b8e114edab084 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176380 expref: 86 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.930090:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281296384 00010000:00010000:2.0:1713279306.930091:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.930093:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281296384 00010000:00010000:0.0:1713279306.930097:0:15500:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e6898c0/0xfc4b8e114edab084 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4096->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176380 expref: 86 pid: 15500 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713279306.930099:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x105a:0x0] updating lvb size from disk: 31037 -> 39420 00000100:00100000:0.0:1713279306.930102:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200063552:192.168.203.4@tcp:105: 00002000:00010000:3.0:1713279306.930102:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x105a:0x0] updating lvb mtime from disk: 1713279304 -> 1713279306 00002000:00010000:3.0:1713279306.930103:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x105a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1713279306.930104:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x105a:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00000100:00100000:1.0:1713279306.930105:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110583 00002000:00010000:3.0:1713279306.930106:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x105a:0x0] updating lvb blocks from disk: 88 -> 88 00000100:00100000:2.0:1713279306.930108:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+97:1954:x1796503281296128:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 71us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.930109:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+84:1956:x1796503281296384:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:2.0:1713279306.930113:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196608 00000100:00100000:0.0:1713279306.930115:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.930120:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+96:1957:x1796503281296192:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 82us (106us total) trans 4295010203 rc 0/0 00000100:00100000:3.0:1713279306.930124:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110582 00000100:00100000:3.0:1713279306.930137:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281296320 00000100:00100000:3.0:1713279306.930139:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281296320 00000100:00100000:3.0:1713279306.930148:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785566 00000100:00100000:3.0:1713279306.930150:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3710:11711:x1796503281296320:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.930155:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.930161:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114edab0ae lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176395 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713279306.930163:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb size from disk: 3214 -> 3214 00002000:00010000:1.0:1713279306.930165:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb mtime from disk: 1713279304 -> 1713279306 00002000:00010000:1.0:1713279306.930166:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb atime from disk: 1713279299 -> 1713279299 00002000:00010000:1.0:1713279306.930167:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.930169:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:1.0:1713279306.930183:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+85:1956:x1796503281296384:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 74us (102us total) trans 4295010141 rc 0/0 00000100:00100000:1.0:1713279306.930187:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110583 00010000:00010000:3.0:1713279306.930193:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edab0b5 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930198:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edab0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930202:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edab0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930207:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edab0bc lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930210:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edab0bc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930214:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edab0bc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00200000:3.0:1713279306.930221:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:3.0:1713279306.930226:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edab0b5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930228:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edab0b5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930231:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edab0b5 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930235:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edab0b5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930237:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba98c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.930239:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edab0b5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930242:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edab0b5 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930245:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012514db00) 00010000:00010000:3.0:1713279306.930247:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.930248:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edab0b5 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930251:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba98c0/0xfc4b8e114edab0b5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930255:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edab0bc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930258:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edab0bc lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930261:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edab0bc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930263:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.930265:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edab0bc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930267:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edab0bc lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930273:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88012514d800) 00010000:00010000:3.0:1713279306.930274:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.930276:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edab0bc lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930278:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8b40/0xfc4b8e114edab0bc lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.930291:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114edab0ae lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176395 expref: 3711 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.930295:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa400/0xfc4b8e114edab0ae lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176395 expref: 3711 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.930299:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baa400, rc 0) 00000100:00100000:3.0:1713279306.930323:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3710:11711:x1796503281296320:12345-192.168.203.4@tcp:101:touch.0 Request processed in 171us (268us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.930327:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785566 00000100:00100000:0.0:1713279306.930719:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.930782:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281296512 00000100:00100000:3.0:1713279306.930786:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281296512 00000100:00100000:0.0:1713279306.930794:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200063552:192.168.203.4@tcp:105: 00010000:00010000:0.0:1713279306.930801:0:15500:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e6898c0, rc 0) 00000100:00100000:3.0:1713279306.930810:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785567 00000100:00100000:3.0:1713279306.930814:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281296512:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.930817:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+86:12021:x1796503281295680:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 1504us (1536us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.930821:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.930823:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110581 00010000:00010000:3.0:1713279306.930828:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edab0c3 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917639c expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.930844:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.930855:0:15649:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281296640 00000100:00100000:2.0:1713279306.930859:0:15649:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281296640 00010000:00010000:3.0:1713279306.930868:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab0ca lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.930888:0:15649:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223142 00010000:00010000:3.0:1713279306.930889:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab0ca lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.930893:0:15649:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3450:12049:x1796503281296640:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:3.0:1713279306.930893:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab0ca lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279306.930896:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.930903:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281296768 00000100:00100000:3.0:1713279306.930906:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281296768 00000100:00100000:0.0:1713279306.930910:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.930918:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223143 00000100:00100000:3.0:1713279306.930921:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3710:12044:x1796503281296768:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.931000:0:15649:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3451:12049:x1796503281296640:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 105us (156us total) trans 4295183811 rc 0/0 00000100:00100000:3.0:1713279306.931001:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3711:12044:x1796503281296768:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 78us (104us total) trans 4295202799 rc 0/0 00000100:00100000:3.0:1713279306.931006:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223143 00000100:00100000:2.0:1713279306.931009:0:15649:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223142 00000100:00100000:2.0:1713279306.931024:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281296896 00010000:00010000:3.0:1713279306.931024:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab0d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.931027:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281296896 00010000:00010000:3.0:1713279306.931029:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab0d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.931033:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab0d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00200000:3.0:1713279306.931043:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00000100:00100000:2.0:1713279306.931048:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785568 00010000:00010000:3.0:1713279306.931049:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab0ca lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713279306.931052:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3666:11711:x1796503281296896:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.931052:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab0ca lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.931056:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab0ca lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.931059:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.931061:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab0ca lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.931064:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baba80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.931082:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114edab0d8 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391763a3 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.931082:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab0ca lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.931086:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab0ca lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.931091:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88007f009300) 00010000:00010000:3.0:1713279306.931093:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.931095:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab0ca lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.931098:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab0ca lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.931103:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab0d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.931106:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab0d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.931109:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab0d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.931112:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab0df lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.931112:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096a2d680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.931113:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab0d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.931116:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab0d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.931119:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab0df lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.931122:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88012bacd700) 00010000:00010000:3.0:1713279306.931124:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.931125:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab0d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.931126:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab0df lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.931128:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab0d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713279306.931136:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114edab0e6 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.931140:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114edab0e6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.931141:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edab0c3 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917639c expref: 3667 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.931143:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114edab0e6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.931145:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edab0c3 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917639c expref: 3667 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.931150:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baaf40, rc 0) 00010000:00010000:2.0:1713279306.931156:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab0df lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.931160:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab0df lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.931162:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab0df lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.931165:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab0df lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.931168:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.931170:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab0df lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.931174:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab0df lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.931174:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3666:11912:x1796503281296512:12345-192.168.203.4@tcp:101:touch.0 Request processed in 359us (456us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.931178:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88007fcb8b00) 00000100:00100000:3.0:1713279306.931178:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785567 00010000:00010000:2.0:1713279306.931179:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.931181:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.931181:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab0df lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.931184:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab0df lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.931186:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281297024 00000100:00100000:3.0:1713279306.931188:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281297024 00010000:00010000:2.0:1713279306.931189:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114edab0e6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.931191:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114edab0e6 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.931194:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114edab0e6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.931197:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6880 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279306.931197:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785569 00010000:00010000:2.0:1713279306.931198:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114edab0e6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000100:00100000:3.0:1713279306.931200:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3711:12063:x1796503281297024:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.931201:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114edab0e6 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.931204:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff88007fcb8a00) 00010000:00010000:2.0:1713279306.931205:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.931205:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.931207:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114edab0e6 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.931210:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6880/0xfc4b8e114edab0e6 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.931211:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed0ba80/0xfc4b8e114edab0ed lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391763aa expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.931223:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114edab0d8 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763a3 expref: 3665 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.931227:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114edab0d8 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763a3 expref: 3665 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.931232:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd7180, rc 0) 00010000:00010000:3.0:1713279306.931249:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114edab0f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.931254:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3664:11711:x1796503281296896:12345-192.168.203.4@tcp:101:touch.0 Request processed in 202us (344us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.931256:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114edab0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.931258:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785568 00010000:00010000:3.0:1713279306.931260:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114edab0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931267:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab0fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931270:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab0fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931273:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab0fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00200000:3.0:1713279306.931311:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7e4f:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.931316:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114edab0f4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931319:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114edab0f4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931322:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114edab0f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931325:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114edab0f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931328:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091805440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.931329:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114edab0f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931332:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114edab0f4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931338:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.931340:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.931342:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114edab0f4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931345:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114edab0f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931349:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab0fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931352:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab0fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931354:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab0fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931357:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880129b31b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.931358:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab0fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931361:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab0fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931364:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x31 (ffff88012bacd500) 00010000:00010000:3.0:1713279306.931365:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.931366:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab0fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931369:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab0fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.931379:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed0ba80/0xfc4b8e114edab0ed lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763aa expref: 3712 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.931384:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed0ba80/0xfc4b8e114edab0ed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763aa expref: 3712 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.931388:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed0ba80, rc 0) 00000100:00100000:3.0:1713279306.931410:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3711:12063:x1796503281297024:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 209us (229us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.931438:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785569 00000100:00100000:0.0:1713279306.931916:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.931935:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.931980:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281297152 00000100:00100000:3.0:1713279306.931985:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281297152 00000100:00100000:3.0:1713279306.931999:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281297280 00000100:00100000:3.0:1713279306.932001:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281297280 00000100:00100000:2.0:1713279306.932007:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785570 00000100:00100000:2.0:1713279306.932012:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3451:12064:x1796503281297152:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:0.0:1713279306.932013:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785571 00000100:00100000:0.0:1713279306.932016:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11204:x1796503281297280:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.932020:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.932024:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.932027:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd46c0/0xfc4b8e114edab102 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391763b1 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.932030:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b840/0xfc4b8e114edab109 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391763b8 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.932050:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114edab110 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932055:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114edab110 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932059:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114edab110 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.932063:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edab117 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.932065:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edab11e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932080:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edab11e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932084:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edab11e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.932084:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edab117 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.932089:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edab117 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:2.0:1713279306.932094:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7b15:0x0]: returning size 23529 00010000:00010000:0.0:1713279306.932097:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114edab110 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932101:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114edab110 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932104:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114edab110 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932106:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114edab110 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932109:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e688b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.932110:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114edab110 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932113:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114edab110 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932117:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:0.0:1713279306.932119:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.932120:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114edab110 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932123:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e688b40/0xfc4b8e114edab110 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.932125:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd46c0/0xfc4b8e114edab102 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763b1 expref: 3454 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.932128:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edab11e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932131:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edab11e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:2.0:1713279306.932135:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd61c0/0xfc4b8e114edab117 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763b1 expref: 3453 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.932139:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b15:0x0].0x0 (ffff880090884a00) 00010000:00010000:2.0:1713279306.932141:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1713279306.932142:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd61c0, rc 0) 00000100:00100000:2.0:1713279306.932168:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3453:12064:x1796503281297152:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 156us (252us total) trans 4295183812 rc 0/0 00000100:00100000:2.0:1713279306.932172:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785570 00010000:00010000:0.0:1713279306.932191:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edab11e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932194:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68a1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.932196:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edab11e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932199:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edab11e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932204:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff8801250c1500) 00010000:00010000:0.0:1713279306.932205:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.932206:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edab11e lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.932209:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a1c0/0xfc4b8e114edab11e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.932213:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.932224:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b840/0xfc4b8e114edab109 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763b8 expref: 3712 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.932228:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b840/0xfc4b8e114edab109 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763b8 expref: 3712 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.932233:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68b840, rc 0) 00000100:00100000:3.0:1713279306.932240:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281297408 00000100:00100000:3.0:1713279306.932243:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281297408 00000100:00100000:0.0:1713279306.932248:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11204:x1796503281297280:12345-192.168.203.4@tcp:101:touch.0 Request processed in 231us (312us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.932252:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785571 00000100:00100000:3.0:1713279306.932257:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785572 00000100:00100000:3.0:1713279306.932260:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281297408:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.932269:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.932276:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edab12c lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391763bf expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.932299:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab133 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932305:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab133 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932309:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab133 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932315:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab13a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932318:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab13a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932322:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab13a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932332:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab133 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932335:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab133 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932337:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab133 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932340:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab133 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932343:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f1d73c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.932345:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab133 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932348:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab133 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932352:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012bacd400) 00010000:00010000:3.0:1713279306.932353:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.932355:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab133 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932358:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab133 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932363:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab13a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932366:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab13a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932369:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab13a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932372:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092725440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.932373:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab13a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932376:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab13a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932379:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88007fdca600) 00010000:00010000:3.0:1713279306.932380:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.932381:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab13a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932384:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab13a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.932395:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edab12c lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763bf expref: 3665 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.932399:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edab12c lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763bf expref: 3665 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.932404:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801237d9b00, rc 0) 00000100:00100000:3.0:1713279306.932454:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281297408:12345-192.168.203.4@tcp:101:touch.0 Request processed in 193us (241us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.932458:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785572 00000100:00100000:0.0:1713279306.932468:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.932478:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281297536 00000100:00100000:3.0:1713279306.932480:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281297536 00000100:00100000:3.0:1713279306.932492:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785573 00000100:00100000:3.0:1713279306.932495:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3711:11711:x1796503281297536:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.932501:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.932507:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edab141 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391763c6 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.932541:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab148 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932545:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab148 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932549:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab148 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932554:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab14f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932558:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab14f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932561:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab14f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000004:00200000:3.0:1713279306.932569:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:3.0:1713279306.932573:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab148 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932576:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab148 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932579:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab148 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932583:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab148 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932585:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012c24fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.932587:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab148 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932590:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab148 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932593:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880096b90f00) 00010000:00010000:3.0:1713279306.932594:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.932596:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab148 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932599:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab148 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932603:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab14f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932606:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab14f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932609:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab14f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932611:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c9b5200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.932612:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab14f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932615:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab14f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932621:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88012cffdd00) 00010000:00010000:3.0:1713279306.932622:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.932623:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab14f lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932626:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab14f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.932638:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edab141 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763c6 expref: 3712 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.932642:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edab141 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763c6 expref: 3712 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.932646:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929098c0, rc 0) 00000100:00100000:3.0:1713279306.932670:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3711:11711:x1796503281297536:12345-192.168.203.4@tcp:101:touch.0 Request processed in 174us (202us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.932674:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785573 00000100:00100000:0.0:1713279306.933173:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.933175:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.933207:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281297728 00000100:00100000:1.0:1713279306.933211:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281297728 00000100:00100000:1.0:1713279306.933228:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110584 00000100:00100000:1.0:1713279306.933233:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+96:1955:x1796503281297728:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:3.0:1713279306.933239:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281297664 00000100:00100000:3.0:1713279306.933244:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281297664 00000100:00100000:3.0:1713279306.933276:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785574 00000100:00100000:3.0:1713279306.933281:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281297664:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.933290:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.933299:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114edab156 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391763cd expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.933349:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab15d lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00002000:00010000:1.0:1713279306.933357:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb size from disk: 23529 -> 23529 00002000:00010000:1.0:1713279306.933359:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.933360:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00010000:00010000:3.0:1713279306.933360:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab15d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00002000:00010000:1.0:1713279306.933362:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.933363:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb blocks from disk: 48 -> 48 00010000:00010000:3.0:1713279306.933365:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab15d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933371:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab164 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.933375:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab164 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933378:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab164 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:3.0:1713279306.933387:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00000100:00100000:1.0:1713279306.933388:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+97:1955:x1796503281297728:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 154us (213us total) trans 4295010204 rc 0/0 00010000:00010000:3.0:1713279306.933393:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab15d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.933394:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110584 00010000:00010000:3.0:1713279306.933396:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab15d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933400:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab15d lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933402:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab15d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933405:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181db00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.933407:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab15d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933410:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab15d lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00000100:00100000:0.0:1713279306.933427:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.933434:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff880096b8e500) 00010000:00010000:3.0:1713279306.933436:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.933438:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab15d lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933441:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab15d lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.933442:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281297856 00000100:00100000:2.0:1713279306.933446:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281297856 00010000:00010000:3.0:1713279306.933446:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab164 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933449:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab164 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933452:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab164 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933455:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.933456:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab164 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.933459:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785575 00010000:00010000:3.0:1713279306.933459:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab164 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933462:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff880089dc3a00) 00000100:00100000:2.0:1713279306.933463:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3666:11711:x1796503281297856:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.933463:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.933464:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab164 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933467:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab164 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.933468:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.933474:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114edab16b lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391763d4 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.933482:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114edab156 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763cd expref: 3667 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.933487:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c9b5680/0xfc4b8e114edab156 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763cd expref: 3667 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.933493:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c9b5680, rc 0) 00010000:00010000:2.0:1713279306.933495:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edab172 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.933500:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edab172 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.933504:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edab172 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.933512:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3666:11912:x1796503281297664:12345-192.168.203.4@tcp:101:touch.0 Request processed in 231us (339us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.933514:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edab179 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000100:00100000:3.0:1713279306.933516:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785574 00010000:00010000:2.0:1713279306.933520:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edab179 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.933525:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edab179 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.933540:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edab172 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.933545:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edab172 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.933551:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edab172 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.933556:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edab172 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.933561:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd73c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.933563:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edab172 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.933569:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edab172 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.933575:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88007fcb8900) 00010000:00010000:2.0:1713279306.933577:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.933580:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edab172 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.933584:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd73c0/0xfc4b8e114edab172 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.933593:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edab179 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.933598:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edab179 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.933603:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edab179 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.933607:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.933609:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edab179 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.933611:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.933614:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edab179 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.933618:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.933620:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff88007fcb8300) 00010000:00010000:2.0:1713279306.933622:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.933624:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edab179 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.933628:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281298048 00010000:00010000:2.0:1713279306.933629:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6d00/0xfc4b8e114edab179 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.933631:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281298048 00000100:00100000:3.0:1713279306.933637:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281297984 00000100:00100000:3.0:1713279306.933640:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281297984 00000100:00100000:1.0:1713279306.933642:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110585 00000100:00100000:1.0:1713279306.933645:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a05f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+86:1954:x1796503281298048:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:2.0:1713279306.933647:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114edab16b lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763d4 expref: 3665 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.933652:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785576 00010000:00010000:2.0:1713279306.933655:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4900/0xfc4b8e114edab16b lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763d4 expref: 3665 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.933655:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3453:11204:x1796503281297984:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.933663:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd4900, rc 0) 00010000:00010000:3.0:1713279306.933663:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.933669:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edab180 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391763db expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.933683:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3664:11711:x1796503281297856:12345-192.168.203.4@tcp:101:touch.0 Request processed in 219us (269us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.933690:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785575 00010000:00010000:3.0:1713279306.933704:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edab187 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.933709:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edab187 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933713:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edab187 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933718:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114edab18e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.933721:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114edab18e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933725:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114edab18e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:3.0:1713279306.933733:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:3.0:1713279306.933737:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edab187 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933740:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edab187 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00002000:00010000:1.0:1713279306.933742:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb size from disk: 42048 -> 42048 00010000:00010000:3.0:1713279306.933743:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edab187 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00002000:00010000:1.0:1713279306.933744:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.933745:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:1.0:1713279306.933746:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00010000:00010000:3.0:1713279306.933746:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edab187 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00002000:00010000:1.0:1713279306.933748:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb blocks from disk: 40 -> 8 00010000:00010000:3.0:1713279306.933748:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c868480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.933750:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edab187 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933753:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edab187 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933756:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:3.0:1713279306.933758:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.933759:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edab187 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933762:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868480/0xfc4b8e114edab187 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.933765:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a05f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+87:1954:x1796503281298048:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 118us (147us total) trans 4295010205 rc 0/0 00010000:00010000:3.0:1713279306.933766:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114edab18e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.933769:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110585 00010000:00010000:3.0:1713279306.933771:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114edab18e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933774:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114edab18e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933776:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c869200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.933778:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114edab18e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933780:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114edab18e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933783:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff880089dc3900) 00010000:00010000:3.0:1713279306.933784:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.933785:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114edab18e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933788:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869200/0xfc4b8e114edab18e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.933800:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edab180 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763db expref: 3454 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.933804:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edab180 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763db expref: 3454 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.933808:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009181fcc0, rc 0) 00000100:00100000:3.0:1713279306.933826:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3453:11204:x1796503281297984:12345-192.168.203.4@tcp:101:touch.0 Request processed in 171us (216us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.933830:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785576 00000100:00100000:0.0:1713279306.934147:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.934159:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.934193:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281298304 00000100:00100000:2.0:1713279306.934197:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281298304 00000100:00100000:3.0:1713279306.934210:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281298176 00000100:00100000:2.0:1713279306.934215:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223144 00000100:00100000:3.0:1713279306.934215:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281298176 00000100:00100000:2.0:1713279306.934219:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3453:12064:x1796503281298304:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:3.0:1713279306.934233:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785577 00000100:00100000:3.0:1713279306.934236:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281298176:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.934243:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.934250:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114edab195 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391763e2 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.934273:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab19c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934279:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab19c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.934283:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3454:12064:x1796503281298304:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 62us (123us total) trans 4295183813 rc 0/0 00010000:00010000:3.0:1713279306.934283:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab19c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.934289:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223144 00010000:00010000:3.0:1713279306.934289:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab1a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934292:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab1a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279306.934293:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.934295:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab1a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.934303:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281298432 00010000:00010000:3.0:1713279306.934305:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab19c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.934306:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281298432 00010000:00010000:3.0:1713279306.934309:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab19c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.934312:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab19c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.934316:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab19c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.934319:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785578 00010000:00010000:3.0:1713279306.934319:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c868900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.934320:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab19c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.934321:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3711:11711:x1796503281298432:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.934323:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab19c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.934327:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.934327:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88011f3ebc00) 00010000:00010000:3.0:1713279306.934329:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.934330:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab19c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279306.934333:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edab1aa lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391763e9 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.934333:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab19c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.934339:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab1a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.934342:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab1a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.934345:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab1a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.934347:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c86a880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.934349:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab1a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.934351:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab1a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.934357:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88011f3eb900) 00010000:00010000:3.0:1713279306.934359:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.934360:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab1a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.934363:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab1a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.934375:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114edab195 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763e2 expref: 3665 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.934379:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114edab195 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763e2 expref: 3665 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.934384:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c869f80, rc 0) 00000100:00100000:3.0:1713279306.934403:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281298176:12345-192.168.203.4@tcp:101:touch.0 Request processed in 166us (256us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.934408:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785577 00000100:00100000:1.0:1713279306.934431:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.934434:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edab1b1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934439:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edab1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.934442:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281298560 00010000:00010000:0.0:1713279306.934444:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edab1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.934444:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281298560 00010000:00010000:0.0:1713279306.934449:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114edab1b8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934453:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114edab1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.934454:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785579 00010000:00010000:0.0:1713279306.934456:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114edab1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.934457:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11204:x1796503281298560:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.934462:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:0.0:1713279306.934506:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:0.0:1713279306.934511:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edab1b1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934514:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edab1b1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934517:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edab1b1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934522:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edab1b1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934525:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68bcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.934526:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edab1b1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934529:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edab1b1 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934534:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8801250c1400) 00010000:00010000:0.0:1713279306.934535:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.934535:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.934536:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edab1b1 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934539:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bcc0/0xfc4b8e114edab1b1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934544:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114edab1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934547:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114edab1b8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934550:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114edab1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934552:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012154d200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.934553:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114edab1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934556:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114edab1b8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.934562:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff8801250c1700) 00010000:00010000:0.0:1713279306.934563:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.934563:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281298688 00010000:00010000:0.0:1713279306.934564:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114edab1b8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.934566:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c480/0xfc4b8e114edab1bf lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391763f0 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.934567:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012154d200/0xfc4b8e114edab1b8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:2.0:1713279306.934567:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281298688 00000100:00100000:2.0:1713279306.934579:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223145 00010000:00010000:0.0:1713279306.934581:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edab1aa lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763e9 expref: 3713 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.934582:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130142050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3713:12021:x1796503281298688:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:0.0:1713279306.934585:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e689200/0xfc4b8e114edab1aa lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763e9 expref: 3713 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.934585:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab1c6 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:0.0:1713279306.934590:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e689200, rc 0) 00010000:00010000:3.0:1713279306.934592:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab1c6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934596:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab1c6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934601:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edab1cd lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934604:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edab1cd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.934605:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3712:11711:x1796503281298432:12345-192.168.203.4@tcp:101:touch.0 Request processed in 283us (312us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.934607:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edab1cd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00000100:00100000:0.0:1713279306.934610:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785578 00010000:00010000:3.0:1713279306.934620:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab1c6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934623:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab1c6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934626:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab1c6 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934629:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab1c6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.934630:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130142050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3712:12021:x1796503281298688:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 47us (94us total) trans 4295202800 rc 0/0 00010000:00010000:3.0:1713279306.934631:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023dd40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.934633:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab1c6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00000100:00100000:2.0:1713279306.934634:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223145 00010000:00010000:3.0:1713279306.934636:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab1c6 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934642:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:3.0:1713279306.934643:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.934645:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab1c6 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934647:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023dd40/0xfc4b8e114edab1c6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934652:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edab1cd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934654:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edab1cd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934657:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edab1cd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934660:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023db00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.934661:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edab1cd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934664:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edab1cd lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934667:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff8800960e8800) 00010000:00010000:3.0:1713279306.934668:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.934669:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edab1cd lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934672:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023db00/0xfc4b8e114edab1cd lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.934682:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c480/0xfc4b8e114edab1bf lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763f0 expref: 3712 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.934686:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009023c480/0xfc4b8e114edab1bf lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763f0 expref: 3712 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.934691:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023c480, rc 0) 00000100:00100000:3.0:1713279306.934707:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:11204:x1796503281298560:12345-192.168.203.4@tcp:101:touch.0 Request processed in 249us (276us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.934710:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785579 00000100:00100000:0.0:1713279306.935059:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.935126:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281298816 00000100:00100000:3.0:1713279306.935131:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281298816 00000100:00100000:3.0:1713279306.935154:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785580 00000100:00100000:3.0:1713279306.935158:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281298816:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.935165:0:15752:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.935171:0:15752:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114edab1d4 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391763f7 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.935209:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114edab1db lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.935215:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114edab1db lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.935220:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114edab1db lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.935225:0:15752:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114edab1e2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15752 initiator: MDT0 00010000:00010000:3.0:1713279306.935228:0:15752:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114edab1e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.935232:0:15752:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114edab1e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000004:00200000:3.0:1713279306.935239:0:15752:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:3.0:1713279306.935246:0:15752:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114edab1db lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15752 initiator: MDT1 00000100:00100000:0.0:1713279306.935247:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.935249:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114edab1db lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.935252:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114edab1db lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.935255:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114edab1db lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.935257:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023ed00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.935259:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114edab1db lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.935262:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114edab1db lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.935266:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff8800960e8b00) 00000100:00100000:2.0:1713279306.935268:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281298944 00010000:00010000:3.0:1713279306.935268:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.935269:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114edab1db lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.935271:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281298944 00010000:00010000:3.0:1713279306.935272:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023ed00/0xfc4b8e114edab1db lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.935277:0:15752:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114edab1e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.935282:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785581 00010000:00010000:3.0:1713279306.935282:0:15752:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114edab1e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00000100:00100000:2.0:1713279306.935285:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3666:11711:x1796503281298944:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.935285:0:15752:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114edab1e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.935288:0:15752:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023eac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.935289:0:15752:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114edab1e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:2.0:1713279306.935290:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.935292:0:15752:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114edab1e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.935295:0:15752:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff8800960e8f00) 00010000:00010000:2.0:1713279306.935296:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edab1e9 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391763fe expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.935296:0:15752:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.935297:0:15752:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114edab1e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.935300:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023eac0/0xfc4b8e114edab1e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:3.0:1713279306.935313:0:15752:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114edab1d4 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763f7 expref: 3667 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.935316:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edab1f0 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.935318:0:15752:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023e880/0xfc4b8e114edab1d4 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763f7 expref: 3667 pid: 15752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.935322:0:15752:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023e880, rc 0) 00010000:00010000:2.0:1713279306.935324:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edab1f0 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935328:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edab1f0 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935333:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114edab1f7 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.935336:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114edab1f7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935340:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114edab1f7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.935349:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3666:11912:x1796503281298816:12345-192.168.203.4@tcp:101:touch.0 Request processed in 190us (289us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.935350:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edab1f0 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279306.935353:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785580 00010000:00010000:2.0:1713279306.935354:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edab1f0 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935357:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edab1f0 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935360:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edab1f0 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935362:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.935364:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edab1f0 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935367:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edab1f0 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935373:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88007fcb8400) 00010000:00010000:2.0:1713279306.935375:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.935377:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edab1f0 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935379:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5440/0xfc4b8e114edab1f0 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935384:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114edab1f7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935387:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114edab1f7 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935389:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114edab1f7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935392:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.935393:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114edab1f7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935396:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114edab1f7 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935400:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff88007fcb8e00) 00010000:00010000:2.0:1713279306.935401:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.935402:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114edab1f7 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935405:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7840/0xfc4b8e114edab1f7 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.935431:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edab1e9 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763fe expref: 3665 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.935436:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6f40/0xfc4b8e114edab1e9 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391763fe expref: 3665 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.935441:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd6f40, rc 0) 00000100:00100000:2.0:1713279306.935455:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3664:11711:x1796503281298944:12345-192.168.203.4@tcp:101:touch.0 Request processed in 169us (209us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.935458:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785581 00000100:00100000:0.0:1713279306.936077:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.936093:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.936106:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281299136 00000100:00100000:2.0:1713279306.936109:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281299136 00000100:00100000:0.0:1713279306.936115:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.936126:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281299200 00000100:00100000:2.0:1713279306.936128:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281299200 00000100:00100000:2.0:1713279306.936135:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281299328 00000100:00100000:2.0:1713279306.936136:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281299328 00000100:00100000:0.0:1713279306.936146:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785582 00000100:00100000:0.0:1713279306.936150:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3665:12055:x1796503281299136:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:2.0:1713279306.936151:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785583 00000100:00100000:2.0:1713279306.936154:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3454:11204:x1796503281299200:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.936157:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.936157:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785584 00010000:00010000:2.0:1713279306.936161:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.936162:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edab1fe lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176405 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.936163:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3665:11912:x1796503281299328:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.936166:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114edab205 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917640c expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.936170:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.936177:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091d2b3c0/0xfc4b8e114edab20c lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176413 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.936198:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114edab213 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.936202:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edab21a lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936203:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edab221 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.936204:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114edab213 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.936208:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114edab213 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.936208:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edab21a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936208:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edab221 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936213:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edab21a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936213:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edab221 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.936214:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edab228 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.936218:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114edab22f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936218:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114edab236 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.936221:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114edab22f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936222:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114edab236 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936224:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114edab22f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936225:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114edab236 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00200000:2.0:1713279306.936232:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:1.0:1713279306.936235:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edab21a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936237:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edab221 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936238:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edab21a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936240:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edab221 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936241:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edab21a lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936243:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edab221 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936244:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edab21a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936246:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edab221 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936247:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b7180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.936249:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edab21a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936249:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.936250:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edab221 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936252:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edab21a lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936253:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edab221 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936256:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880082706100) 00010000:00010000:1.0:1713279306.936257:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.936257:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:2.0:1713279306.936258:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.936259:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edab21a lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936260:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edab221 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936262:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b7180/0xfc4b8e114edab21a lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936262:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4480/0xfc4b8e114edab221 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936267:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114edab22f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.936270:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114edab22f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936270:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114edab236 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936273:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114edab22f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936273:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114edab236 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936275:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b58c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.936276:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114edab236 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936277:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114edab22f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.936278:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edab228 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.936278:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.936279:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114edab236 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936282:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114edab22f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936282:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114edab236 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.936283:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edab228 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.936285:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff880082706d00) 00010000:00010000:2.0:1713279306.936285:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88007fcb8100) 00010000:00010000:1.0:1713279306.936287:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.936287:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.936288:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114edab22f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936288:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114edab236 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936290:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b58c0/0xfc4b8e114edab22f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.936290:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8d80/0xfc4b8e114edab236 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.936302:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091d2b3c0/0xfc4b8e114edab20c lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176413 expref: 3667 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.936304:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114edab205 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917640c expref: 3455 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.936307:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091d2b3c0/0xfc4b8e114edab20c lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176413 expref: 3667 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.936308:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4b40/0xfc4b8e114edab205 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917640c expref: 3455 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.936312:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d2b3c0, rc 0) 00010000:00010000:2.0:1713279306.936312:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd4b40, rc 0) 00000100:00100000:2.0:1713279306.936329:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3454:11204:x1796503281299200:12345-192.168.203.4@tcp:101:touch.0 Request processed in 175us (235us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.936331:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3666:11912:x1796503281299328:12345-192.168.203.4@tcp:101:touch.0 Request processed in 169us (215us total) trans 0 rc 301/301 00000004:00200000:0.0:1713279306.936333:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x76b7:0x0]: returning size 4096 00000100:00100000:2.0:1713279306.936334:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785583 00000100:00100000:1.0:1713279306.936336:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785584 00010000:00010000:0.0:1713279306.936338:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114edab213 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.936342:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114edab213 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.936345:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114edab213 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.936347:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114edab213 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.936350:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012154fa80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.936351:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114edab213 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.936355:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114edab213 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.936359:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:0.0:1713279306.936361:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.936362:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114edab213 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.936365:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012154fa80/0xfc4b8e114edab213 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.936368:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.936369:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edab228 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.936372:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edab228 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.936375:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edab228 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.936378:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012154d680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.936379:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edab228 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.936380:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281299456 00010000:00010000:0.0:1713279306.936381:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edab228 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.936382:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281299456 00010000:00010000:0.0:1713279306.936384:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff8801250c1600) 00010000:00010000:0.0:1713279306.936385:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.936386:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edab228 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.936389:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012154d680/0xfc4b8e114edab228 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.936397:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785585 00000100:00100000:2.0:1713279306.936399:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3712:11711:x1796503281299456:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.936402:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edab1fe lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176405 expref: 3665 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.936406:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012154ef40/0xfc4b8e114edab1fe lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176405 expref: 3665 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.936406:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.936410:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012154ef40, rc 0) 00010000:00010000:2.0:1713279306.936424:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba86c0/0xfc4b8e114edab23d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917641a expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.936440:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3664:12055:x1796503281299136:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 290us (375us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.936444:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785582 00010000:00010000:2.0:1713279306.936457:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab244 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936462:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab244 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936466:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab244 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936471:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab24b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936475:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab24b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936478:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab24b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000004:00200000:2.0:1713279306.936485:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:2.0:1713279306.936489:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab244 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936495:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab244 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936497:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab244 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936500:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab244 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936503:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.936504:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab244 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936507:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab244 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936511:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88007fcb8600) 00010000:00010000:2.0:1713279306.936512:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.936513:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab244 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936516:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab244 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936520:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab24b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936523:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab24b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936526:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab24b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936528:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013585cd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.936530:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab24b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936533:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab24b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936536:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88007fcb8800) 00010000:00010000:2.0:1713279306.936537:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.936539:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab24b lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936541:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab24b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.936553:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba86c0/0xfc4b8e114edab23d lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917641a expref: 3713 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.936557:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba86c0/0xfc4b8e114edab23d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917641a expref: 3713 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.936561:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba86c0, rc 0) 00000100:00100000:2.0:1713279306.936584:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3712:11711:x1796503281299456:12345-192.168.203.4@tcp:101:touch.0 Request processed in 183us (216us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.936587:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785585 00000100:00100000:0.0:1713279306.937079:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.937111:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.937112:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281299584 00000100:00100000:2.0:1713279306.937116:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281299584 00000100:00100000:2.0:1713279306.937136:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281299712 00000100:00100000:2.0:1713279306.937139:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281299712 00000100:00100000:2.0:1713279306.937153:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785586 00000100:00100000:2.0:1713279306.937157:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281299584:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.937165:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.937172:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114edab252 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176421 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.937182:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785587 00000100:00100000:1.0:1713279306.937188:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3712:12068:x1796503281299712:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.937195:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.937203:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114edab259 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176428 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.937215:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab260 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.937222:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab260 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.937228:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab260 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.937236:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edab267 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.937242:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edab267 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.937247:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab26e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.937247:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edab267 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.937253:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab26e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.937258:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab26e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000004:00200000:2.0:1713279306.937258:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:1.0:1713279306.937264:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab275 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.937265:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab260 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.937267:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab275 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.937270:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab275 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.937270:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab260 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.937275:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab260 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.937280:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab260 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.937284:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f556ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.937287:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab260 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.937288:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edab27c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.937292:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab260 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.937293:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edab27c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.937296:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edab27c lrc: 2/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.937299:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edab27c lrc: 3/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.937300:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.937300:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88007fcb8700) 00010000:00010000:1.0:1713279306.937302:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.937302:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.937304:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edab27c lrc: 3/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.937305:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab260 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.937310:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edab27c lrc: 4/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.937310:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab260 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.937314:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:1.0:1713279306.937316:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edab27c lrc: 2/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.937317:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edab267 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.937319:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edab27c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.937322:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edab267 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.937324:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281299840 00000004:00200000:1.0:1713279306.937325:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7fe9:0x0]: returning size 46934 00010000:00010000:2.0:1713279306.937327:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edab267 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.937329:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281299840 00010000:00010000:2.0:1713279306.937332:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f557840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.937334:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edab267 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.937339:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edab267 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.937345:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88007fcb8c00) 00000100:00100000:3.0:1713279306.937346:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785588 00010000:00010000:2.0:1713279306.937347:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.937348:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab26e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.937350:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edab267 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.937350:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3666:11711:x1796503281299840:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.937352:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab26e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.937355:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab26e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.937357:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab26e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.937357:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.937358:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f557840/0xfc4b8e114edab267 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.937360:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.937361:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab26e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.937364:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab26e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.937364:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114edab28a lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917642f expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.937368:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.937369:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.937371:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab26e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.937374:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab26e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.937378:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab275 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.937378:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114edab252 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176421 expref: 3667 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.937381:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab275 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.937395:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab275 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.937395:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edab291 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.937396:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013585ef40/0xfc4b8e114edab252 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176421 expref: 3667 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.937398:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.937399:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab275 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.937400:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edab291 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.937402:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab275 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.937404:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013585ef40, rc 0) 00010000:00010000:3.0:1713279306.937404:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edab291 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.937405:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x38 (ffff880090bee800) 00010000:00010000:1.0:1713279306.937406:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.937407:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab275 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.937410:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab275 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.937410:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edab298 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.937432:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edab298 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.937436:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edab298 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.937440:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114edab259 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176428 expref: 3714 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.937445:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114edab259 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176428 expref: 3714 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.937450:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edab291 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.937452:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d9806c0, rc 0) 00000100:00100000:2.0:1713279306.937452:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3666:11912:x1796503281299584:12345-192.168.203.4@tcp:101:touch.0 Request processed in 293us (382us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.937453:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edab291 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.937456:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edab291 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.937458:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785586 00010000:00010000:3.0:1713279306.937460:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edab291 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.937463:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.937464:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edab291 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.937467:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edab291 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.937468:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3713:12068:x1796503281299712:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 280us (356us total) trans 4295202801 rc 301/301 00010000:00010000:3.0:1713279306.937472:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff8800960e8100) 00000100:00100000:1.0:1713279306.937473:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785587 00010000:00010000:3.0:1713279306.937473:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.937475:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edab291 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.937478:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c6c0/0xfc4b8e114edab291 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.937483:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edab298 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.937486:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edab298 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.937489:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edab298 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.937491:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800919a0000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.937493:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edab298 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.937495:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edab298 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.937501:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff8800960e8600) 00010000:00010000:3.0:1713279306.937503:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.937504:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edab298 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.937507:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800919a0000/0xfc4b8e114edab298 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.937520:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114edab28a lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917642f expref: 3665 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.937524:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023fcc0/0xfc4b8e114edab28a lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917642f expref: 3665 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.937529:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023fcc0, rc 0) 00000100:00100000:3.0:1713279306.937548:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3664:11711:x1796503281299840:12345-192.168.203.4@tcp:101:touch.0 Request processed in 198us (248us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.937553:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785588 00000100:00100000:0.0:1713279306.938077:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.938141:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281299968 00000100:00100000:3.0:1713279306.938146:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281299968 00000100:00100000:3.0:1713279306.938170:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785589 00000100:00100000:3.0:1713279306.938174:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281299968:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.938181:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.938188:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801333158c0/0xfc4b8e114edab29f lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176436 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.938211:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edab2a6 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938220:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edab2a6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.938224:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edab2a6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.938229:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edab2ad lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.938230:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.938232:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edab2ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.938235:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edab2ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.938245:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edab2a6 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.938249:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edab2a6 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.938252:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edab2a6 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.938253:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281300096 00010000:00010000:3.0:1713279306.938255:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edab2a6 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.938256:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281300096 00010000:00010000:3.0:1713279306.938257:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133314fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.938259:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edab2a6 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.938262:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edab2a6 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.938269:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff8800960e8d00) 00010000:00010000:3.0:1713279306.938270:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.938272:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edab2a6 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.938275:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133314fc0/0xfc4b8e114edab2a6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.938276:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785590 00000100:00100000:1.0:1713279306.938279:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3713:11711:x1796503281300096:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.938281:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edab2ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.938284:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edab2ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.938285:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.938286:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edab2ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.938289:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133315b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.938290:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edab2ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.938291:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114edab2b4 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917643d expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.938293:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edab2ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.938297:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff8800960e8a00) 00010000:00010000:3.0:1713279306.938298:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.938299:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edab2ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.938301:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133315b00/0xfc4b8e114edab2ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.938314:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801333158c0/0xfc4b8e114edab29f lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176436 expref: 3665 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.938319:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801333158c0/0xfc4b8e114edab29f lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176436 expref: 3665 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.938324:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801333158c0, rc 0) 00010000:00010000:1.0:1713279306.938327:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981200/0xfc4b8e114edab2bb lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938331:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981200/0xfc4b8e114edab2bb lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938336:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981200/0xfc4b8e114edab2bb lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938341:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edab2c2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.938342:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281299968:12345-192.168.203.4@tcp:101:touch.0 Request processed in 168us (276us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.938344:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edab2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.938346:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785589 00010000:00010000:1.0:1713279306.938348:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edab2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000004:00200000:1.0:1713279306.938358:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:1.0:1713279306.938362:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981200/0xfc4b8e114edab2bb lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938365:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981200/0xfc4b8e114edab2bb lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938368:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981200/0xfc4b8e114edab2bb lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938371:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981200/0xfc4b8e114edab2bb lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938374:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.938375:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981200/0xfc4b8e114edab2bb lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938378:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981200/0xfc4b8e114edab2bb lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938382:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880090beea00) 00010000:00010000:1.0:1713279306.938383:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.938384:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981200/0xfc4b8e114edab2bb lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938387:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981200/0xfc4b8e114edab2bb lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938392:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edab2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938395:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edab2c2 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938400:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edab2c2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938402:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d9833c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.938404:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edab2c2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938406:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edab2c2 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938409:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880090beed00) 00010000:00010000:1.0:1713279306.938410:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.938425:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edab2c2 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.938428:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9833c0/0xfc4b8e114edab2c2 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.938432:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.938441:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114edab2b4 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917643d expref: 3714 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.938445:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982d00/0xfc4b8e114edab2b4 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917643d expref: 3714 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.938450:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d982d00, rc 0) 00000100:00100000:3.0:1713279306.938456:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281300224 00000100:00100000:3.0:1713279306.938459:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281300224 00000100:00100000:1.0:1713279306.938468:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3713:11711:x1796503281300096:12345-192.168.203.4@tcp:101:touch.0 Request processed in 188us (239us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.938470:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785591 00000100:00100000:1.0:1713279306.938473:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785590 00000100:00100000:3.0:1713279306.938473:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3711:12065:x1796503281300224:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.938479:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.938485:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edab2c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176444 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.938519:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114edab2d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938524:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114edab2d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938528:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114edab2d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938534:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edab2d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938538:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edab2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938543:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edab2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938558:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edab2de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938563:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edab2de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938566:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edab2de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000004:00200000:3.0:1713279306.938570:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8430:0x0]: returning size 3214 00010000:00010000:3.0:1713279306.938591:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114edab2d0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938594:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114edab2d0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00000100:00100000:0.0:1713279306.938596:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.938598:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114edab2d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938601:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114edab2d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938604:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd106c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.938605:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114edab2d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938608:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114edab2d0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938612:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279306.938613:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.938615:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114edab2d0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938618:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd106c0/0xfc4b8e114edab2d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.938621:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281300288 00010000:00010000:3.0:1713279306.938623:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edab2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.938624:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281300288 00010000:00010000:3.0:1713279306.938625:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edab2d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938628:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edab2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938631:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd12ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.938632:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edab2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.938635:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edab2d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.938636:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110586 00000100:00100000:1.0:1713279306.938639:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+85:12068:x1796503281300288:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.938639:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x38 (ffff8800960e8c00) 00010000:00010000:3.0:1713279306.938641:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.938643:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edab2d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.938644:0:15500:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.938647:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd12ac0/0xfc4b8e114edab2d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.938651:0:15500:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d980240/0xfc4b8e114edab2ec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917644b expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.938662:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda946f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->20479) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c1e expref: 100 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.938666:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.938667:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.938667:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ceacd80/0xfc4b8e114edab2c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176444 expref: 3714 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.938669:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d980240/0xfc4b8e114edab2ec lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [20480->53247] (req 20480->53247) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917644b expref: 86 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.938675:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edab2de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176444 expref: 3713 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.938682:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda946f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->20479) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c1e expref: 100 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.938685:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8430:0x0].0x0 (ffff8800920e4400) 00010000:00010000:3.0:1713279306.938687:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1713279306.938688:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda946f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->20479) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c1e expref: 100 pid: 15783 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.938689:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd10d80, rc 0) 00000100:00100000:1.0:1713279306.938694:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:15500:1796503200063616:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.938721:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123727a80 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.938721:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:12065:x1796503281300224:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 245us (288us total) trans 4295202802 rc 0/0 00000100:00100000:3.0:1713279306.938727:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785591 00000100:00100000:0.0:1713279306.939266:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.939285:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.939314:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281300416 00000100:00100000:1.0:1713279306.939318:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281300416 00000100:00100000:1.0:1713279306.939333:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281300544 00000100:00100000:1.0:1713279306.939335:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281300544 00000100:00100000:3.0:1713279306.939341:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785592 00000100:00100000:3.0:1713279306.939346:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3665:11912:x1796503281300416:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.939353:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785593 00010000:00010000:3.0:1713279306.939354:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.939357:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3665:11711:x1796503281300544:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.939362:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114edab2f3 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176452 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.939365:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.939375:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983840/0xfc4b8e114edab2fa lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176459 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.939401:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114edab301 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.939403:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab308 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.939407:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114edab301 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.939410:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab308 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.939429:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab308 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.939435:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edab30f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.939436:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114edab301 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.939439:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edab30f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.939442:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edab30f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.939443:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce533c0/0xfc4b8e114edab316 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.939447:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce533c0/0xfc4b8e114edab316 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.939450:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce533c0/0xfc4b8e114edab316 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:0.0:1713279306.939467:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.939467:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:15500:1796503200063616:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.939475:0:15500:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d980240/0xfc4b8e114edab2ec lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [20480->53247] (req 20480->53247) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917644b expref: 86 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.939481:0:15500:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d980240, rc 0) 00000004:00200000:3.0:1713279306.939482:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00000100:00100000:2.0:1713279306.939486:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281300608 00010000:00010000:3.0:1713279306.939489:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114edab301 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279306.939490:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281300608 00010000:00010000:3.0:1713279306.939492:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114edab301 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.939495:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114edab301 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279306.939498:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+86:12068:x1796503281300288:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 858us (903us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.939498:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114edab301 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.939501:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ce52640 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279306.939502:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110586 00010000:00010000:3.0:1713279306.939503:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114edab301 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.939506:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda946f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->20479) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c1e expref: 101 pid: 15783 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.939506:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114edab301 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279306.939510:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff8800960e8000) 00010000:00010000:3.0:1713279306.939511:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.939513:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114edab301 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.939515:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab308 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.939516:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce52640/0xfc4b8e114edab301 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.939519:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab308 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.939521:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce533c0/0xfc4b8e114edab316 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.939522:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab308 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.939523:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196609 00010000:00010000:3.0:1713279306.939523:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce533c0/0xfc4b8e114edab316 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.939525:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab308 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.939527:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980000 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.939528:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:1957:x1796503281300608:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.939529:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab308 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.939529:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce533c0/0xfc4b8e114edab316 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.939532:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab308 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.939532:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ce533c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.939533:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce533c0/0xfc4b8e114edab316 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:2.0:1713279306.939535:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.939536:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880082706400) 00010000:00010000:3.0:1713279306.939536:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce533c0/0xfc4b8e114edab316 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.939538:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.939539:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab308 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.939539:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff8800960e8500) 00010000:00010000:3.0:1713279306.939540:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.939541:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce533c0/0xfc4b8e114edab316 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.939542:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab308 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.939544:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ce533c0/0xfc4b8e114edab316 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.939546:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edab30f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.939549:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edab30f lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.939552:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edab30f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.939555:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.939556:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda946f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->20479) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c1e expref: 101 pid: 15783 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.939557:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edab30f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.939559:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edab30f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.939562:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114edab2f3 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176452 expref: 3667 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.939563:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff88009588c900) 00010000:00010000:1.0:1713279306.939564:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.939565:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edab30f lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.939565:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda946f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->20479) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c1e expref: 101 pid: 15783 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.939567:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10000/0xfc4b8e114edab2f3 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176452 expref: 3667 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.939568:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edab30f lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.939572:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd10000, rc 0) 00010000:00010000:1.0:1713279306.939580:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983840/0xfc4b8e114edab2fa lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176459 expref: 3666 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.939584:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983840/0xfc4b8e114edab2fa lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176459 expref: 3666 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.939584:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935bd680/0xfc4b8e114eda946f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->20479) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175c1e expref: 101 pid: 15783 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.939588:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3666:11912:x1796503281300416:12345-192.168.203.4@tcp:101:touch.0 Request processed in 241us (322us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.939589:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d983840, rc 0) 00010000:00010000:2.0:1713279306.939592:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713279306.939592:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785592 00010000:00010000:2.0:1713279306.939594:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.939599:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d980240/0xfc4b8e114edab2ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->53247) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917644b expref: 85 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.939601:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3664:11711:x1796503281300544:12345-192.168.203.4@tcp:101:touch.0 Request processed in 244us (315us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.939604:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785593 00010000:00010000:2.0:1713279306.939618:0:6916:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d980240/0xfc4b8e114edab2ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->53247) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917644b expref: 85 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.939622:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.939635:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281300736 00010000:00010000:2.0:1713279306.939635:0:6916:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d980240/0xfc4b8e114edab2ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->53247) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917644b expref: 85 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.939637:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281300736 00000100:00100000:2.0:1713279306.939644:0:6916:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c03480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200063680:192.168.203.4@tcp:105: 00000100:00100000:1.0:1713279306.939647:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785594 00000100:00100000:1.0:1713279306.939650:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11204:x1796503281300736:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.939656:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.939661:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab31d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176460 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.939668:0:6916:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008c213b40 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.939679:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114edab324 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939684:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114edab324 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939687:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114edab324 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939692:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab32b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939695:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab32b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939698:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab32b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939709:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114edab324 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939712:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114edab324 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939715:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114edab324 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939718:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114edab324 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939720:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d9821c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.939722:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114edab324 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939727:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114edab324 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939731:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x0 (ffff880136671b00) 00010000:00010000:1.0:1713279306.939732:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.939733:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.939733:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114edab324 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939736:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114edab324 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939741:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab32b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939743:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab32b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:2.0:1713279306.939745:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281300800 00010000:00010000:1.0:1713279306.939746:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab32b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939748:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983600 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279306.939748:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281300800 00010000:00010000:1.0:1713279306.939749:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab32b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939752:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab32b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939755:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e1:0x0].0x3931 (ffff88012cfc6a00) 00010000:00010000:1.0:1713279306.939757:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.939758:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab32b lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.939760:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab32b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:2.0:1713279306.939763:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147279 00000100:00100000:2.0:1713279306.939766:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:1954:x1796503281300800:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.939770:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab31d lrc: 1/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176460 expref: 3715 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.939770:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.939775:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab31d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176460 expref: 3715 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.939777:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd10d80/0xfc4b8e114edab2de lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176444 expref: 3715 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.939779:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d981440, rc 0) 00010000:00010000:2.0:1713279306.939783:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8430:0x0].0x0 (ffff8800920e4400) 00010000:00010000:2.0:1713279306.939786:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.939793:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:11204:x1796503281300736:12345-192.168.203.4@tcp:101:touch.0 Request processed in 143us (172us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.939797:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785594 00000100:00100000:2.0:1713279306.939798:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:1954:x1796503281300800:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 31us (65us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.939802:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147279 00000100:00100000:0.0:1713279306.940061:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.940101:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281300864 00000100:00100000:1.0:1713279306.940105:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281300864 00000100:00100000:1.0:1713279306.940121:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110587 00000100:00100000:1.0:1713279306.940126:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:12065:x1796503281300864:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.940133:0:15500:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.940141:0:15500:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d981680/0xfc4b8e114edab332 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176467 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.940150:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091baad00/0xfc4b8e114edab029 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176364 expref: 85 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.940154:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.940155:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.940157:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d981680/0xfc4b8e114edab332 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176467 expref: 102 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.940168:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091baad00/0xfc4b8e114edab029 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176364 expref: 85 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.940176:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091baad00/0xfc4b8e114edab029 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176364 expref: 85 pid: 15500 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.940182:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:15500:1796503200063744:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.940207:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123727a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.940219:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.940230:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281301120 00000100:00100000:1.0:1713279306.940232:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281301120 00000100:00100000:0.0:1713279306.940235:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.940253:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281300992 00000100:00100000:1.0:1713279306.940255:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281300992 00000100:00100000:2.0:1713279306.940261:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785595 00000100:00100000:2.0:1713279306.940266:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281301120:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.940267:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785596 00000100:00100000:1.0:1713279306.940270:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3454:12075:x1796503281300992:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.940275:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.940275:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.940280:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114edab339 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917646e expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.940282:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114edab340 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176475 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.940304:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114edab347 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.940309:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114edab347 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.940313:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114edab34e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.940313:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114edab347 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.940318:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114edab34e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.940318:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114edab355 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.940322:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114edab34e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.940322:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114edab355 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.940325:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114edab355 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.940328:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983180/0xfc4b8e114edab35c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.940331:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983180/0xfc4b8e114edab35c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.940336:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114edab347 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.940337:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983180/0xfc4b8e114edab35c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.940339:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114edab347 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.940343:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114edab347 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.940346:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114edab347 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.940348:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092345440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.940350:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114edab347 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.940353:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114edab347 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.940354:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9818c0/0xfc4b8e114edab363 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.940357:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88007fcb8b00) 00010000:00010000:1.0:1713279306.940358:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9818c0/0xfc4b8e114edab363 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.940358:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.940360:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114edab347 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.940361:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9818c0/0xfc4b8e114edab363 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.940362:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092345440/0xfc4b8e114edab347 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000004:00200000:1.0:1713279306.940367:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x753e:0x0]: returning size 15382 00010000:00010000:2.0:1713279306.940367:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114edab355 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.940370:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114edab355 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.940373:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114edab355 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.940375:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd88240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.940377:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114edab355 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.940382:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114edab355 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.940386:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88007fcb8a00) 00010000:00010000:2.0:1713279306.940387:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.940388:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114edab355 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279306.940391:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd88240/0xfc4b8e114edab355 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.940397:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114edab34e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.940401:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114edab340 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176475 expref: 3665 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.940403:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114edab34e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.940405:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed51f80/0xfc4b8e114edab340 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176475 expref: 3665 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.940408:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114edab34e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.940410:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed51f80, rc 0) 00010000:00010000:1.0:1713279306.940431:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114edab34e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.940435:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.940438:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114edab34e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.940440:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.940441:0:6916:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c03480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200063680:192.168.203.4@tcp:105: 00010000:00010000:1.0:1713279306.940443:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114edab34e lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.940448:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281301120:12345-192.168.203.4@tcp:101:touch.0 Request processed in 181us (229us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.940450:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:3.0:1713279306.940451:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.940452:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.940452:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785595 00010000:00010000:1.0:1713279306.940454:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114edab34e lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.940459:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981d40/0xfc4b8e114edab34e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.940467:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983180/0xfc4b8e114edab35c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.940467:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+102:1957:x1796503281300608:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 939us (1001us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.940471:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983180/0xfc4b8e114edab35c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00000100:00100000:3.0:1713279306.940473:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196609 00010000:00010000:1.0:1713279306.940476:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983180/0xfc4b8e114edab35c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.940479:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.940481:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983180/0xfc4b8e114edab35c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.940485:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983180/0xfc4b8e114edab35c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.940489:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3031 (ffff88012cfc6800) 00010000:00010000:1.0:1713279306.940491:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.940492:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983180/0xfc4b8e114edab35c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.940497:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983180/0xfc4b8e114edab35c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.940502:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281301184 00000100:00100000:0.0:1713279306.940505:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281301184 00000100:00100000:0.0:1713279306.940517:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110588 00010000:00010000:1.0:1713279306.940517:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114edab339 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917646e expref: 3457 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.940520:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+86:1954:x1796503281301184:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:1.0:1713279306.940526:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9818c0/0xfc4b8e114edab363 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x753e:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917646e expref: 3456 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.940530:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.940536:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x753e:0x0].0x0 (ffff880095b48100) 00010000:00010000:1.0:1713279306.940537:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1713279306.940539:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d9818c0, rc 0) 00000100:00100000:3.0:1713279306.940540:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281301312 00000100:00100000:3.0:1713279306.940543:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281301312 00000100:00100000:3.0:1713279306.940555:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785597 00000100:00100000:1.0:1713279306.940557:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3456:12075:x1796503281300992:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 285us (321us total) trans 4295183814 rc 0/0 00000100:00100000:3.0:1713279306.940558:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3713:11711:x1796503281301312:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.940562:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785596 00010000:00010000:3.0:1713279306.940565:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.940572:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114edab371 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917647c expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.940611:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edab378 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940617:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edab378 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940621:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edab378 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940627:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab37f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940631:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab37f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940634:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab37f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000004:00200000:3.0:1713279306.940642:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:3.0:1713279306.940647:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edab378 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940650:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edab378 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940654:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edab378 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940657:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edab378 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940659:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.940661:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edab378 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940664:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edab378 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940668:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff880092853900) 00010000:00010000:3.0:1713279306.940670:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.940671:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edab378 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940674:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edab378 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940679:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab37f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940681:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab37f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940685:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab37f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00002000:00010000:0.0:1713279306.940689:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb size from disk: 46934 -> 46934 00010000:00010000:3.0:1713279306.940690:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7cc0 already unused, calling callback (ffffffffa0f0d730) 00002000:00010000:0.0:1713279306.940691:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00010000:00010000:3.0:1713279306.940691:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab37f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00002000:00010000:0.0:1713279306.940693:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:0.0:1713279306.940694:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00010000:00010000:3.0:1713279306.940694:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab37f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00002000:00010000:0.0:1713279306.940695:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb blocks from disk: 64 -> 48 00000100:00100000:2.0:1713279306.940696:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.940697:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88012fbfee00) 00010000:00010000:3.0:1713279306.940698:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.940700:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab37f lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940702:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab37f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:0.0:1713279306.940709:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+87:1954:x1796503281301184:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 188us (269us total) trans 4295010142 rc 0/0 00010000:00010000:3.0:1713279306.940716:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114edab371 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917647c expref: 3714 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.940720:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7180/0xfc4b8e114edab371 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917647c expref: 3714 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.940724:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd7180, rc 0) 00000100:00100000:1.0:1713279306.940727:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281301440 00000100:00100000:1.0:1713279306.940730:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281301440 00000100:00100000:3.0:1713279306.940739:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3713:11711:x1796503281301312:12345-192.168.203.4@tcp:101:touch.0 Request processed in 180us (209us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.940743:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785597 00000100:00100000:3.0:1713279306.940751:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785598 00000100:00100000:3.0:1713279306.940754:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3456:11204:x1796503281301440:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:1.0:1713279306.940758:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:15500:1796503200063744:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.940759:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.940764:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114edab386 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176483 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.940766:0:15500:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d981680/0xfc4b8e114edab332 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176467 expref: 101 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.940773:0:15500:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d981680, rc 0) 00000100:00100000:0.0:1713279306.940782:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110588 00000100:00100000:1.0:1713279306.940794:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:12065:x1796503281300864:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 660us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.940798:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110587 00010000:00010000:3.0:1713279306.940800:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114edab38d lrc: 3/1,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940804:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114edab38d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940808:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114edab38d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940813:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edab394 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.940816:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edab394 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940819:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edab394 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:3.0:1713279306.940826:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x743f:0x0]: returning size 2 00010000:00010000:3.0:1713279306.940830:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114edab38d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940833:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114edab38d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940835:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114edab38d lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940838:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114edab38d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940841:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd121c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.940843:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114edab38d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940846:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114edab38d lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940850:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x0 (ffff88008c2e7a00) 00010000:00010000:3.0:1713279306.940851:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.940853:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114edab38d lrc: 3/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940855:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd121c0/0xfc4b8e114edab38d lrc: 0/0,0 mode: --/CR res: [0x240000400:0x20b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940859:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edab394 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940862:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edab394 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940865:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edab394 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940867:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008dae2d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.940869:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edab394 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940872:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edab394 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940875:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x20b:0x0].0x3931 (ffff88012fbfe500) 00010000:00010000:3.0:1713279306.940876:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.940877:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edab394 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.940883:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae2d00/0xfc4b8e114edab394 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.940889:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.940894:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114edab386 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176483 expref: 3457 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.940898:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed098c0/0xfc4b8e114edab386 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x20b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176483 expref: 3457 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.940901:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281301504 00010000:00010000:3.0:1713279306.940902:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed098c0, rc 0) 00000100:00100000:0.0:1713279306.940903:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281301504 00010000:00010000:0.0:1713279306.940912:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091baad00/0xfc4b8e114edab029 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176364 expref: 87 pid: 15500 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.940922:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196610 00000100:00100000:0.0:1713279306.940925:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+87:1955:x1796503281301504:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.940927:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3456:11204:x1796503281301440:12345-192.168.203.4@tcp:101:touch.0 Request processed in 172us (232us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.940929:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.940931:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785598 00010000:00010000:0.0:1713279306.940935:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091baad00/0xfc4b8e114edab029 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176364 expref: 87 pid: 15500 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.940941:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091baad00/0xfc4b8e114edab029 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176364 expref: 87 pid: 15500 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.940950:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091baad00/0xfc4b8e114edab029 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176364 expref: 87 pid: 15500 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.940956:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.940957:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.940960:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d981680/0xfc4b8e114edab332 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176467 expref: 100 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.940965:0:6916:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d981680/0xfc4b8e114edab332 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176467 expref: 100 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.940975:0:6916:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d981680/0xfc4b8e114edab332 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176467 expref: 100 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.940980:0:6916:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200063808:192.168.203.4@tcp:105: 00000100:00100000:0.0:1713279306.941007:0:6916:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.941631:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.941694:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281301632 00000100:00100000:3.0:1713279306.941698:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281301632 00000100:00100000:0.0:1713279306.941700:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.941715:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785599 00000100:00100000:3.0:1713279306.941719:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281301632:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.941726:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.941732:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281301760 00010000:00010000:3.0:1713279306.941733:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114edab39b lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917648a expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.941735:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281301760 00000100:00100000:0.0:1713279306.941746:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.941750:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223146 00000100:00100000:1.0:1713279306.941752:0:6916:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200063808:192.168.203.4@tcp:105: 00000100:00100000:2.0:1713279306.941754:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3713:12068:x1796503281301760:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:1.0:1713279306.941760:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.941771:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114edab3a2 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.941776:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114edab3a2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.941779:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+86:1955:x1796503281301504:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 852us (891us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.941780:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114edab3a2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.941784:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196610 00010000:00010000:3.0:1713279306.941788:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114edab3a9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.941792:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114edab3a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.941794:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114edab3a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.941799:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281301824 00000100:00100000:1.0:1713279306.941801:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281301824 00000004:00200000:3.0:1713279306.941802:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00000100:00100000:2.0:1713279306.941808:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3714:12068:x1796503281301760:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 53us (155us total) trans 4295202803 rc 0/0 00010000:00010000:3.0:1713279306.941808:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114edab3a2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.941811:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110589 00010000:00010000:3.0:1713279306.941811:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114edab3a2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.941812:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223146 00010000:00010000:3.0:1713279306.941814:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114edab3a2 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.941815:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:1956:x1796503281301824:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:3.0:1713279306.941817:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114edab3a2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.941820:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093691440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.941821:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114edab3a2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.941824:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114edab3a2 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.941829:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88012fbfe200) 00010000:00010000:3.0:1713279306.941830:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.941832:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114edab3a2 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.941837:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093691440/0xfc4b8e114edab3a2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.941842:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114edab3a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.941844:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114edab3a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.941847:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114edab3a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.941850:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093693a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.941851:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114edab3a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.941854:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114edab3a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.941857:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88012fbfed00) 00010000:00010000:3.0:1713279306.941858:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279306.941859:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.941859:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114edab3a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.941862:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093693a80/0xfc4b8e114edab3a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:0.0:1713279306.941871:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281301952 00000100:00100000:0.0:1713279306.941874:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281301952 00010000:00010000:3.0:1713279306.941876:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114edab39b lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917648a expref: 3666 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.941880:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3a80/0xfc4b8e114edab39b lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917648a expref: 3666 pid: 15480 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713279306.941881:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb size from disk: 3214 -> 3214 00002000:00010000:1.0:1713279306.941883:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.941884:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb atime from disk: 1713279299 -> 1713279299 00002000:00010000:1.0:1713279306.941886:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.941887:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb blocks from disk: 24 -> 40 00010000:00010000:3.0:1713279306.941888:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dae3a80, rc 0) 00000100:00100000:0.0:1713279306.941889:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785600 00000100:00100000:0.0:1713279306.941892:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3665:11711:x1796503281301952:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.941898:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.941904:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114edab3b0 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176491 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.941904:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+102:1956:x1796503281301824:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 88us (157us total) trans 4295010143 rc 0/0 00000100:00100000:3.0:1713279306.941905:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3665:11912:x1796503281301632:12345-192.168.203.4@tcp:101:touch.0 Request processed in 185us (274us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.941908:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110589 00000100:00100000:3.0:1713279306.941909:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785599 00010000:00010000:0.0:1713279306.941926:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edab3b7 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.941933:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edab3b7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.941938:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edab3b7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.941942:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edab3be lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.941946:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edab3be lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.941949:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edab3be lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.941961:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edab3b7 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.941964:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edab3b7 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.941966:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edab3b7 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.941970:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edab3b7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.941972:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.941974:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edab3b7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.941977:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edab3b7 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.941983:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff8801250c1800) 00010000:00010000:0.0:1713279306.941985:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.941987:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edab3b7 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.941989:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8fcc0/0xfc4b8e114edab3b7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.941994:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edab3be lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.941997:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edab3be lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.941999:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edab3be lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.942002:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8cb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.942003:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edab3be lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.942006:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edab3be lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.942009:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff8801250c1200) 00010000:00010000:0.0:1713279306.942011:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.942012:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edab3be lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.942014:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8cb40/0xfc4b8e114edab3be lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.942026:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114edab3b0 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176491 expref: 3665 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.942030:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf8dd40/0xfc4b8e114edab3b0 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176491 expref: 3665 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.942035:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bf8dd40, rc 0) 00000100:00100000:0.0:1713279306.942058:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3664:11711:x1796503281301952:12345-192.168.203.4@tcp:101:touch.0 Request processed in 165us (199us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.942062:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785600 00000100:00100000:0.0:1713279306.942162:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.942191:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281302016 00000100:00100000:1.0:1713279306.942194:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281302016 00000100:00100000:1.0:1713279306.942206:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110590 00000100:00100000:1.0:1713279306.942209:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+102:12075:x1796503281302016:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.942214:0:15500:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.942221:0:15500:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edab3c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x105e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176498 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.942232:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d320240/0xfc4b8e114eda3731 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x105e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->28671) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391743c8 expref: 85 pid: 15539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.942237:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.942238:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.942240:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edab3c5 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x105e:0x0].0x0 rrc: 3 type: EXT [8192->36863] (req 8192->36863) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176498 expref: 103 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.942250:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d320240/0xfc4b8e114eda3731 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x105e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->28671) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391743c8 expref: 85 pid: 15539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.942259:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d320240/0xfc4b8e114eda3731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x105e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->28671) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391743c8 expref: 85 pid: 15539 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.942265:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:15500:1796503200063872:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.942282:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123727a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.942449:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.942462:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281302144 00000100:00100000:2.0:1713279306.942466:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281302144 00000100:00100000:2.0:1713279306.942489:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223147 00000100:00100000:2.0:1713279306.942493:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:12065:x1796503281302144:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.942570:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:12065:x1796503281302144:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 75us (120us total) trans 4295202804 rc 0/0 00000100:00100000:2.0:1713279306.942576:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223147 00000100:00100000:2.0:1713279306.942608:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.942619:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281302272 00000100:00100000:0.0:1713279306.942622:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281302272 00000100:00100000:2.0:1713279306.942632:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.942637:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281302400 00000100:00100000:0.0:1713279306.942638:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281302400 00000100:00100000:2.0:1713279306.942644:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785601 00000100:00100000:0.0:1713279306.942649:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785602 00000100:00100000:2.0:1713279306.942649:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281302272:12345-192.168.203.4@tcp:101:touch.0 00000100:00100000:0.0:1713279306.942652:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3714:11711:x1796503281302400:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.942657:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.942658:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.942664:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8ef40/0xfc4b8e114edab3cc lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391764a6 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.942666:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114edab3d3 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917649f expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.942693:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114edab3da lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.942699:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8d440/0xfc4b8e114edab3e1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.942701:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114edab3da lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.942703:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8d440/0xfc4b8e114edab3e1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.942707:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8d440/0xfc4b8e114edab3e1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.942707:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114edab3da lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.942714:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8f840/0xfc4b8e114edab3e8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.942718:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8f840/0xfc4b8e114edab3e8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.942719:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edab3ef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.942720:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8f840/0xfc4b8e114edab3e8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.942725:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edab3ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000004:00200000:0.0:1713279306.942728:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:2.0:1713279306.942730:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edab3ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.942732:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8d440/0xfc4b8e114edab3e1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.942735:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8d440/0xfc4b8e114edab3e1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.942743:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114edab3da lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.942748:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114edab3da lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.942753:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114edab3da lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.942758:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114edab3da lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.942763:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009160a880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.942766:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114edab3da lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.942771:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114edab3da lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.942778:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012514de00) 00010000:00010000:2.0:1713279306.942780:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.942783:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114edab3da lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.942788:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009160a880/0xfc4b8e114edab3da lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.942790:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8d440/0xfc4b8e114edab3e1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.942793:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8d440/0xfc4b8e114edab3e1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.942795:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edab3ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.942796:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8d440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.942798:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8d440/0xfc4b8e114edab3e1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.942800:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edab3ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.942801:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8d440/0xfc4b8e114edab3e1 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.942805:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8801250c1d00) 00010000:00010000:2.0:1713279306.942806:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edab3ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.942807:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.942808:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8d440/0xfc4b8e114edab3e1 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.942810:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c366880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.942813:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edab3ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.942814:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8d440/0xfc4b8e114edab3e1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.942824:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:15500:1796503200063872:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.942828:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edab3ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.942829:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8f840/0xfc4b8e114edab3e8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.942832:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8f840/0xfc4b8e114edab3e8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.942834:0:15500:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edab3c5 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x105e:0x0].0x0 rrc: 3 type: EXT [8192->36863] (req 8192->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176498 expref: 103 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.942834:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88012514d900) 00010000:00010000:0.0:1713279306.942835:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8f840/0xfc4b8e114edab3e8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.942836:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.942838:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf8f840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.942838:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edab3ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.942839:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8f840/0xfc4b8e114edab3e8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.942840:0:15500:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fca86c0, rc 0) 00010000:00010000:0.0:1713279306.942842:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8f840/0xfc4b8e114edab3e8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.942843:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c366880/0xfc4b8e114edab3ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.942845:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff8801250c1300) 00010000:00010000:0.0:1713279306.942846:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.942847:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8f840/0xfc4b8e114edab3e8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.942850:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8f840/0xfc4b8e114edab3e8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:1.0:1713279306.942853:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+103:12075:x1796503281302016:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 643us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.942857:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110590 00010000:00010000:2.0:1713279306.942859:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114edab3d3 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917649f expref: 3665 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.942865:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8ef40/0xfc4b8e114edab3cc lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764a6 expref: 3715 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.942867:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dca880/0xfc4b8e114edab3d3 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917649f expref: 3665 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.942869:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf8ef40/0xfc4b8e114edab3cc lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764a6 expref: 3715 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.942875:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dca880, rc 0) 00010000:00010000:0.0:1713279306.942878:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bf8ef40, rc 0) 00000100:00100000:1.0:1713279306.942884:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.942893:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281302272:12345-192.168.203.4@tcp:101:touch.0 Request processed in 243us (284us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.942894:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3714:11711:x1796503281302400:12345-192.168.203.4@tcp:101:touch.0 Request processed in 242us (263us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.942895:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281302464 00000100:00100000:1.0:1713279306.942897:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281302464 00000100:00100000:0.0:1713279306.942898:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785602 00000100:00100000:2.0:1713279306.942902:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785601 00010000:00010000:1.0:1713279306.942905:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d320240/0xfc4b8e114eda3731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x105e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->28671) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391743c8 expref: 86 pid: 15539 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.942923:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196611 00000100:00100000:1.0:1713279306.942926:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+86:1957:x1796503281302464:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.942930:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.942936:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d320240/0xfc4b8e114eda3731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x105e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->28671) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391743c8 expref: 86 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.942945:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d320240/0xfc4b8e114eda3731 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x105e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->28671) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391743c8 expref: 86 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.942955:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d320240/0xfc4b8e114eda3731 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x105e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->28671) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391743c8 expref: 86 pid: 15539 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.942961:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.942962:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.942965:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edab3c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x105e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176498 expref: 102 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.942970:0:6916:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edab3c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x105e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176498 expref: 102 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.942980:0:6916:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007fca86c0/0xfc4b8e114edab3c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x105e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176498 expref: 102 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.942985:0:6916:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200063936:192.168.203.4@tcp:105: 00000100:00100000:1.0:1713279306.942999:0:6916:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123727a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.943653:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.943717:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281302592 00000100:00100000:3.0:1713279306.943722:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281302592 00000100:00100000:3.0:1713279306.943739:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785603 00000100:00100000:3.0:1713279306.943742:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281302592:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.943749:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.943752:0:6916:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200063936:192.168.203.4@tcp:105: 00010000:00010000:3.0:1713279306.943756:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114edab3f6 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391764ad expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.943760:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.943779:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+85:1957:x1796503281302464:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 852us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.943785:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196611 00010000:00010000:3.0:1713279306.943793:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab3fd lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.943799:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab3fd lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943803:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab3fd lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943808:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab404 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.943812:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab404 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943815:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab404 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00200000:3.0:1713279306.943825:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:3.0:1713279306.943831:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab3fd lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943835:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab3fd lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943838:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab3fd lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943840:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab3fd lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943843:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c86a880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.943845:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab3fd lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943848:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab3fd lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943852:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88009606b800) 00010000:00010000:3.0:1713279306.943853:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.943855:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab3fd lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943858:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86a880/0xfc4b8e114edab3fd lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.943863:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.943863:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab404 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943865:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab404 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943871:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab404 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943873:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c868900 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:0.0:1713279306.943874:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281302720 00010000:00010000:3.0:1713279306.943875:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab404 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943877:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab404 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.943878:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281302720 00010000:00010000:3.0:1713279306.943880:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88011f3ebc00) 00010000:00010000:3.0:1713279306.943881:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.943883:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab404 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.943885:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c868900/0xfc4b8e114edab404 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.943896:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785604 00010000:00010000:3.0:1713279306.943899:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114edab3f6 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764ad expref: 3666 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.943900:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3666:11711:x1796503281302720:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.943903:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c869f80/0xfc4b8e114edab3f6 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764ad expref: 3666 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.943907:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.943908:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c869f80, rc 0) 00010000:00010000:0.0:1713279306.943914:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edab40b lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391764b4 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.943927:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3666:11912:x1796503281302592:12345-192.168.203.4@tcp:101:touch.0 Request processed in 184us (276us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.943931:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785603 00010000:00010000:0.0:1713279306.943981:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d680/0xfc4b8e114edab412 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.943987:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d680/0xfc4b8e114edab412 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.943991:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d680/0xfc4b8e114edab412 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:2.0:1713279306.943991:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.943997:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab419 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.944000:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab419 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.944003:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab419 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.944016:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d680/0xfc4b8e114edab412 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.944019:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d680/0xfc4b8e114edab412 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.944019:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281302784 00010000:00010000:0.0:1713279306.944022:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d680/0xfc4b8e114edab412 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.944022:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281302784 00010000:00010000:0.0:1713279306.944025:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d680/0xfc4b8e114edab412 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.944028:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023d680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.944030:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d680/0xfc4b8e114edab412 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.944033:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d680/0xfc4b8e114edab412 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.944036:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110591 00010000:00010000:0.0:1713279306.944037:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff8801250c1500) 00010000:00010000:0.0:1713279306.944038:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.944039:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+103:1954:x1796503281302784:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:0.0:1713279306.944040:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d680/0xfc4b8e114edab412 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.944043:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023d680/0xfc4b8e114edab412 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.944048:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab419 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.944050:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab419 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.944053:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab419 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.944056:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.944058:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab419 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.944061:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab419 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.944064:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff8801250c1b00) 00010000:00010000:0.0:1713279306.944065:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.944078:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab419 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.944082:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c000/0xfc4b8e114edab419 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.944095:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edab40b lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764b4 expref: 3665 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.944100:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091d29440/0xfc4b8e114edab40b lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764b4 expref: 3665 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.944105:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d29440, rc 0) 00002000:00010000:1.0:1713279306.944121:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb size from disk: 15382 -> 35286 00000100:00100000:0.0:1713279306.944123:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3664:11711:x1796503281302720:12345-192.168.203.4@tcp:101:touch.0 Request processed in 222us (259us total) trans 0 rc 301/301 00002000:00010000:1.0:1713279306.944123:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb mtime from disk: 1713279304 -> 1713279306 00002000:00010000:1.0:1713279306.944125:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb atime from disk: 1713279304 -> 1713279304 00002000:00010000:1.0:1713279306.944126:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00000100:00100000:0.0:1713279306.944127:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785604 00002000:00010000:1.0:1713279306.944127:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000400:0x105e:0x0] updating lvb blocks from disk: 80 -> 88 00000100:00100000:1.0:1713279306.944142:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+104:1954:x1796503281302784:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 102us (153us total) trans 4295010144 rc 0/0 00000100:00100000:1.0:1713279306.944146:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110591 00000100:00100000:0.0:1713279306.944525:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.944566:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281302912 00000100:00100000:2.0:1713279306.944570:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281302912 00000100:00100000:2.0:1713279306.944596:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785605 00000100:00100000:2.0:1713279306.944601:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281302912:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.944608:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.944616:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114edab420 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391764bb expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.944625:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.944642:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281303040 00000100:00100000:2.0:1713279306.944645:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281303040 00000100:00100000:0.0:1713279306.944647:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.944658:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281303168 00000100:00100000:2.0:1713279306.944661:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223148 00000100:00100000:3.0:1713279306.944663:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281303168 00000100:00100000:2.0:1713279306.944664:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3456:12075:x1796503281303040:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:3.0:1713279306.944680:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785606 00000100:00100000:3.0:1713279306.944684:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3714:11711:x1796503281303168:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.944692:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.944699:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869200/0xfc4b8e114edab427 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391764c2 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.944738:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114edab42e lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.944739:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3457:12075:x1796503281303040:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 73us (113us total) trans 4295183815 rc 0/0 00000100:00100000:2.0:1713279306.944743:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223148 00010000:00010000:3.0:1713279306.944744:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114edab42e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.944748:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114edab42e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.944753:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edab435 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944756:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114edab43c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.944757:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edab435 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.944760:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edab435 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944762:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114edab43c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.944766:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114edab43c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000004:00200000:3.0:1713279306.944768:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:2.0:1713279306.944772:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114edab443 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.944773:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114edab42e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.944776:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114edab42e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944779:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114edab443 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.944779:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114edab42e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944782:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114edab443 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.944785:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114edab42e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.944788:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c868480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.944790:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114edab42e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944791:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114edab43c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.944792:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114edab42e lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944794:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114edab43c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.944797:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114edab43c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.944797:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88011f3eb900) 00010000:00010000:3.0:1713279306.944798:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.944800:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114edab43c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.944800:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114edab42e lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944803:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800963b9680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.944803:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c868480/0xfc4b8e114edab42e lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944805:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114edab43c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.944807:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edab435 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944808:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114edab43c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.944810:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edab435 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944812:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff88012514d200) 00010000:00010000:2.0:1713279306.944813:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.944813:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edab435 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944815:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114edab43c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.944816:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800929098c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.944817:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edab435 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944818:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800963b9680/0xfc4b8e114edab43c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.944820:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edab435 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944822:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114edab443 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.944826:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114edab443 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.944826:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff880089dc3900) 00010000:00010000:3.0:1713279306.944827:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.944828:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114edab443 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.944828:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edab435 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944831:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f086400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.944831:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929098c0/0xfc4b8e114edab435 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.944832:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114edab443 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.944835:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114edab443 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.944838:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88012514df00) 00010000:00010000:2.0:1713279306.944839:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.944840:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114edab443 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.944843:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f086400/0xfc4b8e114edab443 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.944844:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869200/0xfc4b8e114edab427 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764c2 expref: 3715 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.944849:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c869200/0xfc4b8e114edab427 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764c2 expref: 3715 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.944854:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c869200, rc 0) 00010000:00010000:2.0:1713279306.944855:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114edab420 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764bb expref: 3665 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.944859:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008bf99680/0xfc4b8e114edab420 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764bb expref: 3665 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.944864:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bf99680, rc 0) 00000100:00100000:3.0:1713279306.944884:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3714:11711:x1796503281303168:12345-192.168.203.4@tcp:101:touch.0 Request processed in 200us (236us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.944889:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3664:11912:x1796503281302912:12345-192.168.203.4@tcp:101:touch.0 Request processed in 288us (364us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.944889:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785606 00000100:00100000:2.0:1713279306.944893:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785605 00000100:00100000:0.0:1713279306.945102:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.945131:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281303296 00000100:00100000:2.0:1713279306.945135:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281303296 00000100:00100000:2.0:1713279306.945152:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785607 00000100:00100000:2.0:1713279306.945155:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3713:12056:x1796503281303296:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.945162:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.945167:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0846c0/0xfc4b8e114edab44a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391764c9 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.945200:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab451 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945205:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab451 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945209:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab451 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945215:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114edab458 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945218:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114edab458 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945221:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114edab458 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945237:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114edab45f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945240:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114edab45f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945244:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114edab45f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000004:00200000:2.0:1713279306.945250:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x84eb:0x0]: returning size 6184 00010000:00010000:2.0:1713279306.945270:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab451 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945273:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab451 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945276:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab451 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945279:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab451 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945282:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f085b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.945283:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab451 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945286:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab451 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945290:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:2.0:1713279306.945291:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.945293:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab451 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945295:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab451 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945300:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114edab458 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945303:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114edab458 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945308:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114edab458 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945311:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f084d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.945312:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114edab458 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945315:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114edab458 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945318:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff88012514d800) 00010000:00010000:2.0:1713279306.945319:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.945320:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114edab458 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945322:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114edab458 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.945335:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0846c0/0xfc4b8e114edab44a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764c9 expref: 3716 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.945341:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086f40/0xfc4b8e114edab45f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x84eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764c9 expref: 3715 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.945344:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x84eb:0x0].0x0 (ffff88012061ff00) 00010000:00010000:2.0:1713279306.945345:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713279306.945346:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f086f40, rc 0) 00000100:00100000:2.0:1713279306.945370:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:12056:x1796503281303296:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 214us (268us total) trans 4295202805 rc 0/0 00000100:00100000:2.0:1713279306.945374:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785607 00000100:00100000:0.0:1713279306.945675:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.945706:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.945716:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281303424 00000100:00100000:2.0:1713279306.945720:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281303424 00000100:00100000:2.0:1713279306.945733:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281303552 00000100:00100000:2.0:1713279306.945735:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281303552 00000100:00100000:0.0:1713279306.945740:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785608 00000100:00100000:0.0:1713279306.945744:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3665:11711:x1796503281303424:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.945751:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.945753:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785609 00010000:00010000:0.0:1713279306.945757:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edab46d lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391764d0 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.945758:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3665:11912:x1796503281303552:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.945766:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.945775:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008245dd40/0xfc4b8e114edab474 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391764d7 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.945778:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab47b lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.945783:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab47b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.945787:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab47b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.945791:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab482 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.945795:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab482 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.945798:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab482 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.945809:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab47b lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.945812:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab47b lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.945814:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab47b lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.945817:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edab489 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.945818:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab47b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.945820:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023cb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.945822:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab47b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.945825:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab47b lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.945825:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edab489 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.945829:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff8801250c1a00) 00010000:00010000:0.0:1713279306.945830:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.945831:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edab489 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.945832:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab47b lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.945834:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cb40/0xfc4b8e114edab47b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.945839:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab482 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.945840:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edab490 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.945842:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab482 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.945845:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab482 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.945846:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edab490 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.945847:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009023c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.945848:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab482 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.945851:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab482 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.945851:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edab490 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.945857:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff8801250c1e00) 00010000:00010000:0.0:1713279306.945858:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.945860:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab482 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.945862:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023c900/0xfc4b8e114edab482 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000004:00200000:2.0:1713279306.945862:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:2.0:1713279306.945869:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edab489 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.945873:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edab46d lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764d0 expref: 3667 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.945874:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edab489 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.945877:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009023cfc0/0xfc4b8e114edab46d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764d0 expref: 3667 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.945880:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edab489 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.945882:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009023cfc0, rc 0) 00010000:00010000:2.0:1713279306.945885:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edab489 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.945890:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008245f840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.945893:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edab489 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.945898:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edab489 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.945905:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3666:11711:x1796503281303424:12345-192.168.203.4@tcp:101:touch.0 Request processed in 161us (230us total) trans 0 rc 301/301 00010000:00010000:2.0:1713279306.945905:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88012514dc00) 00010000:00010000:2.0:1713279306.945907:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.945909:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785608 00010000:00010000:2.0:1713279306.945910:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edab489 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.945915:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008245f840/0xfc4b8e114edab489 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.945922:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edab490 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.945928:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edab490 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.945933:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edab490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.945936:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008245c900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.945939:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edab490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.945947:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edab490 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.945954:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88012514da00) 00010000:00010000:2.0:1713279306.945956:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.945958:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edab490 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.945963:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008245c900/0xfc4b8e114edab490 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.945984:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245dd40/0xfc4b8e114edab474 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764d7 expref: 3665 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.945990:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.945991:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008245dd40/0xfc4b8e114edab474 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764d7 expref: 3665 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.945999:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008245dd40, rc 0) 00000100:00100000:1.0:1713279306.946002:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281303680 00000100:00100000:1.0:1713279306.946007:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281303680 00000100:00100000:2.0:1713279306.946021:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3665:11912:x1796503281303552:12345-192.168.203.4@tcp:101:touch.0 Request processed in 262us (314us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.946027:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785609 00000100:00100000:1.0:1713279306.946035:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785610 00000100:00100000:1.0:1713279306.946039:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3664:12059:x1796503281303680:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.946046:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.946053:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edab497 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391764de expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.946095:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.946115:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab49e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946121:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab49e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946126:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab49e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.946127:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281303808 00000100:00100000:3.0:1713279306.946132:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281303808 00010000:00010000:1.0:1713279306.946135:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab4a5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946138:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab4a5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946141:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab4a5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.946148:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785611 00000100:00100000:3.0:1713279306.946152:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:12066:x1796503281303808:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.946159:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fa80/0xfc4b8e114edab4ac lrc: 3/1,0 mode: --/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.946161:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.946165:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fa80/0xfc4b8e114edab4ac lrc: 3/1,0 mode: --/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946167:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fa80/0xfc4b8e114edab4ac lrc: 2/0,0 mode: --/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.946167:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114edab4b3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391764e5 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.946171:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fa80/0xfc4b8e114edab4ac lrc: 3/0,0 mode: --/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946173:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181fa80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.946175:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fa80/0xfc4b8e114edab4ac lrc: 3/0,0 mode: --/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946178:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fa80/0xfc4b8e114edab4ac lrc: 4/0,0 mode: --/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946182:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x78ee:0x0].0x0 (ffff880091b35f00) 00010000:00010000:1.0:1713279306.946184:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fa80/0xfc4b8e114edab4ac lrc: 2/0,0 mode: --/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946187:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fa80/0xfc4b8e114edab4ac lrc: 0/0,0 mode: --/PR res: [0x240000402:0x78ee:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000004:00200000:1.0:1713279306.946193:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x78ee:0x0]: returning size 40670 00010000:00010000:3.0:1713279306.946211:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab4ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.946219:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab4ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.946223:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab4ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.946226:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab49e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946229:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab49e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.946230:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab4c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.946232:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab49e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.946233:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.946235:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab49e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.946236:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.946237:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181c480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.946238:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab49e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946241:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab49e lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946245:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:1.0:1713279306.946246:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.946248:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab49e lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946250:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181c480/0xfc4b8e114edab49e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946254:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab4a5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946257:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab4a5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946262:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab4a5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.946264:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.946265:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181db00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.946266:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab4a5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946269:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab4a5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946273:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff8800958c9700) 00010000:00010000:1.0:1713279306.946275:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.946276:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab4a5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.946278:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181db00/0xfc4b8e114edab4a5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000004:00200000:3.0:1713279306.946279:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8266:0x0]: returning size 4096 00010000:00010000:3.0:1713279306.946284:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab4ba lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.946287:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab4ba lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.946290:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab4ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.946293:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edab497 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764de expref: 3666 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.946293:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab4ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.946296:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c9b5200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.946298:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181fcc0/0xfc4b8e114edab497 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764de expref: 3666 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.946298:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab4ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.946301:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab4ba lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.946303:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009181fcc0, rc 0) 00010000:00010000:3.0:1713279306.946308:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.946310:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.946312:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281303872 00010000:00010000:3.0:1713279306.946312:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab4ba lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.946314:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281303872 00010000:00010000:3.0:1713279306.946315:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5200/0xfc4b8e114edab4ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.946319:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.946322:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab4c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.946325:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.946328:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012c24fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.946329:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.946332:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab4c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.946334:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110592 00010000:00010000:3.0:1713279306.946335:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3731 (ffff880089dc3a00) 00010000:00010000:3.0:1713279306.946336:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279306.946337:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+104:12056:x1796503281303872:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.946337:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab4c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.946340:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24fcc0/0xfc4b8e114edab4c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.946343:0:15500:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.946352:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114edab4b3 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764e5 expref: 3716 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.946353:0:15500:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013076e880/0xfc4b8e114edab4cf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391764ec expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.946357:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c9b5680/0xfc4b8e114edab4b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764e5 expref: 3716 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.946361:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c9b5680, rc 0) 00002000:00010000:1.0:1713279306.946364:0:15500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x1167:0x0] initial LVB size: 6184, mtime: 0x661e9148, atime: 0x0, ctime: 0x661e914a, blocks: 0x38 00010000:00010000:1.0:1713279306.946373:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.946374:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.946380:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013076e880/0xfc4b8e114edab4cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764ec expref: 105 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.946380:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:12066:x1796503281303808:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 227us (285us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.946384:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785611 00010000:00010000:1.0:1713279306.946390:0:15500:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013076e880/0xfc4b8e114edab4cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764ec expref: 105 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.946397:0:15500:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013076e880, rc 0) 00000100:00100000:1.0:1713279306.946445:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+105:12056:x1796503281303872:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 105us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.946451:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110592 00000100:00100000:1.0:1713279306.946475:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3665:12059:x1796503281303680:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 435us (485us total) trans 4295183816 rc 301/301 00000100:00100000:1.0:1713279306.946478:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785610 00000100:00100000:0.0:1713279306.946686:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.946714:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281304000 00000100:00100000:1.0:1713279306.946717:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281304000 00000100:00100000:1.0:1713279306.946733:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785612 00000100:00100000:1.0:1713279306.946736:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3714:11711:x1796503281304000:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.946741:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.946747:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114edab4d6 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391764f3 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.946783:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edab4dd lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946788:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edab4dd lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946792:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edab4dd lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946798:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edab4e4 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946801:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edab4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946805:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edab4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000004:00200000:1.0:1713279306.946812:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:1.0:1713279306.946816:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edab4dd lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946819:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edab4dd lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946822:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edab4dd lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946825:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edab4dd lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946828:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076d200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.946829:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edab4dd lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946832:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edab4dd lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946839:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8801250c1c00) 00010000:00010000:1.0:1713279306.946840:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.946842:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.946842:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edab4dd lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946844:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076d200/0xfc4b8e114edab4dd lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946849:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edab4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946852:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edab4e4 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946854:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edab4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946857:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013076fcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.946858:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edab4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946861:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edab4e4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946864:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff8801250c1900) 00000100:00100000:3.0:1713279306.946865:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281304128 00010000:00010000:1.0:1713279306.946866:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.946867:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edab4e4 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.946869:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076fcc0/0xfc4b8e114edab4e4 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.946869:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281304128 00010000:00010000:1.0:1713279306.946883:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114edab4d6 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764f3 expref: 3715 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.946888:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013076e1c0/0xfc4b8e114edab4d6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764f3 expref: 3715 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.946892:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785613 00010000:00010000:1.0:1713279306.946893:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013076e1c0, rc 0) 00000100:00100000:3.0:1713279306.946896:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3665:11912:x1796503281304128:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.946903:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.946909:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3714:11711:x1796503281304000:12345-192.168.203.4@tcp:101:touch.0 Request processed in 173us (224us total) trans 0 rc 301/301 00010000:00010000:3.0:1713279306.946910:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edab4eb lrc: 2/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391764fa expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.946913:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785612 00010000:00010000:3.0:1713279306.946934:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab4f2 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.946939:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab4f2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:0.0:1713279306.946941:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.946944:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab4f2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.946950:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab4f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:1.0:1713279306.946951:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281304192 00000100:00100000:1.0:1713279306.946953:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281304192 00010000:00010000:3.0:1713279306.946953:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab4f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.946957:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab4f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.946962:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110593 00000100:00100000:1.0:1713279306.946965:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+105:1956:x1796503281304192:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:3.0:1713279306.946967:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab4f2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.946971:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab4f2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.946974:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab4f2 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.946977:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab4f2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.946980:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092725440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.946981:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab4f2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.946984:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab4f2 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.946989:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x0 (ffff880096b90f00) 00010000:00010000:3.0:1713279306.946990:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.946992:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab4f2 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.946995:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092725440/0xfc4b8e114edab4f2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x25b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.946999:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab4f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947002:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab4f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00002000:00010000:1.0:1713279306.947005:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb size from disk: 6184 -> 45054 00010000:00010000:3.0:1713279306.947006:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab4f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00002000:00010000:1.0:1713279306.947007:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb mtime from disk: 1713279304 -> 1713279306 00002000:00010000:1.0:1713279306.947008:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:3.0:1713279306.947008:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f1d73c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.947009:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab4f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00002000:00010000:1.0:1713279306.947010:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.947011:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb blocks from disk: 56 -> 56 00010000:00010000:3.0:1713279306.947012:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab4f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947015:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x37 (ffff88008e5b8400) 00010000:00010000:3.0:1713279306.947016:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.947017:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab4f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947020:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f1d73c0/0xfc4b8e114edab4f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25b:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.947026:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+106:1956:x1796503281304192:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 60us (85us total) trans 4295010145 rc 0/0 00000100:00100000:1.0:1713279306.947030:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110593 00010000:00010000:3.0:1713279306.947032:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edab4eb lrc: 1/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764fa expref: 3666 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.947036:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801237d9b00/0xfc4b8e114edab4eb lrc: 0/0,0 mode: --/CW res: [0x240000400:0x25b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391764fa expref: 3666 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.947040:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801237d9b00, rc 0) 00000100:00100000:3.0:1713279306.947059:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3665:11912:x1796503281304128:12345-192.168.203.4@tcp:101:touch.0 Request processed in 163us (217us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.947063:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785613 00000100:00100000:0.0:1713279306.947178:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.947195:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.947201:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281304320 00000100:00100000:3.0:1713279306.947204:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281304320 00000100:00100000:3.0:1713279306.947217:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785614 00000100:00100000:3.0:1713279306.947220:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3457:12071:x1796503281304320:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:1.0:1713279306.947224:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281304384 00010000:00010000:3.0:1713279306.947226:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.947227:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281304384 00010000:00010000:3.0:1713279306.947232:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edab500 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176501 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.947237:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110594 00000100:00100000:1.0:1713279306.947240:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+87:12059:x1796503281304384:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.947245:0:15500:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.947252:0:15500:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801222ccfc0/0xfc4b8e114edab507 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1012:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176508 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.947262:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013597d680/0xfc4b8e114eda6487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->24575) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f83 expref: 96 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.947262:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114edab50e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.947266:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.947267:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.947267:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114edab50e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.947269:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801222ccfc0/0xfc4b8e114edab507 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1012:0x0].0x0 rrc: 3 type: EXT [24576->36863] (req 24576->36863) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176508 expref: 88 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.947271:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114edab50e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:3.0:1713279306.947275:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7b15:0x0]: returning size 23529 00010000:00010000:1.0:1713279306.947280:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013597d680/0xfc4b8e114eda6487 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->24575) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f83 expref: 96 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.947285:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013597d680/0xfc4b8e114eda6487 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->24575) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f83 expref: 96 pid: 11415 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.947302:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200064000:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.947316:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed0ba80/0xfc4b8e114edab500 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176501 expref: 3460 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.947319:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123727900 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.947323:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114edab50e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176501 expref: 3459 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.947326:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b15:0x0].0x0 (ffff880090884a00) 00010000:00010000:3.0:1713279306.947328:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1713279306.947329:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b31b00, rc 0) 00000100:00100000:3.0:1713279306.947343:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3459:12071:x1796503281304320:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 123us (166us total) trans 4295183817 rc 0/0 00000100:00100000:3.0:1713279306.947347:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785614 00000100:00100000:0.0:1713279306.947493:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.947517:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281304512 00000100:00100000:3.0:1713279306.947520:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281304512 00000100:00100000:3.0:1713279306.947537:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785615 00000100:00100000:3.0:1713279306.947539:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3665:11711:x1796503281304512:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.947546:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.947552:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114edab51c lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917650f expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.947571:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab523 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.947576:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab523 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947580:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab523 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947585:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edab52a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.947588:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edab52a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947591:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edab52a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947602:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab523 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947605:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab523 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947608:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab523 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947611:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab523 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947614:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096a2d680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.947616:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab523 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947619:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab523 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947623:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88007f2ad700) 00010000:00010000:3.0:1713279306.947624:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.947625:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab523 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947628:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096a2d680/0xfc4b8e114edab523 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947632:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edab52a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:0.0:1713279306.947634:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.947635:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edab52a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947638:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edab52a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947640:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba86c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.947641:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edab52a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947644:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edab52a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.947647:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281304640 00010000:00010000:3.0:1713279306.947647:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff88007f2ad300) 00010000:00010000:3.0:1713279306.947649:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.947650:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edab52a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:2.0:1713279306.947651:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281304640 00010000:00010000:3.0:1713279306.947653:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba86c0/0xfc4b8e114edab52a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.947664:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114edab51c lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917650f expref: 3667 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.947668:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091805440/0xfc4b8e114edab51c lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917650f expref: 3667 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.947673:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091805440, rc 0) 00000100:00100000:2.0:1713279306.947674:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785616 00000100:00100000:2.0:1713279306.947679:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3666:11912:x1796503281304640:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.947688:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.947689:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3666:11711:x1796503281304512:12345-192.168.203.4@tcp:101:touch.0 Request processed in 149us (196us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.947693:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785615 00010000:00010000:2.0:1713279306.947697:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114edab531 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176516 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.947740:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200064000:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.947744:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114edab538 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.947751:0:15500:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801222ccfc0/0xfc4b8e114edab507 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1012:0x0].0x0 rrc: 3 type: EXT [24576->36863] (req 24576->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176508 expref: 88 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.947752:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114edab538 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.947759:0:15500:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801222ccfc0, rc 0) 00010000:00010000:2.0:1713279306.947759:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114edab538 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.947767:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed200/0xfc4b8e114edab53f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.947773:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed200/0xfc4b8e114edab53f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.947779:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+88:12059:x1796503281304384:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 538us (585us total) trans 0 rc 0/0 00010000:00010000:2.0:1713279306.947779:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed200/0xfc4b8e114edab53f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.947784:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110594 00000004:00200000:2.0:1713279306.947791:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x7443:0x0]: returning size 1 00010000:00010000:2.0:1713279306.947799:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114edab538 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.947805:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114edab538 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.947810:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114edab538 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.947815:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114edab538 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.947820:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090b25440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.947823:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114edab538 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.947828:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114edab538 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.947836:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x0 (ffff88012514d400) 00010000:00010000:2.0:1713279306.947838:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.947841:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114edab538 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.947845:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090b25440/0xfc4b8e114edab538 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x260:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.947854:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed200/0xfc4b8e114edab53f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.947860:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed200/0xfc4b8e114edab53f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.947864:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed200/0xfc4b8e114edab53f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.947869:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ed200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.947871:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed200/0xfc4b8e114edab53f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:2.0:1713279306.947876:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed200/0xfc4b8e114edab53f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.947877:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.947882:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x37 (ffff88012514d000) 00010000:00010000:2.0:1713279306.947884:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.947887:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed200/0xfc4b8e114edab53f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.947888:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281304704 00000100:00100000:1.0:1713279306.947889:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.947891:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed200/0xfc4b8e114edab53f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x260:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.947892:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281304704 00010000:00010000:0.0:1713279306.947901:0:6916:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013597d680/0xfc4b8e114eda6487 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->24575) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f83 expref: 97 pid: 11415 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.947911:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281304768 00000100:00100000:0.0:1713279306.947912:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281304768 00000100:00100000:1.0:1713279306.947913:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.947914:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114edab531 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176516 expref: 3666 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.947914:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196612 00000100:00100000:3.0:1713279306.947917:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+97:1955:x1796503281304704:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.947921:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147280 00010000:00010000:2.0:1713279306.947923:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008245cfc0/0xfc4b8e114edab531 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x260:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176516 expref: 3666 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.947923:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.947924:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3459:1956:x1796503281304768:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.947929:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.947930:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008245cfc0, rc 0) 00010000:00010000:3.0:1713279306.947931:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013597d680/0xfc4b8e114eda6487 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1012:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->24575) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f83 expref: 97 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.947935:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129b31b00/0xfc4b8e114edab50e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x7b15:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176501 expref: 3459 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.947937:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013597d680/0xfc4b8e114eda6487 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1012:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->24575) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f83 expref: 97 pid: 11415 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.947940:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281304896 00010000:00010000:0.0:1713279306.947941:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7b15:0x0].0x0 (ffff880090884a00) 00000100:00100000:2.0:1713279306.947942:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281304896 00010000:00010000:0.0:1713279306.947943:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.947946:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013597d680/0xfc4b8e114eda6487 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1012:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->24575) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f83 expref: 97 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.947951:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.947953:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713279306.947954:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223149 00010000:00010000:3.0:1713279306.947956:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801222ccfc0/0xfc4b8e114edab507 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176508 expref: 87 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.947957:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3458:1956:x1796503281304768:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 32us (67us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.947957:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:12056:x1796503281304896:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:0.0:1713279306.947961:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147280 00010000:00010000:3.0:1713279306.947961:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801222ccfc0/0xfc4b8e114edab507 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176508 expref: 87 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.947973:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801222ccfc0/0xfc4b8e114edab507 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176508 expref: 87 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.947978:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6917:1796503200064064:192.168.203.4@tcp:105: 00000100:00100000:3.0:1713279306.947994:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.948024:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:12056:x1796503281304896:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 65us (110us total) trans 4295202806 rc 0/0 00000100:00100000:2.0:1713279306.948028:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223149 00000100:00100000:2.0:1713279306.948043:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3665:11912:x1796503281304640:12345-192.168.203.4@tcp:101:touch.0 Request processed in 365us (411us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.948047:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785616 00000100:00100000:0.0:1713279306.948102:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.948113:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281304960 00000100:00100000:2.0:1713279306.948115:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281304960 00000100:00100000:2.0:1713279306.948130:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110595 00000100:00100000:2.0:1713279306.948140:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+97:1956:x1796503281304960:12345-192.168.203.4@tcp:22:fallocate.0 00002000:00010000:2.0:1713279306.948227:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb size from disk: 23529 -> 23529 00002000:00010000:2.0:1713279306.948229:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.948231:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:2.0:1713279306.948232:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.948234:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1050:0x0] updating lvb blocks from disk: 48 -> 48 00000100:00100000:2.0:1713279306.948255:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+98:1956:x1796503281304960:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 113us (153us total) trans 4295010206 rc 0/0 00000100:00100000:2.0:1713279306.948259:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110595 00000100:00100000:1.0:1713279306.948291:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.948301:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281305088 00000100:00100000:2.0:1713279306.948303:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281305088 00000100:00100000:1.0:1713279306.948306:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.948317:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281305216 00000100:00100000:2.0:1713279306.948318:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281305216 00000100:00100000:1.0:1713279306.948320:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785617 00000100:00100000:1.0:1713279306.948324:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3715:12061:x1796503281305088:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:2.0:1713279306.948325:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785618 00000100:00100000:2.0:1713279306.948328:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3715:11711:x1796503281305216:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.948331:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.948333:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.948337:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542640/0xfc4b8e114edab546 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917651d expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.948338:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114edab54d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176524 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.948376:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114edab554 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.948381:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114edab554 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.948385:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114edab554 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.948390:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edab55b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.948391:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab562 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.948394:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab562 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.948396:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edab55b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.948398:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab562 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.948401:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edab55b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.948407:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edab569 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000004:00200000:2.0:1713279306.948408:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:1.0:1713279306.948425:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edab569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.948426:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114edab554 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.948429:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edab569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.948429:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114edab554 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.948432:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114edab554 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.948435:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114edab554 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.948437:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ef3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.948439:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114edab554 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.948442:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114edab554 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.948446:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012514d300) 00010000:00010000:2.0:1713279306.948447:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.948449:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114edab554 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.948450:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edab570 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.948451:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114edab554 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.948455:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edab570 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.948456:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab562 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.948459:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edab570 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.948459:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab562 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000004:00200000:1.0:1713279306.948463:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e71:0x0]: returning size 35262 00010000:00010000:2.0:1713279306.948464:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab562 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.948467:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298efcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.948468:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab562 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.948471:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab562 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.948474:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88012514db00) 00010000:00010000:2.0:1713279306.948475:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.948476:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab562 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:2.0:1713279306.948479:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab562 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.948485:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edab55b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.948488:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edab55b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.948491:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edab55b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.948492:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114edab54d lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176524 expref: 3718 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.948494:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edab55b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.948496:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114edab54d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176524 expref: 3718 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.948497:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092541b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.948499:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edab55b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.948501:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ee400, rc 0) 00010000:00010000:1.0:1713279306.948502:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edab55b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.948506:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:1.0:1713279306.948508:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.948509:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edab55b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.948512:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092541b00/0xfc4b8e114edab55b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.948516:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3717:11711:x1796503281305216:12345-192.168.203.4@tcp:101:touch.0 Request processed in 188us (210us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.948517:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edab569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.948520:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785618 00010000:00010000:1.0:1713279306.948523:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edab569 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.948526:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edab569 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.948528:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092541440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.948529:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edab569 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.948532:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edab569 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.948535:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x37 (ffff880089dc2800) 00010000:00010000:1.0:1713279306.948536:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.948538:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edab569 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.948540:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092541440/0xfc4b8e114edab569 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.948555:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542640/0xfc4b8e114edab546 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917651d expref: 3717 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.948561:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edab570 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917651d expref: 3716 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.948564:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7e71:0x0].0x0 (ffff8800939e3100) 00010000:00010000:1.0:1713279306.948565:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713279306.948566:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542880, rc 0) 00000100:00100000:1.0:1713279306.948581:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3716:12061:x1796503281305088:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 257us (291us total) trans 4295202807 rc 0/0 00000100:00100000:1.0:1713279306.948586:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785617 00000100:00100000:3.0:1713279306.948628:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6917:1796503200064064:192.168.203.4@tcp:105: 00010000:00010000:3.0:1713279306.948636:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.948649:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+97:1955:x1796503281304704:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 731us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.948654:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196612 00000100:00100000:0.0:1713279306.948733:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.948743:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281305344 00000100:00100000:2.0:1713279306.948746:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281305344 00000100:00100000:2.0:1713279306.948760:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223150 00000100:00100000:2.0:1713279306.948762:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3458:12071:x1796503281305344:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.948811:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3459:12071:x1796503281305344:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 48us (79us total) trans 4295183818 rc 0/0 00000100:00100000:2.0:1713279306.948815:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223150 00000100:00100000:2.0:1713279306.948887:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.948908:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.948909:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281305408 00000100:00100000:3.0:1713279306.948912:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281305408 00000100:00100000:0.0:1713279306.948919:0:15534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281305536 00000100:00100000:0.0:1713279306.948922:0:15534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281305536 00000100:00100000:3.0:1713279306.948930:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147281 00000100:00100000:3.0:1713279306.948932:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3716:1957:x1796503281305408:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:3.0:1713279306.948937:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713279306.948938:0:15534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14366 00000100:00100000:0.0:1713279306.948941:0:15534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_011:385c4b71-808c-40cf-91de-b076b668d13f+3665:11995:x1796503281305536:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1713279306.948945:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982f40/0xfc4b8e114eda5fb0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174e56 expref: 3716 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.948951:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7693:0x0].0x0 (ffff880096b90d00) 00010000:00010000:3.0:1713279306.948953:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.948966:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3715:1957:x1796503281305408:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 33us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.948970:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147281 00010000:00010000:0.0:1713279306.948973:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f557840/0xfc4b8e114edab57e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.948977:0:15534:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f557840/0xfc4b8e114edab57e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.948984:0:15534:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f557840/0xfc4b8e114edab57e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15534 initiator: MDT1 00000100:00100000:0.0:1713279306.948993:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064128:0@lo:101:mdt_io00_011.0 00000100:00100000:0.0:1713279306.949057:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.949065:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a240 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.949078:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200064128 00000100:00100000:3.0:1713279306.949080:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200064128 00000100:00100000:2.0:1713279306.949087:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.949093:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98944 00000100:00100000:3.0:1713279306.949095:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:15534:x1796503200064128:12345-0@lo:101:mdt_io00_011.0 00000100:00100000:1.0:1713279306.949098:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281305664 00000100:00100000:1.0:1713279306.949101:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281305664 00010000:00010000:3.0:1713279306.949103:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.949109:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab585 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114edab57e expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.949115:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785619 00000100:00100000:1.0:1713279306.949118:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3666:11711:x1796503281305664:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.949118:0:15494:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab585 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114edab57e expref: 56 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.949123:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.949124:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab585 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edab57e expref: 56 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.949127:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88007f2ad800) 00010000:00010000:3.0:1713279306.949128:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.949129:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114edab58c lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917652b expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.949129:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba9f80, rc 0) 00000100:00100000:3.0:1713279306.949146:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200064128:12345-0@lo:101:mdt_io00_011.0 Request processed in 50us (90us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.949150:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edab593 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.949150:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98944 00000100:00100000:0.0:1713279306.949152:0:15534:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4295202794 gen 2 00010000:00010000:1.0:1713279306.949154:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edab593 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000004:00080000:0.0:1713279306.949155:0:15534:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202794 committed transno 4295202794 00010000:00010000:1.0:1713279306.949158:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edab593 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.949163:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edab59a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.949167:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edab59a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.949169:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064128:0@lo:101:mdt_io00_011.0 00010000:00010000:1.0:1713279306.949170:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edab59a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713279306.949176:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f557840/0xfc4b8e114edab57e lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edab585 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.949181:0:15534:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f557840/0xfc4b8e114edab57e lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edab585 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.949181:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edab593 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.949184:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edab593 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.949188:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edab593 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000004:00080000:0.0:1713279306.949189:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1713279306.949191:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edab593 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.949193:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800925421c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.949195:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edab593 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000004:00080000:0.0:1713279306.949197:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x1:0x0] 00010000:00010000:1.0:1713279306.949198:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edab593 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.949201:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880089dc2900) 00010000:00010000:1.0:1713279306.949203:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.949204:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edab593 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.949207:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800925421c0/0xfc4b8e114edab593 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.949212:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064192:0@lo:1000:mdt_io00_011.0 00010000:00010000:1.0:1713279306.949212:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edab59a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.949214:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edab59a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.949217:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edab59a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.949219:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.949221:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edab59a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.949225:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.949226:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edab59a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.949230:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880089dc2100) 00010000:00010000:1.0:1713279306.949231:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.949232:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a840 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.949232:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edab59a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.949234:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540480/0xfc4b8e114edab59a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713279306.949235:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200064192 00000100:00100000:3.0:1713279306.949237:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200064192 00000100:00100000:3.0:1713279306.949244:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98945 00010000:00010000:1.0:1713279306.949246:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114edab58c lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917652b expref: 3667 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.949246:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200064192:12345-0@lo:1000:mdt_io00_011.0 00010000:00010000:1.0:1713279306.949251:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092540240/0xfc4b8e114edab58c lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917652b expref: 3667 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.949255:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092540240, rc 0) 00000100:00100000:1.0:1713279306.949271:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3666:11711:x1796503281305664:12345-192.168.203.4@tcp:101:touch.0 Request processed in 152us (184us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.949275:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785619 00000100:00100000:3.0:1713279306.949279:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200064192:12345-0@lo:1000:mdt_io00_011.0 Request processed in 32us (53us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.949283:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98945 00000100:00100000:0.0:1713279306.949286:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064192:0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.949304:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064256:0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.949369:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.949375:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a840 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.949377:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200064256 00000100:00100000:3.0:1713279306.949379:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200064256 00000100:00100000:1.0:1713279306.949386:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.949386:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98946 00000100:00100000:3.0:1713279306.949388:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200064256:12345-0@lo:1000:mdt_io00_011.0 00000100:00100000:2.0:1713279306.949401:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281305728 00000100:00100000:2.0:1713279306.949405:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281305728 00000100:00100000:3.0:1713279306.949410:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200064256:12345-0@lo:1000:mdt_io00_011.0 Request processed in 21us (41us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.949426:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98946 00000100:00100000:0.0:1713279306.949430:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064256:0@lo:1000:mdt_io00_011.0 00000100:00100000:2.0:1713279306.949441:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110596 00000100:00100000:2.0:1713279306.949445:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+88:1956:x1796503281305728:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:0.0:1713279306.949449:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064320:0@lo:1000:mdt_io00_011.0 00000100:00100000:0.0:1713279306.949460:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.949465:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a840 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.949468:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200064320 00000100:00100000:3.0:1713279306.949470:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200064320 00000100:00100000:3.0:1713279306.949477:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98947 00000100:00100000:3.0:1713279306.949479:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200064320:12345-0@lo:1000:mdt_io00_011.0 00002000:00010000:2.0:1713279306.949508:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb size from disk: 40670 -> 40670 00000100:00100000:3.0:1713279306.949508:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200064320:12345-0@lo:1000:mdt_io00_011.0 Request processed in 28us (48us total) trans 0 rc 1/1 00002000:00010000:2.0:1713279306.949510:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.949511:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb atime from disk: 1713279304 -> 1713279304 00000100:00100000:3.0:1713279306.949512:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98947 00002000:00010000:2.0:1713279306.949513:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00000100:00100000:0.0:1713279306.949514:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064320:0@lo:1000:mdt_io00_011.0 00002000:00010000:2.0:1713279306.949514:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:2.0:1713279306.949530:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+89:1956:x1796503281305728:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 84us (146us total) trans 4295010207 rc 0/0 00000100:00100000:2.0:1713279306.949534:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110596 00010000:00010000:0.0:1713279306.949573:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f556ac0/0xfc4b8e114edab5a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15534 initiator: MDT0 00010000:00010000:0.0:1713279306.949577:0:15534:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f556ac0/0xfc4b8e114edab5a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.949581:0:15534:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f556ac0/0xfc4b8e114edab5a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15534 initiator: MDT1 00000100:00100000:3.0:1713279306.949586:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.949587:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064384:0@lo:101:mdt_io00_011.0 00000100:00100000:0.0:1713279306.949600:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279306.949605:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a240 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.949611:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200064384 00000100:00100000:1.0:1713279306.949613:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281305856 00000100:00100000:3.0:1713279306.949614:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200064384 00000100:00100000:1.0:1713279306.949616:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281305856 00000100:00100000:3.0:1713279306.949623:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98948 00000100:00100000:3.0:1713279306.949626:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:15534:x1796503200064384:12345-0@lo:101:mdt_io00_011.0 00000100:00100000:1.0:1713279306.949629:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785620 00010000:00010000:3.0:1713279306.949631:0:15494:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713279306.949632:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3715:12077:x1796503281305856:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.949636:0:15494:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114edab5a8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114edab5a1 expref: -99 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.949637:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.949643:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114edab5af lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176532 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.949645:0:15494:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114edab5a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114edab5a1 expref: 57 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.949653:0:15494:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114edab5a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edab5a1 expref: 57 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.949657:0:15494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.949658:0:15494:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.949659:0:15494:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba8d80, rc 0) 00000100:00100000:3.0:1713279306.949674:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:15534:x1796503200064384:12345-0@lo:101:mdt_io00_011.0 Request processed in 47us (74us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.949677:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edab5b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.949677:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98948 00000100:00100000:0.0:1713279306.949680:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064384:0@lo:101:mdt_io00_011.0 00010000:00010000:1.0:1713279306.949683:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edab5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.949685:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f556ac0/0xfc4b8e114edab5a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edab5a8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.949687:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edab5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.949690:0:15534:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f556ac0/0xfc4b8e114edab5a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edab5a8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.949693:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114edab5bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000004:00080000:0.0:1713279306.949696:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x1:0x0] 00010000:00010000:1.0:1713279306.949696:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114edab5bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.949699:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114edab5bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000004:00200000:1.0:1713279306.949737:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5a21:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.949742:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edab5b6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.949745:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edab5b6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.949748:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edab5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.949751:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edab5b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.949753:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013585ef40/0xfc4b8e114edab5c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.949753:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092540900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.949755:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edab5b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.949755:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.949757:0:15534:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013585ef40/0xfc4b8e114edab5c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.949758:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edab5b6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.949761:0:15534:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013585ef40/0xfc4b8e114edab5c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.949763:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.949764:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279306.949765:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281305984 00010000:00010000:1.0:1713279306.949766:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edab5b6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.949767:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281305984 00010000:00010000:1.0:1713279306.949769:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092540900/0xfc4b8e114edab5b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.949770:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064448:0@lo:101:mdt_io00_011.0 00010000:00010000:1.0:1713279306.949774:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114edab5bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.949776:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114edab5bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.949776:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785621 00000100:00100000:3.0:1713279306.949779:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3666:12069:x1796503281305984:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.949780:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114edab5bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.949782:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.949782:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d4b3180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.949783:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114edab5bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949783:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.949786:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114edab5bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949787:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edab5cb lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176539 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.949789:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a240 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.949789:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x34 (ffff880089dc2200) 00010000:00010000:1.0:1713279306.949790:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.949791:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114edab5bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.949794:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d4b3180/0xfc4b8e114edab5bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.949796:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200064448 00000100:00100000:2.0:1713279306.949797:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.949798:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200064448 00010000:00010000:1.0:1713279306.949805:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114edab5af lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176532 expref: 3716 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.949810:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925433c0/0xfc4b8e114edab5af lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176532 expref: 3716 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.949811:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98949 00000100:00100000:0.0:1713279306.949814:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+57:15534:x1796503200064448:12345-0@lo:101:mdt_io00_011.0 00010000:00010000:1.0:1713279306.949815:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925433c0, rc 0) 00010000:00010000:3.0:1713279306.949819:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab5d2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.949820:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.949824:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab5d2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.949826:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab5d9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114edab5c4 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.949829:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab5d2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.949831:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3715:12077:x1796503281305856:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 198us (245us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.949834:0:15516:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab5d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114edab5c4 expref: 58 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.949835:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785620 00010000:00010000:3.0:1713279306.949835:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114edab5e0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.949840:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab5d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edab5c4 expref: 58 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.949841:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114edab5e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00000100:00100000:1.0:1713279306.949842:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281306112 00010000:00010000:0.0:1713279306.949844:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3531 (ffff88007f389700) 00000100:00100000:1.0:1713279306.949844:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281306112 00010000:00010000:3.0:1713279306.949844:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114edab5e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.949846:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.949847:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013585cd80, rc 0) 00000100:00100000:1.0:1713279306.949853:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785622 00000100:00100000:1.0:1713279306.949856:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3715:11711:x1796503281306112:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.949860:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.949861:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+58:15534:x1796503200064448:12345-0@lo:101:mdt_io00_011.0 Request processed in 46us (78us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.949861:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114edab5e7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.949865:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98949 00010000:00010000:3.0:1713279306.949865:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114edab5e7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.949866:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095070fc0/0xfc4b8e114edab5ee lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176540 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.949868:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114edab5e7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000004:00200000:3.0:1713279306.949872:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x75c9:0x0]: returning size 30052 00000100:00100000:0.0:1713279306.949878:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064448:0@lo:101:mdt_io00_011.0 00010000:00010000:0.0:1713279306.949883:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013585ef40/0xfc4b8e114edab5c4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edab5d9 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.949890:0:15534:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013585ef40/0xfc4b8e114edab5c4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edab5d9 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.949892:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab5d2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00000004:00080000:0.0:1713279306.949895:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x1:0x0] 00010000:00010000:3.0:1713279306.949896:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab5d2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.949897:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114edab5fc lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949899:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab5d2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.949901:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114edab5fc lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949902:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab5d2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.949904:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baba80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.949905:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15534 initiator: MDT0 00010000:00010000:1.0:1713279306.949905:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114edab5fc lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949906:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab5d2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.949908:0:15534:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279306.949909:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab5d2 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.949910:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114edab60a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.949912:0:15534:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.949914:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114edab60a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949916:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00000100:00100000:0.0:1713279306.949917:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064512:0@lo:101:mdt_io00_011.0 00010000:00010000:1.0:1713279306.949917:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114edab60a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949917:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.949919:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab5d2 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:3.0:1713279306.949922:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baba80/0xfc4b8e114edab5d2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000004:00200000:1.0:1713279306.949924:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00000100:00100000:0.0:1713279306.949927:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279306.949927:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114edab5e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.949928:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114edab5fc lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949930:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114edab5e0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.949931:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114edab5fc lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.949932:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a240 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.949933:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114edab5e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.949934:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114edab5fc lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949935:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baa400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.949937:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114edab5fc lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949937:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114edab5e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.949938:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200064512 00000100:00100000:0.0:1713279306.949939:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200064512 00010000:00010000:1.0:1713279306.949939:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801250a9200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.949939:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114edab5e0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.949941:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114edab5fc lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949942:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x39 (ffff88012d397500) 00010000:00010000:3.0:1713279306.949943:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.949944:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114edab5fc lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949945:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114edab5e0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.949947:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012cfc6500) 00010000:00010000:3.0:1713279306.949947:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa400/0xfc4b8e114edab5e0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00000100:00100000:0.0:1713279306.949948:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98950 00010000:00010000:1.0:1713279306.949948:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713279306.949950:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+58:15534:x1796503200064512:12345-0@lo:101:mdt_io00_011.0 00010000:00010000:1.0:1713279306.949950:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114edab5fc lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.949952:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801250a9200/0xfc4b8e114edab5fc lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.949955:0:15516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.949960:0:15516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab611 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc4b8e114edab603 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.949960:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114edab60a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949961:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baaf40/0xfc4b8e114edab5cb lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176539 expref: 3669 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.949963:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114edab60a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.949966:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114edab60a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.949968:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114eda61d9 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ee2 expref: 3715 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.949968:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8b40/0xfc4b8e114edab5e7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x75c9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176539 expref: 3668 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.949969:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e5f5200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.949970:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114edab60a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949971:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75c9:0x0].0x0 (ffff88008eb9f100) 00010000:00010000:0.0:1713279306.949972:0:15516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab611 lrc: 4/0,0 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfc4b8e114edab603 expref: 59 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.949972:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1713279306.949973:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114edab60a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.949973:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba8b40, rc 0) 00010000:00010000:1.0:1713279306.949976:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88009588c100) 00010000:00010000:1.0:1713279306.949977:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.949978:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114edab60a lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.949980:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5f5200/0xfc4b8e114edab60a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.949986:0:15516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114eda61d9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ee2 expref: 3715 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.949991:0:15516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114eda61d9 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ee2 expref: 3715 pid: 15473 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.949993:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3668:12069:x1796503281305984:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 211us (236us total) trans 4295183819 rc 0/0 00010000:00010000:1.0:1713279306.949994:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095070fc0/0xfc4b8e114edab5ee lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176540 expref: 3716 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.949997:0:15516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091a2e300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000_UUID:15516:1796503200064576:192.168.203.4@tcp:104: 00010000:00010000:1.0:1713279306.949998:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095070fc0/0xfc4b8e114edab5ee lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176540 expref: 3716 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.949999:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785621 00010000:00010000:1.0:1713279306.950003:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095070fc0, rc 0) 00000100:00100000:0.0:1713279306.950012:0:15516:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a840 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.950017:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3715:11711:x1796503281306112:12345-192.168.203.4@tcp:101:touch.0 Request processed in 160us (220us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.950021:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785622 00000100:00100000:0.0:1713279306.950137:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.950147:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281306240 00000100:00100000:2.0:1713279306.950150:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281306240 00000100:00100000:2.0:1713279306.950165:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223151 00000100:00100000:2.0:1713279306.950169:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130146850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3668:12059:x1796503281306240:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.950217:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130146850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3669:12059:x1796503281306240:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 47us (81us total) trans 4295183820 rc 0/0 00000100:00100000:2.0:1713279306.950221:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223151 00000100:00100000:0.0:1713279306.950489:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.950504:0:15516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091a2e300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000_UUID:15516:1796503200064576:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.950513:0:15516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab611 lrc: 3/0,0 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edab603 expref: 59 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.950517:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281306304 00010000:00010000:2.0:1713279306.950519:0:15516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7693:0x0].0x0 (ffff880096b90d00) 00010000:00010000:2.0:1713279306.950520:0:15516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:3.0:1713279306.950520:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281306304 00010000:00010000:2.0:1713279306.950522:0:15516:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab611 lrc: 3/0,0 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edab603 expref: 59 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.950526:0:15516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd4480, rc 0) 00010000:00010000:3.0:1713279306.950529:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114eda61d9 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ee2 expref: 3716 pid: 15473 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.950542:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+59:15534:x1796503200064512:12345-0@lo:101:mdt_io00_011.0 Request processed in 590us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.950545:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98950 00000100:00100000:3.0:1713279306.950546:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196613 00000100:00100000:3.0:1713279306.950549:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:1956:x1796503281306304:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713279306.950551:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064512:0@lo:101:mdt_io00_011.0 00010000:00010000:3.0:1713279306.950554:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.950556:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114eda61d9 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ee2 expref: 3716 pid: 15473 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.950558:0:15534:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.950562:0:15534:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.950562:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114eda61d9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ee2 expref: 3716 pid: 15473 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.950569:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114eda61d9 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ee2 expref: 3716 pid: 15473 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.950578:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7693:0x0].0x0 (ffff880096b90d00) 00010000:00010000:3.0:1713279306.950581:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab611 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edab603 expref: 58 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.950585:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab611 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114edab603 expref: 58 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.950589:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab611 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfc4b8e114edab603 expref: 58 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.950599:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab611 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfc4b8e114edab603 expref: 58 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.950604:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6917:1796503200064640:0@lo:105: 00000100:00100000:3.0:1713279306.950620:0:6917:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.950627:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.950637:0:6913:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200064640 00000100:00100000:2.0:1713279306.950640:0:6913:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200064640 00000100:00100000:2.0:1713279306.950657:0:6913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33460 00000100:00100000:2.0:1713279306.950661:0:6913:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c161c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6917:x1796503200064640:12345-0@lo:105: 00010000:00010000:2.0:1713279306.950668:0:6913:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 5/0,1 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.950676:0:6913:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 5/0,1 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.950683:0:6913:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 5/0,1 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.950690:0:6913:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 5/0,1 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.950696:0:6913:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 6/0,1 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.950703:0:6913:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 6/0,1 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.950722:0:6913:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880091dd4b40) 00010000:00010000:1.0:1713279306.950734:0:15534:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.950739:0:15534:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.950744:0:6913:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c161c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6917:x1796503200064640:12345-0@lo:105: Request processed in 83us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.950747:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6917:1796503200064640:0@lo:105: 00000100:00100000:0.0:1713279306.950748:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.950750:0:6913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33460 00010000:00010000:1.0:1713279306.950752:0:15534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114edab618 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15534 initiator: MDT0 00010000:00010000:3.0:1713279306.950754:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.950757:0:15534:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114edab618 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x24/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.950761:0:15534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114edab618 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x24/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15534 initiator: MDT1 00000100:00100000:3.0:1713279306.950768:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:1956:x1796503281306304:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 217us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.950771:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.950772:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196613 00000100:00100000:2.0:1713279306.950785:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281306496 00000100:00100000:2.0:1713279306.950788:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281306496 00000100:00100000:2.0:1713279306.950800:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110597 00000100:00100000:2.0:1713279306.950803:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+89:12069:x1796503281306496:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.950809:0:15500:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.950817:0:15500:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801298ec240/0xfc4b8e114edab61f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917654e expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.950823:0:15534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064704:0@lo:1000:mdt_io00_011.0 00010000:00010000:2.0:1713279306.950829:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009224e880/0xfc4b8e114eda5dcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ddf expref: 96 pid: 9197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.950835:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.950836:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.950839:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801298ec240/0xfc4b8e114edab61f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [16384->28671] (req 16384->28671) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917654e expref: 90 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.950841:0:15534:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.950849:0:15534:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237270c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.950849:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200064704 00000100:00100000:3.0:1713279306.950851:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200064704 00010000:00010000:2.0:1713279306.950852:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009224e880/0xfc4b8e114eda5dcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ddf expref: 96 pid: 9197 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.950858:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98951 00010000:00010000:2.0:1713279306.950860:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009224e880/0xfc4b8e114eda5dcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ddf expref: 96 pid: 9197 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.950861:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+59:15534:x1796503200064704:12345-0@lo:1000:mdt_io00_011.0 00000100:00100000:1.0:1713279306.950863:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281306432 00000100:00100000:1.0:1713279306.950866:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281306432 00000100:00100000:2.0:1713279306.950868:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200064768:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.950878:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785623 00000100:00100000:1.0:1713279306.950881:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3669:11711:x1796503281306432:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.950887:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.950889:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800968dda80 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.950890:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+59:15534:x1796503200064704:12345-0@lo:1000:mdt_io00_011.0 Request processed in 29us (49us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.950893:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3218c0/0xfc4b8e114edab626 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176547 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.950894:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98951 00000100:00100000:0.0:1713279306.950900:0:15534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_011:lustre-MDT0001-mdtlov_UUID:15534:1796503200064704:0@lo:1000:mdt_io00_011.0 00010000:00010000:1.0:1713279306.950913:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114edab62d lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.950920:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114edab62d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.950924:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114edab62d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.950928:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114edab634 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.950931:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114edab634 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.950934:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114edab634 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.950945:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114edab62d lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.950948:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114edab62d lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.950951:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114edab62d lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.950953:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114edab618 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x24/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.950954:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114edab62d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.950956:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.950958:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114edab618 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x24/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.950958:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114edab62d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.950960:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114edab62d lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.950961:0:15534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114edab618 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x24/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.950965:0:15534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d3221c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.950966:0:15534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114edab618 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x24/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.950968:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880131eda600) 00010000:00010000:0.0:1713279306.950970:0:15534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114edab618 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x24/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279306.950970:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.950973:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114edab62d lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.950975:0:15534:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7693:0x0].0x0 (ffff880090aad600) 00010000:00010000:0.0:1713279306.950976:0:15534:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 24 00010000:00010000:1.0:1713279306.950977:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323180/0xfc4b8e114edab62d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.950978:0:15534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114edab618 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x24/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.950981:0:15534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3221c0/0xfc4b8e114edab618 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x24/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279306.950986:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.950986:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114edab634 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.950990:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.950990:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114edab634 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.950994:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.950995:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114edab634 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.950999:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d322640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.951001:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114edab634 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279306.951002:0:15534:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1713279306.951004:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x1:0x0] 00010000:00010000:3.0:1713279306.951004:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713279306.951006:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f556ac0/0xfc4b8e114edab5a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edab5a8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.951006:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114edab634 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713279306.951008:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.951009:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f556ac0/0xfc4b8e114edab5a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edab5a8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.951012:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880131eda200) 00010000:00010000:3.0:1713279306.951012:0:9214:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4b40 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:1.0:1713279306.951014:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.951015:0:9214:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.951016:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f556ac0/0xfc4b8e114edab5a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edab5a8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.951017:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114edab634 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000004:00010000:3.0:1713279306.951019:0:9214:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.951021:0:15534:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1713279306.951021:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d322640/0xfc4b8e114edab634 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000004:00080000:0.0:1713279306.951022:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x1:0x0] 00010000:00010000:0.0:1713279306.951024:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013585ef40/0xfc4b8e114edab5c4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edab5d9 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.951027:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013585ef40/0xfc4b8e114edab5c4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edab5d9 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.951030:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013585ef40/0xfc4b8e114edab5c4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edab5d9 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.951030:0:6919:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.951031:0:9214:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.951034:0:6919:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f556ac0/0xfc4b8e114edab5a1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114edab5a8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.951034:0:9214:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713279306.951040:0:6919:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f556ac0 already unused, calling callback (ffffffffa0f0e520) 00010000:00010000:1.0:1713279306.951041:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3218c0/0xfc4b8e114edab626 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176547 expref: 3670 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.951042:0:15534:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1713279306.951043:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 1/0,0 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.951044:0:6919:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f556ac0/0xfc4b8e114edab5a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114edab5a8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713279306.951045:0:15534:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x1:0x0] 00010000:00010000:1.0:1713279306.951046:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3218c0/0xfc4b8e114edab626 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176547 expref: 3670 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.951047:0:15534:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f557840/0xfc4b8e114edab57e lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfc4b8e114edab585 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.951047:0:9214:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880091dd4b40/0xfc4b8e114edab603 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edab611 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.951050:0:15534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f557840/0xfc4b8e114edab57e lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edab585 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713279306.951050:0:6919:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f556ac0/0xfc4b8e114edab5a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114edab5a8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.951052:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3218c0, rc 0) 00010000:00010000:0.0:1713279306.951054:0:15534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f557840/0xfc4b8e114edab57e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfc4b8e114edab585 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.951055:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.951056:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013585ef40/0xfc4b8e114edab5c4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114edab5d9 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.951059:0:15534:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1713279306.951060:0:15544:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713279306.951060:0:9214:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013585ef40 already unused, calling callback (ffffffffa0f0e520) 00000004:00020000:0.0:1713279306.951061:0:15534:0:(mdt_reint.c:2451:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200000402:0x1:0x0]/15 failed: rc = -114 00010000:00010000:3.0:1713279306.951061:0:9214:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013585ef40/0xfc4b8e114edab5c4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114edab5d9 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.951063:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f557840/0xfc4b8e114edab57e lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfc4b8e114edab585 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.951064:0:6919:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f556ac0/0xfc4b8e114edab5a1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edab5a8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.951080:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f557840 already unused, calling callback (ffffffffa0f0e520) 00000004:00010000:3.0:1713279306.951081:0:9214:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013585ef40/0xfc4b8e114edab5c4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114edab5d9 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.951083:0:15544:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f557840/0xfc4b8e114edab57e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114edab585 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.951084:0:6919:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000004:00010000:1.0:1713279306.951087:0:15544:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f557840/0xfc4b8e114edab57e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114edab585 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.951088:0:9214:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013585ef40/0xfc4b8e114edab5c4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edab5d9 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.951092:0:15534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_011:385c4b71-808c-40cf-91de-b076b668d13f+3669:11995:x1796503281305536:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 2149us (2183us total) trans 0 rc -114/-114 00010000:00010000:3.0:1713279306.951092:0:9214:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713279306.951096:0:6919:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f556ac0/0xfc4b8e114edab5a1 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edab5a8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.951096:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013585ef40/0xfc4b8e114edab5c4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edab5d9 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.951099:0:15534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14366 00010000:00010000:1.0:1713279306.951099:0:15544:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f557840/0xfc4b8e114edab57e lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edab585 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.951100:0:9214:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013585ef40/0xfc4b8e114edab5c4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edab5d9 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.951102:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f556ac0/0xfc4b8e114edab5a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edab5a8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.951103:0:15544:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279306.951105:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.951106:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279306.951107:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.951108:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f557840/0xfc4b8e114edab57e lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edab585 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.951111:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.951112:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008f557840/0xfc4b8e114edab57e lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edab585 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.951112:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279306.951113:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200065024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.951114:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.951118:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.951119:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713279306.951120:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279306.951122:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200064832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.951128:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279306.951135:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3668:11711:x1796503281306432:12345-192.168.203.4@tcp:101:touch.0 Request processed in 252us (387us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.951139:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785623 00000100:00100000:2.0:1713279306.951141:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279306.951142:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200064960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.951154:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200065024 00000100:00100000:3.0:1713279306.951156:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200065024 00000100:00100000:1.0:1713279306.951159:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200064832 00000100:00100000:1.0:1713279306.951161:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200064832 00000100:00100000:3.0:1713279306.951166:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147282 00010000:00010000:2.0:1713279306.951167:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279306.951168:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+60:3492:x1796503200065024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.951173:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.951174:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147283 00000100:00100000:2.0:1713279306.951174:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200064896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.951177:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+60:3493:x1796503200064832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.951178:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9f80/0xfc4b8e114edab585 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114edab57e expref: 60 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.951181:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.951183:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88007f2ad800) 00010000:00010000:3.0:1713279306.951187:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.951188:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab611 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x7693:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114edab603 expref: 59 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.951189:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713279306.951193:0:15496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7693:0x0].0x0 (ffff880096b90d00) 00010000:00010000:1.0:1713279306.951196:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.951198:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200064896 00000100:00100000:3.0:1713279306.951200:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+58:3492:x1796503200065024:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.951201:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200064896 00000100:00100000:3.0:1713279306.951204:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147282 00000100:00100000:3.0:1713279306.951211:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147284 00000100:00100000:1.0:1713279306.951212:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+58:3493:x1796503200064832:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (71us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.951213:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+58:3490:x1796503200064896:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713279306.951216:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147283 00010000:00010000:3.0:1713279306.951217:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.951221:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8d80/0xfc4b8e114edab5a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114edab5a1 expref: 57 pid: 15494 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.951224:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200064832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.951226:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.951227:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.951237:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+56:3490:x1796503200064896:12345-0@lo:103:ldlm_bl.0 Request processed in 23us (48us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.951245:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147284 00000100:00100000:0.0:1713279306.951250:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200064896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713279306.951253:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279306.951266:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200064960 00000100:00100000:3.0:1713279306.951267:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200065024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.951269:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200064960 00000100:00100000:2.0:1713279306.951285:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147285 00000100:00100000:2.0:1713279306.951289:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b25ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+56:3491:x1796503200064960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.951295:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.951303:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab5d9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114edab5c4 expref: 56 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.951312:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3531 (ffff88007f389700) 00010000:00010000:2.0:1713279306.951317:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.951336:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b25ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+55:3491:x1796503200064960:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.951336:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200064960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.951342:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147285 00000100:00100000:2.0:1713279306.951455:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200064768:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.951467:0:15500:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801298ec240/0xfc4b8e114edab61f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [16384->28671] (req 16384->28671) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917654e expref: 90 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.951483:0:15500:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ec240, rc 0) 00000100:00100000:2.0:1713279306.951500:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+90:12069:x1796503281306496:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 696us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.951506:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110597 00000100:00100000:2.0:1713279306.951593:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.951604:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281306560 00000100:00100000:0.0:1713279306.951607:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281306560 00010000:00010000:0.0:1713279306.951617:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009224e880/0xfc4b8e114eda5dcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ddf expref: 97 pid: 9197 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.951632:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196614 00000100:00100000:0.0:1713279306.951635:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+97:1954:x1796503281306560:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.951640:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.951647:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009224e880/0xfc4b8e114eda5dcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ddf expref: 97 pid: 9197 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.951652:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009224e880/0xfc4b8e114eda5dcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ddf expref: 97 pid: 9197 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.951661:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009224e880/0xfc4b8e114eda5dcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->32767) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174ddf expref: 97 pid: 9197 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.951667:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.951668:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.951671:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801298ec240/0xfc4b8e114edab61f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917654e expref: 89 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.951676:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801298ec240/0xfc4b8e114edab61f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917654e expref: 89 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.951687:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801298ec240/0xfc4b8e114edab61f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917654e expref: 89 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.951693:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091a2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6917:1796503200065088:192.168.203.4@tcp:105: 00000100:00100000:0.0:1713279306.951709:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a240 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.951988:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.952008:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281306688 00000100:00100000:1.0:1713279306.952011:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281306688 00000100:00100000:1.0:1713279306.952022:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785624 00000100:00100000:1.0:1713279306.952025:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3715:11711:x1796503281306688:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.952030:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.952036:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114edab63b lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176555 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.952082:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114edab642 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952087:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114edab642 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952093:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114edab642 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952099:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114edab649 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952102:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114edab649 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952105:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114edab649 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00200000:1.0:1713279306.952114:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:1.0:1713279306.952119:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114edab642 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952122:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114edab642 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952125:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114edab642 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952128:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114edab642 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952131:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.952132:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114edab642 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952135:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114edab642 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.952135:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091a2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6917:1796503200065088:192.168.203.4@tcp:105: 00010000:00010000:1.0:1713279306.952139:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88008e766400) 00010000:00010000:1.0:1713279306.952141:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.952141:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.952142:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114edab642 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952145:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321b00/0xfc4b8e114edab642 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952150:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114edab649 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952153:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114edab649 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952156:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114edab649 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952158:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.952160:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114edab649 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.952161:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+96:1954:x1796503281306560:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 525us (569us total) trans 0 rc 0/0 00010000:00010000:1.0:1713279306.952163:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114edab649 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952166:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88012cfc6800) 00000100:00100000:2.0:1713279306.952166:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196614 00010000:00010000:1.0:1713279306.952167:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.952168:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114edab649 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952170:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321d40/0xfc4b8e114edab649 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952183:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114edab63b lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176555 expref: 3716 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.952190:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d322400/0xfc4b8e114edab63b lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176555 expref: 3716 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.952195:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d322400, rc 0) 00000100:00100000:1.0:1713279306.952208:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3715:11711:x1796503281306688:12345-192.168.203.4@tcp:101:touch.0 Request processed in 183us (222us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.952212:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785624 00000100:00100000:0.0:1713279306.952698:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.952762:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281306816 00000100:00100000:1.0:1713279306.952766:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281306816 00000100:00100000:1.0:1713279306.952783:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785625 00000100:00100000:1.0:1713279306.952787:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3668:11711:x1796503281306816:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.952796:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.952803:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edab650 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917655c expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.952827:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edab657 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952833:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edab657 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952837:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edab657 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952842:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edab65e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.952846:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edab65e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952849:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edab65e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952861:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edab657 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952864:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edab657 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952868:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edab657 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952871:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edab657 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952873:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.952875:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edab657 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952878:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edab657 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952882:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88012cfc6a00) 00010000:00010000:1.0:1713279306.952884:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.952885:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edab657 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952888:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320b40/0xfc4b8e114edab657 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952894:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edab65e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952897:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edab65e lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952900:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edab65e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952902:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.952904:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edab65e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952906:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edab65e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952909:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff88009588c900) 00010000:00010000:1.0:1713279306.952911:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.952912:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edab65e lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952914:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320900/0xfc4b8e114edab65e lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713279306.952926:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edab650 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917655c expref: 3669 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.952930:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d323cc0/0xfc4b8e114edab650 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917655c expref: 3669 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.952935:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d323cc0, rc 0) 00000100:00100000:1.0:1713279306.952954:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3668:11711:x1796503281306816:12345-192.168.203.4@tcp:101:touch.0 Request processed in 166us (256us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.952958:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785625 00000100:00100000:0.0:1713279306.953043:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.953051:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281306944 00000100:00100000:1.0:1713279306.953054:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281306944 00000100:00100000:1.0:1713279306.953065:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785626 00000100:00100000:1.0:1713279306.953085:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3715:12082:x1796503281306944:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.953091:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.953097:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114edab665 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176563 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.953101:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.953101:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.953116:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281307072 00000100:00100000:0.0:1713279306.953118:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281307072 00000100:00100000:0.0:1713279306.953129:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785627 00010000:00010000:1.0:1713279306.953131:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323840/0xfc4b8e114edab66c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:0.0:1713279306.953132:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:12054:x1796503281307072:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.953136:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323840/0xfc4b8e114edab66c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.953138:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.953140:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323840/0xfc4b8e114edab66c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.953142:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281307136 00010000:00010000:0.0:1713279306.953144:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114edab673 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917656a expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.953146:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edab67a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.953147:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281307136 00010000:00010000:1.0:1713279306.953149:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edab67a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.953152:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edab67a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00200000:1.0:1713279306.953160:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8516:0x0]: returning size 1 00000100:00100000:2.0:1713279306.953165:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110598 00010000:00010000:1.0:1713279306.953166:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323840/0xfc4b8e114edab66c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.953169:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323840/0xfc4b8e114edab66c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.953170:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+90:1955:x1796503281307136:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:1.0:1713279306.953172:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323840/0xfc4b8e114edab66c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.953177:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114edab681 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.953177:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323840/0xfc4b8e114edab66c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.953180:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d323840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.953183:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114edab681 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.953187:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114edab681 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.953190:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323840/0xfc4b8e114edab66c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.953192:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114edab688 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.953193:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323840/0xfc4b8e114edab66c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.953196:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114edab688 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.953198:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.953199:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.953200:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114edab688 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.953201:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323840/0xfc4b8e114edab66c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.953204:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d323840/0xfc4b8e114edab66c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000004:00200000:0.0:1713279306.953207:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8516:0x0]: returning size 1 00010000:00010000:1.0:1713279306.953209:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edab67a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.953212:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114edab681 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.953212:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edab67a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.953215:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114edab681 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.953215:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edab67a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.953217:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982ac0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.953218:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114edab681 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.953219:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edab67a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.953221:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114edab681 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.953221:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edab67a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.953224:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.953225:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114edab681 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.953227:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3931 (ffff880090beed00) 00010000:00010000:0.0:1713279306.953228:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114edab681 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.953229:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.953230:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edab67a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.953233:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.953233:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982ac0/0xfc4b8e114edab67a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.953234:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.953235:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114edab681 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.953238:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd7840/0xfc4b8e114edab681 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.953245:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114edab688 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.953245:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114edab665 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176563 expref: 3716 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.953248:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114edab688 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.953249:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d321f80/0xfc4b8e114edab665 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176563 expref: 3716 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.953251:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114edab688 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.953253:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd5440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.953253:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d321f80, rc 0) 00010000:00010000:0.0:1713279306.953255:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114edab688 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.953257:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114edab688 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00002000:00010000:2.0:1713279306.953258:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb size from disk: 30052 -> 30052 00010000:00010000:0.0:1713279306.953261:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3931 (ffff880090beed00) 00002000:00010000:2.0:1713279306.953261:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00010000:00010000:0.0:1713279306.953262:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.953263:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114edab688 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00002000:00010000:2.0:1713279306.953263:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1713279306.953265:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00010000:00010000:0.0:1713279306.953266:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd5440/0xfc4b8e114edab688 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00002000:00010000:2.0:1713279306.953267:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:1.0:1713279306.953276:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3715:12082:x1796503281306944:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 192us (233us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.953279:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114edab673 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917656a expref: 3716 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.953283:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6f40/0xfc4b8e114edab673 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917656a expref: 3716 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.953287:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd6f40, rc 0) 00000100:00100000:1.0:1713279306.953292:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785626 00000100:00100000:2.0:1713279306.953298:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+91:1955:x1796503281307136:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 126us (195us total) trans 4295010208 rc 0/0 00000100:00100000:0.0:1713279306.953300:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:12054:x1796503281307072:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 168us (202us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.953305:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785627 00000100:00100000:2.0:1713279306.953305:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110598 00000100:00100000:0.0:1713279306.953482:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.953510:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281307264 00000100:00100000:2.0:1713279306.953513:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281307264 00000100:00100000:2.0:1713279306.953532:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785628 00000100:00100000:2.0:1713279306.953535:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3715:11711:x1796503281307264:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.953541:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.953547:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114edab68f lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176571 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.953584:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edab696 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953589:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edab696 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953593:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edab696 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953599:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edab69d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953602:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edab69d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953605:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edab69d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000004:00200000:2.0:1713279306.953613:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:2.0:1713279306.953618:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edab696 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953621:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edab696 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953624:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edab696 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953630:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edab696 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953632:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298edb00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.953634:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edab696 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953637:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edab696 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953641:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012514d700) 00010000:00010000:2.0:1713279306.953642:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.953644:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edab696 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953647:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edab696 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953652:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edab69d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953654:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edab69d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953657:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edab69d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953660:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298efa80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.953661:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edab69d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953664:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edab69d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953670:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88012514d600) 00010000:00010000:2.0:1713279306.953672:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.953673:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edab69d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953676:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efa80/0xfc4b8e114edab69d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.953689:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114edab68f lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176571 expref: 3716 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.953693:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec480/0xfc4b8e114edab68f lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176571 expref: 3716 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.953698:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ec480, rc 0) 00000100:00100000:2.0:1713279306.953721:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3715:11711:x1796503281307264:12345-192.168.203.4@tcp:101:touch.0 Request processed in 185us (239us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.953725:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785628 00000100:00100000:1.0:1713279306.953780:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.953791:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281307392 00000100:00100000:2.0:1713279306.953793:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281307392 00000100:00100000:2.0:1713279306.953802:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223152 00000100:00100000:2.0:1713279306.953805:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3668:12069:x1796503281307392:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.953852:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3669:12069:x1796503281307392:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 46us (72us total) trans 4295183821 rc 0/0 00000100:00100000:2.0:1713279306.953857:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223152 00000100:00100000:0.0:1713279306.953977:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.954001:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281307520 00000100:00100000:2.0:1713279306.954003:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281307520 00000100:00100000:2.0:1713279306.954024:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785629 00000100:00100000:2.0:1713279306.954028:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3715:12054:x1796503281307520:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.954036:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.954043:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114edab6a4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176578 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.954080:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.954091:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281307648 00000100:00100000:1.0:1713279306.954094:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281307648 00010000:00010000:2.0:1713279306.954094:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114edab6ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.954103:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114edab6ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.954109:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114edab6ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.954111:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785630 00000100:00100000:1.0:1713279306.954114:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3715:12082:x1796503281307648:12345-192.168.203.4@tcp:101:fallocate.0 00000004:00200000:2.0:1713279306.954115:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7abd:0x0]: returning size 42048 00010000:00010000:1.0:1713279306.954120:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.954125:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edab6b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917657f expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.954146:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed680/0xfc4b8e114edab6a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176578 expref: 3718 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.954153:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114edab6ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176578 expref: 3717 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.954157:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab6c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.954157:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7abd:0x0].0x0 (ffff88008c2e7d00) 00010000:00010000:2.0:1713279306.954159:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1713279306.954160:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ec6c0, rc 0) 00010000:00010000:1.0:1713279306.954162:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab6c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954166:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab6c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954172:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab6c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954175:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab6c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.954176:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:12054:x1796503281307520:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 148us (200us total) trans 4295202808 rc 0/0 00010000:00010000:1.0:1713279306.954178:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab6c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.954179:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785629 00010000:00010000:1.0:1713279306.954196:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab6ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954200:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab6ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954203:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab6ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954206:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab6ce lrc: 3/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954209:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d983600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.954210:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab6ce lrc: 3/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954213:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab6ce lrc: 4/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954220:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7abd:0x0].0x0 (ffff88008c2e7d00) 00010000:00010000:1.0:1713279306.954222:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab6ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954224:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab6ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000004:00200000:1.0:1713279306.954229:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7abd:0x0]: returning size 42048 00010000:00010000:1.0:1713279306.954250:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab6c0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954253:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab6c0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713279306.954253:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.954256:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab6c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954259:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab6c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954262:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.954263:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab6c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954266:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab6c0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954269:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.954270:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.954272:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab6c0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.954273:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281307776 00010000:00010000:1.0:1713279306.954274:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab6c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.954277:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281307776 00010000:00010000:1.0:1713279306.954278:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab6c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954281:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab6c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954284:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab6c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954286:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.954288:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab6c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713279306.954290:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab6c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.954292:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785631 00010000:00010000:1.0:1713279306.954293:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x33 (ffff880090bee800) 00010000:00010000:1.0:1713279306.954294:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.954295:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab6c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00000100:00100000:3.0:1713279306.954296:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3669:11711:x1796503281307776:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.954298:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab6c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.954303:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.954310:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114edab6dc lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176586 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.954311:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edab6b9 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917657f expref: 3717 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.954315:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edab6b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917657f expref: 3717 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.954319:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d983180, rc 0) 00000100:00100000:1.0:1713279306.954336:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3716:12082:x1796503281307648:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 221us (256us total) trans 4295202809 rc 301/301 00010000:00010000:3.0:1713279306.954337:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114edab6e3 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.954341:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785630 00010000:00010000:3.0:1713279306.954342:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114edab6e3 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954346:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114edab6e3 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954351:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab6ea lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.954354:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab6ea lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954357:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab6ea lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954370:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114edab6e3 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954373:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114edab6e3 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954376:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114edab6e3 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954379:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114edab6e3 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954382:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091bab600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.954383:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114edab6e3 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954389:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114edab6e3 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954393:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88012d397900) 00010000:00010000:3.0:1713279306.954395:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.954397:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114edab6e3 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954400:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab600/0xfc4b8e114edab6e3 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954404:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab6ea lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954407:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab6ea lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954410:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab6ea lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954432:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.954434:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab6ea lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954437:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab6ea lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954441:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff88012d397a00) 00010000:00010000:3.0:1713279306.954442:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.954443:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab6ea lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954446:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8900/0xfc4b8e114edab6ea lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.954460:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114edab6dc lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176586 expref: 3670 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.954464:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba98c0/0xfc4b8e114edab6dc lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176586 expref: 3670 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.954470:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba98c0, rc 0) 00000100:00100000:3.0:1713279306.954488:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3669:11711:x1796503281307776:12345-192.168.203.4@tcp:101:touch.0 Request processed in 191us (234us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.954493:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785631 00000100:00100000:0.0:1713279306.955151:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.955181:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.955194:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281307968 00000100:00100000:0.0:1713279306.955197:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281307968 00000100:00100000:0.0:1713279306.955212:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785632 00000100:00100000:0.0:1713279306.955214:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3716:11711:x1796503281307968:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1713279306.955221:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.955221:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281307840 00000100:00100000:3.0:1713279306.955226:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281307840 00000100:00100000:3.0:1713279306.955245:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147286 00000100:00100000:3.0:1713279306.955249:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:1957:x1796503281307840:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.955254:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.955262:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114edab6ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7abd:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176578 expref: 3717 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.955271:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7abd:0x0].0x0 (ffff88008c2e7d00) 00010000:00010000:3.0:1713279306.955273:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.955276:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114edab6f1 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917658d expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.955290:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:1957:x1796503281307840:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 41us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.955295:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147286 00000100:00100000:1.0:1713279306.955297:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.955344:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.955359:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6d00/0xfc4b8e114edab6f8 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.955365:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6d00/0xfc4b8e114edab6f8 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.955368:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281308160 00010000:00010000:0.0:1713279306.955369:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6d00/0xfc4b8e114edab6f8 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.955369:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.955369:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281308224 00000100:00100000:3.0:1713279306.955371:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281308224 00000100:00100000:1.0:1713279306.955373:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281308160 00010000:00010000:0.0:1713279306.955374:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd73c0/0xfc4b8e114edab6ff lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.955378:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd73c0/0xfc4b8e114edab6ff lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.955378:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281308288 00010000:00010000:0.0:1713279306.955381:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd73c0/0xfc4b8e114edab6ff lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713279306.955381:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281308288 00000100:00100000:3.0:1713279306.955383:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785633 00000100:00100000:3.0:1713279306.955386:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3669:12078:x1796503281308224:12345-192.168.203.4@tcp:101:fallocate.0 00000004:00200000:0.0:1713279306.955391:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:0.0:1713279306.955396:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6d00/0xfc4b8e114edab6f8 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.955396:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785634 00000100:00100000:2.0:1713279306.955398:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110599 00010000:00010000:0.0:1713279306.955399:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6d00/0xfc4b8e114edab6f8 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.955401:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3716:12085:x1796503281308160:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:2.0:1713279306.955401:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+96:12054:x1796503281308288:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.955402:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6d00/0xfc4b8e114edab6f8 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.955405:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6d00/0xfc4b8e114edab6f8 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.955406:0:15500:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.955406:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.955407:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.955409:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6d00/0xfc4b8e114edab6f8 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.955426:0:15500:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801298eef40/0xfc4b8e114edab70d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391765a2 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.955426:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114edab706 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917659b expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.955427:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6d00/0xfc4b8e114edab6f8 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.955430:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713279306.955431:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8801250c1800) 00010000:00010000:0.0:1713279306.955433:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.955434:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6d00/0xfc4b8e114edab6f8 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.955436:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e6898c0/0xfc4b8e114edab084 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176380 expref: 90 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.955437:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6d00/0xfc4b8e114edab6f8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.955437:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114edab714 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176594 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.955441:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd73c0/0xfc4b8e114edab6ff lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.955441:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.955442:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713279306.955444:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd73c0/0xfc4b8e114edab6ff lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.955444:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801298eef40/0xfc4b8e114edab70d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [8192->16383] (req 8192->16383) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765a2 expref: 97 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.955450:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd73c0/0xfc4b8e114edab6ff lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.955452:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd73c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.955454:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd73c0/0xfc4b8e114edab6ff lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.955454:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e6898c0/0xfc4b8e114edab084 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->36863) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176380 expref: 90 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.955456:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd73c0/0xfc4b8e114edab6ff lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.955459:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff8801250c1400) 00010000:00010000:2.0:1713279306.955459:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e6898c0/0xfc4b8e114edab084 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->36863) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176380 expref: 90 pid: 15500 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.955461:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.955462:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd73c0/0xfc4b8e114edab6ff lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.955464:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd73c0/0xfc4b8e114edab6ff lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.955464:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114edab71b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:2.0:1713279306.955465:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200065152:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.955470:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114edab71b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.955471:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114edab722 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.955474:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114edab71b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.955478:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114edab6f1 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917658d expref: 3717 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.955478:0:15473:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917559c expref: 3717 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.955480:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab729 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:2.0:1713279306.955481:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ffbb900 going to sleep for 11 seconds 00010000:00010000:1.0:1713279306.955482:0:15473:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edab570 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917651d expref: 3717 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.955483:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4900/0xfc4b8e114edab6f1 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917658d expref: 3717 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.955484:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab729 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.955485:0:15473:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114edab722 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.955487:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab729 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.955488:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd4900, rc 0) 00010000:00010000:1.0:1713279306.955497:0:15473:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edab570 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917651d expref: 3716 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.955502:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3716:11711:x1796503281307968:12345-192.168.203.4@tcp:101:touch.0 Request processed in 286us (323us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.955503:0:15473:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edab570 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917651d expref: 3716 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.955506:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785632 00000100:00100000:1.0:1713279306.955512:0:15473:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121985f80 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:15473:1796503200065216:192.168.203.4@tcp:104: 00000004:00200000:3.0:1713279306.955529:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x752c:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.955531:0:15473:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917559c expref: 3717 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.955534:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114edab71b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:1.0:1713279306.955536:0:15473:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917559c expref: 3717 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.955537:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114edab71b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.955540:0:15473:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089d500 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:15473:1796503200065280:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.955540:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114edab71b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.955543:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114edab71b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.955546:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091babcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.955548:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114edab71b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279306.955551:0:15473:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123727240 going to sleep for 11 seconds 00010000:00010000:3.0:1713279306.955552:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114edab71b lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.955556:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:3.0:1713279306.955558:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.955559:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114edab71b lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.955562:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091babcc0/0xfc4b8e114edab71b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.955566:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab729 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.955569:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab729 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.955572:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab729 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.955575:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.955576:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab729 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.955579:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab729 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.955582:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3331 (ffff880092853900) 00010000:00010000:3.0:1713279306.955583:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.955584:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab729 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.955587:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8fc0/0xfc4b8e114edab729 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.955599:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114edab706 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917659b expref: 3670 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.955603:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab180/0xfc4b8e114edab706 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917659b expref: 3670 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.955607:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bab180, rc 0) 00000100:00100000:3.0:1713279306.955625:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3669:12078:x1796503281308224:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 238us (282us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.955629:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785633 00000100:00100000:0.0:1713279306.955864:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.955891:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281308352 00000100:00100000:3.0:1713279306.955894:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281308352 00000100:00100000:3.0:1713279306.955907:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110600 00000100:00100000:3.0:1713279306.955909:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+91:1954:x1796503281308352:12345-192.168.203.4@tcp:22:fallocate.0 00002000:00010000:3.0:1713279306.955989:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb size from disk: 42048 -> 42048 00002000:00010000:3.0:1713279306.955991:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.955993:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:3.0:1713279306.955994:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.955995:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb blocks from disk: 8 -> 32 00000100:00100000:3.0:1713279306.956019:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+92:1954:x1796503281308352:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 108us (155us total) trans 4295010209 rc 0/0 00000100:00100000:3.0:1713279306.956023:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110600 00000100:00100000:0.0:1713279306.956080:0:15473:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121985f80 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:15473:1796503200065216:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.956087:0:15473:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089d500 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:15473:1796503200065280:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.956093:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200065152:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.956096:0:15473:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114edab722 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713279306.956116:0:15500:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801298eef40/0xfc4b8e114edab70d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [8192->16383] (req 8192->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765a2 expref: 97 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.956124:0:15500:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298eef40, rc 0) 00000100:00100000:2.0:1713279306.956142:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+97:12054:x1796503281308288:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 741us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.956147:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110599 00000100:00100000:2.0:1713279306.956215:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.956240:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281308416 00000100:00100000:3.0:1713279306.956243:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281308416 00000100:00100000:2.0:1713279306.956247:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.956251:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917559c expref: 3718 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.956258:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281308544 00000100:00100000:0.0:1713279306.956260:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281308544 00000100:00100000:3.0:1713279306.956261:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196615 00000100:00100000:3.0:1713279306.956264:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:1957:x1796503281308416:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.956268:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.956270:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917559c expref: 3718 pid: 15658 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.956272:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785635 00000100:00100000:0.0:1713279306.956275:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3669:11711:x1796503281308544:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.956275:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917559c expref: 3718 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.956282:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.956283:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114eda7c74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917559c expref: 3718 pid: 15658 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.956288:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd46c0/0xfc4b8e114edab730 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391765a9 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.956289:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7e71:0x0].0x0 (ffff8800939e3100) 00010000:00010000:3.0:1713279306.956291:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114edab722 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.956295:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114edab722 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.956297:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.956308:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114edab737 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.956310:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:1957:x1796503281308416:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 46us (95us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.956312:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114edab737 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279306.956313:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196615 00010000:00010000:0.0:1713279306.956316:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114edab737 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956321:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab73e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:0.0:1713279306.956324:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab73e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956327:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab73e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956337:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114edab737 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956346:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114edab737 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956349:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114edab737 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956352:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114edab737 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956354:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.956356:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114edab737 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956359:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114edab737 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956362:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff8801250c1200) 00010000:00010000:0.0:1713279306.956364:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.956365:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114edab737 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956368:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7180/0xfc4b8e114edab737 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956372:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab73e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956375:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab73e lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956378:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab73e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956380:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd7cc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.956382:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab73e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956385:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab73e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956388:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff8801250c1700) 00010000:00010000:0.0:1713279306.956390:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.956391:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab73e lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956393:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab73e lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279306.956404:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd46c0/0xfc4b8e114edab730 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765a9 expref: 3670 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.956408:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd46c0/0xfc4b8e114edab730 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765a9 expref: 3670 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.956487:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd46c0, rc 0) 00000100:00100000:1.0:1713279306.956516:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.956540:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281308608 00000100:00100000:3.0:1713279306.956543:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281308608 00010000:00010000:3.0:1713279306.956550:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e6898c0/0xfc4b8e114edab084 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->36863) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176380 expref: 92 pid: 15500 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.956553:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.956558:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3669:11711:x1796503281308544:12345-192.168.203.4@tcp:101:touch.0 Request processed in 281us (309us total) trans 0 rc 301/301 00000100:00100000:0.0:1713279306.956561:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785635 00000100:00100000:3.0:1713279306.956566:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196616 00000100:00100000:2.0:1713279306.956567:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281308736 00000100:00100000:3.0:1713279306.956568:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+92:1955:x1796503281308608:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.956571:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281308736 00010000:00010000:3.0:1713279306.956573:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.956578:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e6898c0/0xfc4b8e114edab084 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->36863) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176380 expref: 92 pid: 15500 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.956583:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e6898c0/0xfc4b8e114edab084 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->36863) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176380 expref: 92 pid: 15500 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.956588:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223153 00010000:00010000:3.0:1713279306.956592:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e6898c0/0xfc4b8e114edab084 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->36863) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176380 expref: 92 pid: 15500 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.956593:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3716:12082:x1796503281308736:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:3.0:1713279306.956597:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.956598:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.956602:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801298eef40/0xfc4b8e114edab70d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765a2 expref: 96 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.956606:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801298eef40/0xfc4b8e114edab70d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765a2 expref: 96 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.956618:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801298eef40/0xfc4b8e114edab70d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765a2 expref: 96 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.956623:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6917:1796503200065344:192.168.203.4@tcp:105: 00000100:00100000:3.0:1713279306.956640:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.956657:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3717:12082:x1796503281308736:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 62us (102us total) trans 4295202810 rc 0/0 00000100:00100000:2.0:1713279306.956663:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223153 00000100:00100000:0.0:1713279306.957039:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.957087:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281308864 00000100:00100000:2.0:1713279306.957092:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281308864 00000100:00100000:2.0:1713279306.957108:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785636 00000100:00100000:2.0:1713279306.957112:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3717:11711:x1796503281308864:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1713279306.957120:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.957128:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114edab745 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391765b0 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.957175:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab74c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.957182:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6917:1796503200065344:192.168.203.4@tcp:105: 00010000:00010000:2.0:1713279306.957183:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab74c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957190:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab74c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.957191:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.957198:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edab753 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957204:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edab753 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957210:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edab753 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.957211:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+91:1955:x1796503281308608:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 641us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.957216:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196616 00000004:00200000:2.0:1713279306.957222:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:2.0:1713279306.957229:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab74c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957235:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab74c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957240:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab74c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957245:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab74c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957250:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ecfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.957252:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab74c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957258:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab74c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957264:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff8800960e8100) 00010000:00010000:2.0:1713279306.957267:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.957270:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab74c lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957275:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab74c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957283:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edab753 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00000100:00100000:0.0:1713279306.957284:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.957287:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edab753 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957292:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edab753 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957297:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ecd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.957299:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edab753 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957304:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edab753 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.957309:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff8800960e8600) 00000100:00100000:3.0:1713279306.957310:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281308928 00010000:00010000:2.0:1713279306.957311:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.957314:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edab753 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.957314:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281308928 00010000:00010000:2.0:1713279306.957319:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ecd80/0xfc4b8e114edab753 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.957325:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110601 00000100:00100000:3.0:1713279306.957328:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+97:1956:x1796503281308928:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:2.0:1713279306.957338:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114edab745 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765b0 expref: 3718 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.957350:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec000/0xfc4b8e114edab745 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765b0 expref: 3718 pid: 15480 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713279306.957370:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb size from disk: 42048 -> 42048 00002000:00010000:3.0:1713279306.957372:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.957373:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:3.0:1713279306.957375:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.957376:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb blocks from disk: 32 -> 32 00010000:00010000:2.0:1713279306.957384:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ec000, rc 0) 00000100:00100000:3.0:1713279306.957392:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+98:1956:x1796503281308928:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 62us (108us total) trans 4295010210 rc 0/0 00000100:00100000:3.0:1713279306.957395:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110601 00000100:00100000:2.0:1713279306.957403:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3717:11711:x1796503281308864:12345-192.168.203.4@tcp:101:touch.0 Request processed in 290us (364us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.957409:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785636 00000100:00100000:0.0:1713279306.957905:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.957964:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281309056 00000100:00100000:2.0:1713279306.957969:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281309056 00000100:00100000:2.0:1713279306.957991:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223154 00000100:00100000:2.0:1713279306.957994:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3717:12054:x1796503281309056:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:0.0:1713279306.958009:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.958052:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:12054:x1796503281309056:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 56us (147us total) trans 4295202811 rc 0/0 00000100:00100000:2.0:1713279306.958056:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223154 00000100:00100000:3.0:1713279306.958086:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281309184 00000100:00100000:3.0:1713279306.958090:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281309184 00000100:00100000:3.0:1713279306.958108:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785637 00000100:00100000:3.0:1713279306.958111:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3669:11711:x1796503281309184:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.958118:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.958125:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114edab75a lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391765b7 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.958152:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edab761 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.958157:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edab761 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958162:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edab761 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958167:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab768 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.958171:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab768 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958174:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab768 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958186:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edab761 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958189:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edab761 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958192:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edab761 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958195:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edab761 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958198:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba8240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.958199:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edab761 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958205:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edab761 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958209:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff88012fbfed00) 00010000:00010000:3.0:1713279306.958211:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.958212:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edab761 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958215:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba8240/0xfc4b8e114edab761 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958221:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab768 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958223:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab768 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958226:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab768 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958228:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baa1c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.958230:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab768 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958233:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab768 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958236:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff88012fbfe200) 00010000:00010000:3.0:1713279306.958237:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.958239:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab768 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958242:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa1c0/0xfc4b8e114edab768 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279306.958254:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114edab75a lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765b7 expref: 3670 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.958258:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9680/0xfc4b8e114edab75a lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765b7 expref: 3670 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.958263:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba9680, rc 0) 00000100:00100000:3.0:1713279306.958290:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3669:11711:x1796503281309184:12345-192.168.203.4@tcp:101:touch.0 Request processed in 178us (281us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.958294:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785637 00000100:00100000:0.0:1713279306.958812:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.958874:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281309312 00000100:00100000:3.0:1713279306.958878:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281309312 00000100:00100000:3.0:1713279306.958901:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785638 00000100:00100000:3.0:1713279306.958905:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3717:11711:x1796503281309312:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.958912:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.958919:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab76f lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391765be expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.958961:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab776 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.958967:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab776 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.958972:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab776 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.958977:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edab77d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.958981:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edab77d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.958984:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edab77d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00000004:00200000:3.0:1713279306.958992:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:3.0:1713279306.958997:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab776 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959000:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab776 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959003:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab776 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959006:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab776 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959009:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.959011:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab776 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959014:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab776 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959018:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012fbfee00) 00010000:00010000:3.0:1713279306.959019:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.959021:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab776 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959024:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab776 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959031:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edab77d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959034:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edab77d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959038:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edab77d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959040:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093693a80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.959041:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edab77d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959044:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edab77d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959047:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88012fbfe500) 00010000:00010000:3.0:1713279306.959048:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.959049:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edab77d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959052:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093693a80/0xfc4b8e114edab77d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:3.0:1713279306.959065:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab76f lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765be expref: 3718 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.959086:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab76f lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765be expref: 3718 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.959091:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba9b00, rc 0) 00000100:00100000:3.0:1713279306.959117:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3717:11711:x1796503281309312:12345-192.168.203.4@tcp:101:touch.0 Request processed in 212us (305us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.959122:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785638 00000100:00100000:2.0:1713279306.959719:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.959723:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.959742:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281309376 00000100:00100000:3.0:1713279306.959747:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281309376 00010000:00010000:3.0:1713279306.959758:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edab570 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917651d expref: 3717 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.959761:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.959773:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196617 00000100:00100000:3.0:1713279306.959777:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3717:1954:x1796503281309376:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.959782:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713279306.959784:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281309696 00010000:00010000:3.0:1713279306.959785:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edab570 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917651d expref: 3717 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.959789:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281309696 00010000:00010000:3.0:1713279306.959791:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edab570 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917651d expref: 3717 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.959799:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542880/0xfc4b8e114edab570 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7e71:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917651d expref: 3717 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.959803:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281309760 00000100:00100000:1.0:1713279306.959805:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281309760 00010000:00010000:3.0:1713279306.959805:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7e71:0x0].0x0 (ffff8800939e3100) 00010000:00010000:3.0:1713279306.959808:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114edab722 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713279306.959812:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114edab722 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.959815:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785639 00010000:00010000:3.0:1713279306.959815:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114edab722 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713279306.959819:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3669:11711:x1796503281309696:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1713279306.959824:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.959826:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.959833:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edab784 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391765d3 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.959842:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3717:1954:x1796503281309376:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 64us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279306.959844:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785640 00000100:00100000:3.0:1713279306.959846:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196617 00000100:00100000:0.0:1713279306.959849:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3717:12070:x1796503281309760:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.959858:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab78b lrc: 3/1,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.959863:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab78b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959870:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab78b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959875:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982d00/0xfc4b8e114edab792 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.959878:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982d00/0xfc4b8e114edab792 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959882:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982d00/0xfc4b8e114edab792 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.959892:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.959894:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab78b lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959898:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab78b lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:0.0:1713279306.959899:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edab799 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391765cc expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.959901:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab78b lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959904:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab78b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959907:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.959909:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab78b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959912:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab78b lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959916:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x0 (ffff880082706400) 00010000:00010000:1.0:1713279306.959917:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.959919:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab78b lrc: 3/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959923:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980000/0xfc4b8e114edab78b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x11b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959928:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982d00/0xfc4b8e114edab792 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959931:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982d00/0xfc4b8e114edab792 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959934:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982d00/0xfc4b8e114edab792 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959936:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982d00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.959937:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982d00/0xfc4b8e114edab792 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959940:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982d00/0xfc4b8e114edab792 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959943:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x11b:0x0].0x33 (ffff880082706100) 00010000:00010000:1.0:1713279306.959944:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.959946:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982d00/0xfc4b8e114edab792 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959948:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982d00/0xfc4b8e114edab792 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x11b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT1 00010000:00010000:1.0:1713279306.959960:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edab784 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765d3 expref: 3670 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.959964:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981f80/0xfc4b8e114edab784 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x11b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765d3 expref: 3670 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.959970:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d981f80, rc 0) 00010000:00010000:0.0:1713279306.959981:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab7a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x8272:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.959986:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3669:11711:x1796503281309696:12345-192.168.203.4@tcp:101:touch.0 Request processed in 166us (267us total) trans 0 rc 301/301 00010000:00010000:0.0:1713279306.959989:0:15484:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda88ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x8272:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758b3 expref: 3717 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.959991:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785639 00010000:00010000:0.0:1713279306.959993:0:15484:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab7a0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x8272:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.960005:0:15484:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda88ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8272:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758b3 expref: 3717 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.960006:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.960011:0:15484:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda88ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8272:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758b3 expref: 3717 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.960017:0:15484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bbbed80 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000_UUID:15484:1796503200065408:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.960032:0:15484:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1713279306.960035:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.960040:0:15473:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114edab722 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713279306.960044:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114edab722 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00200000:0.0:1713279306.960049:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e71:0x0]: returning size 35262 00000100:00100000:2.0:1713279306.960057:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.960060:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281309952 00000100:00100000:3.0:1713279306.960063:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281309952 00000100:00100000:3.0:1713279306.960088:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110602 00000100:00100000:3.0:1713279306.960091:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+85:1955:x1796503281309952:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:1.0:1713279306.960093:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281309888 00000100:00100000:1.0:1713279306.960095:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281309888 00010000:00010000:0.0:1713279306.960101:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9821c0/0xfc4b8e114edab714 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176594 expref: 3719 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.960107:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281309504 00000100:00100000:1.0:1713279306.960108:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281309504 00010000:00010000:0.0:1713279306.960109:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983840/0xfc4b8e114edab722 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7e71:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176594 expref: 3718 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.960113:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7e71:0x0].0x0 (ffff8800939e3100) 00010000:00010000:0.0:1713279306.960115:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:2.0:1713279306.960115:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785641 00010000:00010000:0.0:1713279306.960116:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d983840, rc 0) 00000100:00100000:1.0:1713279306.960120:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785642 00000100:00100000:2.0:1713279306.960121:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3718:12079:x1796503281309888:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:1.0:1713279306.960123:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3459:12084:x1796503281309504:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.960130:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.960131:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713279306.960133:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:12085:x1796503281308160:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 4733us (4838us total) trans 4295202812 rc 0/0 00000100:00100000:0.0:1713279306.960137:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785634 00010000:00010000:1.0:1713279306.960137:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9833c0/0xfc4b8e114edab7ae lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391765c5 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.960139:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114edab7b5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391765da expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713279306.960163:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb size from disk: 35262 -> 35262 00002000:00010000:3.0:1713279306.960166:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00010000:00010000:1.0:1713279306.960167:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114edab7bc lrc: 3/0,1 mode: --/CW res: [0x240000403:0x75c9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00002000:00010000:3.0:1713279306.960167:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb atime from disk: 1713279302 -> 1713279302 00002000:00010000:3.0:1713279306.960168:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.960170:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb blocks from disk: 8 -> 32 00010000:00010000:1.0:1713279306.960172:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114edab7bc lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x75c9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.960177:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114edab7bc lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x75c9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000004:00200000:1.0:1713279306.960181:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x75c9:0x0]: returning size 30052 00010000:00010000:2.0:1713279306.960185:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114edab7c3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00000100:00100000:3.0:1713279306.960189:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+86:1955:x1796503281309952:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 97us (154us total) trans 4295010146 rc 0/0 00000100:00100000:3.0:1713279306.960193:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110602 00010000:00010000:2.0:1713279306.960194:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114edab7c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960200:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114edab7c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.960211:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d9833c0/0xfc4b8e114edab7ae lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765c5 expref: 3462 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.960211:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edab7d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960216:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edab7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.960218:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114edab7bc lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x75c9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765c5 expref: 3461 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.960222:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75c9:0x0].0x0 (ffff88008eb9f100) 00010000:00010000:2.0:1713279306.960222:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edab7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:1.0:1713279306.960224:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1713279306.960225:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d981200, rc 0) 00000100:00100000:1.0:1713279306.960241:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3461:12084:x1796503281309504:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 118us (184us total) trans 4295183822 rc 0/0 00000100:00100000:1.0:1713279306.960245:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785642 00010000:00010000:2.0:1713279306.960248:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012374cb40/0xfc4b8e114edab7d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960257:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012374cb40/0xfc4b8e114edab7d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960262:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012374cb40/0xfc4b8e114edab7d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960267:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012374cb40/0xfc4b8e114edab7d8 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960272:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012374cb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.960274:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012374cb40/0xfc4b8e114edab7d8 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960279:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012374cb40/0xfc4b8e114edab7d8 lrc: 4/0,0 mode: --/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960290:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7ff8:0x0].0x0 (ffff880089dc3f00) 00010000:00010000:2.0:1713279306.960293:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012374cb40/0xfc4b8e114edab7d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960298:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012374cb40/0xfc4b8e114edab7d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7ff8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00000004:00200000:2.0:1713279306.960307:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7ff8:0x0]: returning size 13836 00010000:00010000:2.0:1713279306.960332:0:15480:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114edab7c3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960336:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114edab7c3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960339:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114edab7c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960341:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114edab7c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960344:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ee880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.960345:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114edab7c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960348:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114edab7c3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960353:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:2.0:1713279306.960354:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.960356:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114edab7c3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960358:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee880/0xfc4b8e114edab7c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960363:0:15480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edab7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960366:0:15480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edab7d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960369:0:15480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edab7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960371:0:15480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a064480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.960373:0:15480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edab7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT0 00000100:00100000:0.0:1713279306.960374:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.960375:0:15480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edab7d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960378:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3731 (ffff8800960e8800) 00010000:00010000:2.0:1713279306.960379:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.960380:0:15480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edab7d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960383:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a064480/0xfc4b8e114edab7d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279306.960397:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114edab7b5 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765da expref: 3720 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.960401:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281310080 00010000:00010000:2.0:1713279306.960401:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef180/0xfc4b8e114edab7b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765da expref: 3720 pid: 15480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.960404:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281310080 00010000:00010000:2.0:1713279306.960405:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ef180, rc 0) 00000100:00100000:1.0:1713279306.960430:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785643 00000100:00100000:1.0:1713279306.960433:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3720:12073:x1796503281310080:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:2.0:1713279306.960438:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3720:12079:x1796503281309888:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 316us (430us total) trans 4295202813 rc 301/301 00010000:00010000:1.0:1713279306.960439:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.960444:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114edab7e6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391765e1 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.960445:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785641 00010000:00010000:1.0:1713279306.960471:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab7ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960476:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab7ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960480:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab7ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960486:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab7f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960490:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960495:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000100:00100000:2.0:1713279306.960499:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1713279306.960503:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edab7fb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x75f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960507:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edab7fb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x75f8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960510:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edab7fb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x75f8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960515:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab7ed lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960518:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab7ed lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960521:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab7ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.960522:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281310208 00010000:00010000:1.0:1713279306.960524:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab7ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.960525:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281310208 00010000:00010000:1.0:1713279306.960526:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.960528:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab7ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960531:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab7ed lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960534:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:1.0:1713279306.960535:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.960537:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab7ed lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.960539:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785644 00010000:00010000:1.0:1713279306.960540:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d980d80/0xfc4b8e114edab7ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:0.0:1713279306.960542:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281310208:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1713279306.960545:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.960548:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.960548:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab7f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960551:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.960553:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114edab802 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391765e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.960554:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.960555:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960557:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab7f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960561:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3631 (ffff880131eda200) 00010000:00010000:1.0:1713279306.960562:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.960563:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab7f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960565:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d982400/0xfc4b8e114edab7f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:1.0:1713279306.960576:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d9806c0/0xfc4b8e114edab7e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765e1 expref: 3723 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.960581:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edab7fb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x75f8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765e1 expref: 3722 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.960589:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x75f8:0x0].0x0 (ffff880082706900) 00010000:00010000:0.0:1713279306.960590:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab809 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.960590:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713279306.960591:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d983cc0, rc 0) 00010000:00010000:0.0:1713279306.960595:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab809 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960599:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab809 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960604:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114edab810 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.960607:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3722:12073:x1796503281310080:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 173us (234us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.960608:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114edab810 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00000100:00100000:1.0:1713279306.960610:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785643 00010000:00010000:0.0:1713279306.960611:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114edab810 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00000004:00200000:0.0:1713279306.960618:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7e61:0x0]: returning size 1 00010000:00010000:0.0:1713279306.960623:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab809 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960626:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab809 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960629:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab809 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960632:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab809 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960688:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880129b31b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.960690:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab809 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960694:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab809 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960699:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x0 (ffff88012514de00) 00010000:00010000:0.0:1713279306.960701:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.960702:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab809 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960705:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b31b00/0xfc4b8e114edab809 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:2.0:1713279306.960712:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.960713:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114edab810 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960716:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114edab810 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960719:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114edab810 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960722:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bf99680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.960723:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114edab810 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960726:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114edab810 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960729:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x22b:0x0].0x33 (ffff88012514df00) 00010000:00010000:0.0:1713279306.960730:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.960731:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114edab810 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:0.0:1713279306.960734:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bf99680/0xfc4b8e114edab810 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x22b:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:2.0:1713279306.960737:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.960747:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281310400 00010000:00010000:0.0:1713279306.960748:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114edab802 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765e8 expref: 3721 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.960750:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281310400 00010000:00010000:0.0:1713279306.960753:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4b40/0xfc4b8e114edab802 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765e8 expref: 3722 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.960757:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd4b40, rc 0) 00000100:00100000:2.0:1713279306.960771:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223155 00000100:00100000:0.0:1713279306.960773:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3721:11711:x1796503281310208:12345-192.168.203.4@tcp:101:touch.0 Request processed in 231us (275us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.960775:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281310272 00000100:00100000:2.0:1713279306.960776:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3721:12061:x1796503281310400:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:0.0:1713279306.960778:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785644 00000100:00100000:3.0:1713279306.960780:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281310272 00010000:00010000:3.0:1713279306.960792:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda88ad lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x8272:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758b3 expref: 3721 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.960796:0:15484:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012bbbed80 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000_UUID:15484:1796503200065408:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.960803:0:15484:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab7a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x8272:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.960807:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196618 00000100:00100000:3.0:1713279306.960810:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b25ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3722:1956:x1796503281310272:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.960816:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.960819:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda88ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x8272:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758b3 expref: 3722 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.960821:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1713279306.960825:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda88ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8272:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758b3 expref: 3722 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.960832:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281310464 00010000:00010000:3.0:1713279306.960834:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd11680/0xfc4b8e114eda88ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8272:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391758b3 expref: 3722 pid: 15480 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.960835:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281310464 00000100:00100000:2.0:1713279306.960838:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3722:12061:x1796503281310400:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 60us (100us total) trans 4295202814 rc 0/0 00010000:00010000:3.0:1713279306.960841:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8272:0x0].0x0 (ffff88009228ee00) 00000100:00100000:2.0:1713279306.960844:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223155 00010000:00010000:3.0:1713279306.960844:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab7a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x8272:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.960848:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab7a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x8272:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.960851:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab7a0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x8272:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713279306.960852:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147287 00000100:00100000:1.0:1713279306.960855:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3461:1956:x1796503281310464:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.960859:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.960859:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713279306.960865:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d981200/0xfc4b8e114edab7bc lrc: 0/0,0 mode: --/CW res: [0x240000403:0x75c9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765c5 expref: 3461 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.960871:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75c9:0x0].0x0 (ffff88008eb9f100) 00010000:00010000:0.0:1713279306.960873:0:15484:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab7a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x8272:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713279306.960873:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.960873:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b25ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+3720:1956:x1796503281310272:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 62us (163us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279306.960877:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab7a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x8272:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.960877:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196618 00000004:00200000:0.0:1713279306.960883:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x8272:0x0]: returning size 32236 00000100:00100000:1.0:1713279306.960885:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3460:1956:x1796503281310464:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 29us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.960888:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147287 00010000:00010000:0.0:1713279306.960913:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd6880/0xfc4b8e114edab799 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765cc expref: 3721 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.960919:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd4480/0xfc4b8e114edab7a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x8272:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765cc expref: 3720 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.960923:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8272:0x0].0x0 (ffff88009228ee00) 00010000:00010000:0.0:1713279306.960925:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1713279306.960926:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd4480, rc 0) 00000100:00100000:0.0:1713279306.960940:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3720:12070:x1796503281309760:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 1091us (1178us total) trans 4295202815 rc 0/0 00000100:00100000:0.0:1713279306.960943:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785640 00000100:00100000:2.0:1713279306.961017:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.961040:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281310528 00000100:00100000:3.0:1713279306.961042:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281310528 00000100:00100000:2.0:1713279306.961044:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.961059:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281310592 00000100:00100000:3.0:1713279306.961060:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281310592 00000100:00100000:0.0:1713279306.961062:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110603 00000100:00100000:0.0:1713279306.961076:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+106:12085:x1796503281310528:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:3.0:1713279306.961083:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110604 00010000:00010000:0.0:1713279306.961084:0:11415:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713279306.961086:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+98:12084:x1796503281310592:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:0.0:1713279306.961090:0:11415:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f0846c0/0xfc4b8e114edab81e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1118:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391765ef expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.961092:0:15500:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.961098:0:15500:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093691440/0xfc4b8e114edab825 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391765f6 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.961101:0:11415:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801250a9b00/0xfc4b8e114eda6330 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1118:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f3d expref: 85 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.961105:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713279306.961106:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713279306.961108:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f0846c0/0xfc4b8e114edab81e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1118:0x0].0x0 rrc: 3 type: EXT [4096->20479] (req 4096->20479) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765ef expref: 107 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.961108:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801298ec240/0xfc4b8e114edab61f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917654e expref: 90 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.961113:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.961114:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.961116:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093691440/0xfc4b8e114edab825 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [12288->40959] (req 12288->40959) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765f6 expref: 99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.961118:0:11415:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801250a9b00/0xfc4b8e114eda6330 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1118:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f3d expref: 85 pid: 15519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.961123:0:11415:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801250a9b00/0xfc4b8e114eda6330 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1118:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f3d expref: 85 pid: 15519 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.961126:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801298ec240/0xfc4b8e114edab61f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917654e expref: 90 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.961129:0:11415:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bbbf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11415:1796503200065472:192.168.203.4@tcp:104: 00010000:00010000:3.0:1713279306.961132:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801298ec240/0xfc4b8e114edab61f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917654e expref: 90 pid: 15500 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.961137:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200065536:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.961146:0:11415:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a240 going to sleep for 11 seconds 00000100:00100000:3.0:1713279306.961152:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.961358:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.961380:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281310656 00000100:00100000:1.0:1713279306.961382:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281310656 00000100:00100000:1.0:1713279306.961399:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110605 00000100:00100000:1.0:1713279306.961401:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+86:12079:x1796503281310656:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.961406:0:15783:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.961426:0:15783:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d982f40/0xfc4b8e114edab82c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x113a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc391765fd expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.961437:0:15783:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092341b00/0xfc4b8e114eda0d5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x113a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->61439) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391737c7 expref: 107 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.961441:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.961442:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713279306.961444:0:15783:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d982f40/0xfc4b8e114edab82c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x113a:0x0].0x0 rrc: 3 type: EXT [16384->36863] (req 16384->36863) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765fd expref: 87 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.961456:0:15783:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092341b00/0xfc4b8e114eda0d5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x113a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->61439) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391737c7 expref: 107 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.961461:0:15783:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092341b00/0xfc4b8e114eda0d5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x113a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->61439) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391737c7 expref: 107 pid: 11415 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.961467:0:15783:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0001_UUID:15783:1796503200065600:192.168.203.4@tcp:104: 00000100:00100000:1.0:1713279306.961484:0:15783:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123727e40 going to sleep for 11 seconds 00000100:00100000:2.0:1713279306.961726:0:11415:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012bbbf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11415:1796503200065472:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.961739:0:11415:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f0846c0/0xfc4b8e114edab81e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1118:0x0].0x0 rrc: 3 type: EXT [4096->20479] (req 4096->20479) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765ef expref: 107 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.961748:0:11415:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f0846c0, rc 0) 00000100:00100000:2.0:1713279306.961776:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+107:12085:x1796503281310528:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 708us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.961782:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110603 00000100:00100000:0.0:1713279306.961834:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.961842:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281310784 00000100:00100000:0.0:1713279306.961845:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.961845:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281310784 00000100:00100000:3.0:1713279306.961848:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200065536:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.961855:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801250a9b00/0xfc4b8e114eda6330 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1118:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f3d expref: 88 pid: 15519 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.961858:0:15500:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093691440/0xfc4b8e114edab825 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [12288->40959] (req 12288->40959) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765f6 expref: 99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.961864:0:15500:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093691440, rc 0) 00000100:00100000:0.0:1713279306.961865:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.961873:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281310848 00000100:00100000:2.0:1713279306.961876:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281310848 00000100:00100000:3.0:1713279306.961879:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+99:12084:x1796503281310592:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 792us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.961881:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196619 00010000:00010000:2.0:1713279306.961883:0:15496:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801298ec240/0xfc4b8e114edab61f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917654e expref: 91 pid: 15500 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.961883:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110604 00000100:00100000:1.0:1713279306.961885:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+88:1956:x1796503281310784:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.961890:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713279306.961890:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281310720 00000100:00100000:3.0:1713279306.961892:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281310720 00000100:00100000:2.0:1713279306.961896:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196620 00010000:00010000:1.0:1713279306.961897:0:6916:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801250a9b00/0xfc4b8e114eda6330 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1118:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f3d expref: 88 pid: 15519 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.961900:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110606 00000100:00100000:2.0:1713279306.961901:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+92:1954:x1796503281310848:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713279306.961903:0:6916:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801250a9b00/0xfc4b8e114eda6330 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1118:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f3d expref: 88 pid: 15519 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.961903:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+92:1954:x1796503281310720:12345-192.168.203.4@tcp:22:fallocate.0 00010000:00010000:2.0:1713279306.961907:0:15496:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713279306.961915:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801250a9b00/0xfc4b8e114eda6330 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1118:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->49151) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39174f3d expref: 88 pid: 15519 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.961915:0:15496:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801298ec240/0xfc4b8e114edab61f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917654e expref: 92 pid: 15500 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.961921:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713279306.961922:0:6916:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.961923:0:15496:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801298ec240/0xfc4b8e114edab61f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917654e expref: 92 pid: 15500 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.961925:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f0846c0/0xfc4b8e114edab81e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1118:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->20479) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765ef expref: 106 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.961930:0:6916:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f0846c0/0xfc4b8e114edab81e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1118:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->20479) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765ef expref: 106 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.961936:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801298ec240/0xfc4b8e114edab61f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917654e expref: 92 pid: 15500 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.961941:0:6916:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007f0846c0/0xfc4b8e114edab81e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1118:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->20479) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765ef expref: 106 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.961945:0:15496:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.961946:0:15496:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713279306.961947:0:6916:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200065664:192.168.203.4@tcp:105: 00010000:00010000:2.0:1713279306.961951:0:15496:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093691440/0xfc4b8e114edab825 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->40959) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765f6 expref: 98 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.961959:0:15496:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093691440/0xfc4b8e114edab825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->40959) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765f6 expref: 98 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.961960:0:6916:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123727900 going to sleep for 11 seconds 00002000:00010000:3.0:1713279306.961967:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x1165:0x0] updating lvb size from disk: 32236 -> 32236 00002000:00010000:3.0:1713279306.961969:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1165:0x0] updating lvb mtime from disk: 1713279305 -> 1713279305 00002000:00010000:3.0:1713279306.961970:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x1165:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1713279306.961972:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x1165:0x0] updating lvb ctime from disk: 1713279305 -> 1713279306 00002000:00010000:3.0:1713279306.961973:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x1165:0x0] updating lvb blocks from disk: 24 -> 48 00010000:00010000:2.0:1713279306.961976:0:15496:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093691440/0xfc4b8e114edab825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->40959) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765f6 expref: 98 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.961985:0:15496:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15496:1796503200065728:192.168.203.4@tcp:105: 00000100:00100000:3.0:1713279306.961986:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+92:1954:x1796503281310720:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 82us (140us total) trans 4295010211 rc 0/0 00000100:00100000:3.0:1713279306.961990:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110606 00000100:00100000:2.0:1713279306.962005:0:15496:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120671f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.962044:0:15783:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0001_UUID:15783:1796503200065600:192.168.203.4@tcp:104: 00010000:00010000:0.0:1713279306.962055:0:15783:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d982f40/0xfc4b8e114edab82c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x113a:0x0].0x0 rrc: 3 type: EXT [16384->36863] (req 16384->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765fd expref: 87 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.962057:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.962065:0:15783:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d982f40, rc 0) 00000100:00100000:3.0:1713279306.962093:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281310912 00000100:00100000:0.0:1713279306.962095:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+87:12079:x1796503281310656:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 692us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.962095:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281310912 00000100:00100000:0.0:1713279306.962099:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110605 00010000:00010000:3.0:1713279306.962103:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092341b00/0xfc4b8e114eda0d5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x113a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->61439) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391737c7 expref: 107 pid: 11415 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.962113:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196621 00000100:00100000:3.0:1713279306.962116:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+107:1955:x1796503281310912:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.962120:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.962125:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092341b00/0xfc4b8e114eda0d5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x113a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->61439) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391737c7 expref: 107 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.962142:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092341b00/0xfc4b8e114eda0d5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x113a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->61439) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391737c7 expref: 107 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.962150:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092341b00/0xfc4b8e114eda0d5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x113a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->61439) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391737c7 expref: 107 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.962155:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.962156:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.962159:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d982f40/0xfc4b8e114edab82c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x113a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765fd expref: 86 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.962164:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d982f40/0xfc4b8e114edab82c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x113a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765fd expref: 86 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.962174:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d982f40/0xfc4b8e114edab82c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x113a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765fd expref: 86 pid: 15783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.962180:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6917:1796503200065792:192.168.203.4@tcp:105: 00000100:00100000:3.0:1713279306.962196:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.962373:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.962401:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281311040 00000100:00100000:2.0:1713279306.962405:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281311040 00000100:00100000:2.0:1713279306.962448:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785645 00000100:00100000:2.0:1713279306.962454:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3669:12073:x1796503281311040:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.962461:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.962470:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114edab833 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x75f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176604 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713279306.962512:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x75f8:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.962525:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114edab833 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x75f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176604 expref: 3670 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.962532:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012374c480/0xfc4b8e114edab833 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x75f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176604 expref: 3670 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.962542:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012374c480, rc 0) 00000100:00100000:2.0:1713279306.962570:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3669:12073:x1796503281311040:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 116us (196us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.962576:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785645 00000100:00100000:1.0:1713279306.962665:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.962679:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281311104 00000100:00100000:2.0:1713279306.962683:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281311104 00000100:00100000:1.0:1713279306.962685:0:6916:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6916:1796503200065664:192.168.203.4@tcp:105: 00010000:00010000:1.0:1713279306.962692:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.962702:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:385c4b71-808c-40cf-91de-b076b668d13f+86:1956:x1796503281310784:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 817us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.962705:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147288 00000100:00100000:1.0:1713279306.962708:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196619 00000100:00100000:2.0:1713279306.962709:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3720:1957:x1796503281311104:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.962716:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.962724:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983cc0/0xfc4b8e114edab7fb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x75f8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765e1 expref: 3720 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.962731:0:15496:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15496:1796503200065728:192.168.203.4@tcp:105: 00010000:00010000:2.0:1713279306.962733:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x75f8:0x0].0x0 (ffff880082706900) 00010000:00010000:2.0:1713279306.962736:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.962738:0:15496:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.962752:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3719:1957:x1796503281311104:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 42us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.962753:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:385c4b71-808c-40cf-91de-b076b668d13f+91:1954:x1796503281310848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 852us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.962757:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196620 00000100:00100000:0.0:1713279306.962760:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.962760:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147288 00000100:00100000:0.0:1713279306.962768:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281311168 00000100:00100000:0.0:1713279306.962770:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281311168 00000100:00100000:0.0:1713279306.962782:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110607 00000100:00100000:0.0:1713279306.962785:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+107:1954:x1796503281311168:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:3.0:1713279306.962786:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6917:1796503200065792:192.168.203.4@tcp:105: 00010000:00010000:3.0:1713279306.962791:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713279306.962798:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.962803:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+107:1955:x1796503281310912:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 686us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.962806:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196621 00000100:00100000:2.0:1713279306.962809:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281311360 00000100:00100000:2.0:1713279306.962812:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281311360 00000100:00100000:2.0:1713279306.962823:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110608 00000100:00100000:2.0:1713279306.962828:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+99:1957:x1796503281311360:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:1.0:1713279306.962842:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00002000:00010000:0.0:1713279306.962847:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb size from disk: 35262 -> 35262 00002000:00010000:0.0:1713279306.962849:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279306.962850:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb atime from disk: 1713279302 -> 1713279302 00000100:00100000:3.0:1713279306.962850:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281311296 00002000:00010000:0.0:1713279306.962852:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00000100:00100000:3.0:1713279306.962852:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281311296 00002000:00010000:0.0:1713279306.962853:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1118:0x0] updating lvb blocks from disk: 32 -> 64 00000100:00100000:3.0:1713279306.962862:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223156 00000100:00100000:3.0:1713279306.962865:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3719:12070:x1796503281311296:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:0.0:1713279306.962869:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+107:1954:x1796503281311168:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 83us (110us total) trans 4295010147 rc 0/0 00000100:00100000:0.0:1713279306.962873:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110607 00000100:00100000:3.0:1713279306.962920:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:385c4b71-808c-40cf-91de-b076b668d13f+3720:12070:x1796503281311296:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 54us (77us total) trans 4295202816 rc 0/0 00000100:00100000:3.0:1713279306.962924:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223156 00002000:00010000:2.0:1713279306.962934:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb size from disk: 30052 -> 30052 00002000:00010000:2.0:1713279306.962937:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.962939:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1713279306.962941:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.962943:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1057:0x0] updating lvb blocks from disk: 40 -> 32 00000100:00100000:2.0:1713279306.962965:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+100:1957:x1796503281311360:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 135us (165us total) trans 4295010212 rc 0/0 00000100:00100000:2.0:1713279306.962971:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110608 00000100:00100000:0.0:1713279306.963010:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.963023:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281311424 00000100:00100000:2.0:1713279306.963026:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281311424 00000100:00100000:2.0:1713279306.963039:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110609 00000100:00100000:2.0:1713279306.963043:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+86:1955:x1796503281311424:12345-192.168.203.4@tcp:22:fallocate.0 00002000:00010000:2.0:1713279306.963106:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb size from disk: 13836 -> 13836 00002000:00010000:2.0:1713279306.963109:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb mtime from disk: 1713279304 -> 1713279304 00002000:00010000:2.0:1713279306.963111:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb atime from disk: 1713279298 -> 1713279298 00002000:00010000:2.0:1713279306.963113:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb ctime from disk: 1713279304 -> 1713279304 00002000:00010000:2.0:1713279306.963115:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x113a:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1713279306.963136:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+87:1955:x1796503281311424:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 91us (125us total) trans 4295010148 rc 0/0 00000100:00100000:2.0:1713279306.963142:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110609 00000100:00100000:0.0:1713279306.963495:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.963520:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281311552 00000100:00100000:3.0:1713279306.963523:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281311552 00000100:00100000:0.0:1713279306.963532:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.963546:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281311680 00000100:00100000:3.0:1713279306.963547:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281311680 00000100:00100000:3.0:1713279306.963556:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223157 00000100:00100000:3.0:1713279306.963559:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130143450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3460:12084:x1796503281311552:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.963574:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223158 00000100:00100000:2.0:1713279306.963580:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3718:12085:x1796503281311680:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:3.0:1713279306.963608:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130143450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3461:12084:x1796503281311552:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 47us (113us total) trans 4295183823 rc 0/0 00000100:00100000:3.0:1713279306.963612:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223157 00000100:00100000:2.0:1713279306.963643:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3719:12085:x1796503281311680:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 62us (109us total) trans 4295202817 rc 0/0 00000100:00100000:2.0:1713279306.963650:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223158 00000100:00100000:1.0:1713279306.963704:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.963718:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281311808 00000100:00100000:2.0:1713279306.963721:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281311808 00000100:00100000:2.0:1713279306.963742:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223159 00000100:00100000:2.0:1713279306.963747:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3720:12079:x1796503281311808:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.963803:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3721:12079:x1796503281311808:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 54us (100us total) trans 4295202818 rc 0/0 00000100:00100000:2.0:1713279306.963809:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223159 00000100:00100000:0.0:1713279306.964811:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.964846:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281311936 00000100:00100000:2.0:1713279306.964849:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281311936 00000100:00100000:2.0:1713279306.964868:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785646 00000100:00100000:2.0:1713279306.964871:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3719:12090:x1796503281311936:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.964878:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.964884:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114edab83a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917660b expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.964920:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114edab841 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.964925:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114edab841 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.964929:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114edab841 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.964936:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edab848 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.964939:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edab848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.964943:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edab848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.964959:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9d40/0xfc4b8e114edab84f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.964963:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9d40/0xfc4b8e114edab84f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.964966:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9d40/0xfc4b8e114edab84f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000004:00200000:2.0:1713279306.964970:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x8235:0x0]: returning size 52702 00010000:00010000:2.0:1713279306.964988:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114edab841 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.964992:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114edab841 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.964997:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114edab841 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.965000:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114edab841 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.965003:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906e9680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.965005:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114edab841 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.965008:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114edab841 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.965012:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:2.0:1713279306.965013:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.965015:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114edab841 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.965018:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9680/0xfc4b8e114edab841 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.965023:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edab848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.965026:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edab848 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.965028:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edab848 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.965031:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906eb600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.965033:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edab848 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.965038:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edab848 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.965041:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x37 (ffff8800960e8f00) 00010000:00010000:2.0:1713279306.965042:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.965044:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edab848 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.965046:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906eb600/0xfc4b8e114edab848 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.965060:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e8b40/0xfc4b8e114edab83a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917660b expref: 3722 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.965077:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906e9d40/0xfc4b8e114edab84f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8235:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917660b expref: 3721 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.965080:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8235:0x0].0x0 (ffff880096da6c00) 00010000:00010000:2.0:1713279306.965082:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1713279306.965083:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906e9d40, rc 0) 00000100:00100000:2.0:1713279306.965106:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:12090:x1796503281311936:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 233us (295us total) trans 4295202819 rc 0/0 00000100:00100000:2.0:1713279306.965110:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785646 00000100:00100000:1.0:1713279306.965592:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.965609:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281312064 00000100:00100000:2.0:1713279306.965614:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281312064 00000100:00100000:2.0:1713279306.965633:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785647 00000100:00100000:2.0:1713279306.965638:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3669:12087:x1796503281312064:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.965647:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.965656:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb3c0/0xfc4b8e114edab85d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176612 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.965701:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edab864 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.965711:0:15484:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda96ec lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cb1 expref: 3460 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.965719:0:15484:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca9b00/0xfc4b8e114eda9b1b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dd0 expref: 3670 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.965725:0:15484:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edab864 lrc: 5/0,1 mode: --/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.965740:0:15484:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca9b00/0xfc4b8e114eda9b1b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dd0 expref: 3670 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.965749:0:15484:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca9b00/0xfc4b8e114eda9b1b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dd0 expref: 3670 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.965758:0:15484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001_UUID:15484:1796503200065856:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.965800:0:15484:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda96ec lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cb1 expref: 3460 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.965808:0:15484:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda96ec lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cb1 expref: 3460 pid: 15482 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.965816:0:15484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001_UUID:15484:1796503200065920:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.965832:0:15484:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120671c00 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.966528:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.966558:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.966578:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281312128 00000100:00100000:2.0:1713279306.966583:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281312128 00000100:00100000:3.0:1713279306.966592:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281312192 00010000:00010000:2.0:1713279306.966596:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca9b00/0xfc4b8e114eda9b1b lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dd0 expref: 3671 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.966597:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281312192 00010000:00010000:3.0:1713279306.966609:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda96ec lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cb1 expref: 3461 pid: 15482 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.966618:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196622 00000100:00100000:2.0:1713279306.966622:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090aff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3671:1954:x1796503281312128:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.966627:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.966630:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca9b00/0xfc4b8e114eda9b1b lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dd0 expref: 3671 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.966631:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196623 00000100:00100000:3.0:1713279306.966635:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3461:1956:x1796503281312192:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.966636:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca9b00/0xfc4b8e114eda9b1b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dd0 expref: 3671 pid: 15484 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.966640:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.966643:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda96ec lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cb1 expref: 3461 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.966644:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7bca:0x0].0x0 (ffff880093598800) 00010000:00010000:2.0:1713279306.966647:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edab864 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.966651:0:15557:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edab864 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.966654:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279306.966660:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda96ec lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cb1 expref: 3461 pid: 15482 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.966669:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7bca:0x0].0x0 (ffff880093598800) 00000100:00100000:2.0:1713279306.966670:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090aff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:385c4b71-808c-40cf-91de-b076b668d13f+3671:1954:x1796503281312128:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 47us (144us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279306.966672:0:6917:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edab864 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713279306.966674:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196622 00010000:00010000:3.0:1713279306.966676:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edab864 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.966679:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edab864 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713279306.966686:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713279306.966693:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fca9b00/0xfc4b8e114eda9b1b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175dd0 expref: 3670 pid: 15484 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.966699:0:15484:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001_UUID:15484:1796503200065856:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.966701:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3461:1956:x1796503281312192:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 65us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.966705:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196623 00010000:00010000:2.0:1713279306.966706:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd10fc0/0xfc4b8e114eda96ec lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7bca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175cb1 expref: 3461 pid: 15482 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.966711:0:15484:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001_UUID:15484:1796503200065920:192.168.203.4@tcp:104: 00010000:00010000:2.0:1713279306.966721:0:15484:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edab864 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.966725:0:15484:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edab864 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.966728:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edab864 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00200000:2.0:1713279306.966733:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7bca:0x0]: returning size 27670 00010000:00010000:2.0:1713279306.966767:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906eb3c0/0xfc4b8e114edab85d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176612 expref: 3671 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.966774:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906ea640/0xfc4b8e114edab864 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x7bca:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176612 expref: 3670 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.966777:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7bca:0x0].0x0 (ffff880093598800) 00010000:00010000:2.0:1713279306.966779:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1713279306.966780:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906ea640, rc 0) 00000100:00100000:2.0:1713279306.966803:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3670:12087:x1796503281312064:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 1164us (1213us total) trans 4295183824 rc 0/0 00000100:00100000:2.0:1713279306.966806:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785647 00000100:00100000:0.0:1713279306.967383:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.967438:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281312384 00000100:00100000:2.0:1713279306.967442:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281312384 00000100:00100000:2.0:1713279306.967459:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110610 00000100:00100000:2.0:1713279306.967464:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+91:1957:x1796503281312384:12345-192.168.203.4@tcp:22:fallocate.0 00002000:00010000:2.0:1713279306.967556:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb size from disk: 27670 -> 48224 00002000:00010000:2.0:1713279306.967559:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.967561:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1713279306.967562:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.967563:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x105b:0x0] updating lvb blocks from disk: 80 -> 104 00000100:00100000:2.0:1713279306.967588:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+92:1957:x1796503281312384:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 123us (205us total) trans 4295010213 rc 0/0 00000100:00100000:2.0:1713279306.967592:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110610 00000100:00100000:0.0:1713279306.967623:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.967649:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281312320 00000100:00100000:2.0:1713279306.967651:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281312320 00000100:00100000:2.0:1713279306.967662:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785648 00000100:00100000:2.0:1713279306.967665:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3460:12097:x1796503281312320:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.967672:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.967677:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114edab872 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176619 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.967715:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114edab879 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.967720:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114edab879 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967725:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114edab879 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967731:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114edab880 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.967736:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114edab880 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967740:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114edab880 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967757:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114edab887 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.967761:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114edab887 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967765:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114edab887 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00200000:2.0:1713279306.967768:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x74d1:0x0]: returning size 39808 00010000:00010000:2.0:1713279306.967786:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114edab879 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967790:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114edab879 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967793:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114edab879 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967796:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114edab879 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967798:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ed680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.967800:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114edab879 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967803:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114edab879 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967810:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:2.0:1713279306.967812:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.967813:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114edab879 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967816:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ed680/0xfc4b8e114edab879 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967821:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114edab880 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967824:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114edab880 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967827:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114edab880 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967830:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec480 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.967831:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114edab880 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967834:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114edab880 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967837:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x33 (ffff8800960e8000) 00010000:00010000:2.0:1713279306.967838:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.967839:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114edab880 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967842:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec480/0xfc4b8e114edab880 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.967856:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906e8fc0/0xfc4b8e114edab872 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176619 expref: 3463 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.967862:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114edab887 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176619 expref: 3462 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.967865:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74d1:0x0].0x0 (ffff88008d597900) 00010000:00010000:2.0:1713279306.967866:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1713279306.967868:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298efa80, rc 0) 00000100:00100000:2.0:1713279306.967891:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3462:12097:x1796503281312320:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 225us (269us total) trans 4295183825 rc 0/0 00000100:00100000:2.0:1713279306.967895:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785648 00000100:00100000:0.0:1713279306.968085:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.968113:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281312512 00000100:00100000:2.0:1713279306.968116:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281312512 00000100:00100000:2.0:1713279306.968131:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223160 00000100:00100000:2.0:1713279306.968133:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3670:12087:x1796503281312512:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.968211:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3671:12087:x1796503281312512:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 76us (127us total) trans 4295183826 rc 0/0 00000100:00100000:2.0:1713279306.968215:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223160 00000100:00100000:0.0:1713279306.968624:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.968649:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281312576 00000100:00100000:3.0:1713279306.968654:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281312576 00000100:00100000:3.0:1713279306.968677:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147289 00000100:00100000:3.0:1713279306.968681:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3462:1954:x1796503281312576:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.968686:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.968694:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298efa80/0xfc4b8e114edab887 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x74d1:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176619 expref: 3462 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.968702:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74d1:0x0].0x0 (ffff88008d597900) 00010000:00010000:3.0:1713279306.968704:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713279306.968720:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3461:1954:x1796503281312576:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 39us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.968724:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147289 00000100:00100000:0.0:1713279306.968772:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.968798:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281312640 00000100:00100000:2.0:1713279306.968802:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281312640 00000100:00100000:2.0:1713279306.968816:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110611 00000100:00100000:2.0:1713279306.968820:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+107:1955:x1796503281312640:12345-192.168.203.4@tcp:22:fallocate.0 00002000:00010000:2.0:1713279306.968875:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb size from disk: 39808 -> 39808 00002000:00010000:2.0:1713279306.968877:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.968879:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb atime from disk: 1713279299 -> 1713279299 00002000:00010000:2.0:1713279306.968881:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.968883:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000400:0x1032:0x0] updating lvb blocks from disk: 72 -> 72 00000100:00100000:2.0:1713279306.968902:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+108:1955:x1796503281312640:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 81us (130us total) trans 4295010149 rc 0/0 00000100:00100000:2.0:1713279306.968908:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110611 00000100:00100000:0.0:1713279306.969938:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.970006:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281312768 00000100:00100000:2.0:1713279306.970010:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281312768 00000100:00100000:2.0:1713279306.970032:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223161 00000100:00100000:2.0:1713279306.970036:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3461:12097:x1796503281312768:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:0.0:1713279306.970088:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.970127:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3462:12097:x1796503281312768:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 89us (188us total) trans 4295183827 rc 0/0 00000100:00100000:2.0:1713279306.970131:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223161 00000100:00100000:2.0:1713279306.970143:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281312896 00000100:00100000:2.0:1713279306.970145:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281312896 00000100:00100000:2.0:1713279306.970154:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785649 00000100:00100000:2.0:1713279306.970156:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:12089:x1796503281312896:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.970161:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.970166:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edab895 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176620 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.970204:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114edab89c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970210:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114edab89c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970214:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114edab89c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970220:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab8a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970224:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970227:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000004:00200000:2.0:1713279306.970276:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7e3b:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.970283:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114edab89c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970289:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114edab89c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970294:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114edab89c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970299:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114edab89c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970303:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ee400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.970306:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114edab89c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970311:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114edab89c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970319:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:2.0:1713279306.970321:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.970324:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114edab89c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970327:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ee400/0xfc4b8e114edab89c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970336:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970339:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab8a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970342:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970344:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298efcc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.970346:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970348:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab8a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970352:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3831 (ffff8800960e8900) 00010000:00010000:2.0:1713279306.970353:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.970354:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab8a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970357:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298efcc0/0xfc4b8e114edab8a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.970370:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edab895 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176620 expref: 3722 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.970374:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edb00/0xfc4b8e114edab895 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176620 expref: 3722 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.970378:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298edb00, rc 0) 00000100:00100000:2.0:1713279306.970402:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:12089:x1796503281312896:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 245us (315us total) trans 0 rc 301/301 00000100:00100000:2.0:1713279306.970407:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785649 00000100:00100000:0.0:1713279306.970953:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.971015:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281313024 00000100:00100000:2.0:1713279306.971020:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281313024 00000100:00100000:2.0:1713279306.971036:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785650 00000100:00100000:2.0:1713279306.971040:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3721:12088:x1796503281313024:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.971049:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.971054:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114edab8aa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176627 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.971106:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114edab8b1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971112:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114edab8b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971116:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114edab8b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971122:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114edab8b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971126:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114edab8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971129:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114edab8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971146:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114edab8bf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.971151:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1713279306.971151:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114edab8bf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971154:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114edab8bf lrc: 2/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971157:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114edab8bf lrc: 3/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971160:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ec6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.971162:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114edab8bf lrc: 3/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971165:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114edab8bf lrc: 4/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971168:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7fe9:0x0].0x0 (ffff880089f68f00) 00010000:00010000:2.0:1713279306.971171:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114edab8bf lrc: 2/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971173:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ec6c0/0xfc4b8e114edab8bf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7fe9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000004:00200000:2.0:1713279306.971179:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x7fe9:0x0]: returning size 46934 00010000:00010000:2.0:1713279306.971199:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114edab8b1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971203:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114edab8b1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971205:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114edab8b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971208:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114edab8b1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971211:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ed200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.971213:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114edab8b1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971216:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114edab8b1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.971217:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281313088 00010000:00010000:2.0:1713279306.971220:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:2.0:1713279306.971221:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.971222:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114edab8b1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.971222:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281313088 00010000:00010000:2.0:1713279306.971225:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ed200/0xfc4b8e114edab8b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971230:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114edab8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971233:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114edab8b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971236:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114edab8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.971238:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298edd40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.971239:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114edab8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.971239:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110612 00010000:00010000:2.0:1713279306.971242:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114edab8b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713279306.971242:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+108:12090:x1796503281313088:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.971245:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x38 (ffff8800960e8a00) 00010000:00010000:2.0:1713279306.971246:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.971247:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114edab8b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.971249:0:11415:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.971252:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298edd40/0xfc4b8e114edab8b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.971255:0:11415:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093693a80/0xfc4b8e114edab8cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917662e expref: -99 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.971267:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114edab8aa lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176627 expref: 3723 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.971268:0:11415:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c86b600/0xfc4b8e114eda98a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->28671) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d3d expref: 86 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.971271:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298ef3c0/0xfc4b8e114edab8aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176627 expref: 3723 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.971272:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.971273:0:11415:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713279306.971275:0:11415:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093693a80/0xfc4b8e114edab8cd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [24576->40959] (req 24576->40959) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917662e expref: 109 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.971276:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ef3c0, rc 0) 00010000:00010000:3.0:1713279306.971286:0:11415:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c86b600/0xfc4b8e114eda98a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->28671) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d3d expref: 86 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.971291:0:11415:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c86b600/0xfc4b8e114eda98a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->28671) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d3d expref: 86 pid: 11415 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.971294:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3722:12088:x1796503281313024:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 254us (342us total) trans 4295202820 rc 301/301 00000100:00100000:3.0:1713279306.971297:0:11415:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11415:1796503200065984:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.971298:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785650 00000100:00100000:3.0:1713279306.971314:0:11415:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.971808:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.971842:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281313152 00000100:00100000:2.0:1713279306.971846:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281313152 00010000:00010000:2.0:1713279306.971858:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c86b600/0xfc4b8e114eda98a5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d3d expref: 87 pid: 11415 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.971863:0:11415:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11415:1796503200065984:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.971873:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196624 00010000:00010000:3.0:1713279306.971875:0:11415:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093693a80/0xfc4b8e114edab8cd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [24576->40959] (req 24576->40959) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917662e expref: 109 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.971877:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090aff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+87:1956:x1796503281313152:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.971884:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.971884:0:11415:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093693a80, rc 0) 00010000:00010000:2.0:1713279306.971892:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c86b600/0xfc4b8e114eda98a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d3d expref: 87 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.971899:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c86b600/0xfc4b8e114eda98a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->28671) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d3d expref: 87 pid: 11415 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.971903:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+109:12090:x1796503281313088:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 660us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.971908:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110612 00010000:00010000:2.0:1713279306.971916:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c86b600/0xfc4b8e114eda98a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->28671) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc39175d3d expref: 87 pid: 11415 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1713279306.971923:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.971925:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713279306.971929:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093693a80/0xfc4b8e114edab8cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917662e expref: 108 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.971936:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093693a80/0xfc4b8e114edab8cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917662e expref: 108 pid: 11415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.971952:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093693a80/0xfc4b8e114edab8cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x117f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917662e expref: 108 pid: 11415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.971961:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6917:1796503200066048:192.168.203.4@tcp:105: 00000100:00100000:2.0:1713279306.971983:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800917f2240 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.972081:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.972115:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281313280 00000100:00100000:2.0:1713279306.972119:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281313280 00000100:00100000:2.0:1713279306.972136:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785651 00000100:00100000:2.0:1713279306.972141:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3671:12102:x1796503281313280:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.972150:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.972157:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114edab8d4 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176635 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.972200:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edab8db lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.972211:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edab8db lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.972218:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edab8db lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.972227:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ee880/0xfc4b8e114edab8e2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713279306.972233:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ee880/0xfc4b8e114edab8e2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.972239:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ee880/0xfc4b8e114edab8e2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713279306.972249:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.972281:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281313408 00000100:00100000:1.0:1713279306.972285:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281313408 00000004:00200000:2.0:1713279306.972290:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x79a0:0x0]: returning size 4096 00010000:00010000:2.0:1713279306.972297:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edab8db lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.972300:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785652 00010000:00010000:2.0:1713279306.972302:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edab8db lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713279306.972304:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:12091:x1796503281313408:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.972308:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edab8db lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.972311:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.972313:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edab8db lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.972316:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edab8e9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917663c expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.972318:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ef180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.972320:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edab8db lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.972326:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edab8db lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.972337:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:2.0:1713279306.972339:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.972342:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edab8db lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.972344:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab8f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.972347:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ef180/0xfc4b8e114edab8db lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.972349:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab8f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.972354:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab8f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.972354:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ee880/0xfc4b8e114edab8e2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713279306.972359:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ee880/0xfc4b8e114edab8e2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.972360:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab8f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.972363:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.972364:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ee880/0xfc4b8e114edab8e2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.972367:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.972369:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ee880 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:2.0:1713279306.972371:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ee880/0xfc4b8e114edab8e2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.972374:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab8fe lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.972376:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ee880/0xfc4b8e114edab8e2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.972378:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab8fe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.972381:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab8fe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.972381:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff8800960e8500) 00010000:00010000:2.0:1713279306.972384:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713279306.972386:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ee880/0xfc4b8e114edab8e2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.972387:0:15658:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab8f0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.972390:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab8f0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.972390:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ee880/0xfc4b8e114edab8e2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713279306.972393:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab8f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.972396:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab8f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.972399:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981440 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.972400:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab8f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.972403:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab8f0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.972407:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:2.0:1713279306.972407:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114edab8d4 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176635 expref: 3672 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.972408:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.972410:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab8f0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.972429:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981440/0xfc4b8e114edab8f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.972434:0:15658:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.972434:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ec240/0xfc4b8e114edab8d4 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176635 expref: 3672 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.972437:0:15658:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab8f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.972440:0:15658:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab8f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:2.0:1713279306.972442:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ec240, rc 0) 00010000:00010000:1.0:1713279306.972443:0:15658:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d981d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279306.972444:0:15658:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab8f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.972447:0:15658:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab8f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.972451:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x36 (ffff880135885200) 00010000:00010000:1.0:1713279306.972452:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713279306.972453:0:15658:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab8f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00000100:00100000:3.0:1713279306.972453:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6917:1796503200066048:192.168.203.4@tcp:105: 00010000:00010000:1.0:1713279306.972456:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d981d40/0xfc4b8e114edab8f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT0 00010000:00010000:3.0:1713279306.972462:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.972464:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3671:12102:x1796503281313280:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 321us (382us total) trans 0 rc 301/301 00010000:00010000:1.0:1713279306.972467:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983180/0xfc4b8e114edab8e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917663c expref: 3723 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.972470:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785651 00010000:00010000:1.0:1713279306.972473:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab8fe lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917663c expref: 3722 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.972476:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7afa:0x0].0x0 (ffff88008d729100) 00010000:00010000:1.0:1713279306.972477:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713279306.972478:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d983600, rc 0) 00000100:00100000:3.0:1713279306.972478:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090aff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+86:1956:x1796503281313152:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 599us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.972483:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196624 00000100:00100000:1.0:1713279306.972495:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:12091:x1796503281313408:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 191us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.972499:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785652 00000100:00100000:0.0:1713279306.973159:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.973179:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.973226:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281313472 00000100:00100000:3.0:1713279306.973230:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281313472 00000100:00100000:3.0:1713279306.973252:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281313536 00000100:00100000:3.0:1713279306.973253:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281313536 00000100:00100000:1.0:1713279306.973264:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110613 00000100:00100000:1.0:1713279306.973270:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+86:1957:x1796503281313472:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:3.0:1713279306.973270:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110614 00000100:00100000:3.0:1713279306.973274:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+109:1956:x1796503281313536:12345-192.168.203.4@tcp:22:fallocate.0 00002000:00010000:2.0:1713279306.973409:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb size from disk: 52702 -> 52702 00002000:00010000:2.0:1713279306.973433:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.973435:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:2.0:1713279306.973436:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279306.973437:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb blocks from disk: 104 -> 96 00000100:00100000:2.0:1713279306.973458:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+110:1956:x1796503281313536:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 182us (276us total) trans 4295010151 rc 0/0 00000100:00100000:2.0:1713279306.973463:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110614 00002000:00010000:1.0:1713279306.973478:0:15783:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb size from disk: 46934 -> 46934 00002000:00010000:1.0:1713279306.973480:0:15783:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.973482:0:15783:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:1.0:1713279306.973483:0:15783:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.973484:0:15783:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x10e6:0x0] updating lvb blocks from disk: 48 -> 8 00000100:00100000:1.0:1713279306.973505:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+87:1957:x1796503281313472:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 234us (345us total) trans 4295010150 rc 0/0 00000100:00100000:1.0:1713279306.973509:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110613 00000100:00100000:0.0:1713279306.973826:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.973857:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.973895:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281313664 00000100:00100000:1.0:1713279306.973900:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281313664 00000100:00100000:1.0:1713279306.973922:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785653 00000100:00100000:3.0:1713279306.973924:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281313728 00000100:00100000:1.0:1713279306.973926:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3462:12091:x1796503281313664:12345-192.168.203.4@tcp:101:fallocate.0 00000100:00100000:3.0:1713279306.973928:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281313728 00010000:00010000:1.0:1713279306.973934:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.973942:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114edab905 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176643 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.973947:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147290 00000100:00100000:3.0:1713279306.973951:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:1956:x1796503281313728:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713279306.973956:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.973964:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d983600/0xfc4b8e114edab8fe lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917663c expref: 3722 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.973972:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7afa:0x0].0x0 (ffff88008d729100) 00010000:00010000:3.0:1713279306.973974:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:1.0:1713279306.973975:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x7afa:0x0]: returning size 4096 00010000:00010000:1.0:1713279306.973984:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114edab905 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176643 expref: 3463 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.973990:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982ac0/0xfc4b8e114edab905 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x7afa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176643 expref: 3463 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.973990:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:1956:x1796503281313728:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 38us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.973994:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147290 00010000:00010000:1.0:1713279306.973997:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d982ac0, rc 0) 00000100:00100000:1.0:1713279306.974016:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3462:12091:x1796503281313664:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 89us (190us total) trans 0 rc 301/301 00000100:00100000:1.0:1713279306.974022:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785653 00000100:00100000:0.0:1713279306.974141:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.974177:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281313856 00000100:00100000:2.0:1713279306.974181:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281313856 00000100:00100000:2.0:1713279306.974206:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223162 00000100:00100000:2.0:1713279306.974211:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3721:12090:x1796503281313856:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.974310:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:12090:x1796503281313856:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 97us (167us total) trans 4295202821 rc 0/0 00000100:00100000:2.0:1713279306.974316:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223162 00000100:00100000:0.0:1713279306.974382:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.974400:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281314112 00000100:00100000:1.0:1713279306.974404:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281314112 00000100:00100000:1.0:1713279306.974436:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785654 00000100:00100000:0.0:1713279306.974439:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.974440:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3462:12108:x1796503281314112:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.974447:0:15658:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713279306.974452:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281313984 00010000:00010000:1.0:1713279306.974454:0:15658:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983cc0/0xfc4b8e114edab90c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917664a expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.974455:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281313984 00000100:00100000:2.0:1713279306.974470:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223163 00000100:00100000:2.0:1713279306.974474:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130142850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3722:12088:x1796503281313984:12345-192.168.203.4@tcp:35:fallocate.0 00010000:00010000:1.0:1713279306.974489:0:15658:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab913 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x758f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15658 initiator: MDT0 00010000:00010000:1.0:1713279306.974496:0:15658:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab913 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x758f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279306.974500:0:15658:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab913 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x758f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15658 initiator: MDT1 00000004:00200000:1.0:1713279306.974504:0:15658:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x758f:0x0]: returning size 64588 00000100:00100000:0.0:1713279306.974510:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.974517:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281314240 00000100:00100000:3.0:1713279306.974520:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281314240 00000100:00100000:3.0:1713279306.974530:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785655 00000100:00100000:3.0:1713279306.974533:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3724:12094:x1796503281314240:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:1.0:1713279306.974535:0:15658:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d983cc0/0xfc4b8e114edab90c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917664a expref: 3465 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.974536:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130142850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:385c4b71-808c-40cf-91de-b076b668d13f+3724:12088:x1796503281313984:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 59us (94us total) trans 4295202822 rc 0/0 00010000:00010000:3.0:1713279306.974540:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713279306.974542:0:15658:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab913 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x758f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917664a expref: 3464 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279306.974543:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223163 00010000:00010000:1.0:1713279306.974546:0:15658:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x758f:0x0].0x0 (ffff8800908e1600) 00010000:00010000:3.0:1713279306.974546:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab921 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176651 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.974548:0:15658:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1713279306.974549:0:15658:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f556ac0, rc 0) 00000100:00100000:1.0:1713279306.974564:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3464:12108:x1796503281314112:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 123us (182us total) trans 4295183828 rc 0/0 00000100:00100000:1.0:1713279306.974569:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785654 00010000:00010000:3.0:1713279306.974584:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013585ef40/0xfc4b8e114edab928 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974589:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013585ef40/0xfc4b8e114edab928 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974594:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013585ef40/0xfc4b8e114edab928 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974600:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114edab92f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974604:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114edab92f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974607:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114edab92f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000004:00200000:3.0:1713279306.974615:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8516:0x0]: returning size 1 00010000:00010000:3.0:1713279306.974621:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013585ef40/0xfc4b8e114edab928 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974624:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013585ef40/0xfc4b8e114edab928 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974627:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013585ef40/0xfc4b8e114edab928 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974631:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013585ef40/0xfc4b8e114edab928 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974634:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013585ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.974636:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013585ef40/0xfc4b8e114edab928 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974639:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013585ef40/0xfc4b8e114edab928 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974642:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279306.974644:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.974645:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013585ef40/0xfc4b8e114edab928 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974648:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013585ef40/0xfc4b8e114edab928 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974653:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114edab92f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974656:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114edab92f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974659:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114edab92f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974661:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008941c6c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.974663:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114edab92f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974665:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114edab92f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974671:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3931 (ffff88012d397500) 00010000:00010000:3.0:1713279306.974672:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.974674:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114edab92f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974676:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008941c6c0/0xfc4b8e114edab92f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.974690:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab921 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176651 expref: 3724 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.974694:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013585cd80/0xfc4b8e114edab921 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176651 expref: 3724 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.974698:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013585cd80, rc 0) 00000100:00100000:3.0:1713279306.974714:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3723:12094:x1796503281314240:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 180us (205us total) trans 0 rc 301/301 00000100:00100000:3.0:1713279306.974719:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785655 00000100:00100000:0.0:1713279306.975396:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.975460:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281314368 00000100:00100000:3.0:1713279306.975465:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281314368 00000100:00100000:3.0:1713279306.975488:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785656 00000100:00100000:3.0:1713279306.975492:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3722:12105:x1796503281314368:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.975499:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.975506:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114edab936 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176658 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.975522:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.975531:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281314496 00000100:00100000:0.0:1713279306.975534:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281314496 00010000:00010000:3.0:1713279306.975546:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab93d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713279306.975547:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785657 00000100:00100000:0.0:1713279306.975551:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3723:12094:x1796503281314496:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.975554:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab93d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.975558:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.975559:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab93d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.975564:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114edab944 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917665f expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.975566:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab94b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.975569:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab94b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.975572:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab94b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.975590:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab952 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.975595:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab952 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.975598:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab952 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000004:00200000:3.0:1713279306.975602:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x8430:0x0]: returning size 3214 00010000:00010000:0.0:1713279306.975606:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab959 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.975612:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab959 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.975616:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab959 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.975622:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086400/0xfc4b8e114edab967 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.975623:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab93d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.975626:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086400/0xfc4b8e114edab967 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.975627:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab93d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.975629:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086400/0xfc4b8e114edab967 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.975630:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab93d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.975633:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab93d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.975636:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.975638:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab93d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.975641:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab93d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.975645:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:0.0:1713279306.975647:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114edab96e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.975647:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.975649:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab93d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.975651:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab93d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.975652:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114edab96e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.975655:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114edab96e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.975657:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab94b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.975658:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114edab96e lrc: 3/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.975660:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab94b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.975661:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd46c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.975663:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114edab96e lrc: 3/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.975663:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab94b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.975665:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279306.975667:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab94b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713279306.975668:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114edab96e lrc: 4/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.975669:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab94b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.975672:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x38 (ffff88012d397a00) 00010000:00010000:3.0:1713279306.975674:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279306.975675:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab94b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.975678:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab94b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713279306.975693:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091805440/0xfc4b8e114edab936 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176658 expref: 3725 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.975699:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab952 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176658 expref: 3724 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.975702:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8430:0x0].0x0 (ffff8800920e4400) 00010000:00010000:3.0:1713279306.975703:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1713279306.975705:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ba9680, rc 0) 00010000:00010000:0.0:1713279306.975724:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7abd:0x0].0x0 (ffff88008c2e7d00) 00000100:00100000:3.0:1713279306.975725:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:12105:x1796503281314368:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 232us (329us total) trans 4295202823 rc 0/0 00010000:00010000:0.0:1713279306.975727:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114edab96e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.975730:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091dd46c0/0xfc4b8e114edab96e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7abd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.975730:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785656 00000004:00200000:0.0:1713279306.975737:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x7abd:0x0]: returning size 42048 00000100:00100000:1.0:1713279306.975754:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.975762:0:15485:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab959 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.975765:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab959 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.975765:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281314560 00010000:00010000:0.0:1713279306.975768:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab959 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.975768:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281314560 00010000:00010000:0.0:1713279306.975771:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab959 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.975773:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f085b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.975775:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab959 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.975778:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab959 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.975782:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:0.0:1713279306.975783:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.975785:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab959 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.975785:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147291 00000100:00100000:3.0:1713279306.975788:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3464:1954:x1796503281314560:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.975789:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f085b00/0xfc4b8e114edab959 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.975792:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.975793:0:15485:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086400/0xfc4b8e114edab967 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.975796:0:15485:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086400/0xfc4b8e114edab967 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.975799:0:15485:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086400/0xfc4b8e114edab967 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.975799:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f556ac0/0xfc4b8e114edab913 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x758f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917664a expref: 3464 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.975802:0:15485:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f086400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279306.975803:0:15485:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086400/0xfc4b8e114edab967 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.975804:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x758f:0x0].0x0 (ffff8800908e1600) 00010000:00010000:0.0:1713279306.975806:0:15485:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086400/0xfc4b8e114edab967 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279306.975806:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.975809:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x33 (ffff8801250c1200) 00010000:00010000:0.0:1713279306.975810:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279306.975811:0:15485:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086400/0xfc4b8e114edab967 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00010000:00010000:0.0:1713279306.975814:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f086400/0xfc4b8e114edab967 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15485 initiator: MDT0 00000100:00100000:3.0:1713279306.975819:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3463:1954:x1796503281314560:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 30us (67us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.975822:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147291 00010000:00010000:0.0:1713279306.975879:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114edab944 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917665f expref: 3725 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.975883:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f084d80/0xfc4b8e114edab944 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917665f expref: 3725 pid: 15485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713279306.975890:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1713279306.975891:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f084d80, rc 0) 00000100:00100000:2.0:1713279306.975906:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281314624 00000100:00100000:2.0:1713279306.975910:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281314624 00000100:00100000:0.0:1713279306.975914:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3724:12094:x1796503281314496:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 362us (392us total) trans 4295202824 rc 301/301 00000100:00100000:0.0:1713279306.975918:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785657 00000100:00100000:2.0:1713279306.975928:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110615 00000100:00100000:2.0:1713279306.975932:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+100:12108:x1796503281314624:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:2.0:1713279306.975940:0:15783:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279306.975948:0:15783:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801298ec000/0xfc4b8e114edab97c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176666 expref: -99 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.975962:0:15783:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013076f840/0xfc4b8e114edaae4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762d1 expref: 91 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.975969:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.975971:0:15783:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713279306.975974:0:15783:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801298ec000/0xfc4b8e114edab97c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176666 expref: 101 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.975990:0:15783:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013076f840/0xfc4b8e114edaae4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->36863) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762d1 expref: 91 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.975999:0:15783:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013076f840/0xfc4b8e114edaae4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->36863) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762d1 expref: 91 pid: 15783 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.976014:0:15783:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0000_UUID:15783:1796503200066112:192.168.203.4@tcp:104: 00000100:00100000:2.0:1713279306.976045:0:15783:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800917f2300 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.976664:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.976682:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.976723:0:15783:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0000_UUID:15783:1796503200066112:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.976728:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281314688 00000100:00100000:3.0:1713279306.976732:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281314688 00010000:00010000:2.0:1713279306.976735:0:15783:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801298ec000/0xfc4b8e114edab97c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176666 expref: 101 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.976744:0:15783:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ec000, rc 0) 00010000:00010000:3.0:1713279306.976745:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013076f840/0xfc4b8e114edaae4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->36863) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762d1 expref: 92 pid: 15783 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1713279306.976760:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196625 00000100:00100000:2.0:1713279306.976763:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:12108:x1796503281314624:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 831us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.976764:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097badf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+92:1955:x1796503281314688:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713279306.976768:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110615 00010000:00010000:3.0:1713279306.976769:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279306.976776:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013076f840/0xfc4b8e114edaae4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->36863) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762d1 expref: 92 pid: 15783 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1713279306.976779:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281314752 00000100:00100000:2.0:1713279306.976782:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281314752 00010000:00010000:3.0:1713279306.976783:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013076f840/0xfc4b8e114edaae4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->36863) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762d1 expref: 92 pid: 15783 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1713279306.976793:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013076f840/0xfc4b8e114edaae4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->36863) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391762d1 expref: 93 pid: 15783 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.976798:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110616 00010000:00010000:3.0:1713279306.976799:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713279306.976800:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713279306.976801:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+92:12094:x1796503281314752:12345-192.168.203.4@tcp:101:fallocate.0 00010000:00010000:3.0:1713279306.976803:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801298ec000/0xfc4b8e114edab97c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176666 expref: 100 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.976807:0:15500:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279306.976808:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801298ec000/0xfc4b8e114edab97c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176666 expref: 100 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.976814:0:15500:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab983 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917666d expref: -99 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.976820:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801298ec000/0xfc4b8e114edab97c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176666 expref: 100 pid: 15783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.976825:0:15500:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801298eef40/0xfc4b8e114edab70d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765a2 expref: 100 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.976826:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6917:1796503200066176:192.168.203.4@tcp:105: 00010000:00010000:0.0:1713279306.976829:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713279306.976830:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713279306.976832:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab983 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [20480->36863] (req 20480->36863) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917666d expref: 93 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.976843:0:15500:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801298eef40/0xfc4b8e114edab70d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765a2 expref: 100 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713279306.976843:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801250c03c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713279306.976848:0:15500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801298eef40/0xfc4b8e114edab70d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765a2 expref: 100 pid: 15500 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.976858:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097bae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200066240:192.168.203.4@tcp:104: 00000100:00100000:0.0:1713279306.976872:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.977487:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.977505:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281314816 00000100:00100000:0.0:1713279306.977508:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281314816 00010000:00010000:0.0:1713279306.977516:0:15557:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801298eef40/0xfc4b8e114edab70d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765a2 expref: 101 pid: 15500 timeout: 509 lvb_type: 0 00000100:00100000:0.0:1713279306.977527:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196626 00000100:00100000:0.0:1713279306.977530:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:1956:x1796503281314816:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713279306.977535:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279306.977541:0:15557:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801298eef40/0xfc4b8e114edab70d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765a2 expref: 101 pid: 15500 timeout: 509 lvb_type: 0 00010000:00010000:0.0:1713279306.977547:0:15557:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801298eef40/0xfc4b8e114edab70d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765a2 expref: 101 pid: 15500 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1713279306.977548:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097bae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:15500:1796503200066240:192.168.203.4@tcp:104: 00000100:00100000:3.0:1713279306.977555:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6917:1796503200066176:192.168.203.4@tcp:105: 00010000:00010000:0.0:1713279306.977556:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801298eef40/0xfc4b8e114edab70d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x2345e2fc391765a2 expref: 101 pid: 15500 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1713279306.977560:0:15500:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab983 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [20480->36863] (req 20480->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917666d expref: 93 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279306.977561:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.977562:0:15557:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713279306.977565:0:15557:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab983 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917666d expref: 93 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279306.977565:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279306.977573:0:15557:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab983 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->36863) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917666d expref: 93 pid: 15500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713279306.977578:0:15500:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dd7cc0, rc 0) 00010000:00010000:0.0:1713279306.977583:0:15557:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091dd7cc0/0xfc4b8e114edab983 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1075:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->36863) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917666d expref: 93 pid: 15500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713279306.977589:0:15557:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097bae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:15557:1796503200066304:192.168.203.4@tcp:105: 00000100:00100000:3.0:1713279306.977591:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097badf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:385c4b71-808c-40cf-91de-b076b668d13f+93:1955:x1796503281314688:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 825us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279306.977594:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:385c4b71-808c-40cf-91de-b076b668d13f+93:12094:x1796503281314752:12345-192.168.203.4@tcp:101:fallocate.0 Request processed in 792us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279306.977596:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196625 00000100:00100000:1.0:1713279306.977599:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110616 00000100:00100000:0.0:1713279306.977603:0:15557:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a240 going to sleep for 11 seconds 00000100:00100000:0.0:1713279306.978880:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.978900:0:15557:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097bae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:15557:1796503200066304:192.168.203.4@tcp:105: 00010000:00010000:2.0:1713279306.978907:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713279306.978908:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.978923:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+100:1956:x1796503281314816:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1392us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.978928:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196626 00000100:00100000:1.0:1713279306.978945:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281314880 00000100:00100000:1.0:1713279306.978949:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281314880 00000100:00100000:3.0:1713279306.978960:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281314944 00000100:00100000:3.0:1713279306.978965:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281314944 00000100:00100000:1.0:1713279306.978966:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110617 00000100:00100000:1.0:1713279306.978970:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+100:1954:x1796503281314880:12345-192.168.203.4@tcp:22:fallocate.0 00000100:00100000:3.0:1713279306.978982:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110618 00000100:00100000:3.0:1713279306.978986:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+92:1957:x1796503281314944:12345-192.168.203.4@tcp:22:fallocate.0 00002000:00010000:3.0:1713279306.979051:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb size from disk: 42048 -> 42048 00002000:00010000:3.0:1713279306.979053:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.979055:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:3.0:1713279306.979056:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279306.979057:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb blocks from disk: 32 -> 64 00000100:00100000:3.0:1713279306.979103:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+93:1957:x1796503281314944:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 114us (193us total) trans 4295010215 rc 0/0 00000100:00100000:3.0:1713279306.979109:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110618 00002000:00010000:1.0:1713279306.979134:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb size from disk: 64588 -> 64588 00002000:00010000:1.0:1713279306.979137:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.979138:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:1.0:1713279306.979140:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.979141:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1051:0x0] updating lvb blocks from disk: 112 -> 104 00000100:00100000:1.0:1713279306.979167:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:1954:x1796503281314880:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 195us (287us total) trans 4295010214 rc 0/0 00000100:00100000:1.0:1713279306.979171:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110617 00000100:00100000:0.0:1713279306.979650:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279306.979670:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.979708:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281315200 00000100:00100000:3.0:1713279306.979712:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281315200 00000100:00100000:2.0:1713279306.979714:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281315136 00000100:00100000:2.0:1713279306.979718:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281315136 00000100:00100000:3.0:1713279306.979731:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223164 00000100:00100000:3.0:1713279306.979736:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3724:12094:x1796503281315200:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.979741:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223165 00000100:00100000:2.0:1713279306.979745:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3463:12108:x1796503281315136:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:2.0:1713279306.979807:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3464:12108:x1796503281315136:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 61us (135us total) trans 4295183829 rc 0/0 00000100:00100000:2.0:1713279306.979814:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223165 00000100:00100000:3.0:1713279306.979814:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:385c4b71-808c-40cf-91de-b076b668d13f+3725:12094:x1796503281315200:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 76us (162us total) trans 4295202825 rc 0/0 00000100:00100000:3.0:1713279306.979821:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223164 00000100:00100000:0.0:1713279306.980481:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279306.980506:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281315264 00000100:00100000:2.0:1713279306.980509:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281315264 00000100:00100000:2.0:1713279306.980528:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147292 00000100:00100000:2.0:1713279306.980531:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a85c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:1955:x1796503281315264:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713279306.980535:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713279306.980542:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9680/0xfc4b8e114edab952 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8430:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176658 expref: 3724 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279306.980550:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8430:0x0].0x0 (ffff8800920e4400) 00010000:00010000:2.0:1713279306.980552:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713279306.980566:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a85c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:1955:x1796503281315264:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 34us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279306.980570:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147292 00000100:00100000:0.0:1713279306.981794:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279306.981865:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281315328 00000100:00100000:1.0:1713279306.981869:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281315328 00000100:00100000:1.0:1713279306.981891:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110619 00000100:00100000:1.0:1713279306.981895:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+110:1956:x1796503281315328:12345-192.168.203.4@tcp:22:fallocate.0 00002000:00010000:1.0:1713279306.981973:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb size from disk: 3214 -> 3214 00002000:00010000:1.0:1713279306.981975:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.981977:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb atime from disk: 1713279299 -> 1713279299 00002000:00010000:1.0:1713279306.981978:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279306.981980:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb blocks from disk: 40 -> 64 00000100:00100000:1.0:1713279306.982004:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+111:1956:x1796503281315328:12345-192.168.203.4@tcp:22:fallocate.0 Request processed in 108us (212us total) trans 4295010152 rc 0/0 00000100:00100000:1.0:1713279306.982009:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110619 00000100:00100000:0.0:1713279306.983725:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279306.983764:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281315456 00000100:00100000:3.0:1713279306.983768:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281315456 00000100:00100000:3.0:1713279306.983788:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223166 00000100:00100000:3.0:1713279306.983791:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3723:12105:x1796503281315456:12345-192.168.203.4@tcp:35:fallocate.0 00000100:00100000:3.0:1713279306.983876:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:12105:x1796503281315456:12345-192.168.203.4@tcp:35:fallocate.0 Request processed in 83us (152us total) trans 4295202826 rc 0/0 00000100:00100000:3.0:1713279306.983881:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223166 00010000:00010000:2.0:1713279307.208757:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279307.330768:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200066432:0@lo:400:kworker.0 00000100:00100000:2.0:1713279307.330781:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200066368:0@lo:400:kworker.0 00000100:00100000:1.0:1713279307.330790:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200066496:0@lo:400:kworker.0 00000100:00100000:3.0:1713279307.330798:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200066560:0@lo:400:kworker.0 00000100:00100000:2.0:1713279307.330861:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279307.330865:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279307.330867:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279307.330890:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200066624:0@lo:400:kworker.0 00000100:00100000:3.0:1713279307.330893:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200066496 00000100:00100000:1.0:1713279307.330898:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200066752:0@lo:400:kworker.0 00000100:00100000:3.0:1713279307.330901:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200066496 00000100:00100000:0.0:1713279307.330909:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200066688:0@lo:400:kworker.0 00000100:00100000:2.0:1713279307.330912:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279307.330921:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279307.330928:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200066880:0@lo:400:kworker.0 00000100:00100000:1.0:1713279307.330937:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200067008:0@lo:400:kworker.0 00000100:00100000:3.0:1713279307.330943:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200066624 00000100:00100000:0.0:1713279307.330944:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279307.330946:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200066624 00000100:00100000:2.0:1713279307.330949:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279307.330964:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200066432 00000100:00100000:3.0:1713279307.330965:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98952 00000100:00100000:1.0:1713279307.330970:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200066432 00000100:00100000:3.0:1713279307.330972:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:3491:x1796503200066496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279307.330975:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200067136:0@lo:400:kworker.0 00000100:00100000:0.0:1713279307.330977:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200066944:0@lo:400:kworker.0 00000100:00100000:2.0:1713279307.330993:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279307.330999:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200066752 00000100:00100000:1.0:1713279307.331001:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200066752 00000100:00100000:0.0:1713279307.331008:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279307.331024:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200066688 00000100:00100000:1.0:1713279307.331027:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200066688 00000100:00100000:2.0:1713279307.331027:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200066880 00000100:00100000:3.0:1713279307.331027:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:3491:x1796503200066496:12345-0@lo:400:kworker.0 Request processed in 54us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279307.331032:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200066880 00000100:00100000:3.0:1713279307.331034:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98952 00000100:00100000:1.0:1713279307.331041:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200066944 00000100:00100000:1.0:1713279307.331043:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200066944 00000100:00100000:3.0:1713279307.331052:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98953 00000100:00100000:3.0:1713279307.331056:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+92:3493:x1796503200066624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279307.331058:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1713279307.331059:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067136 00000100:00100000:2.0:1713279307.331062:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067136 00000100:00100000:1.0:1713279307.331108:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200066432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279307.331123:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1713279307.331128:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3493:x1796503200066880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279307.331131:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+92:3493:x1796503200066624:12345-0@lo:400:kworker.0 Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279307.331137:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98953 00000100:00100000:0.0:1713279307.331148:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1713279307.331154:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200066368 00000100:00100000:1.0:1713279307.331156:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200066432:12345-0@lo:400:kworker.0 Request processed in 91us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279307.331157:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200066752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279307.331157:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200066368 00000100:00100000:2.0:1713279307.331162:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3493:x1796503200066880:12345-0@lo:400:kworker.0 Request processed in 33us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279307.331164:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1713279307.331168:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1713279307.331177:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1713279307.331178:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1713279307.331180:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1713279307.331181:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200066368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279307.331182:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200066688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279307.331183:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200067136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279307.331196:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200066432:0@lo:400:kworker.0 00000100:00100000:3.0:1713279307.331211:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200066368:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279307.331212:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200066688:12345-0@lo:400:kworker.0 Request processed in 30us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279307.331213:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200067136:12345-0@lo:400:kworker.0 Request processed in 29us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279307.331216:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1713279307.331217:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1713279307.331218:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1713279307.331223:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200066688:0@lo:400:kworker.0 00000100:00100000:1.0:1713279307.331225:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1713279307.331228:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200066944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279307.331238:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279307.331247:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200066368:0@lo:400:kworker.0 00000100:00100000:3.0:1713279307.331251:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200066816:0@lo:400:kworker.0 00000100:00100000:2.0:1713279307.331257:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200066624:0@lo:400:kworker.0 00000100:00100000:1.0:1713279307.331258:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200066944:12345-0@lo:400:kworker.0 Request processed in 28us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279307.331263:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1713279307.331266:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200066880:0@lo:400:kworker.0 00000100:00100000:0.0:1713279307.331268:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200066944:0@lo:400:kworker.0 00000100:00100000:3.0:1713279307.331269:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279307.331270:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200066560 00000100:00100000:1.0:1713279307.331272:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200066560 00000100:00100000:2.0:1713279307.331273:0:3493:0:(client.c:2953:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4295010018 gen 2 00000004:00080000:2.0:1713279307.331278:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295009935 committed transno 4295010018 00000100:00100000:3.0:1713279307.331278:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200067072:0@lo:400:kworker.0 00000100:00100000:1.0:1713279307.331284:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1713279307.331288:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200066560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279307.331290:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713279307.331294:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295009943 committed transno 4295010018 00000004:00080000:2.0:1713279307.331307:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295009947 committed transno 4295010018 00000100:00100000:1.0:1713279307.331314:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200066560:12345-0@lo:400:kworker.0 Request processed in 25us (75us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279307.331314:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200066816 00000100:00100000:0.0:1713279307.331317:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200066752:12345-0@lo:400:kworker.0 Request processed in 158us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279307.331317:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200066816 00000100:00100000:1.0:1713279307.331319:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000004:00080000:2.0:1713279307.331323:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295009968 committed transno 4295010018 00000100:00100000:0.0:1713279307.331327:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00080000:1.0:1713279307.331330:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279277 00000100:00080000:1.0:1713279307.331344:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279277 00000004:00080000:2.0:1713279307.331346:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295009998 committed transno 4295010018 00000100:00080000:1.0:1713279307.331347:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279277 00000100:00080000:1.0:1713279307.331348:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279277 00000100:00080000:1.0:1713279307.331350:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279277 00000100:00100000:3.0:1713279307.331352:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067072 00000100:00100000:3.0:1713279307.331354:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067072 00000004:00080000:2.0:1713279307.331358:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010003 committed transno 4295010018 00000100:00100000:1.0:1713279307.331362:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279307.331366:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000004:00080000:2.0:1713279307.331370:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010018 committed transno 4295010018 00000100:00100000:3.0:1713279307.331370:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3492:x1796503200066816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279307.331372:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1713279307.331380:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3492:x1796503200067072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279307.331382:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200067136:0@lo:400:kworker.0 00000100:00100000:1.0:1713279307.331384:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200066496:0@lo:400:kworker.0 00000100:00100000:1.0:1713279307.331393:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200066752:0@lo:400:kworker.0 00000100:00100000:3.0:1713279307.331394:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3492:x1796503200066816:12345-0@lo:400:kworker.0 Request processed in 23us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279307.331399:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1713279307.331436:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067008 00000100:00100000:2.0:1713279307.331439:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067008 00000100:00080000:2.0:1713279307.331450:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279277 00000100:00100000:3.0:1713279307.331454:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200066560:0@lo:400:kworker.0 00000100:00100000:3.0:1713279307.331463:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200066816:0@lo:400:kworker.0 00000100:00100000:0.0:1713279307.331466:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3492:x1796503200067072:12345-0@lo:400:kworker.0 Request processed in 86us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279307.331471:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1713279307.331472:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200067072:0@lo:400:kworker.0 00000100:00100000:0.0:1713279307.331473:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1713279307.331475:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200067008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279307.331504:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200067008:12345-0@lo:400:kworker.0 Request processed in 29us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279307.331509:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1713279307.331527:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200067008:0@lo:400:kworker.0 00000004:00080000:2.0:1713279307.346581:0:11414:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410159165368ns, next at 411159163191ns, rc = 0 00000004:00080000:0.0:1713279307.346583:0:11409:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 410159167285ns, next at 411159165681ns, rc = 0 00000100:00100000:0.0:1713279307.346615:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200067200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279307.346617:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200067264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279307.346671:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279307.346698:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067200 00000100:00100000:2.0:1713279307.346700:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279307.346706:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067200 00000100:00100000:1.0:1713279307.346748:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067264 00000100:00100000:1.0:1713279307.346751:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067264 00000100:00100000:0.0:1713279307.346754:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1713279307.346761:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200067200:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279307.346769:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1713279307.346776:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+14:3491:x1796503200067264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279307.346788:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:1.0:1713279307.346792:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279307.346825:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200067200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279307.346832:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1713279307.346846:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+14:3491:x1796503200067264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279307.346854:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1713279307.346868:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200067200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279307.346887:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200067264:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1713279308.066791:0:10044:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410879373971ns, next at 411879370975ns, rc = 0 00000100:00100000:1.0:1713279308.066807:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713279308.066833:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200067328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279308.066902:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279308.066982:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067328 00000100:00100000:2.0:1713279308.066993:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067328 00000100:00100000:2.0:1713279308.067097:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1713279308.067109:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3493:x1796503200067328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279308.067140:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980977344 pending 61440 free 3849093120 avail 3617570816 00000100:00100000:2.0:1713279308.067213:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3493:x1796503200067328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279308.067222:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1713279308.067269:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200067328:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1713279308.082578:0:10040:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 410895162965ns, next at 411895161291ns, rc = 0 00000100:00100000:1.0:1713279308.082618:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200067392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1713279308.082660:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279308.082727:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067392 00000100:00100000:2.0:1713279308.082734:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067392 00000100:00100000:2.0:1713279308.082778:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1713279308.082787:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+17:3493:x1796503200067392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279308.082808:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980977344 pending 61440 free 3849093120 avail 3617570816 00000100:00100000:2.0:1713279308.082858:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+17:3493:x1796503200067392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279308.082868:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1713279308.082878:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200067392:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1713279308.210709:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279308.891561:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279308.891613:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279308.891649:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279308.891671:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279308.891685:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281315520 00000100:00100000:0.0:1713279308.891699:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279308.891700:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281315520 00000100:00100000:0.0:1713279308.891721:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281315712 00000100:00100000:0.0:1713279308.891727:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281315712 00000100:00080000:2.0:1713279308.891747:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279278 00000100:00080000:2.0:1713279308.891755:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279278 00000100:00100000:0.0:1713279308.891758:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281315776 00000100:00100000:1.0:1713279308.891758:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281315584 00000100:00100000:0.0:1713279308.891761:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281315776 00000100:00100000:3.0:1713279308.891766:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 383 00000100:00100000:1.0:1713279308.891768:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281315584 00000100:00100000:3.0:1713279308.891777:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281315520:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279308.891780:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:2.0:1713279308.891790:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+93:1956:x1796503281315712:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279308.891797:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:0.0:1713279308.891805:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+87:1957:x1796503281315776:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279308.891805:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281315648 00000100:00100000:1.0:1713279308.891807:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281315648 00000100:00100000:1.0:1713279308.891829:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 433 00000100:00100000:1.0:1713279308.891836:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3725:1956:x1796503281315584:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279308.891861:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+93:1956:x1796503281315712:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279308.891862:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+87:1957:x1796503281315776:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 56us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279308.891862:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281315520:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 84us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279308.891869:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:2.0:1713279308.891874:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:3.0:1713279308.891875:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 383 00000100:00100000:1.0:1713279308.891891:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3725:1956:x1796503281315584:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 55us (277us total) trans 0 rc 0/0 00000100:00080000:2.0:1713279308.891896:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279278 00000100:00100000:1.0:1713279308.891899:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 433 00000100:00080000:2.0:1713279308.891899:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279278 00000100:00080000:2.0:1713279308.891902:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279278 00000100:00100000:0.0:1713279308.891911:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279308.891915:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 434 00000100:00100000:2.0:1713279308.891920:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3671:1957:x1796503281315648:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279308.891929:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281315840 00000100:00100000:1.0:1713279308.891932:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281315840 00000100:00080000:2.0:1713279308.891957:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279278 00000100:00100000:1.0:1713279308.891964:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 435 00000100:00100000:1.0:1713279308.891969:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:1956:x1796503281315840:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279308.891977:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3671:1957:x1796503281315648:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 54us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279308.891980:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279308.891989:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 434 00000100:00100000:1.0:1713279308.892007:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:1956:x1796503281315840:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279308.892009:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279308.892011:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281315904 00000100:00100000:1.0:1713279308.892015:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 435 00000100:00100000:3.0:1713279308.892017:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281315904 00000100:00080000:2.0:1713279308.892048:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279278 00000100:00100000:0.0:1713279308.892051:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279308.892099:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 436 00000100:00100000:3.0:1713279308.892108:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3464:1957:x1796503281315904:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279308.892167:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3464:1957:x1796503281315904:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 57us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279308.892179:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 436 00000100:00100000:3.0:1713279308.892206:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316032 00000100:00100000:3.0:1713279308.892211:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316032 00000100:00100000:3.0:1713279308.892267:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281315968 00000100:00100000:3.0:1713279308.892272:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281315968 00000100:00080000:2.0:1713279308.892281:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279278 00000100:00080000:2.0:1713279308.892287:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279278 00000100:00100000:3.0:1713279308.892309:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:0.0:1713279308.892320:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:3.0:1713279308.892320:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+111:1957:x1796503281316032:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279308.892329:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:1956:x1796503281315968:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279308.892370:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+111:1957:x1796503281316032:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 50us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279308.892373:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+101:1956:x1796503281315968:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279308.892382:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:0.0:1713279308.892392:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 84 00010000:00010000:2.0:1713279309.212751:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279309.986680:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200067456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279309.986751:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279309.986812:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067456 00000100:00100000:2.0:1713279309.986824:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067456 00000100:00100000:2.0:1713279309.986883:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98954 00000100:00100000:2.0:1713279309.986891:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+92:3490:x1796503200067456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279309.986929:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279309.986999:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+92:3490:x1796503200067456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279309.987007:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98954 00000100:00100000:0.0:1713279309.987158:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200067456:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1713279310.214602:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279311.216782:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279311.666623:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200067520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713279311.666671:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279311.666708:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067520 00000100:00100000:0.0:1713279311.666715:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067520 00000100:00100000:0.0:1713279311.666758:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98955 00000100:00100000:0.0:1713279311.666765:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:3491:x1796503200067520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713279311.666794:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:0.0:1713279311.666843:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:3491:x1796503200067520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279311.666850:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98955 00000100:00100000:2.0:1713279311.666866:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200067520:0@lo:41:osp-pre-0-1.0 00000004:00080000:0.0:1713279311.892700:0:8061:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 773 committed 00000004:00080000:0.0:1713279311.892725:0:8061:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 763 committed 00010000:00010000:0.0:1713279311.892793:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bc900/0xfc4b8e114edaae5b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114edaae70 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713279311.892808:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bc900/0xfc4b8e114edaae5b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114edaae70 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279311.892840:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bc900/0xfc4b8e114edaae5b lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaae70 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279311.892846:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1713279311.892857:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200067648:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1713279311.892857:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200067584:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1713279311.892864:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800935bc900/0xfc4b8e114edaae5b lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaae70 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.892875:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda9525 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279311.892885:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096a2fcc0/0xfc4b8e114edaaab1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114edaaab8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.892889:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda9525 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00000004:00010000:0.0:1713279311.892893:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096a2fcc0/0xfc4b8e114edaaab1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114edaaab8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.892903:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda9525 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279311.892905:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096a2fcc0/0xfc4b8e114edaaab1 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaaab8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.892909:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092342400 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279311.892913:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda9525 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279311.892917:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713279311.892920:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda9525 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279311.892922:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096a2fcc0/0xfc4b8e114edaaab1 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaaab8 expref: -99 pid: 15534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.892934:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x134:0x0].0x3631 (ffff88012fbfe000) 00010000:00010000:0.0:1713279311.892936:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.892937:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279311.892938:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279311.892940:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279311.892941:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda9525 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000004:00010000:0.0:1713279311.892942:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.892947:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092342400/0xfc4b8e114eda9525 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x134:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279311.892954:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279311.892959:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713279311.892964:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800906e8900/0xfc4b8e114edaa5e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaa5e8 expref: -99 pid: 15658 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713279311.892972:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f38b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200067840:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1713279311.892973:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279311.892976:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce51680/0xfc4b8e114edaa498 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114edaa49f expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.892980:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00000004:00010000:0.0:1713279311.892982:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce51680/0xfc4b8e114edaa498 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114edaa49f expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.892986:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279311.892991:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092340b40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279311.892993:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279311.892994:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279311.892995:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce51680/0xfc4b8e114edaa498 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaa49f expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.892999:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279311.893000:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1713279311.893005:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200067712:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1713279311.893007:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7642:0x0].0x0 (ffff88012fbfe100) 00000100:00100000:2.0:1713279311.893008:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1713279311.893009:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ce51680/0xfc4b8e114edaa498 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114edaa49f expref: -99 pid: 15525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.893010:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1713279311.893013:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279311.893014:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200067904:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1713279311.893018:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092340b40/0xfc4b8e114eda952c lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x7642:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279311.893028:0:8061:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092343a80/0xfc4b8e114eda94b5 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfc4b8e114eda9509 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.893031:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda96de lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00000004:00010000:0.0:1713279311.893062:0:8061:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092343a80/0xfc4b8e114eda94b5 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfc4b8e114eda9509 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.893064:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda96de lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00000100:00100000:1.0:1713279311.893065:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279311.893070:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda96de lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279311.893075:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b6400 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279311.893077:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067840 00010000:00010000:3.0:1713279311.893078:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda96de lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.893079:0:8061:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092343a80/0xfc4b8e114eda94b5 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda9509 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.893083:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda96de lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.893085:0:8061:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713279311.893085:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067840 00010000:00010000:3.0:1713279311.893091:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x3331 (ffff8801250c1100) 00010000:00010000:0.0:1713279311.893092:0:8061:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092343a80/0xfc4b8e114eda94b5 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfc4b8e114eda9509 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.893093:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279311.893096:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda96de lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00000100:00100000:1.0:1713279311.893098:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200067968:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1713279311.893101:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b6400/0xfc4b8e114eda96de lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00000001:00080000:0.0:1713279311.893103:0:8061:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4295183829 is committed 00010000:00010000:3.0:1713279311.893116:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda9708 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00000001:00080000:0.0:1713279311.893117:0:8061:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4295183826 is committed 00000100:00100000:2.0:1713279311.893121:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067712 00010000:00010000:3.0:1713279311.893122:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda9708 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00000100:00100000:1.0:1713279311.893123:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279311.893124:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067712 00010000:00010000:3.0:1713279311.893128:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda9708 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279311.893132:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131f3f3c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279311.893135:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda9708 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00000100:00100000:1.0:1713279311.893139:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713279311.893139:0:15557:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067968 00010000:00010000:3.0:1713279311.893140:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda9708 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT1 00000100:00100000:2.0:1713279311.893141:0:15557:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067968 00000100:00100000:1.0:1713279311.893147:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200067776:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1713279311.893147:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3331 (ffff8801250c1000) 00010000:00010000:3.0:1713279311.893149:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279311.893152:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda9708 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00000100:00100000:2.0:1713279311.893157:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147293 00010000:00010000:3.0:1713279311.893157:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3f3c0/0xfc4b8e114eda9708 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00000020:00080000:0.0:1713279311.893159:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880097df83c0 refcount 2 committed 0 result 0 batchid 17688 00000020:00080000:0.0:1713279311.893163:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008bde0b00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880120513b40 00000100:00100000:2.0:1713279311.893164:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+57:3492:x1796503200067840:12345-0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1713279311.893167:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096b8e400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880097df8180 00000100:00100000:1.0:1713279311.893168:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279311.893168:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00000020:00080000:0.0:1713279311.893170:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2156 00000020:00080000:0.0:1713279311.893173:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096b8e600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008f55bc00 00010000:00010000:3.0:1713279311.893173:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00010000:00010000:2.0:1713279311.893175:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1713279311.893176:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1549 00010000:00010000:3.0:1713279311.893178:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279311.893183:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131f3c240 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279311.893185:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279311.893191:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT1 00000020:00080000:0.0:1713279311.893194:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8801250c0600 refcount 2 committed 0 result 0 batchid 17687 00000020:00080000:0.0:1713279311.893197:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007fdcae00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8801250c0cc0 00000100:00100000:1.0:1713279311.893198:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067776 00010000:00010000:3.0:1713279311.893198:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ad1:0x0].0x0 (ffff880082706a00) 00000020:00080000:0.0:1713279311.893200:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880090371e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8801250c09c0 00010000:00010000:3.0:1713279311.893200:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000020:00080000:0.0:1713279311.893202:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2155 00010000:00010000:3.0:1713279311.893203:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00000100:00100000:1.0:1713279311.893204:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067776 00000020:00080000:0.0:1713279311.893205:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800937ce400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800928d0800 00000020:00080000:0.0:1713279311.893208:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1548 00010000:00010000:3.0:1713279311.893208:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131f3c240/0xfc4b8e114eda970f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7ad1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00010000:00010000:3.0:1713279311.893219:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539d40/0xfc4b8e114eda9f2e lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279311.893225:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539d40/0xfc4b8e114eda9f2e lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279311.893230:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539d40/0xfc4b8e114eda9f2e lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279311.893234:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c539d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279311.893237:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539d40/0xfc4b8e114eda9f2e lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279311.893242:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539d40/0xfc4b8e114eda9f2e lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00000100:00100000:1.0:1713279311.893243:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147294 00010000:00010000:3.0:1713279311.893249:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x3731 (ffff88008ad67e00) 00010000:00010000:3.0:1713279311.893251:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279311.893252:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+58:3490:x1796503200067712:12345-0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1713279311.893254:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88012ffbdc00 refcount 2 committed 0 result 0 batchid 17686 00010000:00010000:3.0:1713279311.893254:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539d40/0xfc4b8e114eda9f2e lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00000020:00080000:0.0:1713279311.893256:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880096b8ef00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091a0e540 00000020:00080000:0.0:1713279311.893259:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2154 00010000:00010000:3.0:1713279311.893259:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539d40/0xfc4b8e114eda9f2e lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00000020:00080000:0.0:1713279311.893262:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012d397800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880093a46800 00000020:00080000:0.0:1713279311.893265:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1547 00010000:00010000:1.0:1713279311.893270:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279311.893270:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda9f4a lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:2.0:1713279311.893274:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134971f80/0xfc4b8e114edaa5e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x140:0x0].0x0 bits 0x7f/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114edaa5e1 expref: 58 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.893275:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda9f4a lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00000020:00080000:0.0:1713279311.893278:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880096540840 refcount 2 committed 0 result 0 batchid 17685 00000020:00080000:0.0:1713279311.893281:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800960e8e00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880096540f00 00010000:00010000:3.0:1713279311.893281:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda9f4a lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00000020:00080000:0.0:1713279311.893283:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800960e8300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8800965403c0 00010000:00010000:3.0:1713279311.893285:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c53ba80 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:0.0:1713279311.893286:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2153 00010000:00010000:3.0:1713279311.893288:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda9f4a lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00000020:00080000:0.0:1713279311.893289:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800960e8700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880095713e00 00010000:00010000:2.0:1713279311.893290:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x140:0x0].0x0 (ffff88008e4c3e00) 00000020:00080000:0.0:1713279311.893291:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1546 00010000:00010000:1.0:1713279311.893292:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801245b61c0/0xfc4b8e114edaae70 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24c:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114edaae5b expref: 57 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.893293:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda9f4a lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279311.893299:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3731 (ffff88012d397100) 00010000:00010000:2.0:1713279311.893301:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279311.893301:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279311.893304:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda9f4a lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279311.893309:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c53ba80/0xfc4b8e114eda9f4a lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279311.893320:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x36 (ffff88009588cf00) 00010000:00010000:3.0:1713279311.893321:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279311.893326:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:1.0:1713279311.893331:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279311.893331:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00000100:00100000:2.0:1713279311.893334:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+56:3492:x1796503200067840:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 169us (338us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279311.893340:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c538900 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279311.893341:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147293 00010000:00010000:3.0:1713279311.893343:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00000001:00080000:0.0:1713279311.893344:0:8061:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4295183752 is committed 00010000:00010000:3.0:1713279311.893348:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00010000:00010000:3.0:1713279311.893355:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7ae1:0x0].0x0 (ffff880091738f00) 00010000:00010000:3.0:1713279311.893357:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1713279311.893359:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00000100:00100000:2.0:1713279311.893361:0:15557:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147295 00010000:00010000:3.0:1713279311.893364:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538900/0xfc4b8e114eda9f51 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7ae1:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00000100:00100000:2.0:1713279311.893366:0:15557:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+55:3490:x1796503200067968:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1713279311.893373:0:15557:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279311.893374:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114edaa188 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279311.893379:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114edaa188 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279311.893383:0:15557:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935bcb40/0xfc4b8e114eda9509 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24a:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114eda94b5 expref: 55 pid: 15580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.893384:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114edaa188 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279311.893389:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c86ad00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279311.893391:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114edaa188 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279311.893393:0:15557:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24a:0x0].0x3631 (ffff88008c124700) 00000020:00080000:0.0:1713279311.893396:0:8061:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880096540e40 refcount 2 committed 0 result 0 batchid 17684 00000100:00100000:1.0:1713279311.893396:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+54:3490:x1796503200067712:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 141us (328us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279311.893397:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114edaa188 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00010000:00010000:2.0:1713279311.893400:0:15557:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1713279311.893401:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880136671900 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880096540c00 00010000:00010000:3.0:1713279311.893403:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x264:0x0].0x3131 (ffff880096b8ee00) 00000020:00080000:0.0:1713279311.893405:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880091b1c700 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880096540d80 00010000:00010000:3.0:1713279311.893406:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713279311.893408:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147294 00010000:00010000:3.0:1713279311.893408:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114edaa188 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x264:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000020:00080000:0.0:1713279311.893409:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012fbfe300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880096540f00 00010000:00010000:3.0:1713279311.893443:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c86ad00/0xfc4b8e114edaa188 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x264:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279311.893455:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11440/0xfc4b8e114edaa23e lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279311.893461:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11440/0xfc4b8e114edaa23e lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279311.893467:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11440/0xfc4b8e114edaa23e lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279311.893468:0:15557:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+54:3490:x1796503200067968:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 99us (343us total) trans 0 rc 0/0 00010000:00010000:3.0:1713279311.893472:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd11440 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:0.0:1713279311.893473:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0xf8:0x0].2152 00010000:00010000:3.0:1713279311.893474:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11440/0xfc4b8e114edaa23e lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00000100:00100000:2.0:1713279311.893475:0:15557:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147295 00000020:00080000:0.0:1713279311.893476:0:8061:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012fbfef00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012fa0c000 00000020:00080000:0.0:1713279311.893479:0:8061:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x1c0:0x0].1545 00010000:00010000:3.0:1713279311.893479:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11440/0xfc4b8e114edaa23e lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279311.893480:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147296 00000100:00100000:1.0:1713279311.893486:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+52:3490:x1796503200067776:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1713279311.893486:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x242:0x0].0x3131 (ffff880096b8e100) 00010000:00010000:3.0:1713279311.893489:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279311.893491:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11440/0xfc4b8e114edaa23e lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279311.893495:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713279311.893496:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11440/0xfc4b8e114edaa23e lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x242:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:3.0:1713279311.893506:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279311.893508:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f0873c0/0xfc4b8e114edaaab8 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24c:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114edaaab1 expref: 52 pid: 15494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713279311.893509:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda938f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7d29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279311.893512:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279311.893517:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda938f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7d29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279311.893518:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279311.893519:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x35 (ffff880097910400) 00010000:00010000:3.0:1713279311.893522:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd11f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279311.893525:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15502 initiator: MDT1 00010000:00010000:1.0:1713279311.893526:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713279311.893529:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda938f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7d29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279311.893530:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279311.893535:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008dae3180 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:2.0:1713279311.893535:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713279311.893537:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6c09:0x0].0x0 (ffff880122263f00) 00010000:00010000:0.0:1713279311.893538:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda938f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7d29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279311.893539:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1713279311.893541:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00010000:00010000:0.0:1713279311.893544:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda938f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7d29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279311.893546:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fd11f80/0xfc4b8e114edaa245 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x6c09:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15502 initiator: MDT1 00000100:00100000:1.0:1713279311.893551:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+51:3490:x1796503200067776:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 65us (383us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279311.893555:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d29:0x0].0x0 (ffff88009e797300) 00010000:00010000:3.0:1713279311.893556:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114edaa762 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:1.0:1713279311.893557:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147296 00010000:00010000:0.0:1713279311.893558:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.893561:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda938f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7d29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279311.893562:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114edaa762 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713279311.893566:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f38b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200067840:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279311.893567:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dae3180/0xfc4b8e114eda938f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7d29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279311.893567:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067904 00010000:00010000:3.0:1713279311.893567:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114edaa762 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00000100:00100000:1.0:1713279311.893571:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067904 00010000:00010000:3.0:1713279311.893572:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ba9200 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279311.893574:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114edaa762 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279311.893580:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114edaa762 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x260:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.893584:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9820 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279311.893588:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x260:0x0].0x3031 (ffff880095455d00) 00010000:00010000:0.0:1713279311.893590:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9820 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279311.893590:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147297 00010000:00010000:3.0:1713279311.893590:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279311.893593:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114edaa762 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:1.0:1713279311.893595:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+51:3492:x1796503200067904:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279311.893596:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9820 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279311.893598:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ba9200/0xfc4b8e114edaa762 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x260:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.893601:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf5b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:1.0:1713279311.893602:0:6916:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713279311.893603:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9820 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.893609:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9820 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279311.893609:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114edaa770 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713279311.893611:0:6916:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce53a80/0xfc4b8e114edaa49f lrc: 0/0,0 mode: --/PW res: [0x200000400:0x24c:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfc4b8e114edaa498 expref: 51 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279311.893614:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114edaa770 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.893617:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7364:0x0].0x0 (ffff88012bacd300) 00010000:00010000:0.0:1713279311.893619:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279311.893619:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114edaa770 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.893623:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9820 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:3.0:1713279311.893624:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091bab840 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:3.0:1713279311.893626:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114edaa770 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.893628:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf5b00/0xfc4b8e114eda9820 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:1.0:1713279311.893628:0:6916:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x24c:0x0].0x3131 (ffff88009e5e1200) 00010000:00010000:3.0:1713279311.893632:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114edaa770 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00000020:00080000:2.0:1713279311.893633:0:8082:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 17688 committed batchid 17683 00010000:00010000:1.0:1713279311.893634:0:6916:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713279311.893638:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x25b:0x0].0x3031 (ffff880094169700) 00010000:00010000:0.0:1713279311.893640:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda9b8b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x717a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279311.893640:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279311.893642:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114edaa770 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.893645:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda9b8b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x717a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279311.893648:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bab840/0xfc4b8e114edaa770 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x25b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.893650:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda9b8b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x717a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713279311.893654:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200067904:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 58us (119us total) trans 0 rc 0/0 00010000:00010000:0.0:1713279311.893655:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d321680 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.893658:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda9b8b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x717a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279311.893658:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:1.0:1713279311.893660:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147297 00010000:00010000:0.0:1713279311.893664:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda9b8b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x717a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279311.893664:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279311.893670:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.893672:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x717a:0x0].0x0 (ffff880090aad100) 00010000:00010000:0.0:1713279311.893674:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279311.893675:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091baa640 already unused, calling callback (ffffffffa0f0d730) 00000020:00080000:2.0:1713279311.893676:0:8082:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17683 00010000:00010000:0.0:1713279311.893677:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda9b8b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x717a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279311.893677:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.893682:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d321680/0xfc4b8e114eda9b8b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x717a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713279311.893682:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713279311.893689:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7abf:0x0].0x0 (ffff8800938abf00) 00010000:00010000:3.0:1713279311.893691:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1713279311.893694:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.893695:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda9e08 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7d55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279311.893699:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baa640/0xfc4b8e114edaa777 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7abf:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:1.0:1713279311.893700:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200067776:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279311.893701:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda9e08 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7d55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00000100:00100000:2.0:1713279311.893704:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200067904:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279311.893707:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda9e08 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7d55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279311.893709:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda9579 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7aed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279311.893710:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200067968:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279311.893712:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe14900 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.893715:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda9e08 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7d55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279311.893715:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda9579 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7aed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279311.893717:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200067712:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1713279311.893720:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda9e08 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7d55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279311.893720:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda9579 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7aed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:3.0:1713279311.893724:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd6640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.893727:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d55:0x0].0x0 (ffff88008c124000) 00010000:00010000:3.0:1713279311.893727:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda9579 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7aed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279311.893729:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.893732:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda9e08 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7d55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279311.893733:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda9579 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7aed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279311.893737:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe14900/0xfc4b8e114eda9e08 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7d55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279311.893740:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7aed:0x0].0x0 (ffff88008eb9f200) 00000100:00100000:1.0:1713279311.893742:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067584 00010000:00010000:3.0:1713279311.893742:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713279311.893744:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda9579 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7aed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279311.893746:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067584 00010000:00010000:0.0:1713279311.893748:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda9e0f lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7321:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15481 initiator: MDT1 00010000:00010000:3.0:1713279311.893750:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd6640/0xfc4b8e114eda9579 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7aed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279311.893753:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda9e0f lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x7321:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279311.893758:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda9e0f lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7321:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279311.893763:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fe158c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.893765:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda9e0f lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7321:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279311.893769:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200067648 00000100:00080000:2.0:1713279311.893769:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279281 00010000:00010000:0.0:1713279311.893771:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda9e0f lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x7321:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15481 initiator: MDT1 00000100:00100000:1.0:1713279311.893771:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200067648 00000100:00100000:3.0:1713279311.893778:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110620 00010000:00010000:0.0:1713279311.893779:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7321:0x0].0x0 (ffff880095455500) 00010000:00010000:0.0:1713279311.893781:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.893783:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda9e0f lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x7321:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00000100:00100000:3.0:1713279311.893786:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a05f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3492:x1796503200067584:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1713279311.893788:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fe158c0/0xfc4b8e114eda9e0f lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x7321:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15481 initiator: MDT1 00010000:00010000:0.0:1713279311.893800:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114edaa0e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x70ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00000100:00080000:2.0:1713279311.893800:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279281 00000100:00100000:1.0:1713279311.893805:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110621 00010000:00010000:0.0:1713279311.893806:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114edaa0e0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x70ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00000100:00100000:1.0:1713279311.893810:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:3493:x1796503200067648:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1713279311.893811:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114edaa0e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x70ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279311.893815:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf46c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.893818:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114edaa0e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x70ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279311.893823:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114edaa0e0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x70ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279311.893830:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x70ad:0x0].0x0 (ffff88008dba4c00) 00010000:00010000:0.0:1713279311.893832:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.893835:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114edaa0e0 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x70ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279311.893840:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf46c0/0xfc4b8e114edaa0e0 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x70ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279311.893851:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114edaa356 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7d64:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279311.893856:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114edaa356 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7d64:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279311.893861:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114edaa356 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7d64:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279311.893866:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d320d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.893868:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114edaa356 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7d64:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279311.893874:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114edaa356 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7d64:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279311.893880:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7d64:0x0].0x0 (ffff880096696c00) 00010000:00010000:0.0:1713279311.893882:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.893884:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114edaa356 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7d64:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279311.893889:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d320d80/0xfc4b8e114edaa356 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7d64:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279311.893902:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edaa516 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x75a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279311.893907:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edaa516 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x75a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279311.893913:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edaa516 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x75a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279311.893921:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801298ecb40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.893924:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edaa516 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x75a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279311.893930:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edaa516 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x75a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279311.893937:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x75a8:0x0].0x0 (ffff8800908e1000) 00010000:00010000:0.0:1713279311.893939:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.893941:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edaa516 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x75a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279311.893946:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edaa516 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x75a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15752 initiator: MDT1 00010000:00010000:0.0:1713279311.893958:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114edaa707 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279311.893963:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114edaa707 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279311.893969:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114edaa707 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279311.893973:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938fcfc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.893976:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114edaa707 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279311.893981:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114edaa707 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279311.893988:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x72a2:0x0].0x0 (ffff8800927b4000) 00010000:00010000:0.0:1713279311.893991:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.893993:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114edaa707 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279311.893999:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800938fcfc0/0xfc4b8e114edaa707 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x72a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15482 initiator: MDT1 00010000:00010000:0.0:1713279311.894009:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894015:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894020:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894024:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f2b600 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.894027:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894032:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894063:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x261:0x0].0x0 (ffff8800908e1900) 00010000:00010000:0.0:1713279311.894066:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.894069:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894074:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b600/0xfc4b8e114edaa50f lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x261:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894086:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00002000:00010000:3.0:1713279311.894089:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb size from disk: 40670 -> 40670 00010000:00010000:0.0:1713279311.894092:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00002000:00010000:1.0:1713279311.894093:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb size from disk: 15538 -> 15538 00002000:00010000:3.0:1713279311.894093:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279311.894096:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb atime from disk: 1713279304 -> 1713279304 00002000:00010000:1.0:1713279311.894097:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb mtime from disk: 1713279304 -> 1713279304 00010000:00010000:0.0:1713279311.894098:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00002000:00010000:3.0:1713279311.894098:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279311.894100:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:3.0:1713279311.894100:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb blocks from disk: 40 -> 40 00002000:00010000:1.0:1713279311.894102:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00010000:00010000:0.0:1713279311.894103:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f2b180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.894105:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00002000:00010000:1.0:1713279311.894105:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb blocks from disk: 64 -> 64 00010000:00010000:0.0:1713279311.894110:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894117:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x76ef:0x0].0x0 (ffff88008d729f00) 00010000:00010000:0.0:1713279311.894119:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:0.0:1713279311.894121:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894126:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f2b180/0xfc4b8e114edaa547 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x76ef:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894136:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114edaa5da lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894141:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114edaa5da lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279311.894143:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+15:3493:x1796503200067648:12345-0@lo:2:osp-syn-1-1.0 Request processed in 332us (1205us total) trans 4295010153 rc 0/0 00010000:00010000:0.0:1713279311.894146:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114edaa5da lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279311.894147:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a05f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+18:3492:x1796503200067584:12345-0@lo:2:osp-syn-0-1.0 Request processed in 361us (1208us total) trans 4295010216 rc 0/0 00010000:00010000:0.0:1713279311.894151:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f28000 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:1.0:1713279311.894151:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110621 00010000:00010000:0.0:1713279311.894153:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114edaa5da lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279311.894156:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110620 00010000:00010000:0.0:1713279311.894158:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114edaa5da lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894165:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x242:0x0].0x0 (ffff880135885d00) 00010000:00010000:0.0:1713279311.894167:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:0.0:1713279311.894170:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114edaa5da lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894175:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f28000/0xfc4b8e114edaa5da lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x242:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000004:00080000:1.0:1713279311.894181:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009764ce00/2, rc 0, transno 42857 00010000:00010000:0.0:1713279311.894185:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114edaa5d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279311.894188:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200067648:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1713279311.894190:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114edaa5d3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894195:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114edaa5d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894201:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f29b00 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.894205:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114edaa5d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894213:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114edaa5d3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894223:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x264:0x0].0x0 (ffff880093401d00) 00010000:00010000:0.0:1713279311.894227:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 7f 00010000:00010000:0.0:1713279311.894231:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114edaa5d3 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894238:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f29b00/0xfc4b8e114edaa5d3 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x264:0x0].0x0 bits 0x7f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:1.0:1713279311.894246:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713279311.894252:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200068096:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1713279311.894260:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114edaa984 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279311.894270:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114edaa984 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279311.894274:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279311.894279:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114edaa984 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279311.894284:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068096 00010000:00010000:0.0:1713279311.894287:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012baf4900 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279311.894288:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068096 00010000:00010000:0.0:1713279311.894291:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114edaa984 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279311.894291:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713279311.894297:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200068032:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1713279311.894299:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114edaa984 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713279311.894309:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110622 00010000:00010000:0.0:1713279311.894311:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71e6:0x0].0x0 (ffff880090bee600) 00000100:00100000:1.0:1713279311.894312:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279311.894314:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279311.894315:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+15:3493:x1796503200068096:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1713279311.894318:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114edaa984 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713279311.894328:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012baf4900/0xfc4b8e114edaa984 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713279311.894328:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068032 00000100:00100000:1.0:1713279311.894332:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068032 00010000:00010000:0.0:1713279311.894347:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaaa87 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x258:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00000100:00100000:1.0:1713279311.894350:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110623 00000100:00100000:1.0:1713279311.894355:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+16:3490:x1796503200068032:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1713279311.894356:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaaa87 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x258:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279311.894364:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaaa87 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x258:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279311.894372:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009181ef40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.894376:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaaa87 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x258:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279311.894385:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaaa87 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x258:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15480 initiator: MDT1 00010000:00010000:0.0:1713279311.894397:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x258:0x0].0x31 (ffff88011eea5b00) 00010000:00010000:0.0:1713279311.894400:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.894404:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaaa87 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x258:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000004:00080000:3.0:1713279311.894455:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800997f8000/2, rc 0, transno 42920 00010000:00010000:0.0:1713279311.894456:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009181ef40/0xfc4b8e114edaaa87 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x258:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15480 initiator: MDT1 00000100:00100000:3.0:1713279311.894465:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200067584:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1713279311.894482:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaab13 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7730:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894492:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaab13 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x7730:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894501:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaab13 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7730:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00000100:00100000:3.0:1713279311.894506:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1713279311.894509:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094550d80 already unused, calling callback (ffffffffa0f0d730) 00000100:00100000:3.0:1713279311.894513:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200068160:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1713279311.894514:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaab13 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7730:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894523:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaab13 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x7730:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894535:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7730:0x0].0x0 (ffff88012061fd00) 00010000:00010000:0.0:1713279311.894538:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713279311.894539:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713279311.894542:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaab13 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x7730:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00010000:00010000:0.0:1713279311.894550:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094550d80/0xfc4b8e114edaab13 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x7730:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15658 initiator: MDT1 00000100:00100000:2.0:1713279311.894561:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068160 00000100:00100000:2.0:1713279311.894567:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068160 00010000:00010000:0.0:1713279311.894568:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda9b4c lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894577:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda9b4c lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894585:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda9b4c lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894593:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091cbc000 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.894598:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda9b4c lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894606:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda9b4c lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT1 00000100:00100000:2.0:1713279311.894609:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110624 00010000:00010000:0.0:1713279311.894617:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x13a:0x0].0x3831 (ffff880130675800) 00000100:00100000:2.0:1713279311.894617:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+18:3492:x1796503200068160:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1713279311.894621:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.894625:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda9b4c lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894634:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091cbc000/0xfc4b8e114eda9b4c lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x13a:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894649:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9b61 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894659:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9b61 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894667:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9b61 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894681:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009524a640 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.894686:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9b61 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894694:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9b61 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894705:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3831 (ffff880130675100) 00010000:00010000:0.0:1713279311.894708:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.894712:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9b61 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894721:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009524a640/0xfc4b8e114eda9b61 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x233:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894738:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894749:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894757:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894765:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009524b180 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.894769:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894779:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894791:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x71e6:0x0].0x0 (ffff880090bee600) 00010000:00010000:0.0:1713279311.894796:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1713279311.894800:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894809:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009524b180/0xfc4b8e114eda9b68 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x71e6:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15526 initiator: MDT1 00010000:00010000:0.0:1713279311.894825:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda9e55 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x263:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.894831:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda9e55 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x263:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.894837:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda9e55 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x263:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.894859:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800950718c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.894861:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda9e55 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x263:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.894865:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda9e55 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x263:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.894872:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x263:0x0].0x36 (ffff8800954bed00) 00010000:00010000:0.0:1713279311.894873:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.894875:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda9e55 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x263:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.894879:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800950718c0/0xfc4b8e114eda9e55 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x263:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.894890:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda9ea9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.894894:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda9ea9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.894899:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda9ea9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.894903:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d980fc0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.894905:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda9ea9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.894909:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda9ea9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.895031:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x252:0x0].0x36 (ffff88008b918f00) 00010000:00010000:0.0:1713279311.895049:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.895053:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda9ea9 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.895057:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d980fc0/0xfc4b8e114eda9ea9 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x252:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.895067:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982640/0xfc4b8e114eda9eb0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x74f3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.895071:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982640/0xfc4b8e114eda9eb0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x74f3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.895076:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982640/0xfc4b8e114eda9eb0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x74f3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.895080:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d982640 already unused, calling callback (ffffffffa0f0d730) 00002000:00010000:3.0:1713279311.895080:0:15500:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000400:0x106b:0x0] updating lvb size from disk: 33128 -> 33128 00010000:00010000:0.0:1713279311.895082:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982640/0xfc4b8e114eda9eb0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x74f3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6942 initiator: MDT1 00002000:00010000:3.0:1713279311.895083:0:15500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x106b:0x0] updating lvb mtime from disk: 1605565498 -> 1605565498 00010000:00010000:0.0:1713279311.895086:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982640/0xfc4b8e114eda9eb0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x74f3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6942 initiator: MDT1 00002000:00010000:3.0:1713279311.895086:0:15500:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000400:0x106b:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:3.0:1713279311.895088:0:15500:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000400:0x106b:0x0] updating lvb ctime from disk: 1713279304 -> 1713279304 00002000:00010000:3.0:1713279311.895089:0:15500:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000400:0x106b:0x0] updating lvb blocks from disk: 72 -> 72 00010000:00010000:0.0:1713279311.895092:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x74f3:0x0].0x0 (ffff880096eff400) 00010000:00010000:0.0:1713279311.895094:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1713279311.895097:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982640/0xfc4b8e114eda9eb0 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x74f3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.895101:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d982640/0xfc4b8e114eda9eb0 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x74f3:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6942 initiator: MDT1 00010000:00010000:0.0:1713279311.895110:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114edaa4bb lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279311.895115:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114edaa4bb lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279311.895119:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114edaa4bb lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279311.895123:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd5f80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.895125:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114edaa4bb lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00000100:00100000:3.0:1713279311.895126:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3493:x1796503200068096:12345-0@lo:2:osp-syn-1-1.0 Request processed in 810us (851us total) trans 4295010154 rc 0/0 00010000:00010000:0.0:1713279311.895130:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114edaa4bb lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT1 00000100:00100000:3.0:1713279311.895132:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110622 00010000:00010000:0.0:1713279311.895135:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x3131 (ffff880097a5fd00) 00010000:00010000:0.0:1713279311.895137:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.895138:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114edaa4bb lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279311.895143:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd5f80/0xfc4b8e114edaa4bb lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x233:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279311.895150:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279311.895155:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279311.895160:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00000004:00080000:1.0:1713279311.895161:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009764dc00/2, rc 0, transno 42858 00010000:00010000:0.0:1713279311.895164:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091dd4d80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.895166:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15525 initiator: MDT1 00000100:00100000:1.0:1713279311.895167:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200068096:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1713279311.895170:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279311.895175:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7364:0x0].0x0 (ffff88012bacd300) 00010000:00010000:0.0:1713279311.895177:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1713279311.895178:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279311.895182:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091dd4d80/0xfc4b8e114edaa4c9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7364:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15525 initiator: MDT1 00010000:00010000:0.0:1713279311.895190:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114edaaac6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279311.895205:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114edaaac6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279311.895210:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114edaaac6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279311.895213:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013597cd80 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.895215:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114edaaac6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279311.895220:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114edaaac6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279311.895226:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x35 (ffff880094e7b100) 00010000:00010000:0.0:1713279311.895228:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713279311.895230:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114edaaac6 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279311.895234:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013597cd80/0xfc4b8e114edaaac6 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x233:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279311.895245:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279311.895249:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15534 initiator: MDT1 00002000:00010000:2.0:1713279311.895250:0:9197:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb size from disk: 15538 -> 15538 00010000:00010000:0.0:1713279311.895253:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00002000:00010000:2.0:1713279311.895254:0:9197:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb mtime from disk: 1713279304 -> 1713279304 00010000:00010000:0.0:1713279311.895257:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e68a640 already unused, calling callback (ffffffffa0f0d730) 00002000:00010000:2.0:1713279311.895257:0:9197:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00010000:00010000:0.0:1713279311.895259:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15534 initiator: MDT1 00002000:00010000:2.0:1713279311.895259:0:9197:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279311.895261:0:9197:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000400:0x1064:0x0] updating lvb blocks from disk: 64 -> 64 00010000:00010000:0.0:1713279311.895263:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279311.895268:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6ed2:0x0].0x0 (ffff8800939e3a00) 00010000:00010000:0.0:1713279311.895270:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1713279311.895272:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279311.895276:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e68a640/0xfc4b8e114edaaacd lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x6ed2:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15534 initiator: MDT1 00010000:00010000:0.0:1713279311.895284:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114edaae93 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.895288:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114edaae93 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.895293:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114edaae93 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.895296:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b46c0 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.895298:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114edaae93 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.895302:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114edaae93 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713279311.895302:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+17:3490:x1796503200068032:12345-0@lo:2:osp-syn-1-1.0 Request processed in 946us (988us total) trans 4295010155 rc 0/0 00010000:00010000:0.0:1713279311.895308:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x233:0x0].0x36 (ffff88009588c500) 00010000:00010000:0.0:1713279311.895309:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713279311.895309:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110623 00010000:00010000:0.0:1713279311.895311:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114edaae93 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.895315:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801245b46c0/0xfc4b8e114edaae93 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x233:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.895324:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000004:00080000:1.0:1713279311.895324:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009764fb80/2, rc 0, transno 42859 00010000:00010000:0.0:1713279311.895328:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00000100:00100000:1.0:1713279311.895328:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200068032:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1713279311.895332:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.895339:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e689d40 already unused, calling callback (ffffffffa0f0d730) 00010000:00010000:0.0:1713279311.895341:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.895346:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.895351:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7831:0x0].0x0 (ffff88008bde0600) 00010000:00010000:0.0:1713279311.895353:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1713279311.895355:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713279311.895359:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e689d40/0xfc4b8e114edaaea1 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7831:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00002000:00010000:0.0:1713279311.895946:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb size from disk: 40670 -> 40670 00002000:00010000:0.0:1713279311.895950:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279311.895952:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb atime from disk: 1713279304 -> 1713279304 00002000:00010000:0.0:1713279311.895954:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279311.895956:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x1012:0x0] updating lvb blocks from disk: 40 -> 40 00000001:00080000:2.0:1713279311.895987:0:10468:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4295010153 is committed 00000001:00080000:2.0:1713279311.895995:0:10468:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4295010152 is committed 00000100:00100000:0.0:1713279311.895999:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+19:3492:x1796503200068160:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1382us (1458us total) trans 4295010217 rc 0/0 00000100:00100000:0.0:1713279311.896006:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110624 00000001:00080000:2.0:1713279311.896008:0:10468:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4295010150 is committed 00000004:00080000:3.0:1713279311.896099:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c160e00/2, rc 0, transno 42921 00000100:00100000:3.0:1713279311.896107:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200068160:0@lo:2:osp-syn-0-1.0 00000001:00080000:1.0:1713279311.896486:0:9195:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4295010216 is committed 00000001:00080000:1.0:1713279311.896498:0:9195:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4295010215 is committed 00000001:00080000:1.0:1713279311.896502:0:9195:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4295010214 is committed 00000001:00080000:1.0:1713279311.896657:0:9195:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4295010106 is committed 00010000:00010000:2.0:1713279312.218614:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279312.297021:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279312.297110:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316096 00000100:00100000:3.0:1713279312.297118:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316096 00000100:00100000:3.0:1713279312.297167:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785658 00000100:00100000:3.0:1713279312.297173:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3724:12283:x1796503281316096:12345-192.168.203.4@tcp:101:df.0 00010000:00010000:3.0:1713279312.297186:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1713279312.297188:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279282 00010000:00010000:3.0:1713279312.297201:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114edab98a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176674 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279312.297241:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114edab991 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279312.297250:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114edab991 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279312.297257:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114edab991 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000004:00200000:3.0:1713279312.297286:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1713279312.297288:0:15485:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713279312.297313:0:15485:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114edab991 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279312.297325:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa640/0xfc4b8e114edab98a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176674 expref: 3726 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279312.297348:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab840/0xfc4b8e114edab991 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176674 expref: 3725 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279312.297353:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279312.297355:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713279312.297357:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bab840, rc 0) 00000100:00100000:3.0:1713279312.297396:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:12283:x1796503281316096:12345-192.168.203.4@tcp:101:df.0 Request processed in 223us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279312.297400:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785658 00000100:00100000:0.0:1713279312.299194:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279312.299261:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316160 00000100:00100000:3.0:1713279312.299265:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316160 00000100:00100000:3.0:1713279312.299288:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785659 00000100:00100000:3.0:1713279312.299292:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:12283:x1796503281316160:12345-192.168.203.4@tcp:41:df.0 00000004:00000024:3.0:1713279312.299322:0:15485:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7726223360 avail 7263117312 00000100:00100000:3.0:1713279312.299362:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:12283:x1796503281316160:12345-192.168.203.4@tcp:41:df.0 Request processed in 68us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279312.299369:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785659 00000100:00100000:0.0:1713279312.312941:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279312.313019:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316224 00000100:00100000:3.0:1713279312.313025:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316224 00000100:00100000:3.0:1713279312.313069:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785660 00000100:00100000:3.0:1713279312.313074:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3725:12291:x1796503281316224:12345-192.168.203.4@tcp:101:df.0 00010000:00010000:3.0:1713279312.313085:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279312.313097:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114edab998 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc3917667b expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279312.313132:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab99f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279312.313140:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab99f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279312.313147:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab99f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000004:00200000:3.0:1713279312.313170:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1713279312.313172:0:15485:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713279312.313179:0:15485:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab99f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279312.313190:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9200/0xfc4b8e114edab998 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917667b expref: 3727 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279312.313209:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baad00/0xfc4b8e114edab99f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc3917667b expref: 3726 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279312.313214:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279312.313215:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713279312.313217:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baad00, rc 0) 00000100:00100000:3.0:1713279312.313245:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3726:12291:x1796503281316224:12345-192.168.203.4@tcp:101:df.0 Request processed in 171us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279312.313252:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785660 00000100:00100000:0.0:1713279312.317718:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279312.317755:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316288 00000100:00100000:3.0:1713279312.317759:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316288 00000100:00100000:3.0:1713279312.317788:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785661 00000100:00100000:3.0:1713279312.317791:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3725:12292:x1796503281316288:12345-192.168.203.4@tcp:101:df.0 00000100:00080000:2.0:1713279312.317798:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279282 00010000:00010000:3.0:1713279312.317799:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279312.317805:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab9a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176682 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279312.317826:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114edab9ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279312.317831:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114edab9ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279312.317836:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114edab9ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000004:00200000:3.0:1713279312.317847:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1713279312.317848:0:15485:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713279312.317854:0:15485:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114edab9ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279312.317862:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba9b00/0xfc4b8e114edab9a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176682 expref: 3727 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279312.317878:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baa1c0/0xfc4b8e114edab9ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176682 expref: 3726 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279312.317882:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88009950e900) 00010000:00010000:3.0:1713279312.317884:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713279312.317886:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baa1c0, rc 0) 00000100:00100000:3.0:1713279312.317904:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3726:12292:x1796503281316288:12345-192.168.203.4@tcp:101:df.0 Request processed in 112us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279312.317908:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785661 00000100:00100000:0.0:1713279312.321395:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279312.321464:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316352 00000100:00100000:3.0:1713279312.321469:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316352 00000100:00100000:3.0:1713279312.321492:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785662 00000100:00100000:3.0:1713279312.321496:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3726:12292:x1796503281316352:12345-192.168.203.4@tcp:41:df.0 00000004:00000024:3.0:1713279312.321509:0:15485:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7726223360 avail 7263117312 00000100:00100000:3.0:1713279312.321551:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3726:12292:x1796503281316352:12345-192.168.203.4@tcp:41:df.0 Request processed in 54us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279312.321555:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785662 00000100:00100000:0.0:1713279312.326021:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279312.326095:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316416 00000100:00100000:3.0:1713279312.326099:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316416 00000100:00100000:3.0:1713279312.326123:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785663 00000100:00100000:3.0:1713279312.326127:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3726:12294:x1796503281316416:12345-192.168.203.4@tcp:101:df.0 00010000:00010000:3.0:1713279312.326134:0:15485:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713279312.326141:0:15485:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8240/0xfc4b8e114edab9b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176689 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279312.326166:0:15485:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edab9bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279312.326173:0:15485:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edab9bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279312.326178:0:15485:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edab9bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00000004:00200000:3.0:1713279312.326196:0:15485:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1713279312.326197:0:15485:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713279312.326203:0:15485:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edab9bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15485 initiator: MDT0 00010000:00010000:3.0:1713279312.326211:0:15485:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ba8240/0xfc4b8e114edab9b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176689 expref: 3728 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279312.326228:0:15485:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091bab180/0xfc4b8e114edab9bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176689 expref: 3727 pid: 15485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713279312.326232:0:15485:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88012b136800) 00010000:00010000:3.0:1713279312.326234:0:15485:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713279312.326235:0:15485:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bab180, rc 0) 00000100:00100000:3.0:1713279312.326258:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3727:12294:x1796503281316416:12345-192.168.203.4@tcp:101:df.0 Request processed in 130us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279312.326262:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785663 00000100:00100000:2.0:1713279312.338531:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200068224:0@lo:400:kworker.0 00000100:00100000:3.0:1713279312.338531:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200068288:0@lo:400:kworker.0 00000100:00100000:0.0:1713279312.338541:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200068416:0@lo:400:kworker.0 00000100:00100000:2.0:1713279312.338568:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279312.338568:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279312.338577:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200068352:0@lo:400:kworker.0 00000100:00100000:2.0:1713279312.338583:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200068480:0@lo:400:kworker.0 00000100:00100000:3.0:1713279312.338583:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200068544:0@lo:400:kworker.0 00000100:00100000:1.0:1713279312.338586:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279312.338592:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279312.338604:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200068672:0@lo:400:kworker.0 00000100:00100000:2.0:1713279312.338605:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279312.338606:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279312.338609:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200068608:0@lo:400:kworker.0 00000100:00100000:2.0:1713279312.338618:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200068736:0@lo:400:kworker.0 00000100:00100000:3.0:1713279312.338618:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200068800:0@lo:400:kworker.0 00000100:00100000:0.0:1713279312.338622:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279312.338623:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279312.338633:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200068864:0@lo:400:kworker.0 00000100:00100000:1.0:1713279312.338634:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200068928:0@lo:400:kworker.0 00000100:00100000:3.0:1713279312.338634:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279312.338635:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279312.338645:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279312.338646:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200068992:0@lo:400:kworker.0 00000100:00100000:1.0:1713279312.338648:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279312.338655:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068352 00000100:00100000:2.0:1713279312.338656:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279312.338658:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068352 00000100:00100000:0.0:1713279312.338662:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068480 00000100:00100000:0.0:1713279312.338665:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068480 00000100:00100000:1.0:1713279312.338665:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068288 00000100:00100000:1.0:1713279312.338668:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068288 00000100:00100000:2.0:1713279312.338670:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068416 00000100:00100000:2.0:1713279312.338673:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068416 00000100:00100000:3.0:1713279312.338677:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98956 00000100:00100000:0.0:1713279312.338680:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98957 00000100:00100000:1.0:1713279312.338681:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068544 00000100:00100000:3.0:1713279312.338681:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200068352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279312.338683:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068544 00000100:00100000:0.0:1713279312.338684:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200068480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279312.338688:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068608 00000100:00100000:2.0:1713279312.338689:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068608 00000100:00100000:1.0:1713279312.338694:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068800 00000100:00100000:1.0:1713279312.338695:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068800 00000100:00100000:2.0:1713279312.338698:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068864 00000100:00100000:2.0:1713279312.338700:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068864 00000100:00100000:1.0:1713279312.338704:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1713279312.338707:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200068480:12345-0@lo:400:kworker.0 Request processed in 23us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279312.338707:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200068288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279312.338707:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200068352:12345-0@lo:400:kworker.0 Request processed in 26us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279312.338711:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1713279312.338711:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98956 00000100:00100000:0.0:1713279312.338713:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98957 00000100:00100000:2.0:1713279312.338714:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200068416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279312.338723:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1713279312.338727:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200068288:12345-0@lo:400:kworker.0 Request processed in 19us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279312.338737:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200068544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279312.338739:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:1.0:1713279312.338741:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1713279312.338742:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200068608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279312.338746:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200068416:12345-0@lo:400:kworker.0 Request processed in 31us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279312.338750:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1713279312.338751:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200068544:12345-0@lo:400:kworker.0 Request processed in 25us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279312.338752:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200068800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279312.338752:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1713279312.338755:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1713279312.338756:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200068608:12345-0@lo:400:kworker.0 Request processed in 14us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279312.338759:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1713279312.338762:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1713279312.338763:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200068800:12345-0@lo:400:kworker.0 Request processed in 11us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279312.338764:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200068864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279312.338767:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1713279312.338769:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068672 00000100:00100000:3.0:1713279312.338771:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068672 00000100:00100000:2.0:1713279312.338778:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200068864:12345-0@lo:400:kworker.0 Request processed in 13us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279312.338780:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068736 00000100:00100000:2.0:1713279312.338781:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1713279312.338781:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068736 00000100:00100000:0.0:1713279312.338782:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200068352:0@lo:400:kworker.0 00000100:00100000:0.0:1713279312.338788:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200068608:0@lo:400:kworker.0 00000100:00100000:1.0:1713279312.338788:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200068416:0@lo:400:kworker.0 00000100:00100000:3.0:1713279312.338791:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068928 00000100:00100000:3.0:1713279312.338792:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068928 00000100:00100000:0.0:1713279312.338793:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200068864:0@lo:400:kworker.0 00000100:00100000:2.0:1713279312.338794:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068992 00000100:00100000:2.0:1713279312.338795:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068992 00000100:00100000:3.0:1713279312.338801:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1713279312.338803:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+6:3493:x1796503200068672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279312.338804:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1713279312.338807:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200068736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279312.338808:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1713279312.338811:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3493:x1796503200068928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279312.338815:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1713279312.338817:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200068992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279312.338821:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+6:3493:x1796503200068672:12345-0@lo:400:kworker.0 Request processed in 17us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279312.338823:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200068736:12345-0@lo:400:kworker.0 Request processed in 16us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279312.338824:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1713279312.338826:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1713279312.338827:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3493:x1796503200068928:12345-0@lo:400:kworker.0 Request processed in 15us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279312.338830:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1713279312.338833:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200068992:12345-0@lo:400:kworker.0 Request processed in 15us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279312.338836:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1713279312.338839:0:3493:0:(client.c:2953:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4295010216 gen 2 00000100:00100000:2.0:1713279312.338840:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200068224 00000100:00100000:2.0:1713279312.338841:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200068224 00000100:00100000:3.0:1713279312.338841:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200068800:0@lo:400:kworker.0 00000004:00080000:1.0:1713279312.338844:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010110 committed transno 4295010216 00000100:00100000:3.0:1713279312.338846:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200068288:0@lo:400:kworker.0 00000100:00100000:3.0:1713279312.338851:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200068544:0@lo:400:kworker.0 00000100:00080000:0.0:1713279312.338852:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279282 00000100:00100000:2.0:1713279312.338853:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00080000:0.0:1713279312.338854:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279282 00000100:00080000:0.0:1713279312.338855:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279282 00000100:00100000:2.0:1713279312.338855:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200068224:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1713279312.338857:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279282 00000004:00080000:1.0:1713279312.338857:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010116 committed transno 4295010216 00000100:00080000:0.0:1713279312.338858:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279282 00000004:00080000:1.0:1713279312.338866:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010118 committed transno 4295010216 00000100:00100000:2.0:1713279312.338867:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200068224:12345-0@lo:400:kworker.0 Request processed in 11us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279312.338870:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000004:00080000:1.0:1713279312.338874:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010130 committed transno 4295010216 00000004:00080000:1.0:1713279312.338885:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010144 committed transno 4295010216 00000100:00100000:2.0:1713279312.338888:0:3490:0:(client.c:2953:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4295010106 gen 2 00000004:00080000:2.0:1713279312.338890:0:3490:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010104 committed transno 4295010106 00000004:00080000:1.0:1713279312.338895:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010151 committed transno 4295010216 00000004:00080000:2.0:1713279312.338902:0:3490:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010106 committed transno 4295010106 00000004:00080000:1.0:1713279312.338905:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010157 committed transno 4295010216 00000100:00100000:2.0:1713279312.338912:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200068736:0@lo:400:kworker.0 00000004:00080000:1.0:1713279312.338915:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010168 committed transno 4295010216 00000100:00100000:2.0:1713279312.338918:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200068992:0@lo:400:kworker.0 00000100:00100000:2.0:1713279312.338922:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200068224:0@lo:400:kworker.0 00000004:00080000:1.0:1713279312.338923:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010185 committed transno 4295010216 00000100:00100000:2.0:1713279312.338926:0:3490:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4295183752 gen 2 00000004:00080000:2.0:1713279312.338928:0:3490:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183733 committed transno 4295183752 00000004:00080000:1.0:1713279312.338932:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010195 committed transno 4295010216 00000004:00080000:2.0:1713279312.338937:0:3490:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183735 committed transno 4295183752 00000004:00080000:1.0:1713279312.338941:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010201 committed transno 4295010216 00000004:00080000:2.0:1713279312.338945:0:3490:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183736 committed transno 4295183752 00000004:00080000:1.0:1713279312.338950:0:3493:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997f8000, transno 4295010216 00000004:00080000:2.0:1713279312.338952:0:3490:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183737 committed transno 4295183752 00000004:00080000:2.0:1713279312.338959:0:3490:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183738 committed transno 4295183752 00000100:00100000:1.0:1713279312.338965:0:3493:0:(client.c:2997:ptlrpc_free_committed()) @@@ stopping search req@ffff88008c160e00 x1796503200068160/t4295010217(4295010217) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1713279327 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 00000004:00080000:2.0:1713279312.338968:0:3490:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295183752 committed transno 4295183752 00000100:00100000:1.0:1713279312.338971:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200068672:0@lo:400:kworker.0 00000100:00100000:2.0:1713279312.338976:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200068480:0@lo:400:kworker.0 00000100:00100000:1.0:1713279312.338977:0:3493:0:(client.c:2953:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4295010153 gen 2 00000004:00080000:1.0:1713279312.338979:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010048 committed transno 4295010153 00000004:00080000:1.0:1713279312.338990:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010060 committed transno 4295010153 00000004:00080000:1.0:1713279312.338998:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010067 committed transno 4295010153 00000004:00080000:1.0:1713279312.339007:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010081 committed transno 4295010153 00000004:00080000:1.0:1713279312.339020:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010085 committed transno 4295010153 00000004:00080000:1.0:1713279312.339028:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010089 committed transno 4295010153 00000004:00080000:1.0:1713279312.339047:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010111 committed transno 4295010153 00000004:00080000:1.0:1713279312.339055:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010127 committed transno 4295010153 00000004:00080000:1.0:1713279312.339072:0:3493:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295010138 committed transno 4295010153 00000004:00080000:1.0:1713279312.339082:0:3493:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009764ce00, transno 4295010153 00000100:00100000:1.0:1713279312.339093:0:3493:0:(client.c:2997:ptlrpc_free_committed()) @@@ stopping search req@ffff88009764dc00 x1796503200068096/t4295010154(4295010154) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1713279327 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 00000100:00100000:1.0:1713279312.339098:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200068928:0@lo:400:kworker.0 00000100:00100000:0.0:1713279312.339193:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279312.339205:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316480 00000100:00100000:2.0:1713279312.339208:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316480 00000100:00080000:0.0:1713279312.339218:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279282 00000100:00100000:2.0:1713279312.339230:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785664 00000100:00100000:2.0:1713279312.339233:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3368:12296:x1796503281316480:12345-192.168.203.4@tcp:101:df.0 00010000:00010000:2.0:1713279312.339239:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279312.339250:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecd80/0xfc4b8e114edab9c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176690 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279312.339276:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab9c9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279312.339283:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab9c9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279312.339289:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab9c9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:2.0:1713279312.339307:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1713279312.339309:0:15480:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1713279312.339331:0:15480:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab9c9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279312.339341:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecd80/0xfc4b8e114edab9c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176690 expref: 3370 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279312.339361:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecfc0/0xfc4b8e114edab9c9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176690 expref: 3369 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279312.339365:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:2.0:1713279312.339367:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713279312.339369:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ecfc0, rc 0) 00000100:00100000:2.0:1713279312.339391:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:12296:x1796503281316480:12345-192.168.203.4@tcp:101:df.0 Request processed in 157us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279312.339395:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785664 00000100:00100000:0.0:1713279312.342809:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279312.342887:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316544 00000100:00100000:2.0:1713279312.342893:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316544 00000100:00080000:0.0:1713279312.342925:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279282 00000100:00100000:2.0:1713279312.342927:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785665 00000100:00100000:2.0:1713279312.342931:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3638:12297:x1796503281316544:12345-192.168.203.4@tcp:101:df.0 00010000:00010000:2.0:1713279312.342940:0:15480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713279312.342948:0:15480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecd80/0xfc4b8e114edab9d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2345e2fc39176697 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279312.342992:0:15480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edab9d7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15480 initiator: MDT0 00010000:00010000:2.0:1713279312.343000:0:15480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edab9d7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279312.343007:0:15480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edab9d7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00000004:00200000:2.0:1713279312.343026:0:15480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1713279312.343029:0:15480:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1713279312.343076:0:15480:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edab9d7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15480 initiator: MDT1 00010000:00010000:2.0:1713279312.343086:0:15480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecd80/0xfc4b8e114edab9d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176697 expref: 3640 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279312.343104:0:15480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801298ecb40/0xfc4b8e114edab9d7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x2345e2fc39176697 expref: 3639 pid: 15480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713279312.343108:0:15480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a055a300) 00010000:00010000:2.0:1713279312.343110:0:15480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713279312.343111:0:15480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801298ecb40, rc 0) 00000100:00100000:2.0:1713279312.343129:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3639:12297:x1796503281316544:12345-192.168.203.4@tcp:101:df.0 Request processed in 198us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279312.343133:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785665 00000100:00100000:2.0:1713279312.354484:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713279312.354491:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200069056:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1713279312.354492:0:11414:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 415167077599ns, next at 416167076420ns, rc = 0 00000100:00100000:0.0:1713279312.354508:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713279312.354512:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279312.354515:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200069120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279312.354535:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279312.354547:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069056 00000100:00100000:1.0:1713279312.354549:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069120 00000100:00100000:3.0:1713279312.354551:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069056 00000100:00100000:1.0:1713279312.354553:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069120 00000100:00100000:3.0:1713279312.354570:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1713279312.354574:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3490:x1796503200069056:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279312.354577:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1713279312.354581:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200069120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1713279312.354589:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:1.0:1713279312.354590:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:3.0:1713279312.354617:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3490:x1796503200069056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279312.354618:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200069120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279312.354621:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1713279312.354624:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1713279312.354628:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200069120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279312.355144:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200069056:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1713279312.356461:0:6911:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 862 committed 00000004:00080000:0.0:1713279312.356484:0:6911:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 859 committed 00000004:00080000:0.0:1713279312.356492:0:6911:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 861 committed 00000001:00080000:0.0:1713279312.356498:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202826 is committed 00000001:00080000:0.0:1713279312.356502:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202825 is committed 00000100:00100000:0.0:1713279312.356573:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200069184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713279312.356596:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279312.356613:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200069440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713279312.356614:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200069248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713279312.356641:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279312.356644:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200069376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713279312.356657:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279312.356664:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069184 00000100:00100000:0.0:1713279312.356667:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069184 00000100:00100000:3.0:1713279312.356670:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200069312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713279312.356672:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279312.356677:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200069504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713279312.356682:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069440 00000100:00100000:0.0:1713279312.356684:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069440 00000100:00100000:2.0:1713279312.356690:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279312.356697:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069248 00000100:00100000:0.0:1713279312.356699:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069248 00000100:00100000:1.0:1713279312.356701:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069376 00000100:00100000:1.0:1713279312.356704:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069376 00000100:00100000:3.0:1713279312.356706:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069504 00000100:00100000:3.0:1713279312.356710:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069504 00000100:00100000:0.0:1713279312.356711:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110625 00000100:00100000:0.0:1713279312.356715:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3493:x1796503200069184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713279312.356719:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110626 00000100:00100000:1.0:1713279312.356727:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110627 00000100:00100000:2.0:1713279312.356727:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3493:x1796503200069440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1713279312.356731:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3490:x1796503200069248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713279312.356736:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110628 00000100:00100000:3.0:1713279312.356741:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3492:x1796503200069376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1713279312.356806:0:15538:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1171:0x0] updating lvb size from disk: 55908 -> 55908 00002000:00010000:3.0:1713279312.356809:0:15538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1171:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279312.356811:0:15538:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1171:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1713279312.356813:0:15538:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1171:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279312.356815:0:15538:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1171:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:1.0:1713279312.356821:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110629 00000100:00100000:1.0:1713279312.356825:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3490:x1796503200069504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713279312.356842:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+7:3492:x1796503200069376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (170us total) trans 4295010156 rc 0/0 00000100:00100000:3.0:1713279312.356848:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110628 00000100:00100000:3.0:1713279312.356864:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279312.356879:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069312 00000100:00100000:3.0:1713279312.356882:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069312 00000100:00100000:3.0:1713279312.356893:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110630 00000100:00100000:3.0:1713279312.356897:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+7:3491:x1796503200069312:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1713279312.356960:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800997f8000/2, rc 0, transno 42860 00000100:00100000:1.0:1713279312.356967:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200069376:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1713279312.357028:0:15499:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x110e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1713279312.357047:0:15499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x110e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1713279312.357050:0:15499:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x110e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1713279312.357051:0:15499:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x110e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1713279312.357053:0:15499:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x110e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1713279312.357058:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3493:x1796503200069184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 340us (459us total) trans 4295010157 rc 0/0 00000100:00100000:0.0:1713279312.357064:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110625 00000004:00080000:1.0:1713279312.357071:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800997f9f80/2, rc 0, transno 42861 00000100:00100000:1.0:1713279312.357075:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200069184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713279312.357081:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3490:x1796503200069248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 349us (423us total) trans 4295010218 rc 0/0 00000100:00100000:2.0:1713279312.357087:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110627 00000100:00100000:3.0:1713279312.357093:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+8:3491:x1796503200069312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 194us (226us total) trans 4295010158 rc 0/0 00000100:00100000:3.0:1713279312.357098:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110630 00000004:00080000:2.0:1713279312.357143:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880130300e00/2, rc 0, transno 42922 00000100:00100000:2.0:1713279312.357149:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200069248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713279312.357152:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713279312.357156:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200069568:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1713279312.357161:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800997f9880/2, rc 0, transno 42862 00000100:00100000:3.0:1713279312.357167:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200069312:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713279312.357168:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279312.357173:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713279312.357176:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069568 00000100:00100000:0.0:1713279312.357178:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200069632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713279312.357178:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069568 00000100:00100000:3.0:1713279312.357186:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110631 00000100:00100000:3.0:1713279312.357189:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+8:3490:x1796503200069568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713279312.357191:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279312.357193:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200069760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713279312.357199:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200069696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713279312.357205:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279312.357211:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279312.357211:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3490:x1796503200069504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 385us (520us total) trans 4295010219 rc 0/0 00000100:00100000:1.0:1713279312.357216:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110629 00000004:00080000:2.0:1713279312.357216:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880130302d80/2, rc 0, transno 42923 00000100:00100000:2.0:1713279312.357219:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200069504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713279312.357221:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069632 00000100:00100000:0.0:1713279312.357222:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069632 00000100:00100000:1.0:1713279312.357223:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069760 00000100:00100000:1.0:1713279312.357225:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069760 00000100:00100000:2.0:1713279312.357229:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069696 00000100:00100000:2.0:1713279312.357231:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069696 00000100:00100000:0.0:1713279312.357232:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110632 00000100:00100000:0.0:1713279312.357236:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3493:x1796503200069632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1713279312.357236:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110633 00000100:00100000:1.0:1713279312.357239:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3490:x1796503200069760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713279312.357242:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110634 00000100:00100000:2.0:1713279312.357244:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3493:x1796503200069696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1713279312.357267:0:15519:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb size from disk: 52702 -> 52702 00002000:00010000:1.0:1713279312.357269:0:15519:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279312.357271:0:15519:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:1.0:1713279312.357272:0:15519:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279312.357274:0:15519:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x117f:0x0] updating lvb blocks from disk: 96 -> 96 00000100:00100000:1.0:1713279312.357288:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+11:3490:x1796503200069760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (82us total) trans 4295010159 rc 0/0 00000100:00100000:1.0:1713279312.357292:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110633 00002000:00010000:0.0:1713279312.357309:0:9197:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x110e:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1713279312.357309:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+11:3490:x1796503200069568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (139us total) trans 4295010160 rc 0/0 00002000:00010000:0.0:1713279312.357311:0:9197:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x110e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1713279312.357312:0:9197:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x110e:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1713279312.357313:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110631 00002000:00010000:0.0:1713279312.357314:0:9197:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x110e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1713279312.357315:0:9197:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x110e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1713279312.357332:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3493:x1796503200069632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (140us total) trans 4295010220 rc 0/0 00000100:00100000:0.0:1713279312.357336:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110632 00000004:00080000:1.0:1713279312.357341:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d180380/2, rc 0, transno 42924 00000100:00100000:1.0:1713279312.357345:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200069632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713279312.357350:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3493:x1796503200069696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (137us total) trans 4295010161 rc 0/0 00000004:00080000:1.0:1713279312.357351:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c01180/2, rc 0, transno 42865 00000100:00100000:2.0:1713279312.357354:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110634 00000100:00100000:1.0:1713279312.357355:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200069696:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1713279312.357358:0:15506:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb size from disk: 42048 -> 42048 00002000:00010000:3.0:1713279312.357360:0:15506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279312.357361:0:15506:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:3.0:1713279312.357363:0:15506:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:3.0:1713279312.357364:0:15506:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb blocks from disk: 64 -> 64 00000004:00080000:2.0:1713279312.357372:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c03b80/2, rc 0, transno 42863 00000100:00100000:2.0:1713279312.357377:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200069760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1713279312.357378:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3493:x1796503200069440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 653us (736us total) trans 4295010221 rc 0/0 00000100:00100000:3.0:1713279312.357381:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110626 00000004:00080000:1.0:1713279312.357382:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880130303800/2, rc 0, transno 42925 00000004:00080000:2.0:1713279312.357382:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096756a00/2, rc 0, transno 42864 00000100:00100000:2.0:1713279312.357384:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200069568:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713279312.357386:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200069440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713279312.357405:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200069824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713279312.357408:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200069888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713279312.357410:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200070016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1713279312.357432:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279312.357439:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279312.357442:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200069952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1713279312.357445:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069824 00000100:00100000:3.0:1713279312.357447:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069824 00000100:00100000:0.0:1713279312.357452:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279312.357455:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070016 00000100:00100000:2.0:1713279312.357456:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069888 00000100:00100000:3.0:1713279312.357457:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070016 00000100:00100000:2.0:1713279312.357458:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069888 00000100:00100000:1.0:1713279312.357464:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279312.357464:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110635 00000100:00100000:3.0:1713279312.357466:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3491:x1796503200069824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713279312.357469:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200069952 00000100:00100000:2.0:1713279312.357470:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200069952 00000100:00100000:0.0:1713279312.357476:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110636 00000100:00100000:0.0:1713279312.357480:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3490:x1796503200070016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713279312.357480:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110637 00000100:00100000:2.0:1713279312.357483:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110638 00000100:00100000:1.0:1713279312.357484:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+9:3493:x1796503200069888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713279312.357486:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3492:x1796503200069952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1713279312.357522:0:11415:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb size from disk: 45054 -> 45054 00002000:00010000:0.0:1713279312.357525:0:11415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279312.357527:0:11415:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1713279312.357529:0:11415:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:0.0:1713279312.357531:0:11415:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1167:0x0] updating lvb blocks from disk: 56 -> 56 00000100:00100000:3.0:1713279312.357539:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3491:x1796503200069824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (106us total) trans 4295010163 rc 0/0 00000100:00100000:3.0:1713279312.357545:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110635 00002000:00010000:1.0:1713279312.357554:0:15519:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb size from disk: 42048 -> 42048 00002000:00010000:1.0:1713279312.357555:0:15519:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00000100:00100000:0.0:1713279312.357556:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3490:x1796503200070016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (114us total) trans 4295010162 rc 0/0 00002000:00010000:1.0:1713279312.357557:0:15519:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb atime from disk: 1648351934 -> 1648351934 00002000:00010000:1.0:1713279312.357558:0:15519:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:1.0:1713279312.357559:0:15519:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x1075:0x0] updating lvb blocks from disk: 64 -> 64 00000004:00080000:3.0:1713279312.357559:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009764e680/2, rc 0, transno 42867 00000100:00100000:0.0:1713279312.357562:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110636 00000100:00100000:3.0:1713279312.357563:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200069824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713279312.357566:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3492:x1796503200069952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (101us total) trans 4295010164 rc 0/0 00000100:00100000:2.0:1713279312.357570:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110638 00000100:00100000:1.0:1713279312.357575:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3493:x1796503200069888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (122us total) trans 4295010222 rc 0/0 00000100:00100000:1.0:1713279312.357578:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110637 00000100:00100000:3.0:1713279312.357582:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200070080:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1713279312.357585:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009764c000/2, rc 0, transno 42866 00000004:00080000:0.0:1713279312.357587:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d182d80/2, rc 0, transno 42926 00000100:00100000:2.0:1713279312.357590:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200070016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713279312.357591:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200069888:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1713279312.357593:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009764d880/2, rc 0, transno 42868 00000100:00100000:3.0:1713279312.357593:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279312.357596:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200069952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713279312.357602:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070080 00000100:00100000:1.0:1713279312.357604:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070080 00000100:00100000:1.0:1713279312.357612:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110639 00000100:00100000:1.0:1713279312.357614:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+14:3491:x1796503200070080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713279312.357619:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200070208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713279312.357638:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279312.357656:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713279312.357661:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200070144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713279312.357666:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070208 00000100:00100000:2.0:1713279312.357668:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070208 00000100:00100000:0.0:1713279312.357676:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279312.357687:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070144 00000100:00100000:1.0:1713279312.357688:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+16:3491:x1796503200070080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (94us total) trans 4295010165 rc 0/0 00000100:00100000:2.0:1713279312.357689:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070144 00000100:00100000:1.0:1713279312.357692:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110639 00000100:00100000:2.0:1713279312.357697:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110640 00000100:00100000:1.0:1713279312.357700:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110641 00000100:00100000:2.0:1713279312.357701:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3493:x1796503200070208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713279312.357703:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+16:3493:x1796503200070144:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1713279312.357714:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880130291880/2, rc 0, transno 42869 00000100:00100000:3.0:1713279312.357717:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200070080:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1713279312.357730:0:15499:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb size from disk: 3214 -> 3214 00002000:00010000:2.0:1713279312.357732:0:15499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb mtime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279312.357733:0:15499:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb atime from disk: 1713279299 -> 1713279299 00002000:00010000:2.0:1713279312.357735:0:15499:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb ctime from disk: 1713279306 -> 1713279306 00002000:00010000:2.0:1713279312.357737:0:15499:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x1150:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:2.0:1713279312.357755:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3493:x1796503200070208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (117us total) trans 4295010166 rc 0/0 00000100:00100000:1.0:1713279312.357759:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+18:3493:x1796503200070144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (82us total) trans 4295010167 rc 0/0 00000100:00100000:2.0:1713279312.357759:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110640 00000100:00100000:1.0:1713279312.357763:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110641 00000004:00080000:0.0:1713279312.357769:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c018380/2, rc 0, transno 42871 00000100:00100000:0.0:1713279312.357774:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200070144:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1713279312.357782:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c019f80/2, rc 0, transno 42870 00000100:00100000:0.0:1713279312.357784:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200070208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713279313.074824:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200070272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279313.074906:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279313.075069:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070272 00000100:00100000:1.0:1713279313.075081:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070272 00000100:00100000:1.0:1713279313.075137:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1713279313.075145:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3490:x1796503200070272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1713279313.075179:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279313.075241:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3490:x1796503200070272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279313.075249:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1713279313.075330:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200070272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279313.090625:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200070336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1713279313.090679:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279313.090739:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070336 00000100:00100000:1.0:1713279313.090747:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070336 00000100:00100000:1.0:1713279313.090804:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00080000:0.0:1713279313.090806:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279283 00000100:00100000:1.0:1713279313.090811:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3491:x1796503200070336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1713279313.090829:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279313.090868:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3491:x1796503200070336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279313.090876:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1713279313.090908:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200070336:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1713279313.220680:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279313.899386:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279313.899496:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279313.899506:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316608 00000100:00100000:2.0:1713279313.899520:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316608 00000100:00100000:0.0:1713279313.899554:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279313.899589:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 385 00000100:00100000:0.0:1713279313.899597:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279313.899602:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281316608:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279313.899622:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279313.899637:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316672 00000100:00100000:3.0:1713279313.899647:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316672 00000100:00100000:0.0:1713279313.899648:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279313.899683:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281316608:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279313.899686:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316800 00000100:00100000:3.0:1713279313.899686:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316736 00000100:00100000:3.0:1713279313.899689:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316736 00000100:00100000:0.0:1713279313.899691:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279313.899695:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316800 00000100:00100000:2.0:1713279313.899696:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 385 00000100:00100000:3.0:1713279313.899704:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316928 00000100:00100000:3.0:1713279313.899706:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316928 00000100:00100000:3.0:1713279313.899725:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 443 00000100:00100000:1.0:1713279313.899732:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316864 00000100:00100000:3.0:1713279313.899732:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281316672:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279313.899735:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316864 00000100:00100000:2.0:1713279313.899743:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317056 00000100:00100000:2.0:1713279313.899749:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317056 00000100:00100000:1.0:1713279313.899757:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:1.0:1713279313.899765:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281316800:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279313.899779:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:3.0:1713279313.899781:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281316672:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 49us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279313.899789:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281316864:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279313.899789:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 443 00000100:00100000:3.0:1713279313.899804:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 444 00000100:00100000:3.0:1713279313.899808:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281316736:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279313.899822:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281316800:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 57us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279313.899830:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:0.0:1713279313.899837:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279313.899837:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281316736:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279313.899838:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281316864:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279313.899844:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 444 00000100:00100000:1.0:1713279313.899847:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:1.0:1713279313.899852:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281317056:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279313.899852:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281316992 00000100:00100000:3.0:1713279313.899855:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281316992 00000100:00100000:2.0:1713279313.899868:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:3.0:1713279313.899870:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 445 00000100:00100000:3.0:1713279313.899874:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281316928:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279313.899881:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281317056:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279313.899888:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:3.0:1713279313.899896:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281316928:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (276us total) trans 0 rc 0/0 00000100:00080000:2.0:1713279313.899901:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279283 00000100:00100000:3.0:1713279313.899902:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 445 00000100:00080000:2.0:1713279313.899907:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279283 00000100:00080000:2.0:1713279313.899911:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279283 00000100:00100000:0.0:1713279313.899914:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279313.899914:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 446 00000100:00100000:1.0:1713279313.899920:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281316992:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279313.899943:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281316992:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279313.899950:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 446 00000100:00100000:2.0:1713279313.899951:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317120 00000100:00100000:2.0:1713279313.899957:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317120 00000100:00100000:2.0:1713279313.899993:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:2.0:1713279313.900002:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281317120:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279313.900117:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281317120:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 113us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279313.900129:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00080000:2.0:1713279313.900153:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279283 00010000:00010000:2.0:1713279314.222657:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279314.994743:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713279314.994771:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c01b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200070400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279314.994842:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279314.994978:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070400 00000100:00100000:2.0:1713279314.994990:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070400 00000100:00100000:2.0:1713279314.995091:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98958 00000100:00100000:2.0:1713279314.995100:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200070400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279314.995140:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279314.995199:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200070400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279314.995207:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98958 00000100:00100000:0.0:1713279314.995226:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c01b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200070400:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279315.224758:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279316.226650:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279316.674645:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200070464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279316.674696:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279316.674738:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070464 00000100:00100000:2.0:1713279316.674745:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070464 00000100:00100000:2.0:1713279316.674782:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98959 00000100:00100000:2.0:1713279316.674788:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200070464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279316.674817:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279316.674870:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200070464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279316.674874:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200070464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713279316.674877:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98959 00010000:00010000:2.0:1713279317.228574:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279317.346643:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200070528:0@lo:400:kworker.0 00000100:00100000:1.0:1713279317.346671:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200070720:0@lo:400:kworker.0 00000100:00100000:3.0:1713279317.346675:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200070592:0@lo:400:kworker.0 00000100:00100000:2.0:1713279317.346697:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200070656:0@lo:400:kworker.0 00000100:00100000:0.0:1713279317.346699:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279317.346708:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279317.346718:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200070784:0@lo:400:kworker.0 00000100:00100000:1.0:1713279317.346720:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200070976:0@lo:400:kworker.0 00000100:00100000:3.0:1713279317.346723:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279317.346733:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279317.346740:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279317.346745:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200070848:0@lo:400:kworker.0 00000100:00100000:0.0:1713279317.346751:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070720 00000100:00100000:1.0:1713279317.346754:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200071232:0@lo:400:kworker.0 00000100:00100000:0.0:1713279317.346757:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070720 00000100:00100000:2.0:1713279317.346759:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200070912:0@lo:400:kworker.0 00000100:00100000:1.0:1713279317.346765:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279317.346766:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279317.346778:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200071104:0@lo:400:kworker.0 00000100:00100000:2.0:1713279317.346781:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279317.346791:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070592 00000100:00100000:0.0:1713279317.346793:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070592 00000100:00100000:3.0:1713279317.346794:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279317.346799:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200071168:0@lo:400:kworker.0 00000100:00100000:1.0:1713279317.346800:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070848 00000100:00100000:1.0:1713279317.346820:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070848 00000100:00100000:0.0:1713279317.346826:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070912 00000100:00100000:3.0:1713279317.346826:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1713279317.346828:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070912 00000100:00100000:3.0:1713279317.346832:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200071040:0@lo:400:kworker.0 00000100:00100000:2.0:1713279317.346837:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279317.346845:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200071104 00000100:00100000:1.0:1713279317.346847:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200071104 00000100:00100000:3.0:1713279317.346851:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279317.346857:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200071168 00000100:00100000:0.0:1713279317.346860:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200071168 00000100:00100000:1.0:1713279317.346861:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1713279317.346865:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200071296:0@lo:400:kworker.0 00000100:00100000:1.0:1713279317.346866:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200070720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279317.346871:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070976 00000100:00100000:2.0:1713279317.346876:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070976 00000100:00100000:0.0:1713279317.346882:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1713279317.346882:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279317.346889:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200070592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279317.346903:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200071232 00000100:00100000:1.0:1713279317.346904:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200070720:12345-0@lo:400:kworker.0 Request processed in 38us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279317.346907:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200071232 00000100:00100000:3.0:1713279317.346908:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200071040 00000100:00100000:1.0:1713279317.346909:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1713279317.346912:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200071040 00000100:00100000:1.0:1713279317.346920:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1713279317.346923:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200070848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279317.346924:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200071296 00000100:00100000:2.0:1713279317.346927:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200071296 00000100:00100000:0.0:1713279317.346950:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200070592:12345-0@lo:400:kworker.0 Request processed in 61us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279317.346954:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1713279317.346955:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200070848:12345-0@lo:400:kworker.0 Request processed in 31us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279317.346957:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1713279317.346959:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1713279317.346960:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1713279317.346960:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+6:3493:x1796503200070976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279317.346965:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3493:x1796503200071232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279317.346967:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1713279317.346970:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200070912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279317.346973:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1713279317.346978:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200071104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279317.346987:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200070912:12345-0@lo:400:kworker.0 Request processed in 17us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279317.346991:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1713279317.346996:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+6:3493:x1796503200070976:12345-0@lo:400:kworker.0 Request processed in 36us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279317.347017:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1713279317.347022:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200071168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279317.347026:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1713279317.347040:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3493:x1796503200071232:12345-0@lo:400:kworker.0 Request processed in 74us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279317.347043:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1713279317.347047:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200071104:12345-0@lo:400:kworker.0 Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279317.347048:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1713279317.347050:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3491:x1796503200071040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279317.347051:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200071168:12345-0@lo:400:kworker.0 Request processed in 26us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279317.347054:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:1.0:1713279317.347061:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1713279317.347061:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1713279317.347065:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3491:x1796503200071296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279317.347076:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3491:x1796503200071040:12345-0@lo:400:kworker.0 Request processed in 27us (223us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279317.347080:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279287 00000100:00100000:3.0:1713279317.347082:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1713279317.347084:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279287 00000100:00100000:0.0:1713279317.347086:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1713279317.347086:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279287 00000100:00080000:1.0:1713279317.347088:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279287 00000100:00100000:2.0:1713279317.347095:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3491:x1796503200071296:12345-0@lo:400:kworker.0 Request processed in 28us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279317.347101:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1713279317.347105:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070528 00000100:00100000:3.0:1713279317.347109:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070528 00000100:00100000:0.0:1713279317.347110:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070656 00000100:00100000:0.0:1713279317.347114:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070656 00000100:00100000:1.0:1713279317.347114:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200070720:0@lo:400:kworker.0 00000100:00100000:1.0:1713279317.347125:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200070976:0@lo:400:kworker.0 00000100:00100000:0.0:1713279317.347132:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200070784 00000100:00100000:1.0:1713279317.347134:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200071232:0@lo:400:kworker.0 00000100:00100000:0.0:1713279317.347135:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200070784 00000100:00100000:3.0:1713279317.347135:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1713279317.347139:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200070528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279317.347149:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98960 00000100:00100000:0.0:1713279317.347154:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200070656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279317.347154:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98961 00000100:00080000:1.0:1713279317.347156:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279287 00000100:00100000:2.0:1713279317.347160:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200070784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279317.347178:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200070528:12345-0@lo:400:kworker.0 Request processed in 38us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279317.347185:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1713279317.347189:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200070656:12345-0@lo:400:kworker.0 Request processed in 34us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279317.347194:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200070784:12345-0@lo:400:kworker.0 Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279317.347196:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98960 00000100:00100000:2.0:1713279317.347200:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98961 00000100:00100000:3.0:1713279317.347217:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200071040:0@lo:400:kworker.0 00000100:00100000:0.0:1713279317.347220:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200070528:0@lo:400:kworker.0 00000100:00100000:3.0:1713279317.347228:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200071296:0@lo:400:kworker.0 00000100:00100000:2.0:1713279317.347230:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200070656:0@lo:400:kworker.0 00000100:00100000:0.0:1713279317.347231:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200070784:0@lo:400:kworker.0 00000100:00100000:3.0:1713279317.347238:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200070592:0@lo:400:kworker.0 00000100:00100000:2.0:1713279317.347241:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200070912:0@lo:400:kworker.0 00000100:00100000:2.0:1713279317.347247:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200071168:0@lo:400:kworker.0 00000100:00100000:3.0:1713279317.347247:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200070848:0@lo:400:kworker.0 00000100:00100000:3.0:1713279317.347256:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200071104:0@lo:400:kworker.0 00000100:00100000:0.0:1713279317.362510:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713279317.362512:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200071424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279317.362519:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200071360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279317.362548:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279317.362567:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279317.362569:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200071424 00000100:00100000:1.0:1713279317.362575:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200071424 00000100:00100000:1.0:1713279317.362601:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200071360 00000100:00100000:1.0:1713279317.362603:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200071360 00000100:00100000:3.0:1713279317.362608:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1713279317.362614:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+17:3492:x1796503200071424:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279317.362616:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1713279317.362621:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3490:x1796503200071360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279317.362637:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279317.362637:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279317.362668:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3490:x1796503200071360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279317.362672:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1713279317.362678:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+17:3492:x1796503200071424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279317.362682:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1713279317.362706:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200071424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279317.362711:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200071360:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1713279317.892345:0:9195:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4295010222 is committed 00000001:00080000:3.0:1713279317.892345:0:10468:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4295010167 is committed 00000001:00080000:1.0:1713279317.892370:0:9195:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4295010217 is committed 00000001:00080000:3.0:1713279317.892381:0:10468:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4295010155 is committed 00000020:00080000:0.0:1713279317.893029:0:8061:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 17688 batchid updated 00000020:00080000:2.0:1713279317.893141:0:8082:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17688 00000004:00080000:2.0:1713279317.893213:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800917f2e40 with version 32021 00000020:00080000:2.0:1713279317.893226:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17684 cancel update log [0x200000401:0xf8:0x0].2152: rc = 0 00000004:00080000:0.0:1713279317.893237:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32021 rpc_version 32021 00000020:00100000:0.0:1713279317.893275:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279317.893287:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880090966a00 x1796503200071552/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000020:00080000:2.0:1713279317.893294:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17684 cancel update log [0x240000400:0x1c0:0x0].1545: rc = 0 00000100:00100000:0.0:1713279317.893312:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090966a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200071552:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1713279317.893315:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800917f2900 with version 32022 00000020:00080000:2.0:1713279317.893319:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17685 cancel update log [0x200000401:0xf8:0x0].2153: rc = 0 00000020:00080000:2.0:1713279317.893332:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17685 cancel update log [0x240000400:0x1c0:0x0].1546: rc = 0 00000004:00080000:2.0:1713279317.893347:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800917f23c0 with version 32023 00000020:00080000:2.0:1713279317.893350:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17686 cancel update log [0x200000401:0xf8:0x0].2154: rc = 0 00000020:00080000:2.0:1713279317.893362:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17686 cancel update log [0x240000400:0x1c0:0x0].1547: rc = 0 00000100:00100000:0.0:1713279317.893378:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713279317.893380:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800917f2c00 with version 32024 00000020:00080000:2.0:1713279317.893383:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17687 cancel update log [0x200000401:0xf8:0x0].2155: rc = 0 00000020:00080000:2.0:1713279317.893395:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17687 cancel update log [0x240000400:0x1c0:0x0].1548: rc = 0 00000100:00100000:0.0:1713279317.893439:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a840 going to sleep for 11 seconds 00000004:00080000:2.0:1713279317.893443:0:8082:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800917f20c0 with version 32025 00000020:00080000:2.0:1713279317.893446:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17688 cancel update log [0x200000401:0xf8:0x0].2156: rc = 0 00000020:00080000:2.0:1713279317.893462:0:8082:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17688 cancel update log [0x240000400:0x1c0:0x0].1549: rc = 0 00000020:00080000:2.0:1713279317.893469:0:8082:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17688 00000100:00100000:3.0:1713279317.893499:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200071552 00000100:00100000:3.0:1713279317.893511:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200071552 00000100:00100000:3.0:1713279317.893559:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98962 00000100:00100000:3.0:1713279317.893567:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:8074:x1796503200071552:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279317.893719:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+51:8074:x1796503200071552:12345-0@lo:1000:osp_up0-1.0 Request processed in 151us (339us total) trans 4295202827 rc 0/0 00000100:00100000:3.0:1713279317.893728:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98962 00000100:00100000:0.0:1713279317.893748:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090966a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200071552:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279317.893758:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32022 rpc_version 32022 00000020:00100000:0.0:1713279317.893771:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279317.893776:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880095a68a80 x1796503200071680/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279317.893791:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095a68a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200071680:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279317.893817:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279317.893842:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a840 going to sleep for 11 seconds 00000100:00100000:3.0:1713279317.893869:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200071680 00000100:00100000:3.0:1713279317.893875:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200071680 00000100:00100000:3.0:1713279317.893894:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98963 00000100:00100000:3.0:1713279317.893899:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+51:8074:x1796503200071680:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279317.893988:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+52:8074:x1796503200071680:12345-0@lo:1000:osp_up0-1.0 Request processed in 84us (166us total) trans 4295202828 rc 0/0 00000100:00100000:0.0:1713279317.894023:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095a68a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200071680:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279317.894026:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98963 00000004:00080000:0.0:1713279317.894030:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32023 rpc_version 32023 00000020:00100000:0.0:1713279317.894042:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279317.894047:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880095a69880 x1796503200071808/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279317.894060:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095a69880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200071808:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279317.894085:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279317.894096:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a840 going to sleep for 11 seconds 00000100:00100000:3.0:1713279317.894110:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200071808 00000100:00100000:3.0:1713279317.894115:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200071808 00000100:00100000:3.0:1713279317.894141:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98964 00000100:00100000:3.0:1713279317.894146:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+52:8074:x1796503200071808:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279317.894226:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+53:8074:x1796503200071808:12345-0@lo:1000:osp_up0-1.0 Request processed in 79us (139us total) trans 4295202829 rc 0/0 00000100:00100000:3.0:1713279317.894233:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98964 00000100:00100000:0.0:1713279317.894240:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095a69880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200071808:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279317.894247:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32024 rpc_version 32024 00000020:00100000:0.0:1713279317.894256:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279317.894261:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880095a6b800 x1796503200071936/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279317.894272:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095a6b800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200071936:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279317.894295:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279317.894305:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a840 going to sleep for 11 seconds 00000100:00100000:3.0:1713279317.894312:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200071936 00000100:00100000:3.0:1713279317.894316:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200071936 00000100:00100000:3.0:1713279317.894331:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98965 00000100:00100000:3.0:1713279317.894335:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+53:8074:x1796503200071936:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279317.894399:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+54:8074:x1796503200071936:12345-0@lo:1000:osp_up0-1.0 Request processed in 62us (102us total) trans 4295202830 rc 0/0 00000100:00100000:3.0:1713279317.894405:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98965 00000100:00100000:0.0:1713279317.894433:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095a6b800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200071936:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1713279317.894440:0:8074:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eafd780 version 32025 rpc_version 32025 00000020:00100000:0.0:1713279317.894451:0:8074:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713279317.894455:0:8074:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880095a69180 x1796503200072064/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713279317.894467:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095a69180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200072064:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713279317.894490:0:8074:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279317.894500:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e2a840 going to sleep for 11 seconds 00000100:00100000:3.0:1713279317.894507:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072064 00000100:00100000:3.0:1713279317.894511:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072064 00000100:00100000:3.0:1713279317.894526:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98966 00000100:00100000:3.0:1713279317.894530:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+54:8074:x1796503200072064:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713279317.894596:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+55:8074:x1796503200072064:12345-0@lo:1000:osp_up0-1.0 Request processed in 64us (105us total) trans 4295202831 rc 0/0 00000100:00100000:3.0:1713279317.894603:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98966 00000100:00100000:0.0:1713279317.894611:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095a69180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8074:1796503200072064:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1713279318.082710:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713279318.082744:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200072128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279318.082835:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279318.082987:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072128 00000100:00100000:3.0:1713279318.083035:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072128 00000100:00100000:3.0:1713279318.083095:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1713279318.083104:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200072128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1713279318.083141:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279318.083204:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200072128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279318.083212:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1713279318.083250:0:3492:0:(client.c:2953:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4295010222 gen 2 00000004:00080000:2.0:1713279318.083257:0:3492:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130300e00, transno 4295010218 00000004:00080000:2.0:1713279318.083276:0:3492:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130302d80, transno 4295010219 00000004:00080000:2.0:1713279318.083279:0:3492:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d180380, transno 4295010220 00000004:00080000:2.0:1713279318.083282:0:3492:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130303800, transno 4295010221 00000004:00080000:2.0:1713279318.083284:0:3492:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d182d80, transno 4295010222 00000100:00100000:2.0:1713279318.083297:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200072128:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1713279318.083507:0:10043:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 5 done 00000100:00100000:2.0:1713279318.098634:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713279318.098654:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200072192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279318.098693:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279318.098749:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072192 00000100:00100000:3.0:1713279318.098755:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072192 00000100:00100000:3.0:1713279318.098789:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1713279318.098796:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200072192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1713279318.098811:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279318.098860:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200072192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279318.098867:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1713279318.098897:0:3491:0:(client.c:2953:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4295010217 gen 2 00000004:00080000:2.0:1713279318.098903:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c160e00, transno 4295010217 00000100:00100000:2.0:1713279318.098920:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200072192:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1713279318.230674:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279318.907589:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279318.907649:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279318.907683:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279318.907693:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317248 00000100:00100000:0.0:1713279318.907705:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279318.907706:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317248 00000100:00100000:0.0:1713279318.907732:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279318.907753:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279318.907775:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317312 00000100:00100000:2.0:1713279318.907778:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317312 00000100:00100000:0.0:1713279318.907781:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279318.907791:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317504 00000100:00100000:0.0:1713279318.907797:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279318.907800:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317504 00000100:00100000:2.0:1713279318.907802:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 453 00000100:00100000:2.0:1713279318.907811:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281317248:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279318.907832:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279318.907836:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317568 00000100:00100000:3.0:1713279318.907839:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317568 00000100:00100000:1.0:1713279318.907845:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317376 00000100:00100000:1.0:1713279318.907855:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317376 00000100:00100000:3.0:1713279318.907860:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 454 00000100:00100000:0.0:1713279318.907868:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 455 00000100:00100000:3.0:1713279318.907869:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281317312:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279318.907878:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281317504:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279318.907890:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281317248:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 78us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279318.907894:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317440 00000100:00100000:1.0:1713279318.907896:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317440 00000100:00100000:2.0:1713279318.907898:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 453 00000100:00100000:1.0:1713279318.907911:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317632 00000100:00100000:1.0:1713279318.907914:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317632 00000100:00100000:3.0:1713279318.907917:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281317312:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279318.907919:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 456 00000100:00100000:0.0:1713279318.907923:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281317504:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279318.907924:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281317568:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279318.907925:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 454 00000100:00100000:1.0:1713279318.907926:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317696 00000100:00100000:1.0:1713279318.907929:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317696 00000100:00100000:0.0:1713279318.907932:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 455 00000100:00100000:1.0:1713279318.907948:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:2.0:1713279318.907948:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281317568:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279318.907955:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 456 00000100:00100000:1.0:1713279318.907956:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281317376:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279318.907962:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:3.0:1713279318.907968:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281317440:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279318.907978:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:2.0:1713279318.907984:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281317632:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279318.908028:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281317440:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 58us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279318.908035:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:1.0:1713279318.908047:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281317376:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 91us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279318.908050:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:3.0:1713279318.908055:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281317696:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279318.908057:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:2.0:1713279318.908064:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281317632:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 78us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279318.908071:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00080000:1.0:1713279318.908080:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279288 00000100:00100000:3.0:1713279318.908080:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281317696:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (248us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279318.908084:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279288 00000100:00080000:1.0:1713279318.908086:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279288 00000100:00100000:3.0:1713279318.908087:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00080000:1.0:1713279318.908089:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279288 00000100:00100000:3.0:1713279318.908105:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317184 00000100:00100000:3.0:1713279318.908109:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317184 00000100:00080000:1.0:1713279318.908135:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279288 00000100:00100000:3.0:1713279318.908136:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 387 00000100:00100000:3.0:1713279318.908141:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281317184:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279318.908192:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281317184:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 50us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279318.908199:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 387 00010000:00010000:2.0:1713279319.232662:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279320.002855:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200072256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1713279320.002933:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279320.003069:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072256 00000100:00100000:3.0:1713279320.003084:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072256 00000100:00100000:3.0:1713279320.003161:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98967 00000100:00100000:3.0:1713279320.003173:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200072256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279320.003218:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279320.003331:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200072256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279320.003344:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98967 00000100:00100000:2.0:1713279320.003384:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200072256:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279320.234729:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279321.236757:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279321.682655:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200072320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713279321.682719:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279321.682874:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072320 00000100:00100000:3.0:1713279321.682885:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072320 00000100:00100000:3.0:1713279321.682938:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98968 00000100:00100000:3.0:1713279321.682946:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+55:3492:x1796503200072320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1713279321.683008:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:3.0:1713279321.683070:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+55:3492:x1796503200072320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279321.683077:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98968 00000100:00100000:2.0:1713279321.683114:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200072320:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279322.238680:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279322.354712:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200072384:0@lo:400:kworker.0 00000100:00100000:1.0:1713279322.354713:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200072512:0@lo:400:kworker.0 00000100:00100000:3.0:1713279322.354713:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200072576:0@lo:400:kworker.0 00000100:00100000:0.0:1713279322.354719:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200072448:0@lo:400:kworker.0 00000100:00100000:1.0:1713279322.354800:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279322.354803:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279322.354804:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279322.354833:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200072768:0@lo:400:kworker.0 00000100:00100000:2.0:1713279322.354836:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200072640:0@lo:400:kworker.0 00000100:00100000:3.0:1713279322.354837:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200072832:0@lo:400:kworker.0 00000100:00100000:0.0:1713279322.354852:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072576 00000100:00100000:1.0:1713279322.354855:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279322.354861:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279322.354863:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072576 00000100:00100000:3.0:1713279322.354866:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279322.354868:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200073024:0@lo:400:kworker.0 00000100:00100000:2.0:1713279322.354877:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200072896:0@lo:400:kworker.0 00000100:00100000:3.0:1713279322.354880:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200073088:0@lo:400:kworker.0 00000100:00100000:1.0:1713279322.354886:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279322.354901:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279322.354919:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072768 00000100:00100000:2.0:1713279322.354919:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200073152:0@lo:400:kworker.0 00000100:00100000:3.0:1713279322.354919:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072512 00000100:00100000:0.0:1713279322.354922:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073024 00000100:00100000:1.0:1713279322.354923:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072768 00000100:00100000:3.0:1713279322.354924:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072512 00000100:00100000:0.0:1713279322.354927:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073024 00000100:00100000:2.0:1713279322.354935:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279322.354954:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072640 00000100:00100000:1.0:1713279322.354956:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1713279322.354956:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072640 00000100:00100000:1.0:1713279322.354992:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200072576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279322.355005:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98969 00000100:00100000:3.0:1713279322.355011:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+55:3491:x1796503200072512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279322.355013:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1713279322.355022:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1713279322.355025:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200072768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279322.355031:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200073024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279322.355040:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200072576:12345-0@lo:400:kworker.0 Request processed in 77us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279322.355048:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1713279322.355059:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+55:3491:x1796503200072512:12345-0@lo:400:kworker.0 Request processed in 47us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279322.355066:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98969 00000100:00100000:1.0:1713279322.355074:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072832 00000100:00100000:1.0:1713279322.355078:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072832 00000100:00100000:2.0:1713279322.355079:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200073024:12345-0@lo:400:kworker.0 Request processed in 49us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279322.355079:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98970 00000100:00100000:3.0:1713279322.355083:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200072640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279322.355087:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1713279322.355093:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200072768:12345-0@lo:400:kworker.0 Request processed in 68us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279322.355099:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072896 00000100:00100000:1.0:1713279322.355102:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072896 00000100:00100000:0.0:1713279322.355106:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1713279322.355110:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200072640:12345-0@lo:400:kworker.0 Request processed in 26us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279322.355114:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073152 00000100:00100000:3.0:1713279322.355116:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98970 00000100:00100000:1.0:1713279322.355117:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073152 00000100:00100000:2.0:1713279322.355118:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1713279322.355124:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200072832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279322.355148:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279322.355149:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200072832:12345-0@lo:400:kworker.0 Request processed in 25us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279322.355155:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1713279322.355155:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200072512:0@lo:400:kworker.0 00000100:00100000:2.0:1713279322.355160:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1713279322.355161:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200072896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279322.355169:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200072768:0@lo:400:kworker.0 00000100:00100000:2.0:1713279322.355175:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1713279322.355176:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200072704:0@lo:400:kworker.0 00000100:00100000:2.0:1713279322.355179:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200073152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279322.355180:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200073024:0@lo:400:kworker.0 00000100:00100000:1.0:1713279322.355197:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200072896:12345-0@lo:400:kworker.0 Request processed in 36us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279322.355204:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1713279322.355207:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200073152:12345-0@lo:400:kworker.0 Request processed in 27us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279322.355214:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279322.355216:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1713279322.355216:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1713279322.355220:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279292 00000100:00080000:1.0:1713279322.355224:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279292 00000100:00100000:2.0:1713279322.355225:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073088 00000100:00080000:1.0:1713279322.355226:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279292 00000100:00100000:2.0:1713279322.355230:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073088 00000100:00100000:0.0:1713279322.355238:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200072960:0@lo:400:kworker.0 00000100:00100000:3.0:1713279322.355239:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200072576:0@lo:400:kworker.0 00000100:00080000:1.0:1713279322.355247:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279292 00000100:00100000:3.0:1713279322.355249:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200072832:0@lo:400:kworker.0 00000100:00100000:2.0:1713279322.355256:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1713279322.355260:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200073088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279322.355266:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279322.355273:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072384 00000100:00100000:1.0:1713279322.355276:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072384 00000100:00100000:3.0:1713279322.355282:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072448 00000100:00100000:3.0:1713279322.355286:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072448 00000100:00100000:2.0:1713279322.355289:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200073088:12345-0@lo:400:kworker.0 Request processed in 28us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279322.355295:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1713279322.355300:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1713279322.355304:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200072384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279322.355305:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072704 00000100:00100000:0.0:1713279322.355308:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200072960 00000100:00100000:3.0:1713279322.355308:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072704 00000100:00100000:0.0:1713279322.355314:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200072960 00000100:00100000:3.0:1713279322.355324:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:3.0:1713279322.355328:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200072448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279322.355331:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200072640:0@lo:400:kworker.0 00000100:00100000:1.0:1713279322.355332:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200072384:12345-0@lo:400:kworker.0 Request processed in 26us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279322.355339:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1713279322.355343:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200072896:0@lo:400:kworker.0 00000100:00100000:0.0:1713279322.355346:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1713279322.355351:0:3493:0:(client.c:2953:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4295010167 gen 2 00000100:00100000:0.0:1713279322.355354:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200072704:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1713279322.355357:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279292 00000004:00080000:2.0:1713279322.355357:0:3493:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997f8000, transno 4295010156 00000100:00080000:1.0:1713279322.355361:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279292 00000004:00080000:2.0:1713279322.355364:0:3493:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997f9f80, transno 4295010157 00000100:00100000:3.0:1713279322.355365:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200072448:12345-0@lo:400:kworker.0 Request processed in 35us (218us total) trans 0 rc 0/0 00000004:00080000:2.0:1713279322.355366:0:3493:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997f9880, transno 4295010158 00000004:00080000:2.0:1713279322.355369:0:3493:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c03b80, transno 4295010159 00000100:00100000:1.0:1713279322.355371:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000004:00080000:2.0:1713279322.355372:0:3493:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096756a00, transno 4295010160 00000004:00080000:2.0:1713279322.355375:0:3493:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c01180, transno 4295010161 00000100:00100000:3.0:1713279322.355375:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1713279322.355377:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200072960:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1713279322.355378:0:3493:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009764c000, transno 4295010162 00000004:00080000:2.0:1713279322.355380:0:3493:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009764e680, transno 4295010163 00000004:00080000:2.0:1713279322.355383:0:3493:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009764d880, transno 4295010164 00000004:00080000:2.0:1713279322.355385:0:3493:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130291880, transno 4295010165 00000004:00080000:2.0:1713279322.355388:0:3493:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c019f80, transno 4295010166 00000004:00080000:2.0:1713279322.355391:0:3493:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c018380, transno 4295010167 00000100:00100000:2.0:1713279322.355395:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200073152:0@lo:400:kworker.0 00000100:00100000:1.0:1713279322.355406:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200072960:12345-0@lo:400:kworker.0 Request processed in 28us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279322.355409:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200072704:12345-0@lo:400:kworker.0 Request processed in 52us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279322.355441:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1713279322.355456:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200072384:0@lo:400:kworker.0 00000100:00100000:0.0:1713279322.355465:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1713279322.355519:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200072448:0@lo:400:kworker.0 00000100:00100000:0.0:1713279322.355536:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200072704:0@lo:400:kworker.0 00000100:00100000:0.0:1713279322.355551:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200072960:0@lo:400:kworker.0 00000004:00080000:3.0:1713279322.355559:0:11413:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 11 done 00000100:00100000:3.0:1713279322.355603:0:3492:0:(client.c:2953:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4295010155 gen 2 00000004:00080000:3.0:1713279322.355607:0:3492:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009764dc00, transno 4295010154 00000004:00080000:3.0:1713279322.355630:0:3492:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009764fb80, transno 4295010155 00000100:00100000:3.0:1713279322.355635:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200073088:0@lo:400:kworker.0 00000100:00100000:2.0:1713279322.370571:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713279322.370585:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200073216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279322.370623:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279322.370644:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200073280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279322.370654:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073216 00000100:00100000:2.0:1713279322.370660:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279322.370663:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073216 00000100:00100000:3.0:1713279322.370687:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073280 00000100:00100000:3.0:1713279322.370694:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073280 00000100:00100000:0.0:1713279322.370702:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1713279322.370711:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200073216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279322.370723:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1713279322.370733:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200073280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279322.370744:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:1.0:1713279322.370754:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279322.370824:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200073280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279322.370826:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200073216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279322.370836:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1713279322.370850:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1713279322.370856:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200073280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279322.370868:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200073216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279323.090771:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713279323.090801:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200073344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279323.090878:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279323.090945:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073344 00000100:00100000:2.0:1713279323.090957:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073344 00000100:00100000:2.0:1713279323.091059:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1713279323.091071:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200073344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279323.091114:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279323.091198:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200073344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279323.091211:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1713279323.091272:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200073344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279323.106604:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200073408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279323.106652:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279323.106712:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073408 00000100:00100000:2.0:1713279323.106722:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073408 00000100:00100000:2.0:1713279323.106772:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1713279323.106781:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200073408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279323.106803:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279323.106875:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200073408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279323.106887:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1713279323.106941:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200073408:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1713279323.240779:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1713279323.892145:0:6911:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202831 is committed 00000100:00100000:0.0:1713279323.915281:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279323.915329:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279323.915356:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279323.915372:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317760 00000100:00100000:0.0:1713279323.915376:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279323.915383:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317760 00000100:00100000:0.0:1713279323.915405:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279323.915447:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279323.915465:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279323.915465:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317824 00000100:00100000:1.0:1713279323.915467:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 389 00000100:00100000:2.0:1713279323.915475:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317824 00000100:00100000:1.0:1713279323.915476:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281317760:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279323.915483:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279323.915507:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317952 00000100:00100000:0.0:1713279323.915511:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279323.915514:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281317888 00000100:00100000:2.0:1713279323.915516:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317888 00000100:00100000:3.0:1713279323.915517:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281317952 00000100:00100000:2.0:1713279323.915532:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318080 00000100:00100000:2.0:1713279323.915534:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318080 00000100:00100000:1.0:1713279323.915544:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281317760:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279323.915548:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318144 00000100:00100000:2.0:1713279323.915550:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318144 00000100:00100000:3.0:1713279323.915553:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318016 00000100:00100000:1.0:1713279323.915555:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 389 00000100:00100000:3.0:1713279323.915556:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318016 00000100:00100000:2.0:1713279323.915568:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 463 00000100:00100000:3.0:1713279323.915571:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318208 00000100:00100000:3.0:1713279323.915573:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318208 00000100:00100000:2.0:1713279323.915576:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281317824:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279323.915585:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318272 00000100:00100000:3.0:1713279323.915588:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318272 00000100:00080000:1.0:1713279323.915594:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279293 00000100:00080000:1.0:1713279323.915600:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279293 00000100:00080000:1.0:1713279323.915604:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279293 00000100:00080000:1.0:1713279323.915608:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279293 00000100:00100000:3.0:1713279323.915608:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00080000:1.0:1713279323.915612:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279293 00000100:00100000:0.0:1713279323.915616:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 464 00000100:00100000:3.0:1713279323.915616:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281317952:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279323.915626:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281317888:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279323.915629:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281317824:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 53us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279323.915631:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 465 00000100:00100000:2.0:1713279323.915637:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 463 00000100:00100000:1.0:1713279323.915640:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281318080:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279323.915655:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 466 00000100:00100000:2.0:1713279323.915660:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281318144:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279323.915660:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281317952:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 44us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279323.915668:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:0.0:1713279323.915671:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281317888:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279323.915679:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 464 00000100:00100000:3.0:1713279323.915683:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 106 00000100:00100000:2.0:1713279323.915687:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281318144:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279323.915688:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281318080:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279323.915688:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281318016:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279323.915694:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 466 00000100:00100000:1.0:1713279323.915708:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 465 00000100:00100000:3.0:1713279323.915711:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281318016:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279323.915718:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 106 00000100:00100000:2.0:1713279323.915724:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 107 00000100:00100000:2.0:1713279323.915729:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281318208:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279323.915729:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 108 00000100:00100000:3.0:1713279323.915734:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281318272:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279323.915755:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281318208:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279323.915762:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 107 00000100:00100000:3.0:1713279323.915766:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281318272:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279323.915773:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 108 00010000:00010000:2.0:1713279324.242736:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279325.010672:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713279325.010699:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200073472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279325.010772:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279325.010865:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073472 00000100:00100000:1.0:1713279325.010876:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073472 00000100:00100000:1.0:1713279325.010938:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98971 00000100:00100000:1.0:1713279325.010982:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200073472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1713279325.011023:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:1.0:1713279325.011088:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200073472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279325.011101:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98971 00000100:00100000:0.0:1713279325.011148:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200073472:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1713279325.244754:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279326.246657:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279326.690726:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200073536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279326.690803:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279326.690995:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073536 00000100:00100000:1.0:1713279326.691007:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073536 00000100:00100000:1.0:1713279326.691067:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98972 00000100:00100000:1.0:1713279326.691075:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200073536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1713279326.691112:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:1.0:1713279326.691174:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200073536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279326.691182:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98972 00000100:00100000:0.0:1713279326.691284:0:3491:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4295202831 gen 2 00000004:00080000:0.0:1713279326.691297:0:3491:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202827 committed transno 4295202831 00000004:00080000:0.0:1713279326.691329:0:3491:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202828 committed transno 4295202831 00000004:00080000:0.0:1713279326.691350:0:3491:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202829 committed transno 4295202831 00000004:00080000:0.0:1713279326.691368:0:3491:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202830 committed transno 4295202831 00000004:00080000:0.0:1713279326.691387:0:3491:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202831 committed transno 4295202831 00000100:00100000:0.0:1713279326.691469:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200073536:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279327.248699:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279327.362694:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200073600:0@lo:400:kworker.0 00000100:00100000:0.0:1713279327.362768:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200073664:0@lo:400:kworker.0 00000100:00100000:3.0:1713279327.362768:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279327.362803:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073600 00000100:00100000:1.0:1713279327.362804:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200073792:0@lo:400:kworker.0 00000100:00100000:2.0:1713279327.362815:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073600 00000100:00100000:3.0:1713279327.362818:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200073856:0@lo:400:kworker.0 00000100:00100000:0.0:1713279327.362820:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279327.362859:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279327.362864:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200073920:0@lo:400:kworker.0 00000100:00100000:2.0:1713279327.362871:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1713279327.362874:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279327.362880:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200073600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279327.362884:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200074112:0@lo:400:kworker.0 00000100:00080000:0.0:1713279327.362901:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279297 00000100:00100000:0.0:1713279327.362917:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073664 00000100:00100000:1.0:1713279327.362920:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200074048:0@lo:400:kworker.0 00000100:00100000:0.0:1713279327.362922:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073664 00000100:00100000:2.0:1713279327.362980:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200073600:12345-0@lo:400:kworker.0 Request processed in 99us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279327.362984:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073792 00000100:00100000:0.0:1713279327.362988:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073792 00000100:00100000:2.0:1713279327.362988:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1713279327.362988:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279327.363015:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1713279327.363021:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200073664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279327.363025:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1713279327.363032:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200074368:0@lo:400:kworker.0 00000100:00100000:1.0:1713279327.363037:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200073792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279327.363043:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200073728:0@lo:400:kworker.0 00000100:00100000:3.0:1713279327.363067:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279327.363070:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200073664:12345-0@lo:400:kworker.0 Request processed in 48us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279327.363073:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279327.363078:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1713279327.363098:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200073600:0@lo:400:kworker.0 00000100:00100000:0.0:1713279327.363099:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279327.363099:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200073792:12345-0@lo:400:kworker.0 Request processed in 62us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279327.363102:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200073984:0@lo:400:kworker.0 00000100:00100000:1.0:1713279327.363111:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:0.0:1713279327.363113:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200074176:0@lo:400:kworker.0 00000100:00100000:2.0:1713279327.363121:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279327.363133:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073856 00000100:00100000:0.0:1713279327.363136:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279327.363136:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200074240:0@lo:400:kworker.0 00000100:00100000:1.0:1713279327.363138:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073920 00000100:00100000:3.0:1713279327.363138:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073856 00000100:00100000:1.0:1713279327.363144:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073920 00000100:00100000:2.0:1713279327.363154:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279327.363164:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073728 00000100:00100000:0.0:1713279327.363166:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200073664:0@lo:400:kworker.0 00000100:00100000:3.0:1713279327.363167:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073728 00000100:00100000:1.0:1713279327.363182:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200073984 00000100:00100000:3.0:1713279327.363182:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98973 00000100:00100000:2.0:1713279327.363183:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074176 00000100:00100000:1.0:1713279327.363187:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200073984 00000100:00100000:3.0:1713279327.363187:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200073856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279327.363188:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074240 00000100:00100000:2.0:1713279327.363188:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074176 00000100:00100000:0.0:1713279327.363191:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074240 00000100:00100000:1.0:1713279327.363212:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1713279327.363218:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1713279327.363220:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200073920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279327.363235:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200073984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279327.363238:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200073856:12345-0@lo:400:kworker.0 Request processed in 49us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279327.363244:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1713279327.363245:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98973 00000100:00100000:2.0:1713279327.363253:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200074240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279327.363258:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98974 00000100:00100000:3.0:1713279327.363263:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200073728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279327.363274:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200073984:12345-0@lo:400:kworker.0 Request processed in 39us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279327.363281:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1713279327.363289:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200073920:12345-0@lo:400:kworker.0 Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279327.363292:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200073728:12345-0@lo:400:kworker.0 Request processed in 28us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279327.363294:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1713279327.363299:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200074176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279327.363299:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98974 00000100:00100000:1.0:1713279327.363307:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1713279327.363312:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200074240:12345-0@lo:400:kworker.0 Request processed in 58us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279327.363319:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074112 00000100:00100000:0.0:1713279327.363322:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200074176:12345-0@lo:400:kworker.0 Request processed in 22us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279327.363322:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074112 00000100:00100000:2.0:1713279327.363324:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1713279327.363329:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1713279327.363341:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074368 00000100:00100000:3.0:1713279327.363343:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074368 00000100:00080000:0.0:1713279327.363348:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279297 00000100:00100000:1.0:1713279327.363349:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1713279327.363352:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279297 00000100:00080000:0.0:1713279327.363354:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279297 00000100:00100000:1.0:1713279327.363355:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200074112:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1713279327.363356:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279297 00000100:00100000:3.0:1713279327.363361:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1713279327.363366:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200074368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279327.363376:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200073920:0@lo:400:kworker.0 00000100:00100000:0.0:1713279327.363385:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200074176:0@lo:400:kworker.0 00000100:00100000:1.0:1713279327.363397:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200074112:12345-0@lo:400:kworker.0 Request processed in 42us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279327.363398:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200074368:12345-0@lo:400:kworker.0 Request processed in 31us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279327.363404:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1713279327.363404:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200073728:0@lo:400:kworker.0 00000100:00100000:3.0:1713279327.363408:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1713279327.363454:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279327.363464:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074048 00000100:00100000:3.0:1713279327.363467:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074048 00000100:00100000:1.0:1713279327.363474:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200074304:0@lo:400:kworker.0 00000100:00080000:0.0:1713279327.363479:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279297 00000100:00100000:2.0:1713279327.363479:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200073984:0@lo:400:kworker.0 00000100:00100000:3.0:1713279327.363487:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1713279327.363491:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200074048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279327.363492:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200074240:0@lo:400:kworker.0 00000100:00100000:1.0:1713279327.363498:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279327.363513:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074304 00000100:00100000:0.0:1713279327.363516:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074304 00000100:00100000:3.0:1713279327.363521:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200074048:12345-0@lo:400:kworker.0 Request processed in 29us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279327.363526:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200073792:0@lo:400:kworker.0 00000100:00100000:3.0:1713279327.363528:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1713279327.363532:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200073856:0@lo:400:kworker.0 00000100:00100000:1.0:1713279327.363537:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200074048:0@lo:400:kworker.0 00000100:00100000:3.0:1713279327.363538:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1713279327.363542:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200074304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279327.363543:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200074112:0@lo:400:kworker.0 00000100:00080000:0.0:1713279327.363545:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279297 00000100:00100000:2.0:1713279327.363552:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200074368:0@lo:400:kworker.0 00000100:00100000:3.0:1713279327.363588:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200074304:12345-0@lo:400:kworker.0 Request processed in 41us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279327.363597:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1713279327.363601:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200074304:0@lo:400:kworker.0 00000100:00100000:2.0:1713279327.378577:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713279327.378592:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200074432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279327.378627:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200074496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279327.378630:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279327.378660:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074432 00000100:00100000:3.0:1713279327.378664:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279327.378665:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074432 00000100:00100000:2.0:1713279327.378697:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074496 00000100:00100000:2.0:1713279327.378700:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074496 00000100:00100000:1.0:1713279327.378707:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1713279327.378720:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200074432:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279327.378735:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1713279327.378741:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200074496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1713279327.378758:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279327.378758:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279327.378799:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200074496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279327.378806:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1713279327.378818:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200074496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279327.378838:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200074432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279327.378846:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200074432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279327.378851:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1713279328.098804:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713279328.098831:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200074560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279328.098904:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279328.098997:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074560 00000100:00100000:1.0:1713279328.099012:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074560 00000100:00100000:1.0:1713279328.099086:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1713279328.099097:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200074560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1713279328.099140:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279328.099229:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200074560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279328.099248:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1713279328.099266:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200074560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279328.114617:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200074624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279328.114673:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279328.114703:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074624 00000100:00100000:1.0:1713279328.114712:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074624 00000100:00100000:1.0:1713279328.114753:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1713279328.114761:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200074624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1713279328.114780:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279328.114825:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200074624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279328.114832:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1713279328.114862:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200074624:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1713279328.250727:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279328.923505:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279328.923560:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279328.923593:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279328.923610:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279328.923636:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279328.923645:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318400 00000100:00100000:2.0:1713279328.923649:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318336 00000100:00100000:0.0:1713279328.923653:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279328.923658:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318400 00000100:00100000:2.0:1713279328.923659:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318336 00000100:00100000:0.0:1713279328.923670:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279328.923687:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279328.923711:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318464 00000100:00100000:3.0:1713279328.923714:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318464 00000100:00100000:2.0:1713279328.923718:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 391 00000100:00100000:0.0:1713279328.923721:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279328.923728:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281318336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279328.923730:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318656 00000100:00100000:3.0:1713279328.923732:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318656 00000100:00100000:1.0:1713279328.923736:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318528 00000100:00100000:0.0:1713279328.923747:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318720 00000100:00100000:1.0:1713279328.923748:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318528 00000100:00100000:0.0:1713279328.923753:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318720 00000100:00100000:3.0:1713279328.923753:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 473 00000100:00100000:3.0:1713279328.923761:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281318400:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279328.923785:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 474 00000100:00100000:0.0:1713279328.923792:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281318464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279328.923792:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318784 00000100:00100000:1.0:1713279328.923797:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318784 00000100:00100000:2.0:1713279328.923800:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281318336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 73us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279328.923809:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 391 00000100:00100000:3.0:1713279328.923809:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281318400:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279328.923817:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 473 00000100:00100000:1.0:1713279328.923818:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318592 00000100:00100000:1.0:1713279328.923832:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318592 00000100:00100000:3.0:1713279328.923843:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 475 00000100:00100000:0.0:1713279328.923847:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281318464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 54us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279328.923848:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281318656:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279328.923851:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318848 00000100:00100000:0.0:1713279328.923855:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 474 00000100:00100000:1.0:1713279328.923855:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318848 00000100:00100000:2.0:1713279328.923859:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:2.0:1713279328.923864:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281318528:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279328.923869:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281318656:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279328.923870:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 476 00000100:00100000:0.0:1713279328.923875:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281318720:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279328.923877:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 475 00000100:00100000:1.0:1713279328.923881:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:2.0:1713279328.923892:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281318528:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279328.923893:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281318784:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:3.0:1713279328.923895:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279298 00000100:00100000:0.0:1713279328.923896:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281318720:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279328.923899:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00080000:3.0:1713279328.923899:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279298 00000100:00080000:3.0:1713279328.923901:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279298 00000100:00100000:0.0:1713279328.923903:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 476 00000100:00080000:3.0:1713279328.923904:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279298 00000100:00080000:3.0:1713279328.923907:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279298 00000100:00100000:2.0:1713279328.923913:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:2.0:1713279328.923918:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281318592:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279328.923919:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:3.0:1713279328.923954:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281318848:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279328.923986:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281318592:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 65us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279328.923987:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281318848:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279328.923988:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281318784:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 94us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279328.923993:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:3.0:1713279328.923998:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:1.0:1713279328.924004:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 114 00010000:00010000:2.0:1713279329.252795:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279330.018835:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200074688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279330.018938:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279330.018990:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074688 00000100:00100000:2.0:1713279330.019001:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074688 00000100:00100000:2.0:1713279330.019039:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98975 00000100:00100000:2.0:1713279330.019047:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200074688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279330.019080:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279330.019138:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200074688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279330.019146:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98975 00000100:00100000:0.0:1713279330.019169:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200074688:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279330.254739:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279331.256781:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279331.698740:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713279331.698765:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200074752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1713279331.698833:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279331.699022:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074752 00000100:00100000:2.0:1713279331.699036:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074752 00000100:00100000:2.0:1713279331.699108:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98976 00000100:00100000:2.0:1713279331.699120:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200074752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279331.699161:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279331.699238:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200074752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279331.699246:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98976 00000100:00100000:1.0:1713279331.699304:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200074752:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279332.258791:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279332.370707:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200074880:0@lo:400:kworker.0 00000100:00100000:2.0:1713279332.370707:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200074816:0@lo:400:kworker.0 00000100:00100000:3.0:1713279332.370707:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200075008:0@lo:400:kworker.0 00000100:00100000:0.0:1713279332.370716:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200074944:0@lo:400:kworker.0 00000100:00100000:3.0:1713279332.370796:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279332.370797:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279332.370799:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279332.370830:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075008 00000100:00100000:2.0:1713279332.370834:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200075072:0@lo:400:kworker.0 00000100:00100000:3.0:1713279332.370835:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200075264:0@lo:400:kworker.0 00000100:00100000:0.0:1713279332.370837:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200075200:0@lo:400:kworker.0 00000100:00100000:1.0:1713279332.370838:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075008 00000100:00100000:0.0:1713279332.370863:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279332.370864:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279332.370875:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075200 00000100:00100000:1.0:1713279332.370877:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075200 00000100:00100000:3.0:1713279332.370878:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279332.370881:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200075456:0@lo:400:kworker.0 00000100:00100000:2.0:1713279332.370881:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200075328:0@lo:400:kworker.0 00000100:00100000:1.0:1713279332.370933:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1713279332.370939:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200075520:0@lo:400:kworker.0 00000100:00100000:0.0:1713279332.370947:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279332.370948:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200075008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279332.370948:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279332.370971:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200075584:0@lo:400:kworker.0 00000100:00100000:3.0:1713279332.370971:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075264 00000100:00100000:3.0:1713279332.370976:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075264 00000100:00100000:0.0:1713279332.370991:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075456 00000100:00100000:2.0:1713279332.370991:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279332.370997:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075456 00000100:00100000:1.0:1713279332.371022:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200075008:12345-0@lo:400:kworker.0 Request processed in 76us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279332.371024:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074816 00000100:00100000:2.0:1713279332.371030:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074816 00000100:00100000:0.0:1713279332.371035:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1713279332.371044:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200075200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279332.371050:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1713279332.371060:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1713279332.371066:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200074816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279332.371066:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075328 00000100:00100000:3.0:1713279332.371069:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075328 00000100:00100000:1.0:1713279332.371079:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1713279332.371085:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200075456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279332.371085:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075584 00000100:00100000:3.0:1713279332.371088:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075584 00000100:00100000:3.0:1713279332.371105:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1713279332.371107:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200074816:12345-0@lo:400:kworker.0 Request processed in 38us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279332.371110:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200075200:12345-0@lo:400:kworker.0 Request processed in 62us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279332.371111:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200075264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279332.371114:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1713279332.371121:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1713279332.371128:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200075456:12345-0@lo:400:kworker.0 Request processed in 42us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279332.371139:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1713279332.371148:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074944 00000100:00100000:0.0:1713279332.371152:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074944 00000100:00100000:2.0:1713279332.371154:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1713279332.371154:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200075264:12345-0@lo:400:kworker.0 Request processed in 41us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279332.371158:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200075328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279332.371162:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1713279332.371174:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075072 00000100:00100000:3.0:1713279332.371176:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1713279332.371177:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075072 00000100:00100000:3.0:1713279332.371180:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200075584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279332.371183:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200075328:12345-0@lo:400:kworker.0 Request processed in 24us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279332.371190:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1713279332.371192:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98977 00000100:00100000:0.0:1713279332.371197:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200074944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279332.371199:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279332.371203:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200075584:12345-0@lo:400:kworker.0 Request processed in 22us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279332.371211:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98978 00000100:00100000:3.0:1713279332.371211:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1713279332.371216:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200075072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279332.371226:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200075136:0@lo:400:kworker.0 00000100:00080000:3.0:1713279332.371233:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279302 00000100:00100000:0.0:1713279332.371236:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200074944:12345-0@lo:400:kworker.0 Request processed in 38us (437us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279332.371237:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279302 00000100:00080000:3.0:1713279332.371239:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279302 00000100:00100000:2.0:1713279332.371242:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200075072:12345-0@lo:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279332.371242:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279302 00000100:00100000:0.0:1713279332.371243:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98977 00000100:00100000:2.0:1713279332.371249:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98978 00000100:00100000:3.0:1713279332.371254:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279332.371259:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200074880 00000100:00100000:0.0:1713279332.371262:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200074880 00000100:00100000:1.0:1713279332.371263:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279332.371280:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075136 00000100:00100000:2.0:1713279332.371280:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200074816:0@lo:400:kworker.0 00000100:00100000:0.0:1713279332.371282:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075136 00000100:00100000:3.0:1713279332.371283:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200075008:0@lo:400:kworker.0 00000100:00100000:1.0:1713279332.371285:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200075392:0@lo:400:kworker.0 00000100:00100000:2.0:1713279332.371292:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200075072:0@lo:400:kworker.0 00000100:00100000:3.0:1713279332.371293:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200075264:0@lo:400:kworker.0 00000100:00100000:0.0:1713279332.371299:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1713279332.371304:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200075328:0@lo:400:kworker.0 00000100:00100000:0.0:1713279332.371305:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200074880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279332.371314:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200075584:0@lo:400:kworker.0 00000100:00100000:1.0:1713279332.371316:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279332.371330:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200074880:12345-0@lo:400:kworker.0 Request processed in 25us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279332.371336:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1713279332.371337:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075392 00000100:00100000:3.0:1713279332.371341:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075392 00000100:00100000:0.0:1713279332.371344:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1713279332.371348:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200075136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279332.371359:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200074880:0@lo:400:kworker.0 00000100:00100000:0.0:1713279332.371369:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200075136:12345-0@lo:400:kworker.0 Request processed in 20us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279332.371374:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1713279332.371376:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200075136:0@lo:400:kworker.0 00000100:00100000:0.0:1713279332.371381:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1713279332.371381:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200075392:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279332.371384:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279302 00000100:00100000:3.0:1713279332.371391:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075520 00000100:00100000:3.0:1713279332.371394:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075520 00000100:00100000:3.0:1713279332.371410:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1713279332.371440:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200074944:0@lo:400:kworker.0 00000100:00100000:0.0:1713279332.371454:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200075200:0@lo:400:kworker.0 00000100:00100000:2.0:1713279332.371454:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200075392:12345-0@lo:400:kworker.0 Request processed in 73us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279332.371459:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200075520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279332.371461:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1713279332.371463:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200075456:0@lo:400:kworker.0 00000100:00100000:1.0:1713279332.371466:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200075392:0@lo:400:kworker.0 00000100:00100000:3.0:1713279332.371497:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200075520:12345-0@lo:400:kworker.0 Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279332.371503:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1713279332.371518:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279302 00000100:00100000:3.0:1713279332.371535:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200075520:0@lo:400:kworker.0 00000100:00100000:1.0:1713279332.386568:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200075648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279332.386609:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279332.386659:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200075712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279332.386706:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279332.386741:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075648 00000100:00100000:2.0:1713279332.386749:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075648 00000100:00100000:3.0:1713279332.386771:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075712 00000100:00100000:3.0:1713279332.386778:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075712 00000100:00100000:2.0:1713279332.386785:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1713279332.386792:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200075648:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279332.386807:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1713279332.386814:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200075712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1713279332.386822:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279332.386832:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279332.386888:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200075648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279332.386890:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200075712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279332.386896:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1713279332.386927:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1713279332.386957:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200075712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279332.386959:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200075648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279333.106774:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200075776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279333.106873:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279333.106948:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075776 00000100:00100000:0.0:1713279333.106970:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075776 00000100:00100000:0.0:1713279333.107029:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1713279333.107037:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200075776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279333.107114:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279333.107180:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200075776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279333.107189:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1713279333.107249:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200075776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279333.122642:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713279333.122663:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200075840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1713279333.122708:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279333.122762:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075840 00000100:00100000:0.0:1713279333.122771:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075840 00000100:00100000:0.0:1713279333.122815:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1713279333.122822:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200075840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279333.122839:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279333.122892:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200075840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279333.122922:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1713279333.122975:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200075840:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1713279333.260696:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279333.931578:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279333.931649:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279333.931695:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318912 00000100:00100000:0.0:1713279333.931705:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279333.931708:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318912 00000100:00100000:0.0:1713279333.931737:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279333.931762:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279333.931774:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 393 00000100:00100000:2.0:1713279333.931786:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281318912:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279333.931789:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281318976 00000100:00100000:0.0:1713279333.931790:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279333.931799:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281318976 00000100:00100000:0.0:1713279333.931817:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279333.931859:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319040 00000100:00100000:3.0:1713279333.931865:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319040 00000100:00100000:2.0:1713279333.931873:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281318912:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 86us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279333.931878:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279333.931884:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 393 00000100:00100000:3.0:1713279333.931922:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319232 00000100:00100000:3.0:1713279333.931927:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319232 00000100:00100000:1.0:1713279333.931937:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319296 00000100:00100000:1.0:1713279333.931946:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319296 00000100:00100000:3.0:1713279333.931958:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 483 00000100:00100000:3.0:1713279333.931968:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281318976:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279333.931974:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 484 00000100:00100000:1.0:1713279333.931983:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 485 00000100:00100000:2.0:1713279333.931983:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281319040:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279333.931991:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281319232:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279333.932056:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279333.932096:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 486 00000100:00100000:0.0:1713279333.932108:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281319296:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279333.932150:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281318976:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 181us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279333.932159:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 483 00000100:00100000:2.0:1713279333.932160:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281319040:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 174us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279333.932166:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281319232:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 173us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279333.932172:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 484 00000100:00100000:1.0:1713279333.932177:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 485 00000100:00100000:3.0:1713279333.932184:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319104 00000100:00100000:3.0:1713279333.932188:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319104 00000100:00100000:3.0:1713279333.932208:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319168 00000100:00100000:3.0:1713279333.932210:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319168 00000100:00100000:2.0:1713279333.932213:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319424 00000100:00100000:2.0:1713279333.932219:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319424 00000100:00100000:0.0:1713279333.932221:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281319296:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 111us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279333.932223:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319360 00000100:00100000:3.0:1713279333.932225:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319360 00000100:00100000:1.0:1713279333.932229:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:0.0:1713279333.932234:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 486 00000100:00100000:1.0:1713279333.932235:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281319104:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279333.932241:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:3.0:1713279333.932246:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281319168:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279333.932256:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:2.0:1713279333.932264:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281319360:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279333.932302:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281319104:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279333.932310:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:3.0:1713279333.932318:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281319168:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 71us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279333.932324:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:1.0:1713279333.932330:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281319424:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279333.932330:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00080000:3.0:1713279333.932345:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279303 00000100:00080000:3.0:1713279333.932349:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279303 00000100:00080000:3.0:1713279333.932351:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279303 00000100:00080000:3.0:1713279333.932353:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279303 00000100:00080000:3.0:1713279333.932355:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279303 00000100:00100000:2.0:1713279333.932392:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281319360:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 125us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279333.932400:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281319424:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 69us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279333.932404:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:1.0:1713279333.932409:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 124 00010000:00010000:2.0:1713279334.262667:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279335.026815:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713279335.026843:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200075904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279335.026953:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279335.027020:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075904 00000100:00100000:2.0:1713279335.027032:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075904 00000100:00100000:2.0:1713279335.027091:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98979 00000100:00100000:2.0:1713279335.027103:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200075904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279335.027211:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279335.027305:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200075904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 200us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279335.027318:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98979 00000100:00100000:0.0:1713279335.027336:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200075904:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279335.264718:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279336.266713:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279336.706773:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713279336.706801:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200075968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713279336.706917:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279336.706979:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200075968 00000100:00100000:0.0:1713279336.706991:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200075968 00000100:00100000:0.0:1713279336.707049:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98980 00000100:00100000:0.0:1713279336.707058:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200075968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713279336.707095:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:0.0:1713279336.707163:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200075968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279336.707171:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98980 00000100:00100000:2.0:1713279336.707198:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200075968:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279337.268654:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279337.378690:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200076096:0@lo:400:kworker.0 00000100:00100000:3.0:1713279337.378690:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200076032:0@lo:400:kworker.0 00000100:00100000:2.0:1713279337.378739:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200076160:0@lo:400:kworker.0 00000100:00100000:0.0:1713279337.378766:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279337.378767:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279337.378797:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279337.378799:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200076288:0@lo:400:kworker.0 00000100:00100000:0.0:1713279337.378802:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200076352:0@lo:400:kworker.0 00000100:00100000:0.0:1713279337.378825:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279337.378828:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076096 00000100:00100000:2.0:1713279337.378828:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200076416:0@lo:400:kworker.0 00000100:00100000:1.0:1713279337.378837:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076096 00000100:00100000:3.0:1713279337.378837:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279337.378847:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200076608:0@lo:400:kworker.0 00000100:00100000:2.0:1713279337.378860:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279337.378896:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076160 00000100:00100000:3.0:1713279337.378898:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200076544:0@lo:400:kworker.0 00000100:00100000:0.0:1713279337.378901:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076160 00000100:00100000:1.0:1713279337.378905:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076352 00000100:00100000:1.0:1713279337.378909:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076352 00000100:00100000:2.0:1713279337.378918:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200076672:0@lo:400:kworker.0 00000100:00100000:0.0:1713279337.378926:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076288 00000100:00100000:0.0:1713279337.378929:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076288 00000100:00100000:3.0:1713279337.378937:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279337.378939:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076416 00000100:00100000:1.0:1713279337.378943:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076416 00000100:00100000:2.0:1713279337.378949:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279337.378956:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98981 00000100:00100000:0.0:1713279337.378962:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200076160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279337.378969:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076672 00000100:00100000:2.0:1713279337.378972:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1713279337.378973:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076672 00000100:00100000:2.0:1713279337.378982:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200076224:0@lo:400:kworker.0 00000100:00100000:3.0:1713279337.378982:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98982 00000100:00100000:3.0:1713279337.378993:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200076288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279337.378998:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1713279337.379009:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200076096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279337.379011:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279337.379016:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200076160:12345-0@lo:400:kworker.0 Request processed in 52us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279337.379023:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98981 00000100:00100000:2.0:1713279337.379027:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200076480:0@lo:400:kworker.0 00000100:00100000:0.0:1713279337.379048:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076224 00000100:00100000:3.0:1713279337.379049:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200076288:12345-0@lo:400:kworker.0 Request processed in 57us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279337.379051:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076224 00000100:00100000:3.0:1713279337.379059:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98982 00000100:00100000:2.0:1713279337.379060:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279337.379070:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1713279337.379075:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200076352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279337.379077:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200076096:12345-0@lo:400:kworker.0 Request processed in 68us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279337.379079:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200076736:0@lo:400:kworker.0 00000100:00100000:1.0:1713279337.379088:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00080000:3.0:1713279337.379092:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279307 00000100:00080000:3.0:1713279337.379098:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279307 00000100:00100000:0.0:1713279337.379107:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200076352:12345-0@lo:400:kworker.0 Request processed in 32us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279337.379108:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279337.379110:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1713279337.379118:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200076416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279337.379119:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1713279337.379127:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200076672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279337.379130:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1713279337.379141:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200076160:0@lo:400:kworker.0 00000100:00100000:0.0:1713279337.379150:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1713279337.379159:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200076224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279337.379159:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200076416:12345-0@lo:400:kworker.0 Request processed in 40us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279337.379159:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200076416:0@lo:400:kworker.0 00000100:00100000:1.0:1713279337.379170:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1713279337.379181:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200076672:12345-0@lo:400:kworker.0 Request processed in 51us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279337.379186:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200076672:0@lo:400:kworker.0 00000100:00100000:3.0:1713279337.379192:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1713279337.379205:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200076224:12345-0@lo:400:kworker.0 Request processed in 45us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279337.379206:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200076224:0@lo:400:kworker.0 00000100:00100000:0.0:1713279337.379215:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1713279337.379226:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076544 00000100:00100000:3.0:1713279337.379231:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076544 00000100:00100000:2.0:1713279337.379234:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076032 00000100:00100000:2.0:1713279337.379240:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076032 00000100:00100000:1.0:1713279337.379255:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076480 00000100:00100000:0.0:1713279337.379258:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279337.379260:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076736 00000100:00100000:1.0:1713279337.379261:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076480 00000100:00100000:3.0:1713279337.379263:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076736 00000100:00100000:2.0:1713279337.379275:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1713279337.379281:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1713279337.379283:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200076032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279337.379287:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200076544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279337.379293:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200076096:0@lo:400:kworker.0 00000100:00100000:1.0:1713279337.379294:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1713279337.379303:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200076736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279337.379310:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200076352:0@lo:400:kworker.0 00000100:00100000:3.0:1713279337.379327:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200076544:12345-0@lo:400:kworker.0 Request processed in 39us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279337.379333:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1713279337.379338:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200076032:12345-0@lo:400:kworker.0 Request processed in 53us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279337.379340:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076608 00000100:00100000:0.0:1713279337.379345:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076608 00000100:00100000:3.0:1713279337.379345:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1713279337.379350:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1713279337.379350:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200076480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279337.379355:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200076736:12345-0@lo:400:kworker.0 Request processed in 51us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279337.379365:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1713279337.379372:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200076480:12345-0@lo:400:kworker.0 Request processed in 22us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279337.379374:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1713279337.379378:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1713279337.379382:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200076608:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279337.379395:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279307 00000100:00080000:3.0:1713279337.379398:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279307 00000100:00100000:2.0:1713279337.379401:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200076480:0@lo:400:kworker.0 00000100:00080000:3.0:1713279337.379401:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279307 00000100:00080000:3.0:1713279337.379404:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279307 00000100:00100000:3.0:1713279337.379463:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200076800:0@lo:400:kworker.0 00000100:00100000:0.0:1713279337.379488:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200076608:12345-0@lo:400:kworker.0 Request processed in 103us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279337.379494:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279337.379499:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1713279337.379512:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200076736:0@lo:400:kworker.0 00000100:00100000:1.0:1713279337.379517:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200076608:0@lo:400:kworker.0 00000100:00100000:3.0:1713279337.379527:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200076032:0@lo:400:kworker.0 00000100:00100000:3.0:1713279337.379544:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200076288:0@lo:400:kworker.0 00000100:00100000:1.0:1713279337.379546:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076800 00000100:00100000:1.0:1713279337.379551:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076800 00000100:00100000:3.0:1713279337.379574:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200076544:0@lo:400:kworker.0 00000100:00080000:2.0:1713279337.379580:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279307 00000100:00100000:1.0:1713279337.379599:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1713279337.379607:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200076800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279337.379671:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200076800:12345-0@lo:400:kworker.0 Request processed in 62us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279337.379681:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1713279337.379719:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200076800:0@lo:400:kworker.0 00000100:00100000:1.0:1713279337.394617:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200076864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279337.394630:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713279337.394649:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200076928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279337.394679:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279337.394704:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076864 00000100:00100000:0.0:1713279337.394711:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076864 00000100:00100000:0.0:1713279337.394764:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1713279337.394771:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200076864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279337.394798:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279337.394862:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200076864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279337.394899:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1713279337.394931:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279337.394957:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200076864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279337.394991:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076928 00000100:00100000:2.0:1713279337.394999:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076928 00000100:00100000:2.0:1713279337.395027:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1713279337.395033:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200076928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1713279337.395048:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279337.395098:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200076928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279337.395104:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1713279337.395135:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200076928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279338.114641:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200076992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279338.114700:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279338.114740:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200076992 00000100:00100000:2.0:1713279338.114749:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200076992 00000100:00100000:2.0:1713279338.114820:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1713279338.114829:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200076992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279338.114884:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279338.114952:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200076992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279338.114960:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1713279338.114977:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200076992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279338.130614:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200077056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279338.130660:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279338.130747:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077056 00000100:00100000:2.0:1713279338.130758:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077056 00000100:00100000:2.0:1713279338.130812:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1713279338.130821:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200077056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279338.130854:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279338.130950:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200077056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279338.130961:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1713279338.130975:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200077056:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1713279338.270698:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279338.939296:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279338.939342:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279338.939374:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279338.939389:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319488 00000100:00100000:0.0:1713279338.939390:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279338.939402:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319488 00000100:00100000:0.0:1713279338.939407:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279338.939462:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279338.939462:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319680 00000100:00100000:1.0:1713279338.939472:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319680 00000100:00100000:0.0:1713279338.939479:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279338.939496:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279338.939508:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 395 00000100:00100000:1.0:1713279338.939516:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319744 00000100:00100000:2.0:1713279338.939517:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281319488:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279338.939520:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319744 00000100:00100000:0.0:1713279338.939528:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00080000:3.0:1713279338.939531:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279308 00000100:00080000:3.0:1713279338.939537:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279308 00000100:00080000:3.0:1713279338.939540:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279308 00000100:00100000:0.0:1713279338.939550:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319552 00000100:00100000:1.0:1713279338.939553:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319936 00000100:00100000:0.0:1713279338.939555:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319552 00000100:00100000:1.0:1713279338.939557:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319936 00000100:00100000:3.0:1713279338.939557:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320000 00000100:00100000:3.0:1713279338.939561:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320000 00000100:00100000:0.0:1713279338.939585:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319616 00000100:00100000:1.0:1713279338.939585:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:2.0:1713279338.939586:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281319488:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 70us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279338.939587:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319616 00000100:00100000:2.0:1713279338.939594:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 395 00000100:00100000:1.0:1713279338.939595:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281319680:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279338.939597:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:0.0:1713279338.939600:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319808 00000100:00100000:0.0:1713279338.939602:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319808 00000100:00100000:3.0:1713279338.939604:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281319744:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279338.939613:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281319872 00000100:00100000:0.0:1713279338.939615:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281319872 00000100:00100000:0.0:1713279338.939628:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 493 00000100:00100000:0.0:1713279338.939635:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281319552:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279338.939724:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281319744:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 116us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279338.939730:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281319680:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 135us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279338.939735:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:0.0:1713279338.939741:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281319552:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 105us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279338.939741:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:0.0:1713279338.939749:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 493 00000100:00100000:3.0:1713279338.939756:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:1.0:1713279338.939761:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:0.0:1713279338.939762:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 494 00000100:00100000:3.0:1713279338.939763:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281319936:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279338.939767:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281320000:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279338.939768:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281319616:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279338.939796:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 495 00000100:00100000:2.0:1713279338.939802:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281319808:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279338.939813:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281319616:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279338.939820:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 494 00000100:00100000:0.0:1713279338.939829:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 496 00000100:00100000:0.0:1713279338.939834:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281319872:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279338.939848:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281320000:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 79us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279338.939885:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:3.0:1713279338.939886:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281319936:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 121us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279338.939893:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281319808:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 89us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279338.939895:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:2.0:1713279338.939900:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 495 00000100:00080000:3.0:1713279338.939912:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279308 00000100:00080000:3.0:1713279338.939916:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279308 00000100:00080000:3.0:1713279338.939919:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279308 00000100:00100000:0.0:1713279338.939921:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281319872:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 85us (423us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279338.939922:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279308 00000100:00100000:0.0:1713279338.939927:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 496 00010000:00010000:2.0:1713279339.272704:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279340.034767:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713279340.034792:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200077120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279340.034884:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279340.034940:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077120 00000100:00100000:3.0:1713279340.034953:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077120 00000100:00100000:3.0:1713279340.035022:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98983 00000100:00100000:3.0:1713279340.035030:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200077120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279340.035069:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279340.035136:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200077120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279340.035144:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98983 00000100:00100000:0.0:1713279340.035176:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200077120:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279340.274718:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279341.276697:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279341.714647:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200077184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279341.714725:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279341.714812:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077184 00000100:00100000:3.0:1713279341.714823:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077184 00000100:00100000:3.0:1713279341.714897:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98984 00000100:00100000:3.0:1713279341.714905:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200077184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1713279341.714946:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:3.0:1713279341.715002:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200077184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279341.715009:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98984 00000100:00100000:0.0:1713279341.715043:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200077184:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279342.278720:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279342.386788:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200077376:0@lo:400:kworker.0 00000100:00100000:2.0:1713279342.386788:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200077248:0@lo:400:kworker.0 00000100:00100000:0.0:1713279342.386796:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200077440:0@lo:400:kworker.0 00000100:00100000:0.0:1713279342.386920:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279342.386920:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279342.386924:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279342.386962:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200077696:0@lo:400:kworker.0 00000100:00100000:2.0:1713279342.386968:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200077504:0@lo:400:kworker.0 00000100:00100000:1.0:1713279342.386974:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200077632:0@lo:400:kworker.0 00000100:00100000:0.0:1713279342.386986:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279342.386991:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279342.387001:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200077952:0@lo:400:kworker.0 00000100:00100000:2.0:1713279342.387007:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200077760:0@lo:400:kworker.0 00000100:00100000:1.0:1713279342.387008:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279342.387017:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279342.387022:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200077888:0@lo:400:kworker.0 00000100:00100000:3.0:1713279342.387033:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077440 00000100:00100000:2.0:1713279342.387037:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077376 00000100:00100000:1.0:1713279342.387043:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279342.387045:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077376 00000100:00100000:3.0:1713279342.387045:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077440 00000100:00100000:1.0:1713279342.387060:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1713279342.387062:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077632 00000100:00100000:1.0:1713279342.387066:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200077312:0@lo:400:kworker.0 00000100:00100000:0.0:1713279342.387068:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077632 00000100:00100000:2.0:1713279342.387079:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077504 00000100:00100000:1.0:1713279342.387080:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279342.387081:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077504 00000100:00100000:1.0:1713279342.387091:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200077568:0@lo:400:kworker.0 00000100:00100000:3.0:1713279342.387092:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077888 00000100:00100000:3.0:1713279342.387096:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077888 00000100:00100000:2.0:1713279342.387099:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98985 00000100:00100000:0.0:1713279342.387100:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077312 00000100:00100000:0.0:1713279342.387103:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077312 00000100:00100000:1.0:1713279342.387106:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279342.387106:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200077376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279342.387115:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077568 00000100:00100000:3.0:1713279342.387118:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077568 00000100:00100000:1.0:1713279342.387119:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200077824:0@lo:400:kworker.0 00000100:00100000:0.0:1713279342.387124:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:0.0:1713279342.387131:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200077440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279342.387134:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279342.387159:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077824 00000100:00100000:1.0:1713279342.387164:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077824 00000100:00100000:2.0:1713279342.387166:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200077376:12345-0@lo:400:kworker.0 Request processed in 60us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279342.387172:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200077440:12345-0@lo:400:kworker.0 Request processed in 41us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279342.387174:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98985 00000100:00100000:0.0:1713279342.387180:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1713279342.387192:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98986 00000100:00100000:1.0:1713279342.387196:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1713279342.387197:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200077504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279342.387201:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1713279342.387203:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200077632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279342.387206:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200077888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279342.387213:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1713279342.387221:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200077504:12345-0@lo:400:kworker.0 Request processed in 23us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279342.387222:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200077312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279342.387227:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98986 00000100:00100000:0.0:1713279342.387232:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200077888:12345-0@lo:400:kworker.0 Request processed in 25us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279342.387238:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200077632:12345-0@lo:400:kworker.0 Request processed in 35us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279342.387239:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1713279342.387245:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1713279342.387250:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1713279342.387256:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1713279342.387257:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200077824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279342.387261:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200077568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279342.387269:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077696 00000100:00100000:1.0:1713279342.387272:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077696 00000100:00100000:3.0:1713279342.387275:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200077312:12345-0@lo:400:kworker.0 Request processed in 54us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279342.387283:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1713279342.387286:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200077824:12345-0@lo:400:kworker.0 Request processed in 30us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279342.387287:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200077568:12345-0@lo:400:kworker.0 Request processed in 26us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279342.387290:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077952 00000100:00100000:1.0:1713279342.387292:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077952 00000100:00100000:2.0:1713279342.387293:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1713279342.387297:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1713279342.387309:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077248 00000100:00100000:1.0:1713279342.387310:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1713279342.387312:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077248 00000100:00100000:1.0:1713279342.387315:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200077696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279342.387322:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279342.387338:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1713279342.387339:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200077440:0@lo:400:kworker.0 00000100:00100000:2.0:1713279342.387339:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200078016:0@lo:400:kworker.0 00000100:00100000:1.0:1713279342.387343:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200077696:12345-0@lo:400:kworker.0 Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279342.387343:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200077248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279342.387350:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1713279342.387351:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200077696:0@lo:400:kworker.0 00000100:00100000:1.0:1713279342.387359:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200077760 00000100:00100000:2.0:1713279342.387359:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279342.387361:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200077760 00000100:00100000:3.0:1713279342.387371:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200077248:12345-0@lo:400:kworker.0 Request processed in 27us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279342.387375:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078016 00000100:00100000:1.0:1713279342.387378:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078016 00000100:00100000:0.0:1713279342.387381:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1713279342.387382:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1713279342.387385:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200077248:0@lo:400:kworker.0 00000100:00100000:0.0:1713279342.387386:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200077952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279342.387392:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1713279342.387395:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200077504:0@lo:400:kworker.0 00000100:00100000:1.0:1713279342.387396:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200077760:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279342.387408:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279312 00000100:00100000:0.0:1713279342.387456:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200077952:12345-0@lo:400:kworker.0 Request processed in 67us (436us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279342.387462:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279312 00000100:00100000:0.0:1713279342.387463:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1713279342.387464:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200077760:12345-0@lo:400:kworker.0 Request processed in 65us (139us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279342.387466:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279312 00000100:00080000:3.0:1713279342.387468:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279312 00000100:00100000:2.0:1713279342.387470:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1713279342.387471:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279312 00000100:00100000:1.0:1713279342.387475:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1713279342.387477:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200078016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279342.387490:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200077952:0@lo:400:kworker.0 00000100:00100000:2.0:1713279342.387509:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200078016:12345-0@lo:400:kworker.0 Request processed in 33us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279342.387515:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1713279342.387533:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200077312:0@lo:400:kworker.0 00000100:00100000:2.0:1713279342.387542:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200077760:0@lo:400:kworker.0 00000100:00100000:1.0:1713279342.387543:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200077568:0@lo:400:kworker.0 00000100:00100000:2.0:1713279342.387551:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200078016:0@lo:400:kworker.0 00000100:00100000:1.0:1713279342.387552:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200077824:0@lo:400:kworker.0 00000100:00100000:1.0:1713279342.387561:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200077376:0@lo:400:kworker.0 00000100:00100000:1.0:1713279342.387569:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200077632:0@lo:400:kworker.0 00000100:00100000:1.0:1713279342.387577:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200077888:0@lo:400:kworker.0 00000100:00100000:0.0:1713279342.402602:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200078144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279342.402615:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200078080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279342.402649:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279342.402697:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279342.402736:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078144 00000100:00100000:0.0:1713279342.402742:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078144 00000100:00100000:3.0:1713279342.402750:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078080 00000100:00100000:3.0:1713279342.402759:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078080 00000100:00100000:0.0:1713279342.402791:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1713279342.402798:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200078144:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279342.402812:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1713279342.402820:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200078080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1713279342.402824:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279342.402858:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279342.402885:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200078144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279342.402893:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1713279342.402919:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200078080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279342.402928:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1713279342.402945:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200078144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279342.402972:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200078080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279343.122635:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200078208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279343.122699:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279343.122750:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078208 00000100:00100000:3.0:1713279343.122760:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078208 00000100:00100000:3.0:1713279343.122811:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1713279343.122819:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200078208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1713279343.122870:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279343.122933:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200078208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279343.122942:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1713279343.122977:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200078208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279343.138548:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713279343.138564:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200078272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279343.138590:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279343.138624:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078272 00000100:00100000:3.0:1713279343.138630:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078272 00000100:00100000:3.0:1713279343.138660:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1713279343.138665:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200078272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1713279343.138681:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279343.138721:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200078272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279343.138729:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1713279343.138748:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200078272:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1713279343.280797:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279343.947354:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279343.947406:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279343.947484:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320064 00000100:00100000:0.0:1713279343.947488:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279343.947501:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320064 00000100:00100000:1.0:1713279343.947510:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320128 00000100:00100000:0.0:1713279343.947512:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279343.947519:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320128 00000100:00100000:0.0:1713279343.947558:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279343.947573:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279343.947579:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 397 00000100:00100000:1.0:1713279343.947583:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320192 00000100:00100000:1.0:1713279343.947585:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320192 00000100:00100000:0.0:1713279343.947587:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279343.947588:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281320064:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279343.947600:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279343.947601:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320448 00000100:00100000:1.0:1713279343.947603:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320448 00000100:00100000:1.0:1713279343.947612:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320384 00000100:00100000:1.0:1713279343.947614:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320384 00000100:00100000:2.0:1713279343.947628:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320256 00000100:00100000:0.0:1713279343.947629:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279343.947630:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 503 00000100:00100000:1.0:1713279343.947636:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281320128:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279343.947637:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320256 00000100:00100000:0.0:1713279343.947656:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 504 00000100:00100000:3.0:1713279343.947659:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281320064:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 70us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279343.947664:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281320192:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279343.947670:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 397 00000100:00100000:2.0:1713279343.947674:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320320 00000100:00100000:1.0:1713279343.947677:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281320128:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279343.947678:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320320 00000100:00100000:1.0:1713279343.947683:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 503 00000100:00100000:2.0:1713279343.947695:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320576 00000100:00100000:1.0:1713279343.947697:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 505 00000100:00100000:2.0:1713279343.947698:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320576 00000100:00100000:0.0:1713279343.947699:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281320192:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279343.947701:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281320448:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:3.0:1713279343.947704:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279313 00000100:00100000:0.0:1713279343.947705:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 504 00000100:00080000:3.0:1713279343.947709:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279313 00000100:00080000:3.0:1713279343.947712:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279313 00000100:00100000:2.0:1713279343.947715:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320512 00000100:00080000:3.0:1713279343.947715:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279313 00000100:00100000:2.0:1713279343.947718:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320512 00000100:00080000:3.0:1713279343.947718:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279313 00000100:00100000:1.0:1713279343.947719:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281320448:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 17us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279343.947723:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 506 00000100:00100000:1.0:1713279343.947727:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 505 00000100:00100000:0.0:1713279343.947728:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281320384:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279343.947746:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:0.0:1713279343.947747:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281320384:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279343.947753:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 506 00000100:00100000:3.0:1713279343.947754:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281320256:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279343.947764:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:1.0:1713279343.947770:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00100000:2.0:1713279343.947774:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281320320:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279343.947776:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:1.0:1713279343.947776:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281320576:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279343.947780:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281320512:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279343.947791:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281320256:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279343.947798:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281320512:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 17us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279343.947800:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:0.0:1713279343.947804:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:2.0:1713279343.947819:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281320320:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279343.947844:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281320576:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279343.947850:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00080000:3.0:1713279343.947854:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279313 00000100:00100000:2.0:1713279343.947855:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 138 00010000:00010000:2.0:1713279344.282643:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279345.043003:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200078336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279345.043094:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279345.043225:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078336 00000100:00100000:3.0:1713279345.043240:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078336 00000100:00100000:3.0:1713279345.043315:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98987 00000100:00100000:3.0:1713279345.043328:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200078336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279345.043374:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279345.043506:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200078336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 177us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279345.043527:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98987 00000100:00100000:0.0:1713279345.043609:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200078336:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279345.284767:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279346.286635:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279346.722771:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713279346.722799:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f1d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200078400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713279346.722908:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279346.723016:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078400 00000100:00100000:3.0:1713279346.723026:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078400 00000100:00100000:3.0:1713279346.723087:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98988 00000100:00100000:3.0:1713279346.723098:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200078400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1713279346.723142:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:3.0:1713279346.723228:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200078400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279346.723241:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98988 00000100:00100000:2.0:1713279346.723278:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f1d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200078400:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279347.288714:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279347.394629:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200078464:0@lo:400:kworker.0 00000100:00100000:3.0:1713279347.394671:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200078528:0@lo:400:kworker.0 00000100:00100000:0.0:1713279347.394725:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200078656:0@lo:400:kworker.0 00000100:00100000:2.0:1713279347.394728:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279347.394730:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279347.394766:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200078720:0@lo:400:kworker.0 00000100:00100000:3.0:1713279347.394770:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200078784:0@lo:400:kworker.0 00000100:00100000:0.0:1713279347.394791:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279347.394845:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279347.394860:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279347.394861:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078528 00000100:00100000:0.0:1713279347.394862:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200078912:0@lo:400:kworker.0 00000100:00100000:2.0:1713279347.394863:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200078976:0@lo:400:kworker.0 00000100:00100000:1.0:1713279347.394873:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078528 00000100:00100000:3.0:1713279347.394889:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200079040:0@lo:400:kworker.0 00000100:00100000:0.0:1713279347.394893:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279347.394900:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078720 00000100:00100000:2.0:1713279347.394905:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078720 00000100:00100000:0.0:1713279347.394914:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200079168:0@lo:400:kworker.0 00000100:00100000:1.0:1713279347.394916:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078656 00000100:00100000:1.0:1713279347.394921:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078656 00000100:00100000:3.0:1713279347.394921:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279347.394936:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98989 00000100:00100000:1.0:1713279347.394938:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078784 00000100:00100000:1.0:1713279347.394941:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078784 00000100:00100000:3.0:1713279347.394942:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713279347.394943:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279347.394943:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200078720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279347.394950:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200079232:0@lo:400:kworker.0 00000100:00100000:0.0:1713279347.394966:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1713279347.394968:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079040 00000100:00100000:1.0:1713279347.394972:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079040 00000100:00100000:0.0:1713279347.394977:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200078592:0@lo:400:kworker.0 00000100:00100000:3.0:1713279347.394981:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279347.394992:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200078720:12345-0@lo:400:kworker.0 Request processed in 49us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279347.394994:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1713279347.395000:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98989 00000100:00100000:1.0:1713279347.395005:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200078528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279347.395010:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279347.395016:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078464 00000100:00100000:3.0:1713279347.395021:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078464 00000100:00100000:2.0:1713279347.395028:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078592 00000100:00100000:0.0:1713279347.395031:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200078848:0@lo:400:kworker.0 00000100:00100000:2.0:1713279347.395032:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078592 00000100:00100000:2.0:1713279347.395047:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98990 00000100:00100000:2.0:1713279347.395052:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200078592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279347.395058:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1713279347.395060:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279347.395066:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200078528:12345-0@lo:400:kworker.0 Request processed in 61us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279347.395066:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200078464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279347.395077:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1713279347.395082:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200078592:12345-0@lo:400:kworker.0 Request processed in 29us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279347.395084:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200079104:0@lo:400:kworker.0 00000100:00100000:2.0:1713279347.395088:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98990 00000100:00100000:1.0:1713279347.395106:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078848 00000100:00100000:1.0:1713279347.395110:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078848 00000100:00100000:2.0:1713279347.395113:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078912 00000100:00100000:2.0:1713279347.395116:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078912 00000100:00100000:3.0:1713279347.395121:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200078464:12345-0@lo:400:kworker.0 Request processed in 53us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279347.395124:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279347.395131:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1713279347.395133:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079168 00000100:00100000:2.0:1713279347.395136:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079168 00000100:00100000:1.0:1713279347.395149:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079104 00000100:00100000:2.0:1713279347.395149:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079232 00000100:00100000:2.0:1713279347.395152:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079232 00000100:00100000:1.0:1713279347.395154:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079104 00000100:00100000:2.0:1713279347.395166:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1713279347.395170:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200078912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279347.395172:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1713279347.395173:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200078592:0@lo:400:kworker.0 00000100:00100000:1.0:1713279347.395178:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1713279347.395180:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b3cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200078656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279347.395185:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200078784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279347.395195:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200078912:12345-0@lo:400:kworker.0 Request processed in 24us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279347.395201:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1713279347.395206:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200078912:0@lo:400:kworker.0 00000100:00100000:2.0:1713279347.395210:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1713279347.395214:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200079168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279347.395226:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200078656:0@lo:400:kworker.0 00000100:00100000:1.0:1713279347.395226:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200078784:12345-0@lo:400:kworker.0 Request processed in 38us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279347.395226:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b3cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200078656:12345-0@lo:400:kworker.0 Request processed in 44us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279347.395234:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200079168:12345-0@lo:400:kworker.0 Request processed in 19us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279347.395236:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1713279347.395241:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1713279347.395242:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1713279347.395249:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1713279347.395253:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200079232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279347.395254:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200079168:0@lo:400:kworker.0 00000100:00100000:2.0:1713279347.395271:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200079232:12345-0@lo:400:kworker.0 Request processed in 17us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279347.395276:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1713279347.395296:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1713279347.395300:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279347.395307:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200079040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279347.395321:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200078464:0@lo:400:kworker.0 00000100:00100000:2.0:1713279347.395339:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200078720:0@lo:400:kworker.0 00000100:00100000:1.0:1713279347.395350:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1713279347.395354:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200078976 00000100:00100000:1.0:1713279347.395357:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200078848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279347.395357:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200078976 00000100:00100000:0.0:1713279347.395367:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200079040:12345-0@lo:400:kworker.0 Request processed in 59us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279347.395372:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1713279347.395376:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200078976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279347.395379:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1713279347.395407:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200078976:12345-0@lo:400:kworker.0 Request processed in 29us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279347.395408:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200078848:12345-0@lo:400:kworker.0 Request processed in 49us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279347.395409:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1713279347.395457:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1713279347.395460:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200079104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279347.395464:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1713279347.395494:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200078976:0@lo:400:kworker.0 00000100:00100000:0.0:1713279347.395510:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200079104:12345-0@lo:400:kworker.0 Request processed in 51us (385us total) trans 0 rc 0/0 00000100:00080000:2.0:1713279347.395518:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279317 00000100:00100000:0.0:1713279347.395520:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00080000:2.0:1713279347.395522:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279317 00000100:00080000:2.0:1713279347.395524:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279317 00000100:00080000:2.0:1713279347.395526:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279317 00000100:00080000:2.0:1713279347.395529:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279317 00000100:00100000:0.0:1713279347.395565:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200078848:0@lo:400:kworker.0 00000100:00100000:0.0:1713279347.395576:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200079104:0@lo:400:kworker.0 00000100:00100000:3.0:1713279347.396491:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200079232:0@lo:400:kworker.0 00000100:00100000:3.0:1713279347.396504:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200079040:0@lo:400:kworker.0 00000100:00100000:3.0:1713279347.396514:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200078784:0@lo:400:kworker.0 00000100:00100000:3.0:1713279347.396522:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200078528:0@lo:400:kworker.0 00000100:00100000:2.0:1713279347.410559:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713279347.410573:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200079296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279347.410616:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279347.410617:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200079360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279347.410656:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279347.410694:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079296 00000100:00100000:0.0:1713279347.410702:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079296 00000100:00100000:1.0:1713279347.410720:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079360 00000100:00100000:1.0:1713279347.410727:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079360 00000100:00100000:0.0:1713279347.410757:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1713279347.410763:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200079296:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279347.410770:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1713279347.410776:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200079360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279347.410787:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:1.0:1713279347.410791:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279347.410857:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200079296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279347.410865:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200079360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279347.410868:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1713279347.410873:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1713279347.410886:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200079296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279347.410933:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200079360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279348.130715:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200079424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279348.130874:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279348.130967:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079424 00000100:00100000:1.0:1713279348.130979:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079424 00000100:00100000:1.0:1713279348.131039:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1713279348.131047:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200079424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1713279348.131080:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279348.131134:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200079424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279348.131151:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1713279348.131183:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200079424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279348.146648:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713279348.146669:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200079488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1713279348.146717:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279348.146848:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079488 00000100:00100000:1.0:1713279348.146857:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079488 00000100:00100000:1.0:1713279348.146910:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1713279348.146918:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200079488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1713279348.146937:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279348.147005:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200079488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279348.147017:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1713279348.147054:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200079488:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1713279348.290672:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279348.955523:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279348.955569:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279348.955611:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279348.955627:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279348.955651:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279348.955668:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279348.955670:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320640 00000100:00100000:3.0:1713279348.955681:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320704 00000100:00100000:0.0:1713279348.955682:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279348.955682:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320640 00000100:00100000:3.0:1713279348.955690:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320704 00000100:00100000:0.0:1713279348.955697:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279348.955714:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320768 00000100:00100000:1.0:1713279348.955725:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320768 00000100:00100000:3.0:1713279348.955735:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320960 00000100:00100000:2.0:1713279348.955736:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 399 00000100:00100000:0.0:1713279348.955738:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279348.955738:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320960 00000100:00100000:2.0:1713279348.955745:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281320640:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279348.955762:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320832 00000100:00100000:1.0:1713279348.955764:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321024 00000100:00100000:1.0:1713279348.955767:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321024 00000100:00100000:0.0:1713279348.955768:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320832 00000100:00100000:3.0:1713279348.955771:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 513 00000100:00100000:3.0:1713279348.955778:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281320704:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279348.955820:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 514 00000100:00100000:0.0:1713279348.955825:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321088 00000100:00100000:0.0:1713279348.955828:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321088 00000100:00100000:1.0:1713279348.955828:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281320768:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279348.955838:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281320640:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 93us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279348.955842:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281320896 00000100:00100000:0.0:1713279348.955844:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281320896 00000100:00100000:2.0:1713279348.955845:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 399 00000100:00100000:0.0:1713279348.955856:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321152 00000100:00100000:0.0:1713279348.955858:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321152 00000100:00100000:3.0:1713279348.955858:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281320704:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 80us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279348.955866:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 513 00000100:00100000:0.0:1713279348.955872:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00100000:0.0:1713279348.955879:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281320832:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279348.955880:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281320768:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 50us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279348.955883:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 515 00000100:00100000:2.0:1713279348.955884:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 146 00000100:00100000:3.0:1713279348.955888:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281320960:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279348.955890:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281321088:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279348.955892:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 514 00000100:00100000:3.0:1713279348.955909:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281320960:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279348.955915:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 516 00000100:00100000:0.0:1713279348.955919:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281320832:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279348.955923:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281321024:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279348.955929:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00100000:3.0:1713279348.955930:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 515 00000100:00100000:2.0:1713279348.955932:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281321088:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279348.955939:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 146 00000100:00100000:0.0:1713279348.955943:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00100000:0.0:1713279348.955948:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281320896:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279348.955953:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 148 00000100:00100000:2.0:1713279348.955958:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281321152:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279348.955963:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281321024:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279348.955968:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281320896:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279348.955974:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 516 00000100:00100000:0.0:1713279348.955976:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00100000:2.0:1713279348.955976:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281321152:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 17us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279348.955983:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 148 00000100:00080000:3.0:1713279348.955984:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279318 00000100:00080000:3.0:1713279348.955988:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279318 00000100:00080000:3.0:1713279348.955990:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279318 00000100:00080000:3.0:1713279348.955992:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279318 00000100:00080000:3.0:1713279348.955994:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279318 00010000:00010000:2.0:1713279349.292581:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279350.050638:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200079552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279350.050693:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279350.050726:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079552 00000100:00100000:1.0:1713279350.050734:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079552 00000100:00100000:1.0:1713279350.050768:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98991 00000100:00100000:1.0:1713279350.050776:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200079552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1713279350.050812:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:1.0:1713279350.050850:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200079552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279350.050855:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98991 00000100:00100000:0.0:1713279350.050887:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200079552:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279350.294611:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279351.296562:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279351.730832:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200079616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1713279351.730909:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279351.731018:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079616 00000100:00100000:1.0:1713279351.731029:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079616 00000100:00100000:1.0:1713279351.731092:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98992 00000100:00100000:1.0:1713279351.731100:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200079616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1713279351.731141:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:1.0:1713279351.731207:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200079616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279351.731220:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98992 00000100:00100000:3.0:1713279351.731276:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200079616:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279352.298683:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279352.402671:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200079744:0@lo:400:kworker.0 00000100:00100000:3.0:1713279352.402723:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713279352.402741:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279352.402750:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200079680:0@lo:400:kworker.0 00000100:00100000:3.0:1713279352.402838:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279352.402854:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713279352.402862:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200079808:0@lo:400:kworker.0 00000100:00100000:3.0:1713279352.402885:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079680 00000100:00100000:1.0:1713279352.402889:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279352.402895:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079680 00000100:00100000:2.0:1713279352.402899:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079744 00000100:00100000:2.0:1713279352.402911:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079744 00000100:00100000:0.0:1713279352.402919:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079808 00000100:00100000:1.0:1713279352.402924:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200079872:0@lo:400:kworker.0 00000100:00100000:0.0:1713279352.402928:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079808 00000100:00100000:1.0:1713279352.402942:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279352.402951:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1713279352.402961:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200079680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279352.402968:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98993 00000100:00100000:2.0:1713279352.402970:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079872 00000100:00100000:0.0:1713279352.402975:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200079808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279352.402975:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079872 00000100:00100000:1.0:1713279352.402985:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1713279352.402995:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200079744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279352.403014:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1713279352.403025:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200079872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279352.403030:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200079680:12345-0@lo:400:kworker.0 Request processed in 67us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279352.403041:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200079808:12345-0@lo:400:kworker.0 Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279352.403043:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1713279352.403049:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98993 00000100:00100000:1.0:1713279352.403053:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200079744:12345-0@lo:400:kworker.0 Request processed in 57us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279352.403065:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00080000:3.0:1713279352.403085:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279322 00000100:00100000:0.0:1713279352.403089:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200079808:0@lo:400:kworker.0 00000100:00100000:2.0:1713279352.403094:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200079872:12345-0@lo:400:kworker.0 Request processed in 69us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279352.403102:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200079744:0@lo:400:kworker.0 00000100:00100000:2.0:1713279352.403105:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1713279352.403122:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200079872:0@lo:400:kworker.0 00000100:00100000:1.0:1713279352.403136:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200079680:0@lo:400:kworker.0 00000100:00100000:0.0:1713279352.403183:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200079936:0@lo:400:kworker.0 00000100:00100000:1.0:1713279352.403208:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713279352.403209:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279352.403216:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200080000:0@lo:400:kworker.0 00000100:00100000:1.0:1713279352.403242:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279352.403267:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200079936 00000100:00100000:2.0:1713279352.403268:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080000 00000100:00100000:3.0:1713279352.403273:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200079936 00000100:00100000:2.0:1713279352.403275:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080000 00000100:00100000:0.0:1713279352.403277:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713279352.403284:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713279352.403285:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200080064:0@lo:400:kworker.0 00000100:00100000:1.0:1713279352.403291:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200080128:0@lo:400:kworker.0 00000100:00100000:3.0:1713279352.403298:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98994 00000100:00100000:3.0:1713279352.403304:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200079936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279352.403306:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279352.403311:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1713279352.403314:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279352.403319:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200080000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279352.403334:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080128 00000100:00100000:1.0:1713279352.403339:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080128 00000100:00100000:3.0:1713279352.403353:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200079936:12345-0@lo:400:kworker.0 Request processed in 48us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279352.403359:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98994 00000100:00100000:1.0:1713279352.403366:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1713279352.403367:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200079936:0@lo:400:kworker.0 00000100:00100000:1.0:1713279352.403372:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200080128:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279352.403375:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279322 00000100:00080000:3.0:1713279352.403378:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279322 00000100:00100000:2.0:1713279352.403379:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200080000:12345-0@lo:400:kworker.0 Request processed in 59us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279352.403386:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080064 00000100:00100000:3.0:1713279352.403389:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080064 00000100:00100000:0.0:1713279352.403391:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200080000:0@lo:400:kworker.0 00000100:00100000:2.0:1713279352.403392:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1713279352.403409:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200080128:12345-0@lo:400:kworker.0 Request processed in 35us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279352.403410:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1713279352.403436:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200080128:0@lo:400:kworker.0 00000100:00100000:3.0:1713279352.403452:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200080064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279352.403455:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1713279352.403487:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200080064:12345-0@lo:400:kworker.0 Request processed in 72us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279352.403494:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1713279352.403499:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200080064:0@lo:400:kworker.0 00000100:00080000:3.0:1713279352.403508:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279322 00000100:00100000:0.0:1713279352.403514:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200080192:0@lo:400:kworker.0 00000100:00100000:1.0:1713279352.403528:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713279352.403535:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279352.403540:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200080256:0@lo:400:kworker.0 00000100:00100000:2.0:1713279352.403560:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080192 00000100:00100000:2.0:1713279352.403567:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080192 00000100:00100000:1.0:1713279352.403577:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1713279352.403590:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279322 00000100:00100000:3.0:1713279352.403598:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080256 00000100:00100000:2.0:1713279352.403601:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1713279352.403602:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080256 00000100:00100000:2.0:1713279352.403609:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200080192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279352.403620:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1713279352.403624:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200080256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279352.403625:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713279352.403632:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200080320:0@lo:400:kworker.0 00000100:00100000:1.0:1713279352.403644:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200080384:0@lo:400:kworker.0 00000100:00100000:0.0:1713279352.403658:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279352.403666:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200080256:12345-0@lo:400:kworker.0 Request processed in 41us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279352.403672:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200080192:12345-0@lo:400:kworker.0 Request processed in 61us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279352.403672:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1713279352.403680:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080320 00000100:00100000:2.0:1713279352.403683:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1713279352.403683:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080320 00000100:00100000:1.0:1713279352.403684:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279352.403687:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200080256:0@lo:400:kworker.0 00000100:00100000:3.0:1713279352.403697:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1713279352.403701:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080384 00000100:00100000:3.0:1713279352.403701:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200080320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279352.403706:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080384 00000100:00100000:0.0:1713279352.403719:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200080192:0@lo:400:kworker.0 00000100:00100000:3.0:1713279352.403728:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200080320:12345-0@lo:400:kworker.0 Request processed in 26us (70us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279352.403734:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1713279352.403735:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1713279352.403743:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200080384:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279352.403746:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279322 00000100:00080000:3.0:1713279352.403748:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279322 00000100:00100000:1.0:1713279352.403750:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200080448:0@lo:400:kworker.0 00000100:00080000:3.0:1713279352.403751:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279322 00000100:00100000:0.0:1713279352.403753:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200080320:0@lo:400:kworker.0 00000100:00100000:1.0:1713279352.403814:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279352.403822:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200080384:12345-0@lo:400:kworker.0 Request processed in 77us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279352.403833:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1713279352.403851:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080448 00000100:00100000:2.0:1713279352.403856:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080448 00000100:00100000:1.0:1713279352.403881:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200080384:0@lo:400:kworker.0 00000100:00100000:2.0:1713279352.403918:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1713279352.403926:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200080448:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279352.403956:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279322 00000100:00100000:2.0:1713279352.404002:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200080448:12345-0@lo:400:kworker.0 Request processed in 74us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279352.404013:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1713279352.404049:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200080448:0@lo:400:kworker.0 00000100:00100000:0.0:1713279352.418663:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200080512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279352.418678:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200080576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279352.418709:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279352.418759:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279352.418815:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080512 00000100:00100000:0.0:1713279352.418818:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080576 00000100:00100000:0.0:1713279352.418824:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080576 00000100:00100000:2.0:1713279352.418825:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080512 00000100:00100000:0.0:1713279352.418863:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1713279352.418870:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200080576:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279352.418877:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1713279352.418889:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200080512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279352.418898:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279352.418911:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279352.418949:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200080576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279352.418962:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1713279352.418974:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200080512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279352.418986:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1713279352.419006:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200080512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279352.419010:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200080576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279353.138803:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713279353.138834:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200080640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279353.138909:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279353.138979:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080640 00000100:00100000:2.0:1713279353.138991:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080640 00000100:00100000:2.0:1713279353.139038:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1713279353.139049:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200080640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279353.139086:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279353.139164:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200080640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279353.139176:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1713279353.139217:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200080640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279353.154665:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200080704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279353.154712:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279353.154849:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080704 00000100:00100000:2.0:1713279353.154858:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080704 00000100:00100000:2.0:1713279353.154905:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1713279353.154913:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200080704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279353.154934:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279353.154980:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200080704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279353.154987:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1713279353.155003:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200080704:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1713279353.300660:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279353.963505:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279353.963568:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279353.963600:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279353.963619:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321280 00000100:00100000:0.0:1713279353.963620:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279353.963633:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321280 00000100:00100000:0.0:1713279353.963637:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279353.963651:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279353.963668:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279353.963695:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279353.963697:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321216 00000100:00100000:3.0:1713279353.963706:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321216 00000100:00100000:2.0:1713279353.963713:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321344 00000100:00100000:2.0:1713279353.963720:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321344 00000100:00100000:0.0:1713279353.963731:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279353.963747:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321536 00000100:00100000:3.0:1713279353.963748:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 401 00000100:00100000:2.0:1713279353.963750:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321536 00000100:00100000:3.0:1713279353.963786:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281321216:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279353.963789:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321408 00000100:00100000:1.0:1713279353.963790:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321600 00000100:00100000:0.0:1713279353.963796:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321408 00000100:00100000:1.0:1713279353.963799:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321600 00000100:00100000:2.0:1713279353.963807:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 523 00000100:00100000:2.0:1713279353.963815:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281321280:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279353.963827:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321472 00000100:00100000:0.0:1713279353.963829:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321472 00000100:00100000:1.0:1713279353.963840:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 524 00000100:00100000:0.0:1713279353.963843:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321664 00000100:00100000:0.0:1713279353.963845:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321664 00000100:00100000:1.0:1713279353.963848:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281321344:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279353.963858:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321728 00000100:00100000:0.0:1713279353.963860:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321728 00000100:00100000:3.0:1713279353.963860:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281321216:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 103us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279353.963863:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281321280:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279353.963868:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 401 00000100:00100000:2.0:1713279353.963871:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 523 00000100:00100000:0.0:1713279353.963877:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 153 00000100:00100000:0.0:1713279353.963885:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281321408:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279353.963889:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 525 00000100:00100000:1.0:1713279353.963893:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281321344:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279353.963894:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281321536:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279353.963901:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 524 00000100:00100000:3.0:1713279353.963908:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 526 00000100:00100000:3.0:1713279353.963913:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281321600:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279353.963917:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281321536:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279353.963924:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 525 00000100:00100000:0.0:1713279353.963927:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281321408:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279353.963936:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 154 00000100:00100000:1.0:1713279353.963942:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281321472:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279353.963942:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281321600:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279353.963947:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 153 00000100:00100000:3.0:1713279353.963954:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 526 00000100:00100000:2.0:1713279353.963957:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 155 00000100:00100000:0.0:1713279353.963965:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00100000:2.0:1713279353.963966:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281321664:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279353.963967:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281321472:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279353.963971:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281321728:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279353.963974:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 154 00000100:00100000:0.0:1713279353.963996:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281321728:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279353.964003:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00080000:3.0:1713279353.964006:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279323 00000100:00080000:3.0:1713279353.964011:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279323 00000100:00080000:3.0:1713279353.964013:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279323 00000100:00100000:2.0:1713279353.964015:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281321664:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (342us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279353.964015:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279323 00000100:00080000:3.0:1713279353.964018:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279323 00000100:00100000:2.0:1713279353.964027:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 155 00010000:00010000:2.0:1713279354.302638:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279355.058732:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200080768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279355.058831:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279355.058885:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080768 00000100:00100000:3.0:1713279355.058897:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080768 00000100:00100000:3.0:1713279355.058940:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98995 00000100:00100000:3.0:1713279355.058948:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200080768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279355.058984:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279355.059061:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200080768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279355.059069:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98995 00000100:00100000:0.0:1713279355.059105:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200080768:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279355.304625:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279356.306546:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279356.738645:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713279356.738664:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200080832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279356.738723:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279356.738775:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080832 00000100:00100000:3.0:1713279356.738782:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080832 00000100:00100000:3.0:1713279356.738818:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98996 00000100:00100000:3.0:1713279356.738824:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200080832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1713279356.738853:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:3.0:1713279356.738893:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200080832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279356.738898:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98996 00000100:00100000:0.0:1713279356.738919:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200080832:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279357.308678:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279357.410810:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200080960:0@lo:400:kworker.0 00000100:00100000:2.0:1713279357.410810:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200080896:0@lo:400:kworker.0 00000100:00100000:1.0:1713279357.410886:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200081088:0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.410896:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279357.410899:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279357.410944:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279357.410960:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200081152:0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.410961:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200081216:0@lo:400:kworker.0 00000100:00100000:1.0:1713279357.410966:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200081344:0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.410991:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279357.410992:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279357.410996:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279357.411006:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200081472:0@lo:400:kworker.0 00000100:00100000:2.0:1713279357.411010:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200081408:0@lo:400:kworker.0 00000100:00100000:1.0:1713279357.411011:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200081600:0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.411023:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279357.411033:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279357.411033:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080960 00000100:00100000:3.0:1713279357.411045:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080960 00000100:00100000:0.0:1713279357.411068:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081088 00000100:00100000:2.0:1713279357.411069:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081344 00000100:00100000:0.0:1713279357.411073:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081088 00000100:00100000:2.0:1713279357.411075:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081344 00000100:00100000:1.0:1713279357.411077:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1713279357.411086:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200081024:0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.411101:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081216 00000100:00100000:0.0:1713279357.411103:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081216 00000100:00100000:3.0:1713279357.411113:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081472 00000100:00100000:1.0:1713279357.411114:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279357.411117:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081600 00000100:00100000:3.0:1713279357.411118:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081472 00000100:00100000:0.0:1713279357.411121:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1713279357.411122:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081600 00000100:00100000:0.0:1713279357.411128:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200081088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279357.411134:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200081280:0@lo:400:kworker.0 00000100:00100000:2.0:1713279357.411148:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1713279357.411150:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1713279357.411157:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200081344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279357.411160:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200080960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279357.411162:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279357.411175:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200081088:12345-0@lo:400:kworker.0 Request processed in 46us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279357.411182:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1713279357.411182:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200081536:0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.411195:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081280 00000100:00100000:0.0:1713279357.411197:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081280 00000100:00100000:0.0:1713279357.411212:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1713279357.411217:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200081216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279357.411217:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279357.411218:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200081344:12345-0@lo:400:kworker.0 Request processed in 60us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279357.411229:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1713279357.411235:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200080960:12345-0@lo:400:kworker.0 Request processed in 74us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279357.411243:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200081216:12345-0@lo:400:kworker.0 Request processed in 26us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279357.411247:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1713279357.411252:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1713279357.411252:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1713279357.411259:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081536 00000100:00100000:2.0:1713279357.411259:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200081600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.411261:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081536 00000100:00100000:1.0:1713279357.411262:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200081088:0@lo:400:kworker.0 00000100:00100000:3.0:1713279357.411269:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1713279357.411272:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200081344:0@lo:400:kworker.0 00000100:00100000:3.0:1713279357.411276:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200081472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.411281:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1713279357.411284:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200081280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279357.411297:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200081600:12345-0@lo:400:kworker.0 Request processed in 39us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279357.411304:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1713279357.411306:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:0.0:1713279357.411310:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200081280:12345-0@lo:400:kworker.0 Request processed in 25us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279357.411312:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200081536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.411316:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1713279357.411321:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200081472:12345-0@lo:400:kworker.0 Request processed in 43us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279357.411330:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081152 00000100:00100000:3.0:1713279357.411330:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1713279357.411334:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081152 00000100:00100000:0.0:1713279357.411339:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081024 00000100:00100000:0.0:1713279357.411341:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081024 00000100:00100000:1.0:1713279357.411346:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200081536:12345-0@lo:400:kworker.0 Request processed in 34us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279357.411353:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1713279357.411355:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98997 00000100:00100000:3.0:1713279357.411359:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200080896 00000100:00100000:2.0:1713279357.411360:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200081152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.411361:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98998 00000100:00100000:3.0:1713279357.411364:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200080896 00000100:00100000:0.0:1713279357.411365:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200081024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279357.411388:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200081152:12345-0@lo:400:kworker.0 Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279357.411393:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200081024:12345-0@lo:400:kworker.0 Request processed in 27us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279357.411394:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98997 00000100:00100000:1.0:1713279357.411395:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200081024:0@lo:400:kworker.0 00000100:00100000:3.0:1713279357.411395:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1713279357.411399:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98998 00000100:00100000:3.0:1713279357.411403:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200080896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279357.411405:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200081280:0@lo:400:kworker.0 00000100:00100000:1.0:1713279357.411413:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200081536:0@lo:400:kworker.0 00000100:00100000:2.0:1713279357.411415:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279357.411450:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200081600:0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.411453:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081408 00000100:00100000:0.0:1713279357.411457:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081408 00000100:00100000:2.0:1713279357.411461:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200081664:0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.411475:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1713279357.411480:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200081408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279357.411490:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279357.411502:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200080896:12345-0@lo:400:kworker.0 Request processed in 97us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279357.411512:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200081408:12345-0@lo:400:kworker.0 Request processed in 31us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279357.411513:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200081216:0@lo:400:kworker.0 00000100:00100000:3.0:1713279357.411513:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1713279357.411518:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200080896:0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.411519:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1713279357.411523:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200081472:0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.411526:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081664 00000100:00100000:0.0:1713279357.411529:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081664 00000100:00100000:1.0:1713279357.411531:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200080960:0@lo:400:kworker.0 00000100:00100000:2.0:1713279357.411539:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200081152:0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.411541:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1713279357.411545:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200081664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279357.411549:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200081408:0@lo:400:kworker.0 00000100:00080000:3.0:1713279357.411551:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279327 00000100:00080000:3.0:1713279357.411555:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279327 00000100:00080000:3.0:1713279357.411559:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279327 00000100:00080000:3.0:1713279357.411561:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279327 00000100:00080000:3.0:1713279357.411564:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279327 00000100:00100000:0.0:1713279357.411572:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200081664:12345-0@lo:400:kworker.0 Request processed in 26us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279357.411576:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200081664:0@lo:400:kworker.0 00000100:00100000:0.0:1713279357.411577:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1713279357.426575:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713279357.426590:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200081792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279357.426611:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713279357.426628:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200081728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279357.426634:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279357.426667:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081792 00000100:00100000:3.0:1713279357.426667:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279357.426678:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081792 00000100:00100000:0.0:1713279357.426692:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081728 00000100:00100000:0.0:1713279357.426697:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081728 00000100:00100000:0.0:1713279357.426719:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1713279357.426725:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200081792:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279357.426762:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1713279357.426775:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200081728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1713279357.426778:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279357.426799:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279357.426836:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200081792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279357.426844:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1713279357.426882:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200081792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279357.426882:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200081728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279357.426896:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1713279357.426913:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200081728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279358.146650:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200081856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279358.146723:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279358.146818:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081856 00000100:00100000:2.0:1713279358.146828:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081856 00000100:00100000:2.0:1713279358.146876:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1713279358.146883:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200081856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279358.146911:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279358.146984:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200081856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279358.146994:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1713279358.147029:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200081856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279358.162652:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713279358.162674:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200081920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279358.162758:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279358.162812:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081920 00000100:00100000:0.0:1713279358.162819:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081920 00000100:00100000:0.0:1713279358.162858:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1713279358.162865:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200081920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279358.162905:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279358.162966:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200081920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279358.162973:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1713279358.163024:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200081920:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1713279358.310687:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279358.971402:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279358.971506:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279358.971518:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321792 00000100:00100000:3.0:1713279358.971530:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321792 00000100:00100000:0.0:1713279358.971539:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279358.971568:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279358.971583:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 403 00000100:00100000:3.0:1713279358.971602:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281321792:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279358.971618:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321856 00000100:00100000:2.0:1713279358.971629:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321856 00000100:00100000:0.0:1713279358.971664:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279358.971670:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281321792:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 78us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279358.971678:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 403 00000100:00100000:2.0:1713279358.971679:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321920 00000100:00100000:2.0:1713279358.971684:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321920 00000100:00100000:1.0:1713279358.971689:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322176 00000100:00100000:1.0:1713279358.971698:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322176 00000100:00080000:3.0:1713279358.971707:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279328 00000100:00080000:3.0:1713279358.971711:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279328 00000100:00080000:3.0:1713279358.971714:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279328 00000100:00100000:2.0:1713279358.971716:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 533 00000100:00100000:2.0:1713279358.971759:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281321856:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279358.971779:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 534 00000100:00100000:1.0:1713279358.971788:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281321920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279358.971791:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 535 00000100:00100000:3.0:1713279358.971798:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281322176:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279358.971817:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281321856:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 58us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279358.971830:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 533 00000100:00100000:1.0:1713279358.971844:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281321920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 56us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279358.971848:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281322176:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 50us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279358.971853:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 534 00000100:00100000:3.0:1713279358.971858:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 535 00000100:00100000:2.0:1713279358.971892:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322048 00000100:00100000:2.0:1713279358.971899:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322048 00000100:00080000:3.0:1713279358.971932:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279328 00000100:00100000:2.0:1713279358.971966:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:2.0:1713279358.971975:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281322048:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279358.971981:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279358.972002:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322304 00000100:00100000:1.0:1713279358.972007:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322304 00000100:00100000:3.0:1713279358.972021:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279358.972036:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281321984 00000100:00100000:1.0:1713279358.972039:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281321984 00000100:00100000:2.0:1713279358.972047:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281322048:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 70us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279358.972055:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:1.0:1713279358.972062:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281322304:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279358.972062:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:2.0:1713279358.972083:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:2.0:1713279358.972091:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281321984:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279358.972096:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281322304:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279358.972104:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:2.0:1713279358.972133:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281321984:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279358.972144:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00080000:3.0:1713279358.972164:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279328 00000100:00080000:3.0:1713279358.972168:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279328 00000100:00100000:0.0:1713279358.972195:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279358.972216:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322112 00000100:00100000:1.0:1713279358.972219:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322112 00000100:00100000:0.0:1713279358.972241:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279358.972269:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 536 00000100:00080000:3.0:1713279358.972272:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279328 00000100:00100000:1.0:1713279358.972275:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281322112:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279358.972306:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281322112:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279358.972311:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322240 00000100:00100000:1.0:1713279358.972312:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 536 00000100:00100000:2.0:1713279358.972318:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322240 00000100:00080000:3.0:1713279358.972340:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279328 00000100:00100000:2.0:1713279358.972358:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00100000:2.0:1713279358.972366:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281322240:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279358.972487:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281322240:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 118us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279358.972500:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 164 00010000:00010000:2.0:1713279359.312767:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279360.066790:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200081984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279360.066945:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279360.067047:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200081984 00000100:00100000:2.0:1713279360.067059:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200081984 00000100:00100000:2.0:1713279360.067135:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98999 00000100:00100000:2.0:1713279360.067144:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200081984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279360.067207:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279360.067280:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200081984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279360.067289:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98999 00000100:00100000:0.0:1713279360.067335:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200081984:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279360.314643:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279361.316806:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279361.746782:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200082048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713279361.746864:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279361.746932:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082048 00000100:00100000:0.0:1713279361.746942:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082048 00000100:00100000:0.0:1713279361.746999:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99000 00000100:00100000:0.0:1713279361.747007:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200082048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713279361.747104:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:0.0:1713279361.747174:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200082048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 167us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279361.747183:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99000 00000100:00100000:2.0:1713279361.747215:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200082048:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279362.318676:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279362.418639:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200082112:0@lo:400:kworker.0 00000100:00100000:1.0:1713279362.418685:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200082176:0@lo:400:kworker.0 00000100:00100000:3.0:1713279362.418686:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200082304:0@lo:400:kworker.0 00000100:00100000:0.0:1713279362.418741:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200082240:0@lo:400:kworker.0 00000100:00100000:2.0:1713279362.418743:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279362.418778:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200082368:0@lo:400:kworker.0 00000100:00100000:0.0:1713279362.418792:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279362.418793:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082112 00000100:00100000:1.0:1713279362.418801:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082112 00000100:00100000:3.0:1713279362.418813:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279362.418821:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082240 00000100:00100000:2.0:1713279362.418827:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082240 00000100:00100000:0.0:1713279362.418835:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200082496:0@lo:400:kworker.0 00000100:00100000:1.0:1713279362.418849:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1713279362.418856:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200082560:0@lo:400:kworker.0 00000100:00100000:1.0:1713279362.418857:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200082112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279362.418859:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279362.418861:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99001 00000100:00100000:2.0:1713279362.418867:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200082240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279362.418872:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200082752:0@lo:400:kworker.0 00000100:00100000:3.0:1713279362.418901:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279362.418912:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279362.418922:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200082816:0@lo:400:kworker.0 00000100:00100000:1.0:1713279362.418925:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200082112:12345-0@lo:400:kworker.0 Request processed in 68us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279362.418926:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200082240:12345-0@lo:400:kworker.0 Request processed in 58us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279362.418932:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1713279362.418933:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99001 00000100:00100000:3.0:1713279362.418942:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279362.418952:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200082240:0@lo:400:kworker.0 00000100:00100000:2.0:1713279362.418958:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082560 00000100:00100000:3.0:1713279362.418958:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1713279362.418962:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082560 00000100:00100000:3.0:1713279362.418965:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200082624:0@lo:400:kworker.0 00000100:00100000:0.0:1713279362.418981:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082304 00000100:00100000:2.0:1713279362.418983:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082816 00000100:00100000:2.0:1713279362.418985:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082816 00000100:00100000:0.0:1713279362.418986:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082304 00000100:00100000:3.0:1713279362.418994:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279362.418997:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082496 00000100:00100000:1.0:1713279362.419001:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082496 00000100:00100000:3.0:1713279362.419009:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200082880:0@lo:400:kworker.0 00000100:00100000:2.0:1713279362.419012:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082624 00000100:00100000:2.0:1713279362.419015:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082624 00000100:00100000:2.0:1713279362.419031:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1713279362.419036:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200082560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279362.419043:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279362.419045:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082752 00000100:00100000:0.0:1713279362.419048:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082752 00000100:00100000:1.0:1713279362.419065:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:2.0:1713279362.419068:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200082560:12345-0@lo:400:kworker.0 Request processed in 31us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279362.419072:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1713279362.419072:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200082304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279362.419075:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1713279362.419079:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200082496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279362.419083:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082880 00000100:00100000:3.0:1713279362.419083:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200082560:0@lo:400:kworker.0 00000100:00100000:2.0:1713279362.419086:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082880 00000100:00100000:2.0:1713279362.419102:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1713279362.419106:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200082816:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279362.419108:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279332 00000100:00080000:3.0:1713279362.419112:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279332 00000100:00080000:3.0:1713279362.419115:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279332 00000100:00080000:3.0:1713279362.419117:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279332 00000100:00100000:1.0:1713279362.419118:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200082304:12345-0@lo:400:kworker.0 Request processed in 46us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279362.419124:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1713279362.419128:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200082496:12345-0@lo:400:kworker.0 Request processed in 49us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279362.419133:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200082816:12345-0@lo:400:kworker.0 Request processed in 25us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279362.419136:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1713279362.419139:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1713279362.419140:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:1.0:1713279362.419145:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200082752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279362.419146:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200082624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279362.419150:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1713279362.419160:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1713279362.419164:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200082880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279362.419167:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200082752:12345-0@lo:400:kworker.0 Request processed in 21us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279362.419173:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1713279362.419184:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200082496:0@lo:400:kworker.0 00000100:00100000:3.0:1713279362.419187:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200082624:12345-0@lo:400:kworker.0 Request processed in 41us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279362.419192:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200082880:12345-0@lo:400:kworker.0 Request processed in 26us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279362.419194:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1713279362.419195:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200082752:0@lo:400:kworker.0 00000100:00100000:2.0:1713279362.419198:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1713279362.419218:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279362.419225:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279362.419233:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200082624:0@lo:400:kworker.0 00000100:00100000:1.0:1713279362.419237:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200082432:0@lo:400:kworker.0 00000100:00100000:3.0:1713279362.419245:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200082880:0@lo:400:kworker.0 00000100:00100000:3.0:1713279362.419254:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200082304:0@lo:400:kworker.0 00000100:00100000:1.0:1713279362.419261:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279362.419263:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082368 00000100:00100000:2.0:1713279362.419263:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200082112:0@lo:400:kworker.0 00000100:00100000:3.0:1713279362.419264:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200082816:0@lo:400:kworker.0 00000100:00100000:0.0:1713279362.419267:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082368 00000100:00100000:1.0:1713279362.419273:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200082688:0@lo:400:kworker.0 00000100:00100000:2.0:1713279362.419287:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082176 00000100:00100000:0.0:1713279362.419288:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99002 00000100:00100000:2.0:1713279362.419290:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082176 00000100:00100000:0.0:1713279362.419292:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200082368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279362.419297:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279362.419308:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082432 00000100:00100000:2.0:1713279362.419311:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082432 00000100:00100000:3.0:1713279362.419323:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082688 00000100:00100000:3.0:1713279362.419328:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082688 00000100:00100000:2.0:1713279362.419331:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1713279362.419333:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200082368:12345-0@lo:400:kworker.0 Request processed in 39us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279362.419336:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200082176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279362.419339:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99002 00000100:00100000:1.0:1713279362.419339:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:1.0:1713279362.419348:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200082432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279362.419355:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1713279362.419360:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200082688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279362.419369:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200082176:12345-0@lo:400:kworker.0 Request processed in 32us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279362.419375:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1713279362.419403:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200082368:0@lo:400:kworker.0 00000100:00100000:3.0:1713279362.419403:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200082688:12345-0@lo:400:kworker.0 Request processed in 39us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279362.419406:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200082432:12345-0@lo:400:kworker.0 Request processed in 52us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279362.419409:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1713279362.419467:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00080000:3.0:1713279362.419477:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279332 00000100:00100000:1.0:1713279362.419515:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200082176:0@lo:400:kworker.0 00000100:00100000:1.0:1713279362.419525:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200082432:0@lo:400:kworker.0 00000100:00100000:1.0:1713279362.419533:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200082688:0@lo:400:kworker.0 00000100:00100000:1.0:1713279362.434553:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200083008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279362.434585:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200082944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279362.434599:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279362.434658:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279362.434733:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083008 00000100:00100000:2.0:1713279362.434741:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083008 00000100:00100000:3.0:1713279362.434743:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200082944 00000100:00100000:3.0:1713279362.434751:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200082944 00000100:00100000:2.0:1713279362.434783:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1713279362.434790:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200083008:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279362.434793:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1713279362.434801:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200082944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1713279362.434848:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279362.434848:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279362.434904:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200083008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279362.434911:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1713279362.434919:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200082944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279362.434930:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1713279362.434967:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200083008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279362.434968:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200082944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279363.154736:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200083072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279363.154815:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279363.154969:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083072 00000100:00100000:0.0:1713279363.154980:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083072 00000100:00100000:0.0:1713279363.155045:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1713279363.155053:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200083072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279363.155090:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279363.155161:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200083072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279363.155169:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1713279363.155225:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200083072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279363.170669:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200083136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279363.170740:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279363.170801:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083136 00000100:00100000:2.0:1713279363.170809:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083136 00000100:00100000:2.0:1713279363.170851:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1713279363.170858:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200083136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279363.170876:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279363.170924:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200083136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279363.170931:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1713279363.170945:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200083136:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279363.320779:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279363.979523:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279363.979617:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322432 00000100:00100000:1.0:1713279363.979627:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322432 00000100:00100000:0.0:1713279363.979632:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279363.979672:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279363.979725:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279363.979726:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 543 00000100:00100000:1.0:1713279363.979735:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281322432:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279363.979736:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322368 00000100:00100000:3.0:1713279363.979744:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322368 00000100:00100000:0.0:1713279363.979753:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00080000:2.0:1713279363.979766:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279333 00000100:00080000:2.0:1713279363.979773:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279333 00000100:00100000:0.0:1713279363.979780:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279363.979787:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 405 00000100:00100000:2.0:1713279363.979789:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322496 00000100:00100000:2.0:1713279363.979795:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322496 00000100:00100000:3.0:1713279363.979797:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281322368:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279363.979805:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281322432:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 70us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279363.979811:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 543 00000100:00100000:0.0:1713279363.979819:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279363.979826:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322688 00000100:00100000:1.0:1713279363.979829:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322688 00000100:00100000:2.0:1713279363.979834:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 544 00000100:00100000:2.0:1713279363.979840:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281322496:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279363.979844:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 545 00000100:00100000:1.0:1713279363.979849:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281322688:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279363.979850:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281322368:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 53us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279363.979861:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 405 00000100:00100000:1.0:1713279363.979872:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281322688:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279363.979878:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 545 00000100:00100000:2.0:1713279363.979882:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281322496:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279363.979889:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 544 00000100:00100000:3.0:1713279363.979898:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322560 00000100:00100000:3.0:1713279363.979904:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322560 00000100:00100000:2.0:1713279363.979912:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322624 00000100:00100000:2.0:1713279363.979915:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322624 00000100:00100000:0.0:1713279363.979917:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279363.979932:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322816 00000100:00100000:3.0:1713279363.979935:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322816 00000100:00100000:2.0:1713279363.979945:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:2.0:1713279363.979951:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281322560:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279363.979954:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322752 00000100:00100000:1.0:1713279363.979959:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322752 00000100:00100000:3.0:1713279363.979962:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 170 00000100:00100000:3.0:1713279363.979969:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281322624:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279363.979979:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281322560:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279363.979985:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:1.0:1713279363.979986:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 546 00000100:00100000:0.0:1713279363.979992:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279363.979993:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281322752:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279363.979995:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 171 00000100:00100000:2.0:1713279363.979999:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281322816:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279363.980006:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281322624:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279363.980015:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 170 00000100:00100000:2.0:1713279363.980018:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281322816:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 17us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279363.980023:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 171 00000100:00100000:3.0:1713279363.980030:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322880 00000100:00100000:3.0:1713279363.980033:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322880 00000100:00100000:1.0:1713279363.980037:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281322752:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (119us total) trans 0 rc 0/0 00000100:00080000:2.0:1713279363.980041:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279333 00000100:00080000:2.0:1713279363.980044:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279333 00000100:00100000:1.0:1713279363.980046:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 546 00000100:00080000:2.0:1713279363.980046:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279333 00000100:00080000:2.0:1713279363.980047:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279333 00000100:00100000:3.0:1713279363.980056:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 172 00000100:00100000:3.0:1713279363.980062:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281322880:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279363.980091:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281322880:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279363.980100:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 172 00010000:00010000:2.0:1713279364.322619:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279365.074769:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200083200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279365.074824:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279365.074856:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083200 00000100:00100000:2.0:1713279365.074862:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083200 00000100:00100000:2.0:1713279365.074891:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99003 00000100:00100000:2.0:1713279365.074895:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200083200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279365.074919:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279365.074952:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200083200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279365.074956:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99003 00000100:00100000:0.0:1713279365.074964:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200083200:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279365.324651:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279366.326723:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279366.754820:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200083264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1713279366.754901:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279366.754968:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083264 00000100:00100000:2.0:1713279366.754979:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083264 00000100:00100000:2.0:1713279366.755034:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99004 00000100:00100000:2.0:1713279366.755042:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200083264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279366.755080:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279366.755150:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200083264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279366.755158:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99004 00000100:00100000:1.0:1713279366.755200:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200083264:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279367.328744:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279367.426737:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200083328:0@lo:400:kworker.0 00000100:00100000:0.0:1713279367.426748:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200083392:0@lo:400:kworker.0 00000100:00100000:1.0:1713279367.426768:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200083520:0@lo:400:kworker.0 00000100:00100000:0.0:1713279367.426822:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279367.426824:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279367.426868:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083392 00000100:00100000:3.0:1713279367.426870:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200083584:0@lo:400:kworker.0 00000100:00100000:0.0:1713279367.426874:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200083648:0@lo:400:kworker.0 00000100:00100000:1.0:1713279367.426878:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083392 00000100:00100000:0.0:1713279367.426896:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279367.426898:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279367.426909:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200083904:0@lo:400:kworker.0 00000100:00100000:0.0:1713279367.426926:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279367.426926:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200083840:0@lo:400:kworker.0 00000100:00100000:0.0:1713279367.426946:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713279367.426947:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083648 00000100:00100000:3.0:1713279367.426948:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279367.426952:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200084096:0@lo:400:kworker.0 00000100:00100000:1.0:1713279367.426953:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083648 00000100:00100000:0.0:1713279367.426970:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279367.426984:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083840 00000100:00100000:1.0:1713279367.426988:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083904 00000100:00100000:3.0:1713279367.426989:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083840 00000100:00100000:1.0:1713279367.426992:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083904 00000100:00100000:0.0:1713279367.427002:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1713279367.427011:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200083392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279367.427019:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:3.0:1713279367.427026:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084096 00000100:00100000:1.0:1713279367.427029:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200083648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279367.427029:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084096 00000100:00100000:2.0:1713279367.427033:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1713279367.427044:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200083904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279367.427047:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1713279367.427054:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200083840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279367.427058:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200083392:12345-0@lo:400:kworker.0 Request processed in 47us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279367.427065:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1713279367.427094:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279367.427100:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200083648:12345-0@lo:400:kworker.0 Request processed in 71us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279367.427112:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1713279367.427113:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200083776:0@lo:400:kworker.0 00000100:00100000:3.0:1713279367.427115:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200083840:12345-0@lo:400:kworker.0 Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279367.427120:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200083904:12345-0@lo:400:kworker.0 Request processed in 75us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279367.427122:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1713279367.427132:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279367.427133:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1713279367.427134:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083520 00000100:00100000:3.0:1713279367.427135:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1713279367.427139:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083520 00000100:00100000:3.0:1713279367.427140:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200084096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279367.427145:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200084032:0@lo:400:kworker.0 00000100:00100000:2.0:1713279367.427161:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1713279367.427163:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279367.427168:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200084096:12345-0@lo:400:kworker.0 Request processed in 27us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279367.427170:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200083520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279367.427174:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1713279367.427177:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1713279367.427181:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083776 00000100:00100000:0.0:1713279367.427182:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200083456:0@lo:400:kworker.0 00000100:00100000:1.0:1713279367.427182:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083328 00000100:00100000:3.0:1713279367.427184:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083776 00000100:00100000:1.0:1713279367.427187:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083328 00000100:00100000:3.0:1713279367.427197:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084032 00000100:00100000:0.0:1713279367.427199:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279367.427200:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084032 00000100:00100000:0.0:1713279367.427211:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200083712:0@lo:400:kworker.0 00000100:00100000:3.0:1713279367.427214:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1713279367.427218:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200083776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279367.427223:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1713279367.427223:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200083520:12345-0@lo:400:kworker.0 Request processed in 51us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279367.427227:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279367.427231:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200083328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279367.427234:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1713279367.427240:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200083968:0@lo:400:kworker.0 00000100:00100000:3.0:1713279367.427242:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200083776:12345-0@lo:400:kworker.0 Request processed in 22us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279367.427248:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1713279367.427252:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083712 00000100:00100000:3.0:1713279367.427255:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1713279367.427258:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279367.427259:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083712 00000100:00100000:3.0:1713279367.427260:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200084032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279367.427287:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200084032:12345-0@lo:400:kworker.0 Request processed in 26us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279367.427288:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200083328:12345-0@lo:400:kworker.0 Request processed in 55us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279367.427289:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200083520:0@lo:400:kworker.0 00000100:00100000:2.0:1713279367.427291:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083968 00000100:00100000:3.0:1713279367.427292:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1713279367.427294:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083968 00000100:00100000:0.0:1713279367.427301:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200083776:0@lo:400:kworker.0 00000100:00100000:1.0:1713279367.427306:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1713279367.427310:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200084032:0@lo:400:kworker.0 00000100:00100000:2.0:1713279367.427312:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1713279367.427317:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200083712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279367.427332:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200083328:0@lo:400:kworker.0 00000100:00100000:3.0:1713279367.427345:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200083840:0@lo:400:kworker.0 00000100:00100000:1.0:1713279367.427353:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1713279367.427357:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200083712:12345-0@lo:400:kworker.0 Request processed in 39us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279367.427362:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200083968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279367.427363:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:0.0:1713279367.427375:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200083712:0@lo:400:kworker.0 00000100:00080000:2.0:1713279367.427384:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279337 00000100:00080000:2.0:1713279367.427388:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279337 00000100:00100000:0.0:1713279367.427391:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083584 00000100:00080000:2.0:1713279367.427391:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279337 00000100:00080000:2.0:1713279367.427394:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279337 00000100:00100000:0.0:1713279367.427396:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083584 00000100:00080000:2.0:1713279367.427396:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279337 00000100:00100000:2.0:1713279367.427406:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200083456 00000100:00100000:2.0:1713279367.427409:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200083456 00000100:00100000:1.0:1713279367.427457:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200083968:12345-0@lo:400:kworker.0 Request processed in 52us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279367.427467:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99005 00000100:00100000:1.0:1713279367.427470:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1713279367.427473:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200083584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279367.427477:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99006 00000100:00100000:2.0:1713279367.427482:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200083456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279367.427518:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200083584:12345-0@lo:400:kworker.0 Request processed in 45us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279367.427519:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200083456:12345-0@lo:400:kworker.0 Request processed in 36us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279367.427525:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99005 00000100:00100000:2.0:1713279367.427529:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99006 00000100:00100000:3.0:1713279367.427529:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200083584:0@lo:400:kworker.0 00000100:00100000:0.0:1713279367.427552:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200083456:0@lo:400:kworker.0 00000100:00100000:0.0:1713279367.427561:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200083968:0@lo:400:kworker.0 00000100:00100000:2.0:1713279367.427577:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200084096:0@lo:400:kworker.0 00000100:00100000:2.0:1713279367.427588:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200083392:0@lo:400:kworker.0 00000100:00100000:2.0:1713279367.427598:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200083648:0@lo:400:kworker.0 00000100:00100000:2.0:1713279367.427607:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200083904:0@lo:400:kworker.0 00000100:00100000:3.0:1713279367.442700:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1713279367.442719:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200084224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279367.442760:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279367.442796:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200084160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279367.442814:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279367.442837:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084224 00000100:00100000:2.0:1713279367.442846:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084224 00000100:00100000:0.0:1713279367.442871:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084160 00000100:00100000:0.0:1713279367.442879:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084160 00000100:00100000:2.0:1713279367.442894:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1713279367.442901:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200084224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279367.442918:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1713279367.442929:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200084160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1713279367.442930:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:0.0:1713279367.442954:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279367.442989:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200084224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279367.442996:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1713279367.443012:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200084160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279367.443021:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1713279367.443037:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200084224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279367.443057:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200084160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279368.162731:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200084288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279368.162809:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279368.162867:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084288 00000100:00100000:0.0:1713279368.162880:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084288 00000100:00100000:0.0:1713279368.162944:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1713279368.162953:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200084288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279368.162988:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279368.163063:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200084288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279368.163076:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1713279368.163144:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200084288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279368.178657:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200084352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279368.178721:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279368.178779:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084352 00000100:00100000:2.0:1713279368.178787:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084352 00000100:00100000:2.0:1713279368.178819:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1713279368.178827:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200084352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279368.178844:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279368.178891:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200084352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279368.178899:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1713279368.178908:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200084352:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279368.330738:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279368.987457:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279368.987508:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279368.987551:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279368.987559:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281322944 00000100:00100000:1.0:1713279368.987573:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281322944 00000100:00100000:0.0:1713279368.987578:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279368.987604:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279368.987613:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323008 00000100:00100000:0.0:1713279368.987621:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279368.987622:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323008 00000100:00100000:0.0:1713279368.987639:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279368.987646:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 407 00000100:00100000:1.0:1713279368.987691:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281322944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279368.987692:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323072 00000100:00100000:0.0:1713279368.987693:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279368.987696:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323072 00000100:00100000:3.0:1713279368.987700:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323136 00000100:00100000:3.0:1713279368.987710:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323136 00000100:00100000:2.0:1713279368.987714:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323264 00000100:00100000:2.0:1713279368.987716:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323264 00000100:00100000:2.0:1713279368.987728:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323328 00000100:00100000:2.0:1713279368.987730:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323328 00000100:00100000:3.0:1713279368.987748:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323392 00000100:00100000:3.0:1713279368.987751:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323392 00000100:00100000:2.0:1713279368.987756:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 553 00000100:00100000:3.0:1713279368.987764:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323200 00000100:00100000:2.0:1713279368.987766:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281323008:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279368.987767:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323200 00000100:00100000:1.0:1713279368.987785:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281322944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 124us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279368.987787:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279368.987787:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 177 00000100:00100000:3.0:1713279368.987795:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281323136:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279368.987799:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 407 00000100:00100000:2.0:1713279368.987831:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281323008:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279368.987840:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281323136:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279368.987844:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 553 00000100:00100000:3.0:1713279368.987848:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 177 00000100:00100000:1.0:1713279368.987856:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 554 00000100:00100000:3.0:1713279368.987860:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323456 00000100:00100000:3.0:1713279368.987863:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323456 00000100:00100000:1.0:1713279368.987865:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281323072:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279368.987871:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 555 00000100:00100000:2.0:1713279368.987879:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281323264:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279368.987879:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 178 00000100:00100000:3.0:1713279368.987884:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281323392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279368.987917:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281323072:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 49us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279368.987920:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281323392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279368.987929:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 554 00000100:00100000:3.0:1713279368.987932:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 178 00000100:00100000:3.0:1713279368.987941:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 179 00000100:00100000:2.0:1713279368.987943:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281323264:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 60us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279368.987946:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281323200:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279368.987955:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 556 00000100:00100000:1.0:1713279368.987963:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281323328:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279368.987965:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 555 00000100:00100000:3.0:1713279368.987976:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281323200:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279368.987982:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 180 00000100:00100000:0.0:1713279368.987991:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281323456:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279368.987992:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 179 00000100:00080000:2.0:1713279368.987994:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279338 00000100:00080000:2.0:1713279368.988000:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279338 00000100:00080000:2.0:1713279368.988003:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279338 00000100:00080000:2.0:1713279368.988006:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279338 00000100:00080000:2.0:1713279368.988010:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279338 00000100:00100000:1.0:1713279368.988012:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281323328:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279368.988023:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 556 00000100:00100000:0.0:1713279368.988033:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281323456:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279368.988042:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 180 00010000:00010000:2.0:1713279369.332712:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279370.082875:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200084416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279370.082995:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279370.083063:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084416 00000100:00100000:2.0:1713279370.083076:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084416 00000100:00100000:2.0:1713279370.083164:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99007 00000100:00100000:2.0:1713279370.083172:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200084416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279370.083216:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279370.083306:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200084416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279370.083316:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99007 00000100:00100000:0.0:1713279370.083367:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200084416:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279370.334726:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279371.336840:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279371.762695:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713279371.762736:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200084480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279371.762813:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279371.762913:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084480 00000100:00100000:3.0:1713279371.762923:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084480 00000100:00100000:3.0:1713279371.762968:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99008 00000100:00100000:3.0:1713279371.762973:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200084480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1713279371.763007:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:3.0:1713279371.763050:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200084480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279371.763055:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99008 00000100:00100000:0.0:1713279371.763074:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200084480:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279372.338770:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279372.434740:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200084544:0@lo:400:kworker.0 00000100:00100000:0.0:1713279372.434746:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200084608:0@lo:400:kworker.0 00000100:00100000:1.0:1713279372.434771:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200084672:0@lo:400:kworker.0 00000100:00100000:3.0:1713279372.434805:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200084736:0@lo:400:kworker.0 00000100:00100000:0.0:1713279372.434834:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279372.434834:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279372.434845:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279372.434883:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200084864:0@lo:400:kworker.0 00000100:00100000:2.0:1713279372.434898:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200084800:0@lo:400:kworker.0 00000100:00100000:1.0:1713279372.434902:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200084928:0@lo:400:kworker.0 00000100:00100000:0.0:1713279372.434913:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279372.434943:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200085120:0@lo:400:kworker.0 00000100:00100000:3.0:1713279372.434947:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084544 00000100:00100000:2.0:1713279372.434948:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279372.434950:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279372.434959:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084544 00000100:00100000:2.0:1713279372.434974:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200085056:0@lo:400:kworker.0 00000100:00100000:0.0:1713279372.434975:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084608 00000100:00100000:1.0:1713279372.434975:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200085184:0@lo:400:kworker.0 00000100:00100000:0.0:1713279372.434983:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084608 00000100:00100000:1.0:1713279372.435002:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279372.435004:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279372.435023:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200085312:0@lo:400:kworker.0 00000100:00100000:0.0:1713279372.435024:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084864 00000100:00100000:0.0:1713279372.435027:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084864 00000100:00100000:3.0:1713279372.435033:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1713279372.435038:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084672 00000100:00100000:2.0:1713279372.435040:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279372.435042:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200084544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279372.435043:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084928 00000100:00100000:1.0:1713279372.435043:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084672 00000100:00100000:0.0:1713279372.435045:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084928 00000100:00100000:0.0:1713279372.435058:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085184 00000100:00100000:0.0:1713279372.435061:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085184 00000100:00100000:1.0:1713279372.435073:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99009 00000100:00100000:2.0:1713279372.435073:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1713279372.435081:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1713279372.435081:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200084672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279372.435082:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200084608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279372.435087:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200084864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279372.435117:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200084544:12345-0@lo:400:kworker.0 Request processed in 74us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279372.435126:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1713279372.435143:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200084864:12345-0@lo:400:kworker.0 Request processed in 55us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279372.435144:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200084608:12345-0@lo:400:kworker.0 Request processed in 63us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279372.435146:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200084672:12345-0@lo:400:kworker.0 Request processed in 65us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279372.435151:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1713279372.435153:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99009 00000100:00100000:2.0:1713279372.435156:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00080000:3.0:1713279372.435165:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279342 00000100:00100000:1.0:1713279372.435167:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084800 00000100:00100000:0.0:1713279372.435168:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:1.0:1713279372.435170:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084800 00000100:00080000:3.0:1713279372.435170:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279342 00000100:00100000:0.0:1713279372.435172:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200084928:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279372.435174:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279342 00000100:00100000:2.0:1713279372.435175:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:2.0:1713279372.435180:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200085184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279372.435192:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99010 00000100:00100000:0.0:1713279372.435200:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200084928:12345-0@lo:400:kworker.0 Request processed in 26us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279372.435201:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200084800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279372.435207:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1713279372.435208:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200085184:12345-0@lo:400:kworker.0 Request processed in 27us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279372.435210:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279372.435215:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1713279372.435220:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084736 00000100:00100000:0.0:1713279372.435223:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084736 00000100:00100000:3.0:1713279372.435233:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200084992:0@lo:400:kworker.0 00000100:00100000:0.0:1713279372.435238:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1713279372.435245:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200084736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279372.435248:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200084800:12345-0@lo:400:kworker.0 Request processed in 45us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279372.435256:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085056 00000100:00100000:1.0:1713279372.435259:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99010 00000100:00100000:2.0:1713279372.435261:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085056 00000100:00100000:3.0:1713279372.435261:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279372.435272:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200084736:12345-0@lo:400:kworker.0 Request processed in 27us (62us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279372.435277:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009966bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200085248:0@lo:400:kworker.0 00000100:00100000:0.0:1713279372.435279:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:2.0:1713279372.435294:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085312 00000100:00100000:2.0:1713279372.435296:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085312 00000100:00100000:0.0:1713279372.435300:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200084992 00000100:00100000:0.0:1713279372.435303:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200084992 00000100:00100000:2.0:1713279372.435312:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1713279372.435317:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200085056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279372.435317:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279372.435327:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200084672:0@lo:400:kworker.0 00000100:00100000:0.0:1713279372.435328:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085248 00000100:00100000:0.0:1713279372.435332:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085248 00000100:00100000:1.0:1713279372.435346:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200084928:0@lo:400:kworker.0 00000100:00100000:2.0:1713279372.435350:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200085056:12345-0@lo:400:kworker.0 Request processed in 33us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279372.435357:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1713279372.435362:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200085184:0@lo:400:kworker.0 00000100:00100000:2.0:1713279372.435362:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1713279372.435365:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200085312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279372.435371:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200084736:0@lo:400:kworker.0 00000100:00100000:3.0:1713279372.435409:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1713279372.435466:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200085312:12345-0@lo:400:kworker.0 Request processed in 46us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279372.435486:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200084992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279372.435488:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1713279372.435495:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200085248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279372.435501:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1713279372.435535:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279372.435538:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200084992:12345-0@lo:400:kworker.0 Request processed in 52us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279372.435544:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200085248:12345-0@lo:400:kworker.0 Request processed in 49us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279372.435545:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1713279372.435552:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1713279372.435571:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200084608:0@lo:400:kworker.0 00000100:00100000:3.0:1713279372.435580:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085120 00000100:00100000:0.0:1713279372.435582:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200084864:0@lo:400:kworker.0 00000100:00100000:3.0:1713279372.435584:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085120 00000100:00100000:1.0:1713279372.435605:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200085312:0@lo:400:kworker.0 00000100:00100000:3.0:1713279372.435614:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1713279372.435617:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200084544:0@lo:400:kworker.0 00000100:00100000:3.0:1713279372.435621:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200085120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279372.435627:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200084800:0@lo:400:kworker.0 00000100:00100000:1.0:1713279372.435703:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200085056:0@lo:400:kworker.0 00000100:00100000:3.0:1713279372.435742:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200085120:12345-0@lo:400:kworker.0 Request processed in 119us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279372.435750:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00080000:3.0:1713279372.435774:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279342 00000100:00080000:3.0:1713279372.435777:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279342 00000100:00080000:3.0:1713279372.435780:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279342 00000100:00100000:0.0:1713279372.435787:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200085120:0@lo:400:kworker.0 00000100:00100000:3.0:1713279372.435804:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200084992:0@lo:400:kworker.0 00000100:00100000:3.0:1713279372.435816:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009966bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200085248:0@lo:400:kworker.0 00000100:00100000:3.0:1713279372.450610:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713279372.450626:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200085376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279372.450710:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279372.450716:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200085440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279372.450760:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279372.450808:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085376 00000100:00100000:0.0:1713279372.450811:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085440 00000100:00100000:2.0:1713279372.450818:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085376 00000100:00100000:0.0:1713279372.450820:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085440 00000100:00100000:2.0:1713279372.450869:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1713279372.450878:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1713279372.450878:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200085376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279372.450885:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200085440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1713279372.450907:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:0.0:1713279372.450908:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279372.450961:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200085440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279372.450968:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1713279372.450973:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200085376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279372.450981:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1713279372.450986:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200085440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279372.451024:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200085376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279373.170844:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713279373.170873:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200085504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279373.170951:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279373.171050:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085504 00000100:00100000:2.0:1713279373.171061:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085504 00000100:00100000:2.0:1713279373.171123:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1713279373.171132:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200085504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279373.171175:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279373.171239:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200085504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279373.171247:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1713279373.171282:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200085504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279373.186658:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713279373.186679:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200085568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1713279373.186721:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279373.186842:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085568 00000100:00100000:2.0:1713279373.186851:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085568 00000100:00100000:2.0:1713279373.186894:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1713279373.186901:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200085568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279373.186921:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279373.186973:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200085568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279373.186981:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1713279373.187042:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200085568:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279373.340713:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279373.995562:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279373.995663:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279373.995698:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279373.995728:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279373.995746:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279373.995746:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323584 00000100:00100000:1.0:1713279373.995747:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323520 00000100:00100000:1.0:1713279373.995760:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323520 00000100:00100000:2.0:1713279373.995760:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323584 00000100:00100000:0.0:1713279373.995763:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279373.995782:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279373.995808:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279373.995817:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 409 00000100:00100000:2.0:1713279373.995817:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323648 00000100:00100000:2.0:1713279373.995820:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323648 00000100:00100000:1.0:1713279373.995826:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281323520:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279373.995838:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323840 00000100:00100000:2.0:1713279373.995840:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323840 00000100:00100000:2.0:1713279373.995852:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323904 00000100:00100000:2.0:1713279373.995855:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323904 00000100:00100000:0.0:1713279373.995860:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279373.995876:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 563 00000100:00100000:3.0:1713279373.995879:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323712 00000100:00100000:2.0:1713279373.995884:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281323584:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279373.995898:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323712 00000100:00100000:0.0:1713279373.995906:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 564 00000100:00100000:0.0:1713279373.995919:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281323648:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279373.995936:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281323584:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 52us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279373.995937:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281323520:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 107us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279373.995945:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 563 00000100:00100000:1.0:1713279373.995951:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 409 00000100:00100000:2.0:1713279373.995966:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 565 00000100:00100000:3.0:1713279373.995969:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323776 00000100:00100000:2.0:1713279373.995971:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281323840:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279373.995972:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323776 00000100:00100000:0.0:1713279373.995974:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281323648:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 57us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279373.995983:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 564 00000100:00100000:3.0:1713279373.995991:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281323968 00000100:00100000:2.0:1713279373.995993:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281323840:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279373.995994:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281323968 00000100:00100000:2.0:1713279373.996000:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 565 00000100:00100000:1.0:1713279373.996003:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324032 00000100:00100000:0.0:1713279373.996006:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 566 00000100:00100000:1.0:1713279373.996009:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324032 00000100:00100000:0.0:1713279373.996012:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281323904:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279373.996020:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 185 00000100:00100000:3.0:1713279373.996030:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281323712:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279373.996038:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281323904:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279373.996045:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 566 00000100:00100000:1.0:1713279373.996046:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:1.0:1713279373.996057:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281323776:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279373.996069:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00100000:0.0:1713279373.996075:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281323968:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279373.996119:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281323712:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 90us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279373.996129:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281323776:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279373.996131:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 185 00000100:00100000:0.0:1713279373.996133:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281323968:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 53us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279373.996142:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:0.0:1713279373.996148:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00100000:3.0:1713279373.996154:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 188 00000100:00100000:3.0:1713279373.996160:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281324032:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279373.996189:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281324032:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279373.996197:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 188 00000100:00080000:0.0:1713279373.996215:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279343 00000100:00080000:0.0:1713279373.996219:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279343 00000100:00080000:0.0:1713279373.996222:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279343 00000100:00080000:0.0:1713279373.996224:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279343 00000100:00080000:0.0:1713279373.996227:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279343 00010000:00010000:2.0:1713279374.342696:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279375.090878:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713279375.090919:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200085632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279375.091021:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279375.091162:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085632 00000100:00100000:0.0:1713279375.091177:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085632 00000100:00100000:0.0:1713279375.091242:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99011 00000100:00100000:0.0:1713279375.091251:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200085632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1713279375.091294:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:0.0:1713279375.091388:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200085632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279375.091396:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99011 00000100:00100000:3.0:1713279375.091516:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200085632:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279375.344718:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279376.346821:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279376.770861:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200085696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713279376.770942:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279376.771009:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085696 00000100:00100000:0.0:1713279376.771020:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085696 00000100:00100000:0.0:1713279376.771076:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99012 00000100:00100000:0.0:1713279376.771085:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200085696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713279376.771122:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:0.0:1713279376.771188:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200085696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279376.771196:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99012 00000100:00100000:2.0:1713279376.771234:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200085696:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279377.348778:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279377.442700:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200085760:0@lo:400:kworker.0 00000100:00100000:0.0:1713279377.442711:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200085888:0@lo:400:kworker.0 00000100:00100000:2.0:1713279377.442711:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009966bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200085952:0@lo:400:kworker.0 00000100:00100000:1.0:1713279377.442774:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009966ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200085824:0@lo:400:kworker.0 00000100:00100000:3.0:1713279377.442799:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279377.442801:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279377.442801:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279377.442828:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279377.442839:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200086016:0@lo:400:kworker.0 00000100:00100000:0.0:1713279377.442845:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200086144:0@lo:400:kworker.0 00000100:00100000:2.0:1713279377.442854:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200086208:0@lo:400:kworker.0 00000100:00100000:1.0:1713279377.442855:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200086080:0@lo:400:kworker.0 00000100:00100000:3.0:1713279377.442861:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279377.442885:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279377.442887:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279377.442901:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200086272:0@lo:400:kworker.0 00000100:00100000:2.0:1713279377.442909:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200086464:0@lo:400:kworker.0 00000100:00100000:1.0:1713279377.442911:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279377.442912:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200086400:0@lo:400:kworker.0 00000100:00100000:3.0:1713279377.442922:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279377.442941:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200086528:0@lo:400:kworker.0 00000100:00100000:1.0:1713279377.442943:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200086336:0@lo:400:kworker.0 00000100:00100000:0.0:1713279377.442945:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279377.442945:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279377.442972:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085952 00000100:00100000:3.0:1713279377.442979:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085952 00000100:00100000:1.0:1713279377.443002:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279377.443006:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085760 00000100:00100000:2.0:1713279377.443006:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086208 00000100:00100000:0.0:1713279377.443013:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085760 00000100:00100000:2.0:1713279377.443013:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086208 00000100:00100000:3.0:1713279377.443023:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085824 00000100:00100000:3.0:1713279377.443025:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085824 00000100:00100000:3.0:1713279377.443040:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086144 00000100:00100000:3.0:1713279377.443043:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086144 00000100:00100000:1.0:1713279377.443047:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086080 00000100:00100000:1.0:1713279377.443053:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086080 00000100:00100000:2.0:1713279377.443053:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086272 00000100:00100000:2.0:1713279377.443058:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086272 00000100:00100000:3.0:1713279377.443059:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086400 00000100:00100000:0.0:1713279377.443060:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1713279377.443062:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086400 00000100:00100000:0.0:1713279377.443069:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200085760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279377.443076:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086464 00000100:00100000:2.0:1713279377.443079:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086464 00000100:00100000:1.0:1713279377.443083:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086336 00000100:00100000:1.0:1713279377.443086:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086336 00000100:00100000:3.0:1713279377.443087:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1713279377.443093:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200085952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279377.443102:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1713279377.443105:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1713279377.443110:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200086208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279377.443112:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200085824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279377.443130:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200085760:12345-0@lo:400:kworker.0 Request processed in 60us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279377.443140:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200085952:12345-0@lo:400:kworker.0 Request processed in 46us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279377.443141:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1713279377.443148:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:2.0:1713279377.443157:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200086208:12345-0@lo:400:kworker.0 Request processed in 47us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279377.443160:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200085824:12345-0@lo:400:kworker.0 Request processed in 48us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279377.443162:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1713279377.443167:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200086144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279377.443168:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1713279377.443169:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1713279377.443184:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1713279377.443187:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1713279377.443189:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200086080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279377.443190:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:3.0:1713279377.443193:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200086144:12345-0@lo:400:kworker.0 Request processed in 25us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279377.443194:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200086272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279377.443197:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200086400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279377.443199:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1713279377.443210:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1713279377.443212:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200086080:12345-0@lo:400:kworker.0 Request processed in 23us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279377.443215:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200086336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279377.443219:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1713279377.443234:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200086400:12345-0@lo:400:kworker.0 Request processed in 35us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279377.443234:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200086272:12345-0@lo:400:kworker.0 Request processed in 38us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279377.443239:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200085888 00000100:00100000:3.0:1713279377.443239:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200086336:12345-0@lo:400:kworker.0 Request processed in 24us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279377.443242:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200085888 00000100:00100000:0.0:1713279377.443244:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1713279377.443244:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1713279377.443249:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1713279377.443258:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1713279377.443260:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086016 00000100:00100000:1.0:1713279377.443262:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086016 00000100:00100000:2.0:1713279377.443265:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200086464:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1713279377.443270:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279347 00000100:00080000:0.0:1713279377.443275:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279347 00000100:00080000:0.0:1713279377.443279:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279347 00000100:00100000:1.0:1713279377.443279:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99013 00000100:00080000:0.0:1713279377.443282:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279347 00000100:00100000:1.0:1713279377.443284:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200085888:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1713279377.443286:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279347 00000100:00100000:3.0:1713279377.443286:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99014 00000100:00100000:3.0:1713279377.443291:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200086016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279377.443302:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200086464:12345-0@lo:400:kworker.0 Request processed in 36us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279377.443311:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1713279377.443314:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200085888:12345-0@lo:400:kworker.0 Request processed in 29us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279377.443321:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99013 00000100:00100000:3.0:1713279377.443321:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200086016:12345-0@lo:400:kworker.0 Request processed in 30us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279377.443328:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99014 00000100:00100000:0.0:1713279377.443334:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200086400:0@lo:400:kworker.0 00000100:00100000:3.0:1713279377.443348:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279377.443351:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200085888:0@lo:400:kworker.0 00000100:00100000:2.0:1713279377.443361:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200086208:0@lo:400:kworker.0 00000100:00100000:1.0:1713279377.443366:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009966ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200085824:0@lo:400:kworker.0 00000100:00100000:0.0:1713279377.443367:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200086144:0@lo:400:kworker.0 00000100:00100000:3.0:1713279377.443373:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200085760:0@lo:400:kworker.0 00000100:00100000:2.0:1713279377.443374:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200086464:0@lo:400:kworker.0 00000100:00100000:1.0:1713279377.443377:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200086080:0@lo:400:kworker.0 00000100:00100000:3.0:1713279377.443384:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200086016:0@lo:400:kworker.0 00000100:00100000:1.0:1713279377.443388:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200086336:0@lo:400:kworker.0 00000100:00100000:2.0:1713279377.443389:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009966bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200085952:0@lo:400:kworker.0 00000100:00100000:3.0:1713279377.443404:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200086272:0@lo:400:kworker.0 00000100:00100000:1.0:1713279377.443442:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086528 00000100:00100000:1.0:1713279377.443446:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086528 00000100:00080000:0.0:1713279377.443478:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279347 00000100:00100000:1.0:1713279377.443478:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1713279377.443483:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200086528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279377.443528:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200086528:12345-0@lo:400:kworker.0 Request processed in 43us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279377.443534:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1713279377.443583:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200086528:0@lo:400:kworker.0 00000100:00100000:3.0:1713279377.458538:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713279377.458553:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200086656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279377.458590:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279377.458635:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200086592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279377.458653:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279377.458665:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086656 00000100:00100000:2.0:1713279377.458677:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086656 00000100:00100000:0.0:1713279377.458683:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086592 00000100:00100000:0.0:1713279377.458690:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086592 00000100:00100000:2.0:1713279377.458733:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1713279377.458741:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1713279377.458743:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200086656:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279377.458749:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200086592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1713279377.458777:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279377.458777:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279377.458849:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200086592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279377.458849:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200086656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279377.458860:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1713279377.458869:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1713279377.458888:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200086656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279377.458901:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200086592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279378.178777:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200086720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279378.178850:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279378.178908:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086720 00000100:00100000:0.0:1713279378.178917:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086720 00000100:00100000:0.0:1713279378.178967:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1713279378.178974:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200086720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279378.179005:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279378.179054:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200086720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279378.179061:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1713279378.179077:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200086720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279378.194686:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713279378.194705:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200086784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279378.194744:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279378.194827:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086784 00000100:00100000:0.0:1713279378.194838:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086784 00000100:00100000:0.0:1713279378.194893:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1713279378.194904:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200086784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279378.194931:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279378.195008:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200086784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279378.195021:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1713279378.195032:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200086784:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279378.350756:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279379.003535:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279379.003669:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324160 00000100:00100000:2.0:1713279379.003682:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324160 00000100:00100000:0.0:1713279379.003695:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279379.003730:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279379.003751:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324224 00000100:00100000:0.0:1713279379.003753:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279379.003755:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324224 00000100:00100000:0.0:1713279379.003771:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279379.003777:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 573 00000100:00100000:2.0:1713279379.003786:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281324160:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279379.003790:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279379.003807:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279379.003823:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00080000:3.0:1713279379.003826:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279349 00000100:00080000:3.0:1713279379.003834:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279349 00000100:00100000:1.0:1713279379.003836:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324096 00000100:00100000:1.0:1713279379.003846:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324096 00000100:00100000:2.0:1713279379.003865:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281324160:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 79us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279379.003866:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324480 00000100:00100000:3.0:1713279379.003873:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324480 00000100:00100000:2.0:1713279379.003874:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 573 00000100:00100000:2.0:1713279379.003892:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324416 00000100:00100000:2.0:1713279379.003895:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324416 00000100:00100000:1.0:1713279379.003896:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 411 00000100:00100000:1.0:1713279379.003904:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281324096:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279379.003912:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 574 00000100:00100000:0.0:1713279379.003919:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279379.003921:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281324224:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279379.003924:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 575 00000100:00100000:2.0:1713279379.003929:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281324480:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279379.003949:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281324096:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279379.003957:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 411 00000100:00100000:2.0:1713279379.003957:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281324480:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279379.003964:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 575 00000100:00100000:3.0:1713279379.003968:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281324224:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279379.003976:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 574 00000100:00100000:2.0:1713279379.003981:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 576 00000100:00100000:2.0:1713279379.003986:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281324416:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279379.003991:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324352 00000100:00100000:1.0:1713279379.003994:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324352 00000100:00100000:3.0:1713279379.004009:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324608 00000100:00100000:2.0:1713279379.004012:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281324416:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279379.004014:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324608 00000100:00100000:1.0:1713279379.004018:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324288 00000100:00100000:2.0:1713279379.004019:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 576 00000100:00100000:1.0:1713279379.004020:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324288 00000100:00100000:1.0:1713279379.004036:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324544 00000100:00100000:1.0:1713279379.004038:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324544 00000100:00100000:3.0:1713279379.004053:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 193 00000100:00100000:3.0:1713279379.004060:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281324352:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279379.004062:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 194 00000100:00100000:2.0:1713279379.004069:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281324288:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279379.004079:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 195 00000100:00100000:1.0:1713279379.004085:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281324608:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279379.004091:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196 00000100:00100000:2.0:1713279379.004099:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281324288:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279379.004101:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281324544:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279379.004106:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 194 00000100:00100000:3.0:1713279379.004108:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281324352:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 44us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279379.004115:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281324608:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279379.004119:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 193 00000100:00100000:1.0:1713279379.004124:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 195 00000100:00100000:0.0:1713279379.004142:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281324544:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279379.004151:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196 00000100:00080000:3.0:1713279379.004155:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279349 00000100:00080000:3.0:1713279379.004160:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279349 00000100:00080000:3.0:1713279379.004164:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279349 00000100:00080000:3.0:1713279379.004167:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279349 00000100:00080000:3.0:1713279379.004170:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279349 00010000:00010000:2.0:1713279379.352706:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279380.098772:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200086848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279380.098859:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279380.098959:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086848 00000100:00100000:1.0:1713279380.098969:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086848 00000100:00100000:1.0:1713279380.099021:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99015 00000100:00100000:1.0:1713279380.099029:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200086848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1713279380.099067:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:1.0:1713279380.099130:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200086848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279380.099138:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99015 00000100:00100000:0.0:1713279380.099180:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200086848:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279380.354776:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279381.356733:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279381.778705:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200086912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1713279381.778783:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279381.778850:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086912 00000100:00100000:1.0:1713279381.778862:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086912 00000100:00100000:1.0:1713279381.778933:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99016 00000100:00100000:1.0:1713279381.778942:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200086912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1713279381.778987:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:1.0:1713279381.779073:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200086912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279381.779086:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99016 00000100:00100000:3.0:1713279381.779107:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200086912:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279382.358706:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279382.450699:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200087040:0@lo:400:kworker.0 00000100:00100000:2.0:1713279382.450732:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200086976:0@lo:400:kworker.0 00000100:00100000:1.0:1713279382.450743:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200087168:0@lo:400:kworker.0 00000100:00100000:0.0:1713279382.450775:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200087104:0@lo:400:kworker.0 00000100:00100000:3.0:1713279382.450776:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279382.450790:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279382.450806:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087040 00000100:00100000:1.0:1713279382.450816:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087040 00000100:00100000:3.0:1713279382.450825:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200087296:0@lo:400:kworker.0 00000100:00100000:2.0:1713279382.450829:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200087232:0@lo:400:kworker.0 00000100:00100000:0.0:1713279382.450845:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279382.450857:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279382.450868:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087296 00000100:00100000:1.0:1713279382.450873:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087296 00000100:00100000:2.0:1713279382.450886:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:0.0:1713279382.450894:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200087360:0@lo:400:kworker.0 00000100:00100000:2.0:1713279382.450895:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200087040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279382.450896:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200087552:0@lo:400:kworker.0 00000100:00100000:1.0:1713279382.450907:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:0.0:1713279382.450916:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279382.450918:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200087296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279382.450933:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087360 00000100:00100000:0.0:1713279382.450934:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200087616:0@lo:400:kworker.0 00000100:00100000:3.0:1713279382.450939:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087360 00000100:00100000:2.0:1713279382.450949:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200087040:12345-0@lo:400:kworker.0 Request processed in 55us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279382.450957:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279382.450958:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1713279382.450974:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087616 00000100:00100000:3.0:1713279382.450977:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087616 00000100:00100000:1.0:1713279382.450982:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200087296:12345-0@lo:400:kworker.0 Request processed in 64us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279382.450982:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:2.0:1713279382.450986:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200087360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279382.450995:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1713279382.451001:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:3.0:1713279382.451008:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200087616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279382.451017:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200087360:12345-0@lo:400:kworker.0 Request processed in 30us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279382.451018:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279382.451024:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1713279382.451029:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200086976 00000100:00100000:1.0:1713279382.451034:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200086976 00000100:00100000:0.0:1713279382.451040:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200087488:0@lo:400:kworker.0 00000100:00100000:3.0:1713279382.451044:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200087616:12345-0@lo:400:kworker.0 Request processed in 35us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279382.451051:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1713279382.451053:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087104 00000100:00100000:2.0:1713279382.451058:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087104 00000100:00100000:1.0:1713279382.451069:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00080000:3.0:1713279382.451069:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279352 00000100:00080000:3.0:1713279382.451072:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279352 00000100:00100000:0.0:1713279382.451073:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1713279382.451074:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279352 00000100:00100000:1.0:1713279382.451078:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200086976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279382.451081:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087232 00000100:00100000:2.0:1713279382.451083:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087232 00000100:00100000:3.0:1713279382.451089:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279382.451093:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200087744:0@lo:400:kworker.0 00000100:00100000:2.0:1713279382.451097:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99017 00000100:00100000:2.0:1713279382.451102:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200087104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279382.451116:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200087040:0@lo:400:kworker.0 00000100:00100000:0.0:1713279382.451124:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279382.451127:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200087296:0@lo:400:kworker.0 00000100:00100000:1.0:1713279382.451134:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200086976:12345-0@lo:400:kworker.0 Request processed in 54us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279382.451135:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200087104:12345-0@lo:400:kworker.0 Request processed in 32us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279382.451141:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99017 00000100:00100000:1.0:1713279382.451145:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1713279382.451153:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087552 00000100:00100000:2.0:1713279382.451155:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99018 00000100:00100000:3.0:1713279382.451156:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087552 00000100:00100000:2.0:1713279382.451159:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200087232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279382.451162:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200086976:0@lo:400:kworker.0 00000100:00100000:3.0:1713279382.451176:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1713279382.451180:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200087232:12345-0@lo:400:kworker.0 Request processed in 20us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279382.451181:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200087552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279382.451186:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99018 00000100:00100000:1.0:1713279382.451188:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087488 00000100:00100000:0.0:1713279382.451191:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200087232:0@lo:400:kworker.0 00000100:00100000:1.0:1713279382.451193:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087488 00000100:00100000:3.0:1713279382.451211:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200087552:12345-0@lo:400:kworker.0 Request processed in 29us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279382.451217:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1713279382.451223:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087744 00000100:00100000:1.0:1713279382.451227:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087744 00000100:00100000:0.0:1713279382.451229:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00080000:3.0:1713279382.451230:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279352 00000100:00080000:3.0:1713279382.451234:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279352 00000100:00080000:3.0:1713279382.451237:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279352 00000100:00100000:0.0:1713279382.451240:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200087488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279382.451252:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200087552:0@lo:400:kworker.0 00000100:00100000:1.0:1713279382.451263:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1713279382.451269:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200087744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279382.451302:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200087488:12345-0@lo:400:kworker.0 Request processed in 61us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279382.451314:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1713279382.451314:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200087744:12345-0@lo:400:kworker.0 Request processed in 44us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279382.451317:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200087488:0@lo:400:kworker.0 00000100:00100000:1.0:1713279382.451321:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1713279382.451329:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200087744:0@lo:400:kworker.0 00000100:00100000:1.0:1713279382.451340:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279382.451357:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200087104:0@lo:400:kworker.0 00000100:00100000:1.0:1713279382.451369:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200087424:0@lo:400:kworker.0 00000100:00100000:0.0:1713279382.451373:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200087360:0@lo:400:kworker.0 00000100:00100000:0.0:1713279382.451388:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200087616:0@lo:400:kworker.0 00000100:00100000:1.0:1713279382.451391:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279382.451393:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087168 00000100:00100000:3.0:1713279382.451397:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087168 00000100:00100000:1.0:1713279382.451404:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200087680:0@lo:400:kworker.0 00000100:00100000:1.0:1713279382.451447:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279382.451458:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087424 00000100:00100000:0.0:1713279382.451465:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087424 00000100:00100000:1.0:1713279382.451470:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087680 00000100:00100000:2.0:1713279382.451470:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1713279382.451474:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087680 00000100:00100000:2.0:1713279382.451477:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200087168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279382.451492:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1713279382.451497:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200087680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279382.451504:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1713279382.451513:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200087424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279382.451522:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200087168:12345-0@lo:400:kworker.0 Request processed in 45us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279382.451527:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200087680:12345-0@lo:400:kworker.0 Request processed in 29us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279382.451529:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1713279382.451534:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1713279382.451563:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200087424:12345-0@lo:400:kworker.0 Request processed in 49us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279382.451586:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200087168:0@lo:400:kworker.0 00000100:00100000:1.0:1713279382.451599:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200087424:0@lo:400:kworker.0 00000100:00100000:1.0:1713279382.451609:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200087680:0@lo:400:kworker.0 00000100:00100000:0.0:1713279382.451613:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:0.0:1713279382.451637:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279352 00000100:00080000:0.0:1713279382.451643:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279352 00000100:00100000:3.0:1713279382.466562:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200087808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279382.466624:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279382.466657:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200087872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279382.466696:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279382.466746:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087808 00000100:00100000:1.0:1713279382.466755:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087808 00000100:00100000:2.0:1713279382.466764:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087872 00000100:00100000:2.0:1713279382.466775:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087872 00000100:00100000:1.0:1713279382.466804:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1713279382.466812:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200087808:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279382.466818:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1713279382.466829:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200087872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1713279382.466841:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279382.466852:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279382.466898:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200087808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279382.466906:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1713279382.466918:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200087872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279382.466930:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1713279382.466934:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012ee31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200087872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279382.466942:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200087808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279383.186747:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200087936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279383.186839:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279383.186926:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200087936 00000100:00100000:2.0:1713279383.186941:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200087936 00000100:00100000:2.0:1713279383.187006:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1713279383.187014:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200087936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279383.187049:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279383.187114:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200087936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279383.187122:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1713279383.187188:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200087936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279383.202639:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713279383.202658:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200088000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1713279383.202699:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279383.202759:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088000 00000100:00100000:2.0:1713279383.202767:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088000 00000100:00100000:2.0:1713279383.202806:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1713279383.202814:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200088000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279383.202835:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279383.202887:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200088000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279383.202895:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1713279383.202940:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200088000:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279383.360685:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279384.011718:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279384.011785:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279384.011820:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279384.011842:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279384.011873:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279384.011892:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279384.011894:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324736 00000100:00100000:0.0:1713279384.011909:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279384.011912:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324736 00000100:00100000:0.0:1713279384.011928:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279384.011931:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324672 00000100:00100000:1.0:1713279384.011942:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324672 00000100:00100000:0.0:1713279384.011969:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279384.011975:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324800 00000100:00100000:2.0:1713279384.011983:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324992 00000100:00100000:3.0:1713279384.011985:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324800 00000100:00100000:2.0:1713279384.011986:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324992 00000100:00100000:1.0:1713279384.011994:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 413 00000100:00100000:2.0:1713279384.012000:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325056 00000100:00080000:0.0:1713279384.012001:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279354 00000100:00100000:2.0:1713279384.012002:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325056 00000100:00100000:1.0:1713279384.012003:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281324672:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:0.0:1713279384.012007:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279354 00000100:00080000:0.0:1713279384.012011:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279354 00000100:00080000:0.0:1713279384.012014:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279354 00000100:00100000:3.0:1713279384.012032:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 583 00000100:00100000:0.0:1713279384.012034:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324864 00000100:00100000:2.0:1713279384.012041:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 584 00000100:00100000:3.0:1713279384.012041:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281324736:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279384.012044:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324864 00000100:00100000:2.0:1713279384.012050:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281324992:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279384.012092:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281324672:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 89us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279384.012093:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281324736:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 52us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279384.012094:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281324928 00000100:00100000:0.0:1713279384.012097:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281324928 00000100:00100000:2.0:1713279384.012097:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281324992:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279384.012102:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 413 00000100:00100000:3.0:1713279384.012102:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 583 00000100:00100000:2.0:1713279384.012107:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 584 00000100:00100000:0.0:1713279384.012111:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325120 00000100:00100000:0.0:1713279384.012113:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325120 00000100:00100000:3.0:1713279384.012123:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 585 00000100:00100000:0.0:1713279384.012127:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325184 00000100:00100000:3.0:1713279384.012128:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281324800:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279384.012129:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325184 00000100:00100000:2.0:1713279384.012135:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 586 00000100:00100000:2.0:1713279384.012141:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281325056:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279384.012151:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 201 00000100:00100000:3.0:1713279384.012152:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281324800:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279384.012160:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 585 00000100:00100000:0.0:1713279384.012161:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281324864:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279384.012167:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281325056:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279384.012168:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 202 00000100:00100000:2.0:1713279384.012174:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 586 00000100:00100000:1.0:1713279384.012175:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281324928:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279384.012196:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 203 00000100:00100000:3.0:1713279384.012201:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281325120:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279384.012204:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 204 00000100:00100000:1.0:1713279384.012205:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281324928:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279384.012210:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281325184:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279384.012212:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 202 00000100:00100000:3.0:1713279384.012229:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281325120:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279384.012232:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281325184:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279384.012234:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281324864:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 74us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279384.012236:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 203 00000100:00100000:2.0:1713279384.012240:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 204 00000100:00100000:0.0:1713279384.012246:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 201 00000100:00080000:0.0:1713279384.012285:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279354 00000100:00080000:0.0:1713279384.012289:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279354 00010000:00010000:2.0:1713279384.362772:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279385.106793:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200088064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279385.106897:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279385.106992:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088064 00000100:00100000:2.0:1713279385.107003:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088064 00000100:00100000:2.0:1713279385.107059:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99019 00000100:00100000:2.0:1713279385.107066:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac44a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200088064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279385.107102:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279385.107205:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac44a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200088064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279385.107217:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99019 00000100:00100000:0.0:1713279385.107240:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200088064:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279385.364659:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279386.366678:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279386.786675:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200088128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279386.786752:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279386.786829:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088128 00000100:00100000:2.0:1713279386.786841:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088128 00000100:00100000:2.0:1713279386.786915:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99020 00000100:00100000:2.0:1713279386.786926:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200088128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279386.786971:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279386.787062:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200088128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279386.787075:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99020 00000100:00100000:0.0:1713279386.787097:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200088128:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279387.368719:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279387.458773:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200088320:0@lo:400:kworker.0 00000100:00100000:1.0:1713279387.458780:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200088256:0@lo:400:kworker.0 00000100:00100000:2.0:1713279387.458792:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200088192:0@lo:400:kworker.0 00000100:00100000:0.0:1713279387.458869:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279387.458869:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279387.458871:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279387.458903:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200088576:0@lo:400:kworker.0 00000100:00100000:2.0:1713279387.458905:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200088448:0@lo:400:kworker.0 00000100:00100000:1.0:1713279387.458907:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200088512:0@lo:400:kworker.0 00000100:00100000:0.0:1713279387.458927:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279387.458930:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279387.458942:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088192 00000100:00100000:0.0:1713279387.458945:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200088832:0@lo:400:kworker.0 00000100:00100000:2.0:1713279387.458946:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008acce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200088704:0@lo:400:kworker.0 00000100:00100000:1.0:1713279387.458950:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088192 00000100:00100000:3.0:1713279387.458960:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088256 00000100:00100000:0.0:1713279387.458966:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279387.458969:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088256 00000100:00100000:2.0:1713279387.458970:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279387.458983:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200088960:0@lo:400:kworker.0 00000100:00100000:2.0:1713279387.458998:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279387.459001:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088320 00000100:00100000:3.0:1713279387.459006:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088576 00000100:00100000:0.0:1713279387.459007:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088320 00000100:00100000:1.0:1713279387.459009:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1713279387.459009:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088576 00000100:00100000:2.0:1713279387.459014:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1713279387.459020:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200088192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279387.459020:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200088384:0@lo:400:kworker.0 00000100:00100000:3.0:1713279387.459025:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088832 00000100:00100000:3.0:1713279387.459028:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088832 00000100:00100000:0.0:1713279387.459036:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088448 00000100:00100000:2.0:1713279387.459037:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279387.459039:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088448 00000100:00100000:2.0:1713279387.459050:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200088640:0@lo:400:kworker.0 00000100:00100000:3.0:1713279387.459052:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088384 00000100:00100000:0.0:1713279387.459054:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99021 00000100:00100000:3.0:1713279387.459055:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088384 00000100:00100000:0.0:1713279387.459060:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200088320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279387.459069:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279387.459074:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1713279387.459081:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200088896:0@lo:400:kworker.0 00000100:00100000:3.0:1713279387.459082:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200088256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279387.459083:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200088192:12345-0@lo:400:kworker.0 Request processed in 62us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279387.459095:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1713279387.459098:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279387.459103:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200088320:12345-0@lo:400:kworker.0 Request processed in 42us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279387.459110:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99021 00000100:00100000:0.0:1713279387.459122:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99022 00000100:00100000:2.0:1713279387.459124:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200088192:0@lo:400:kworker.0 00000100:00100000:0.0:1713279387.459127:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200088448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279387.459134:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200088256:12345-0@lo:400:kworker.0 Request processed in 52us (266us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279387.459135:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279357 00000100:00080000:1.0:1713279387.459139:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279357 00000100:00100000:3.0:1713279387.459142:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1713279387.459152:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279387.459156:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200088448:12345-0@lo:400:kworker.0 Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279387.459156:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1713279387.459161:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088512 00000100:00100000:3.0:1713279387.459161:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200088576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279387.459162:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99022 00000100:00100000:2.0:1713279387.459166:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088512 00000100:00100000:1.0:1713279387.459172:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008acce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200088768:0@lo:400:kworker.0 00000100:00100000:0.0:1713279387.459179:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088704 00000100:00100000:0.0:1713279387.459183:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088704 00000100:00100000:3.0:1713279387.459186:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200088576:12345-0@lo:400:kworker.0 Request processed in 24us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279387.459193:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1713279387.459195:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279387.459198:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:3.0:1713279387.459204:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088768 00000100:00100000:0.0:1713279387.459205:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088960 00000100:00100000:2.0:1713279387.459205:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200088832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279387.459207:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088960 00000100:00100000:3.0:1713279387.459208:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088768 00000100:00100000:0.0:1713279387.459220:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088640 00000100:00100000:0.0:1713279387.459222:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088640 00000100:00100000:1.0:1713279387.459226:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200088256:0@lo:400:kworker.0 00000100:00100000:3.0:1713279387.459226:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1713279387.459230:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200088384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279387.459237:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200088896 00000100:00100000:0.0:1713279387.459239:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200088896 00000100:00100000:2.0:1713279387.459243:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200088832:12345-0@lo:400:kworker.0 Request processed in 37us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279387.459252:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:0.0:1713279387.459254:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1713279387.459255:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200088384:12345-0@lo:400:kworker.0 Request processed in 23us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279387.459257:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1713279387.459258:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200088512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279387.459259:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200088704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279387.459262:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1713279387.459271:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1713279387.459276:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008acced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200088768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279387.459288:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200088704:12345-0@lo:400:kworker.0 Request processed in 28us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279387.459294:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1713279387.459298:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200088512:12345-0@lo:400:kworker.0 Request processed in 39us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279387.459303:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008acced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200088768:12345-0@lo:400:kworker.0 Request processed in 26us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279387.459304:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1713279387.459305:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:0.0:1713279387.459309:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200088960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279387.459309:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1713279387.459310:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1713279387.459314:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200088640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279387.459333:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1713279387.459335:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200088960:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279387.459338:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200088896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279387.459341:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200088640:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279387.459348:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1713279387.459352:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1713279387.459363:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200088896:12345-0@lo:400:kworker.0 Request processed in 24us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279387.459369:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1713279387.459375:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200088384:0@lo:400:kworker.0 00000100:00080000:1.0:1713279387.459384:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279357 00000100:00100000:2.0:1713279387.459386:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200088640:0@lo:400:kworker.0 00000100:00080000:1.0:1713279387.459388:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279357 00000100:00080000:1.0:1713279387.459390:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279357 00000100:00100000:0.0:1713279387.459391:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200088320:0@lo:400:kworker.0 00000100:00100000:2.0:1713279387.459397:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200088896:0@lo:400:kworker.0 00000100:00100000:0.0:1713279387.459402:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200088576:0@lo:400:kworker.0 00000100:00100000:1.0:1713279387.459407:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200088512:0@lo:400:kworker.0 00000100:00100000:2.0:1713279387.459407:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200088448:0@lo:400:kworker.0 00000100:00100000:0.0:1713279387.459446:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200088832:0@lo:400:kworker.0 00000100:00100000:1.0:1713279387.459451:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008acce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200088768:0@lo:400:kworker.0 00000100:00100000:2.0:1713279387.459470:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008acce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200088704:0@lo:400:kworker.0 00000100:00100000:2.0:1713279387.459480:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200088960:0@lo:400:kworker.0 00000100:00100000:3.0:1713279387.474595:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713279387.474610:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200089024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279387.474650:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279387.474677:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200089088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279387.474695:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279387.474741:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089024 00000100:00100000:1.0:1713279387.474750:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089024 00000100:00100000:2.0:1713279387.474771:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089088 00000100:00100000:2.0:1713279387.474780:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089088 00000100:00100000:1.0:1713279387.474797:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1713279387.474805:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200089024:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279387.474823:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1713279387.474831:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200089088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1713279387.474834:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279387.474849:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279387.474903:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200089024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279387.474909:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200089088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279387.474916:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1713279387.474920:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1713279387.474937:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200089024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279387.474951:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200089088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279388.194817:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200089152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279388.194896:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279388.194956:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089152 00000100:00100000:2.0:1713279388.194968:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089152 00000100:00100000:2.0:1713279388.195032:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1713279388.195040:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200089152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279388.195078:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279388.195145:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200089152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279388.195153:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1713279388.195200:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200089152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279388.210634:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200089216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279388.210678:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279388.210708:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089216 00000100:00100000:0.0:1713279388.210717:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089216 00000100:00100000:0.0:1713279388.210766:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1713279388.210774:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200089216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279388.210791:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279388.210846:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200089216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279388.210853:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1713279388.210899:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200089216:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279388.370718:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279389.019768:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279389.019821:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279389.019856:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279389.019879:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279389.019912:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279389.019922:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325248 00000100:00100000:0.0:1713279389.019927:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279389.019939:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325248 00000100:00100000:0.0:1713279389.019942:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279389.019958:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279389.019963:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325312 00000100:00100000:3.0:1713279389.019973:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325312 00000100:00100000:2.0:1713279389.019979:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325440 00000100:00100000:2.0:1713279389.019991:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325440 00000100:00100000:0.0:1713279389.019993:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279389.020012:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 415 00000100:00100000:3.0:1713279389.020015:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325376 00000100:00100000:3.0:1713279389.020017:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325376 00000100:00100000:0.0:1713279389.020019:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325568 00000100:00100000:0.0:1713279389.020025:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325568 00000100:00100000:1.0:1713279389.020025:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281325248:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279389.020034:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325632 00000100:00100000:3.0:1713279389.020037:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325632 00000100:00100000:2.0:1713279389.020039:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325504 00000100:00100000:2.0:1713279389.020045:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325504 00000100:00100000:3.0:1713279389.020058:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 593 00000100:00100000:3.0:1713279389.020066:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281325312:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279389.020069:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 594 00000100:00100000:2.0:1713279389.020069:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325696 00000100:00100000:2.0:1713279389.020074:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325696 00000100:00100000:0.0:1713279389.020077:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281325376:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279389.020094:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325760 00000100:00100000:2.0:1713279389.020098:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325760 00000100:00100000:1.0:1713279389.020109:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281325248:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 85us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279389.020118:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 415 00000100:00100000:3.0:1713279389.020121:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281325312:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 55us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279389.020122:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 209 00000100:00100000:0.0:1713279389.020129:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281325376:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 52us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279389.020129:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 593 00000100:00100000:2.0:1713279389.020134:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281325440:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279389.020137:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 594 00000100:00100000:3.0:1713279389.020145:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 595 00000100:00100000:0.0:1713279389.020153:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 596 00000100:00100000:3.0:1713279389.020153:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281325568:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279389.020159:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281325632:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:1.0:1713279389.020166:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279359 00000100:00080000:1.0:1713279389.020170:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279359 00000100:00080000:1.0:1713279389.020173:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279359 00000100:00080000:1.0:1713279389.020175:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279359 00000100:00080000:1.0:1713279389.020177:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279359 00000100:00100000:0.0:1713279389.020187:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281325632:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279389.020193:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281325440:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 59us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279389.020194:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 596 00000100:00100000:2.0:1713279389.020206:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 209 00000100:00100000:3.0:1713279389.020209:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281325568:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 54us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279389.020221:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 210 00000100:00100000:3.0:1713279389.020221:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 595 00000100:00100000:0.0:1713279389.020227:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 211 00000100:00100000:1.0:1713279389.020227:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281325504:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279389.020232:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281325696:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279389.020234:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 212 00000100:00100000:2.0:1713279389.020242:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281325760:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279389.020259:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281325504:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279389.020261:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281325696:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279389.020266:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 210 00000100:00100000:0.0:1713279389.020270:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 211 00000100:00100000:2.0:1713279389.020272:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281325760:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279389.020285:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 212 00010000:00010000:2.0:1713279389.372606:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279390.114810:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200089280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1713279390.114894:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279390.114955:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089280 00000100:00100000:0.0:1713279390.114966:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089280 00000100:00100000:0.0:1713279390.115020:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99023 00000100:00100000:0.0:1713279390.115028:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008acce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200089280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1713279390.115066:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:0.0:1713279390.115136:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008acce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200089280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279390.115144:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99023 00000100:00100000:1.0:1713279390.115218:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200089280:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279390.374692:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279391.376637:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279391.794649:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713279391.794676:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200089344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1713279391.794745:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279391.794811:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089344 00000100:00100000:0.0:1713279391.794822:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089344 00000100:00100000:0.0:1713279391.794873:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99024 00000100:00100000:0.0:1713279391.794881:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200089344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713279391.794920:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:0.0:1713279391.794986:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200089344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279391.794994:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99024 00000100:00100000:1.0:1713279391.795052:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200089344:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279392.378663:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279392.466666:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008acce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200089408:0@lo:400:kworker.0 00000100:00100000:2.0:1713279392.466698:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200089472:0@lo:400:kworker.0 00000100:00100000:1.0:1713279392.466709:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200089536:0@lo:400:kworker.0 00000100:00100000:3.0:1713279392.466712:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200089600:0@lo:400:kworker.0 00000100:00100000:0.0:1713279392.466744:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279392.466774:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279392.466777:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279392.466779:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200089664:0@lo:400:kworker.0 00000100:00100000:1.0:1713279392.466791:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200089792:0@lo:400:kworker.0 00000100:00100000:0.0:1713279392.466810:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279392.466811:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200089728:0@lo:400:kworker.0 00000100:00100000:3.0:1713279392.466816:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279392.466822:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089408 00000100:00100000:0.0:1713279392.466823:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200089920:0@lo:400:kworker.0 00000100:00100000:1.0:1713279392.466829:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089408 00000100:00100000:2.0:1713279392.466843:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279392.466849:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200089856:0@lo:400:kworker.0 00000100:00100000:0.0:1713279392.466850:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279392.466862:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200090176:0@lo:400:kworker.0 00000100:00100000:2.0:1713279392.466865:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200089984:0@lo:400:kworker.0 00000100:00100000:1.0:1713279392.466867:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1713279392.466873:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200089408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279392.466876:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279392.466896:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089920 00000100:00100000:0.0:1713279392.466900:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089920 00000100:00100000:2.0:1713279392.466903:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279392.466913:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200090112:0@lo:400:kworker.0 00000100:00100000:0.0:1713279392.466925:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089856 00000100:00100000:1.0:1713279392.466925:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200089408:12345-0@lo:400:kworker.0 Request processed in 52us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279392.466927:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089856 00000100:00100000:1.0:1713279392.466931:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1713279392.466936:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279392.466944:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090112 00000100:00100000:2.0:1713279392.466944:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089472 00000100:00100000:0.0:1713279392.466946:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090112 00000100:00100000:2.0:1713279392.466950:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089472 00000100:00080000:1.0:1713279392.466955:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279362 00000100:00080000:1.0:1713279392.466959:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279362 00000100:00080000:1.0:1713279392.466961:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279362 00000100:00100000:0.0:1713279392.466962:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1713279392.466967:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200089920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279392.466971:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089600 00000100:00100000:1.0:1713279392.466973:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089600 00000100:00100000:3.0:1713279392.466973:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089728 00000100:00100000:3.0:1713279392.466979:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089728 00000100:00100000:2.0:1713279392.466982:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089984 00000100:00100000:2.0:1713279392.466986:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089984 00000100:00100000:1.0:1713279392.466992:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:1.0:1713279392.466996:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200089472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279392.467001:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200089920:12345-0@lo:400:kworker.0 Request processed in 33us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279392.467007:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1713279392.467017:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1713279392.467022:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200089472:12345-0@lo:400:kworker.0 Request processed in 24us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279392.467026:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1713279392.467029:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200089856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279392.467035:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200089600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279392.467036:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1713279392.467043:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200089728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279392.467047:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:0.0:1713279392.467053:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200089856:12345-0@lo:400:kworker.0 Request processed in 32us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279392.467058:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1713279392.467061:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1713279392.467065:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200089984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279392.467066:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1713279392.467070:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200090112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279392.467078:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200089600:12345-0@lo:400:kworker.0 Request processed in 44us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279392.467087:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200089984:12345-0@lo:400:kworker.0 Request processed in 22us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279392.467088:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1713279392.467093:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1713279392.467095:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200090112:12345-0@lo:400:kworker.0 Request processed in 24us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279392.467097:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200089728:12345-0@lo:400:kworker.0 Request processed in 52us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279392.467100:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1713279392.467106:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00080000:1.0:1713279392.467111:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279362 00000100:00100000:1.0:1713279392.467118:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279392.467122:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089536 00000100:00100000:2.0:1713279392.467124:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089792 00000100:00100000:0.0:1713279392.467125:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089536 00000100:00100000:2.0:1713279392.467128:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089792 00000100:00100000:1.0:1713279392.467132:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200090048:0@lo:400:kworker.0 00000100:00100000:3.0:1713279392.467139:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200089600:0@lo:400:kworker.0 00000100:00100000:0.0:1713279392.467140:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200089664 00000100:00100000:0.0:1713279392.467143:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200089664 00000100:00100000:1.0:1713279392.467147:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279392.467148:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200089856:0@lo:400:kworker.0 00000100:00100000:2.0:1713279392.467154:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090048 00000100:00100000:0.0:1713279392.467155:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99025 00000100:00100000:2.0:1713279392.467157:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090048 00000100:00100000:3.0:1713279392.467157:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200090112:0@lo:400:kworker.0 00000100:00100000:0.0:1713279392.467159:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200089536:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1713279392.467164:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279362 00000100:00100000:2.0:1713279392.467176:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:2.0:1713279392.467183:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200089792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279392.467186:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99026 00000100:00100000:3.0:1713279392.467186:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:0.0:1713279392.467187:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200089536:12345-0@lo:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279392.467191:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200089664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279392.467192:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200090048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279392.467193:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99025 00000100:00100000:0.0:1713279392.467209:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279392.467224:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200089664:12345-0@lo:400:kworker.0 Request processed in 33us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279392.467229:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99026 00000100:00100000:2.0:1713279392.467230:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200089792:12345-0@lo:400:kworker.0 Request processed in 46us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279392.467231:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200090048:12345-0@lo:400:kworker.0 Request processed in 39us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279392.467233:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008acce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200089408:0@lo:400:kworker.0 00000100:00100000:3.0:1713279392.467237:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1713279392.467241:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1713279392.467250:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200089664:0@lo:400:kworker.0 00000100:00100000:1.0:1713279392.467257:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200089536:0@lo:400:kworker.0 00000100:00100000:0.0:1713279392.467258:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200089920:0@lo:400:kworker.0 00000100:00100000:1.0:1713279392.467266:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200089792:0@lo:400:kworker.0 00000100:00100000:0.0:1713279392.467274:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090176 00000100:00100000:1.0:1713279392.467274:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200090048:0@lo:400:kworker.0 00000100:00100000:0.0:1713279392.467276:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090176 00000100:00100000:2.0:1713279392.467288:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200089472:0@lo:400:kworker.0 00000100:00080000:1.0:1713279392.467289:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279362 00000100:00100000:0.0:1713279392.467291:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1713279392.467295:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200090176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279392.467301:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200089728:0@lo:400:kworker.0 00000100:00100000:2.0:1713279392.467313:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200089984:0@lo:400:kworker.0 00000100:00100000:0.0:1713279392.467322:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200090176:12345-0@lo:400:kworker.0 Request processed in 26us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279392.467327:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1713279392.467335:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200090176:0@lo:400:kworker.0 00000100:00100000:1.0:1713279392.482689:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713279392.482707:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200090240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279392.482747:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bbbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200090304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279392.482749:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279392.482847:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279392.482893:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090240 00000100:00100000:1.0:1713279392.482897:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090304 00000100:00100000:0.0:1713279392.482898:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090240 00000100:00100000:1.0:1713279392.482904:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090304 00000100:00100000:0.0:1713279392.482935:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1713279392.482942:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200090240:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279392.482957:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1713279392.482967:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200090304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279392.482969:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:1.0:1713279392.482990:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279392.483006:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200090240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279392.483013:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1713279392.483042:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200090240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279392.483047:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200090304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279392.483065:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1713279392.483074:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012bbbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200090304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279393.202804:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bbbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200090368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279393.202888:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279393.202969:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090368 00000100:00100000:1.0:1713279393.202981:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090368 00000100:00100000:1.0:1713279393.203056:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1713279393.203068:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200090368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1713279393.203111:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279393.203189:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200090368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279393.203197:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1713279393.203234:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012bbbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200090368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279393.218702:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713279393.218729:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200090432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1713279393.218771:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279393.218860:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090432 00000100:00100000:1.0:1713279393.218870:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090432 00000100:00100000:1.0:1713279393.218926:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1713279393.218936:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200090432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1713279393.218961:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279393.219036:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200090432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279393.219048:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1713279393.219111:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200090432:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279393.380727:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279394.027585:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279394.027639:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279394.027673:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279394.027700:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279394.027747:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325888 00000100:00100000:3.0:1713279394.027761:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325888 00000100:00100000:0.0:1713279394.027781:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279394.027793:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326016 00000100:00100000:1.0:1713279394.027802:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326016 00000100:00100000:0.0:1713279394.027804:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279394.027817:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326144 00000100:00100000:0.0:1713279394.027821:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279394.027823:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325952 00000100:00100000:3.0:1713279394.027826:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325952 00000100:00100000:2.0:1713279394.027827:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326144 00000100:00100000:0.0:1713279394.027838:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279394.027841:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326272 00000100:00100000:1.0:1713279394.027844:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326272 00000100:00100000:3.0:1713279394.027852:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326208 00000100:00100000:3.0:1713279394.027854:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326208 00000100:00100000:1.0:1713279394.027859:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326080 00000100:00100000:1.0:1713279394.027862:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326080 00000100:00100000:2.0:1713279394.027870:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 603 00000100:00100000:2.0:1713279394.027880:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281325888:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279394.027880:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 604 00000100:00100000:1.0:1713279394.027883:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 217 00000100:00100000:3.0:1713279394.027888:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281325952:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279394.027890:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281326016:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279394.027961:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281325888:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 81us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279394.027961:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281325952:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 73us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279394.027969:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279394.027970:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 603 00000100:00100000:1.0:1713279394.027971:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281326016:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 78us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279394.027975:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 604 00000100:00100000:1.0:1713279394.027984:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 217 00000100:00100000:2.0:1713279394.027989:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 605 00000100:00100000:2.0:1713279394.027995:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281326144:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279394.027995:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 606 00000100:00100000:1.0:1713279394.027998:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326336 00000100:00100000:3.0:1713279394.028001:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281326208:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279394.028002:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326336 00000100:00100000:1.0:1713279394.028020:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 218 00000100:00100000:2.0:1713279394.028021:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281326144:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279394.028025:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281326272:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279394.028025:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281326208:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279394.028028:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 605 00000100:00100000:3.0:1713279394.028032:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 606 00000100:00100000:1.0:1713279394.028050:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281326272:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279394.028057:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 218 00000100:00100000:1.0:1713279394.028066:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 219 00000100:00100000:1.0:1713279394.028071:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281326080:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279394.028071:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 220 00000100:00100000:3.0:1713279394.028077:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281326336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279394.028096:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281326080:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279394.028101:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281326336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279394.028103:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 219 00000100:00100000:3.0:1713279394.028107:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 220 00000100:00080000:1.0:1713279394.028118:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279364 00000100:00080000:1.0:1713279394.028122:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279364 00000100:00080000:1.0:1713279394.028124:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279364 00000100:00080000:1.0:1713279394.028126:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279364 00000100:00100000:1.0:1713279394.028137:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281325824 00000100:00100000:1.0:1713279394.028140:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281325824 00000100:00080000:0.0:1713279394.028162:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279364 00000100:00100000:1.0:1713279394.028166:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 417 00000100:00100000:1.0:1713279394.028171:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281325824:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279394.028196:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281325824:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279394.028203:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 417 00010000:00010000:2.0:1713279394.382659:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279395.122795:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200090496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279395.122871:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279395.123004:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090496 00000100:00100000:2.0:1713279395.123016:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090496 00000100:00100000:2.0:1713279395.123074:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99027 00000100:00100000:2.0:1713279395.123082:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008acce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200090496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279395.123124:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279395.123191:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008acce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200090496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279395.123198:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99027 00000100:00100000:3.0:1713279395.123232:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200090496:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279395.384733:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279396.386739:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279396.802569:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200090560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713279396.802623:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279396.802686:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090560 00000100:00100000:0.0:1713279396.802694:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090560 00000100:00100000:0.0:1713279396.802743:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99028 00000100:00100000:0.0:1713279396.802750:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200090560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713279396.802781:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:0.0:1713279396.802837:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200090560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279396.802845:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99028 00000100:00100000:2.0:1713279396.802871:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200090560:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279397.388666:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279397.474691:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200090624:0@lo:400:kworker.0 00000100:00100000:0.0:1713279397.474775:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200090688:0@lo:400:kworker.0 00000100:00100000:1.0:1713279397.474777:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200090816:0@lo:400:kworker.0 00000100:00100000:2.0:1713279397.474797:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279397.474842:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279397.474866:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200090880:0@lo:400:kworker.0 00000100:00100000:0.0:1713279397.474881:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090816 00000100:00100000:1.0:1713279397.474884:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200091072:0@lo:400:kworker.0 00000100:00100000:3.0:1713279397.474887:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200090752:0@lo:400:kworker.0 00000100:00100000:0.0:1713279397.474893:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090816 00000100:00100000:2.0:1713279397.474900:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279397.474914:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279397.474919:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200091136:0@lo:400:kworker.0 00000100:00100000:1.0:1713279397.474959:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200091328:0@lo:400:kworker.0 00000100:00100000:3.0:1713279397.474960:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279397.474961:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279397.474967:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1713279397.474974:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200091392:0@lo:400:kworker.0 00000100:00100000:0.0:1713279397.474978:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200090816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279397.474992:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279397.474992:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200091008:0@lo:400:kworker.0 00000100:00100000:2.0:1713279397.475004:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090880 00000100:00100000:2.0:1713279397.475008:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090880 00000100:00100000:3.0:1713279397.475027:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279397.475042:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090624 00000100:00100000:2.0:1713279397.475042:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090752 00000100:00100000:2.0:1713279397.475046:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090752 00000100:00100000:1.0:1713279397.475048:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090624 00000100:00100000:3.0:1713279397.475064:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200091264:0@lo:400:kworker.0 00000100:00100000:0.0:1713279397.475066:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200090816:12345-0@lo:400:kworker.0 Request processed in 89us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279397.475070:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99029 00000100:00100000:0.0:1713279397.475075:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1713279397.475079:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200090880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279397.475092:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091008 00000100:00100000:1.0:1713279397.475093:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1713279397.475093:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279397.475095:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091008 00000100:00100000:1.0:1713279397.475102:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200090624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279397.475112:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091264 00000100:00100000:0.0:1713279397.475114:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091264 00000100:00100000:0.0:1713279397.475128:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1713279397.475133:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200091008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279397.475134:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091072 00000100:00100000:2.0:1713279397.475138:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200090880:12345-0@lo:400:kworker.0 Request processed in 58us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279397.475140:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091072 00000100:00100000:2.0:1713279397.475150:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99029 00000100:00100000:1.0:1713279397.475152:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200090624:12345-0@lo:400:kworker.0 Request processed in 49us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279397.475163:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1713279397.475164:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200091008:12345-0@lo:400:kworker.0 Request processed in 30us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279397.475170:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1713279397.475173:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99030 00000100:00100000:3.0:1713279397.475174:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091136 00000100:00100000:2.0:1713279397.475178:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200090752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279397.475178:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091136 00000100:00100000:0.0:1713279397.475179:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:0.0:1713279397.475182:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200091264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279397.475197:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091328 00000100:00100000:3.0:1713279397.475201:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091328 00000100:00100000:1.0:1713279397.475204:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1713279397.475210:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200091264:12345-0@lo:400:kworker.0 Request processed in 26us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279397.475211:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200091072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279397.475215:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1713279397.475215:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200090752:12345-0@lo:400:kworker.0 Request processed in 36us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279397.475221:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99030 00000100:00100000:3.0:1713279397.475226:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00080000:0.0:1713279397.475232:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279367 00000100:00100000:3.0:1713279397.475234:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200091136:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1713279397.475236:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279367 00000100:00080000:0.0:1713279397.475238:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279367 00000100:00080000:0.0:1713279397.475240:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279367 00000100:00100000:2.0:1713279397.475241:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1713279397.475246:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200091328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279397.475250:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200091072:12345-0@lo:400:kworker.0 Request processed in 39us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279397.475257:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279397.475257:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1713279397.475276:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200090944:0@lo:400:kworker.0 00000100:00100000:2.0:1713279397.475278:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200091328:12345-0@lo:400:kworker.0 Request processed in 32us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279397.475284:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1713279397.475294:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200091136:12345-0@lo:400:kworker.0 Request processed in 58us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279397.475296:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279397.475297:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090688 00000100:00100000:1.0:1713279397.475301:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090688 00000100:00100000:3.0:1713279397.475305:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1713279397.475306:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200090944 00000100:00100000:0.0:1713279397.475307:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200091200:0@lo:400:kworker.0 00000100:00100000:2.0:1713279397.475309:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200090944 00000100:00100000:0.0:1713279397.475322:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279397.475322:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:1.0:1713279397.475327:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200090688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279397.475340:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091200 00000100:00100000:2.0:1713279397.475342:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091200 00000100:00080000:0.0:1713279397.475344:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279367 00000100:00100000:2.0:1713279397.475353:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:1.0:1713279397.475357:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200090688:12345-0@lo:400:kworker.0 Request processed in 30us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279397.475358:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1713279397.475358:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200090944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279397.475364:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200091200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279397.475364:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1713279397.475389:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200090944:12345-0@lo:400:kworker.0 Request processed in 29us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279397.475391:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200091200:12345-0@lo:400:kworker.0 Request processed in 27us (69us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279397.475398:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1713279397.475402:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1713279397.475423:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279397.475512:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091392 00000100:00100000:3.0:1713279397.475514:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200090752:0@lo:400:kworker.0 00000100:00100000:1.0:1713279397.475518:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091392 00000100:00100000:0.0:1713279397.475523:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200090688:0@lo:400:kworker.0 00000100:00100000:0.0:1713279397.475538:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200090944:0@lo:400:kworker.0 00000100:00100000:3.0:1713279397.475542:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200091008:0@lo:400:kworker.0 00000100:00100000:1.0:1713279397.475545:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1713279397.475545:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200090624:0@lo:400:kworker.0 00000100:00100000:0.0:1713279397.475547:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200091200:0@lo:400:kworker.0 00000100:00100000:1.0:1713279397.475550:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200091392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279397.475558:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200091264:0@lo:400:kworker.0 00000100:00100000:2.0:1713279397.475573:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200090880:0@lo:400:kworker.0 00000100:00080000:3.0:1713279397.475624:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279367 00000100:00100000:0.0:1713279397.475767:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200090816:0@lo:400:kworker.0 00000100:00100000:1.0:1713279397.475770:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200091392:12345-0@lo:400:kworker.0 Request processed in 219us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279397.475775:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200091136:0@lo:400:kworker.0 00000100:00100000:1.0:1713279397.475777:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1713279397.475793:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200091392:0@lo:400:kworker.0 00000100:00100000:0.0:1713279397.475836:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200091072:0@lo:400:kworker.0 00000100:00100000:0.0:1713279397.475846:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200091328:0@lo:400:kworker.0 00000100:00100000:1.0:1713279397.490647:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200091456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279397.490658:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200091520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279397.490691:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279397.490744:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279397.490772:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091456 00000100:00100000:1.0:1713279397.490777:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091456 00000100:00100000:0.0:1713279397.490781:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091520 00000100:00100000:0.0:1713279397.490791:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091520 00000100:00100000:1.0:1713279397.490814:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1713279397.490821:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200091456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1713279397.490850:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279397.490853:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1713279397.490865:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200091520:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279397.490888:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200091456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (197us total) trans 0 rc 0/0 00002000:00000024:0.0:1713279397.490889:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279397.490895:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1713279397.490917:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200091456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279397.490966:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200091520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279397.490979:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1713279397.490991:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200091520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279398.210611:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713279398.210635:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200091584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279398.210701:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279398.210748:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091584 00000100:00100000:0.0:1713279398.210758:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091584 00000100:00100000:0.0:1713279398.210809:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1713279398.210817:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200091584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279398.210865:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279398.210949:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200091584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279398.210955:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1713279398.210996:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200091584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279398.226631:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713279398.226649:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200091648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279398.226688:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279398.226717:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091648 00000100:00100000:2.0:1713279398.226726:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091648 00000100:00100000:2.0:1713279398.226773:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1713279398.226780:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200091648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279398.226798:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279398.226853:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200091648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279398.226860:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1713279398.226893:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200091648:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279398.390743:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279399.036247:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279399.036298:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279399.036328:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279399.036358:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279399.036376:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279399.036396:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279399.036399:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326400 00000100:00100000:2.0:1713279399.036399:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326464 00000100:00100000:3.0:1713279399.036403:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326528 00000100:00100000:1.0:1713279399.036449:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326400 00000100:00100000:3.0:1713279399.036472:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326528 00000100:00100000:0.0:1713279399.036478:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279399.036493:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326464 00000100:00100000:0.0:1713279399.036502:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279399.036530:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326720 00000100:00100000:1.0:1713279399.036535:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 419 00000100:00100000:3.0:1713279399.036535:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326720 00000100:00100000:0.0:1713279399.036537:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279399.036541:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326784 00000100:00100000:1.0:1713279399.036544:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281326400:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279399.036546:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326784 00000100:00100000:3.0:1713279399.036571:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 613 00000100:00100000:0.0:1713279399.036581:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 614 00000100:00100000:3.0:1713279399.036582:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281326528:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279399.036590:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281326464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279399.036592:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 615 00000100:00100000:2.0:1713279399.036605:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281326720:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279399.036617:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281326400:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 73us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279399.036625:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 419 00000100:00100000:0.0:1713279399.036637:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281326464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279399.036645:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 614 00000100:00100000:3.0:1713279399.036660:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281326528:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 75us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279399.036664:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326592 00000100:00100000:0.0:1713279399.036667:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 616 00000100:00100000:2.0:1713279399.036667:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281326720:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 62us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279399.036668:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326592 00000100:00100000:0.0:1713279399.036673:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281326784:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279399.036675:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 613 00000100:00100000:2.0:1713279399.036682:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 615 00000100:00100000:1.0:1713279399.036690:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326656 00000100:00100000:1.0:1713279399.036692:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326656 00000100:00100000:0.0:1713279399.036696:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281326784:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279399.036704:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326848 00000100:00100000:0.0:1713279399.036707:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 616 00000100:00100000:1.0:1713279399.036707:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326848 00000100:00100000:3.0:1713279399.036713:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326912 00000100:00100000:1.0:1713279399.036719:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 225 00000100:00100000:3.0:1713279399.036719:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326912 00000100:00100000:1.0:1713279399.036724:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281326592:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279399.036728:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 226 00000100:00100000:2.0:1713279399.036737:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281326656:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279399.036740:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 227 00000100:00100000:0.0:1713279399.036745:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281326848:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279399.036751:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281326592:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279399.036758:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 225 00000100:00100000:3.0:1713279399.036766:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 228 00000100:00100000:0.0:1713279399.036770:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281326848:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279399.036776:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281326912:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279399.036777:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 227 00000100:00100000:2.0:1713279399.036783:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281326656:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 44us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279399.036795:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 226 00000100:00100000:3.0:1713279399.036822:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281326912:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279399.036834:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 228 00000100:00080000:2.0:1713279399.036841:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279369 00000100:00080000:2.0:1713279399.036848:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279369 00000100:00080000:2.0:1713279399.036852:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279369 00000100:00080000:2.0:1713279399.036855:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279369 00000100:00080000:2.0:1713279399.036859:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279369 00010000:00010000:2.0:1713279399.392729:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279400.130821:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713279400.130849:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200091712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279400.130926:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279400.130984:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091712 00000100:00100000:2.0:1713279400.130997:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091712 00000100:00100000:2.0:1713279400.131062:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99031 00000100:00100000:2.0:1713279400.131070:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200091712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279400.131109:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279400.131179:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200091712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279400.131188:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99031 00000100:00100000:3.0:1713279400.131221:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200091712:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279400.394719:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279401.396729:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279401.810557:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713279401.810577:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200091776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279401.810635:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279401.810682:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091776 00000100:00100000:2.0:1713279401.810689:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091776 00000100:00100000:2.0:1713279401.810723:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99032 00000100:00100000:2.0:1713279401.810728:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200091776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279401.810751:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279401.810791:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200091776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279401.810795:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99032 00000100:00100000:0.0:1713279401.810816:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200091776:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279402.398737:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279402.482746:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200091904:0@lo:400:kworker.0 00000100:00100000:1.0:1713279402.482762:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200091968:0@lo:400:kworker.0 00000100:00100000:0.0:1713279402.482767:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200091840:0@lo:400:kworker.0 00000100:00100000:3.0:1713279402.482770:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200092032:0@lo:400:kworker.0 00000100:00100000:2.0:1713279402.482856:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279402.482858:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279402.482861:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279402.482900:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091968 00000100:00100000:0.0:1713279402.482903:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200092096:0@lo:400:kworker.0 00000100:00100000:2.0:1713279402.482906:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200092160:0@lo:400:kworker.0 00000100:00100000:3.0:1713279402.482909:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091968 00000100:00100000:1.0:1713279402.482913:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200092224:0@lo:400:kworker.0 00000100:00100000:0.0:1713279402.482927:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279402.482934:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279402.482944:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200092352:0@lo:400:kworker.0 00000100:00100000:1.0:1713279402.482952:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279402.482953:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092096 00000100:00100000:3.0:1713279402.482956:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092096 00000100:00100000:2.0:1713279402.482957:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200092416:0@lo:400:kworker.0 00000100:00100000:0.0:1713279402.482964:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279402.482977:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99033 00000100:00100000:0.0:1713279402.482978:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200092608:0@lo:400:kworker.0 00000100:00100000:1.0:1713279402.482978:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200092480:0@lo:400:kworker.0 00000100:00100000:3.0:1713279402.482985:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200091968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279402.482989:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279402.482997:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279402.483010:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279402.483034:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091904 00000100:00100000:0.0:1713279402.483040:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091904 00000100:00100000:2.0:1713279402.483040:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092160 00000100:00100000:2.0:1713279402.483048:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092160 00000100:00100000:3.0:1713279402.483050:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200091968:12345-0@lo:400:kworker.0 Request processed in 65us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279402.483058:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99033 00000100:00100000:1.0:1713279402.483061:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200091968:0@lo:400:kworker.0 00000100:00100000:0.0:1713279402.483067:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092224 00000100:00100000:0.0:1713279402.483070:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092224 00000100:00100000:3.0:1713279402.483075:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99034 00000100:00100000:3.0:1713279402.483080:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200092096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279402.483088:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092416 00000100:00100000:0.0:1713279402.483090:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092416 00000100:00100000:2.0:1713279402.483091:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092480 00000100:00100000:2.0:1713279402.483096:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092480 00000100:00100000:1.0:1713279402.483099:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200091840 00000100:00100000:1.0:1713279402.483106:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200091840 00000100:00100000:3.0:1713279402.483106:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200092096:12345-0@lo:400:kworker.0 Request processed in 26us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279402.483108:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:0.0:1713279402.483116:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200091904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279402.483116:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99034 00000100:00100000:2.0:1713279402.483129:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:2.0:1713279402.483138:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200092160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279402.483145:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092352 00000100:00100000:1.0:1713279402.483148:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1713279402.483150:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092352 00000100:00100000:0.0:1713279402.483156:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200091904:12345-0@lo:400:kworker.0 Request processed in 40us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279402.483156:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200091840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279402.483163:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:0.0:1713279402.483177:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:0.0:1713279402.483182:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200092224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279402.483184:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092608 00000100:00100000:3.0:1713279402.483188:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092608 00000100:00100000:2.0:1713279402.483201:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200092160:12345-0@lo:400:kworker.0 Request processed in 61us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279402.483215:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200091840:12345-0@lo:400:kworker.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279402.483216:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1713279402.483217:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200092224:12345-0@lo:400:kworker.0 Request processed in 30us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279402.483217:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1713279402.483224:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1713279402.483225:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1713279402.483227:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200092352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279402.483234:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:0.0:1713279402.483238:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200092416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279402.483245:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:2.0:1713279402.483253:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200092480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279402.483265:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200092416:12345-0@lo:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279402.483271:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1713279402.483280:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200092352:12345-0@lo:400:kworker.0 Request processed in 55us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279402.483291:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1713279402.483299:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200092608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279402.483299:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1713279402.483300:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200092224:0@lo:400:kworker.0 00000100:00100000:2.0:1713279402.483304:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200092480:12345-0@lo:400:kworker.0 Request processed in 50us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279402.483311:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1713279402.483312:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200092480:0@lo:400:kworker.0 00000100:00100000:1.0:1713279402.483332:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200092608:12345-0@lo:400:kworker.0 Request processed in 35us (334us total) trans 0 rc 0/0 00000100:00080000:2.0:1713279402.483335:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279372 00000100:00100000:0.0:1713279402.483336:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200091840:0@lo:400:kworker.0 00000100:00080000:2.0:1713279402.483339:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279372 00000100:00080000:2.0:1713279402.483341:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279372 00000100:00100000:3.0:1713279402.483342:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279402.483343:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:2.0:1713279402.483343:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279372 00000100:00100000:0.0:1713279402.483346:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200092096:0@lo:400:kworker.0 00000100:00080000:2.0:1713279402.483346:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279372 00000100:00100000:0.0:1713279402.483354:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200092352:0@lo:400:kworker.0 00000100:00100000:2.0:1713279402.483355:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092032 00000100:00100000:2.0:1713279402.483359:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092032 00000100:00100000:0.0:1713279402.483363:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200092608:0@lo:400:kworker.0 00000100:00100000:3.0:1713279402.483370:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200092288:0@lo:400:kworker.0 00000100:00100000:2.0:1713279402.483381:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1713279402.483404:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279402.483511:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200092032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279402.483515:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092288 00000100:00100000:0.0:1713279402.483520:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092288 00000100:00100000:3.0:1713279402.483534:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200092544:0@lo:400:kworker.0 00000100:00080000:1.0:1713279402.483540:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279372 00000100:00100000:0.0:1713279402.483546:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1713279402.483551:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200092288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279402.483572:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200092032:12345-0@lo:400:kworker.0 Request processed in 60us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279402.483573:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279402.483584:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1713279402.483586:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200092288:12345-0@lo:400:kworker.0 Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279402.483592:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1713279402.483601:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092544 00000100:00100000:0.0:1713279402.483604:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092544 00000100:00100000:3.0:1713279402.483616:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200092032:0@lo:400:kworker.0 00000100:00100000:2.0:1713279402.483633:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200091904:0@lo:400:kworker.0 00000100:00100000:0.0:1713279402.483635:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1713279402.483635:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200092288:0@lo:400:kworker.0 00000100:00100000:0.0:1713279402.483639:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200092544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279402.483651:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200092160:0@lo:400:kworker.0 00000100:00080000:1.0:1713279402.483652:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279372 00000100:00100000:2.0:1713279402.483663:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200092416:0@lo:400:kworker.0 00000100:00100000:0.0:1713279402.483672:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200092544:12345-0@lo:400:kworker.0 Request processed in 32us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279402.483678:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1713279402.483688:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200092544:0@lo:400:kworker.0 00000100:00100000:2.0:1713279402.498550:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200092672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279402.498589:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279402.498621:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092672 00000100:00100000:3.0:1713279402.498628:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092672 00000100:00100000:0.0:1713279402.498649:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200092736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279402.498660:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1713279402.498667:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200092672:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279402.498687:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1713279402.498694:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279402.498710:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092736 00000100:00100000:1.0:1713279402.498720:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092736 00000100:00100000:3.0:1713279402.498751:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200092672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279402.498757:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1713279402.498764:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1713279402.498768:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200092736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1713279402.498792:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279402.498802:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200092672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279402.498865:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200092736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279402.498877:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1713279402.498900:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200092736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279403.218794:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200092800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279403.218875:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279403.218936:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092800 00000100:00100000:1.0:1713279403.218948:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092800 00000100:00100000:1.0:1713279403.219009:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1713279403.219018:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200092800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1713279403.219056:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279403.219121:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200092800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279403.219129:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1713279403.219170:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200092800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279403.234703:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713279403.234726:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200092864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279403.234778:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279403.234835:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092864 00000100:00100000:1.0:1713279403.234844:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092864 00000100:00100000:1.0:1713279403.234887:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1713279403.234894:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200092864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1713279403.234911:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279403.234963:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200092864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279403.234975:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1713279403.235017:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200092864:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279403.400684:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279404.043796:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279404.043859:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279404.043893:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279404.043915:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279404.043942:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279404.043953:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327040 00000100:00100000:0.0:1713279404.043959:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279404.043968:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327040 00000100:00100000:0.0:1713279404.043975:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279404.043990:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279404.043996:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281326976 00000100:00100000:1.0:1713279404.044006:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281326976 00000100:00100000:3.0:1713279404.044024:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327104 00000100:00100000:3.0:1713279404.044027:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327104 00000100:00100000:0.0:1713279404.044029:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279404.044039:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327296 00000100:00100000:3.0:1713279404.044045:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327360 00000100:00100000:3.0:1713279404.044048:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327360 00000100:00100000:2.0:1713279404.044049:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327296 00000100:00100000:1.0:1713279404.044050:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 421 00000100:00100000:0.0:1713279404.044058:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327168 00000100:00100000:1.0:1713279404.044059:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281326976:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279404.044064:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327168 00000100:00100000:3.0:1713279404.044068:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 623 00000100:00100000:3.0:1713279404.044076:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281327040:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279404.044095:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327232 00000100:00100000:0.0:1713279404.044098:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327232 00000100:00100000:2.0:1713279404.044102:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 624 00000100:00100000:0.0:1713279404.044109:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327424 00000100:00100000:2.0:1713279404.044110:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281327104:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279404.044112:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327424 00000100:00100000:0.0:1713279404.044124:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327488 00000100:00100000:0.0:1713279404.044126:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327488 00000100:00100000:1.0:1713279404.044131:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281326976:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279404.044139:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 421 00000100:00100000:3.0:1713279404.044139:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281327040:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 62us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279404.044142:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 233 00000100:00100000:3.0:1713279404.044148:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 623 00000100:00100000:0.0:1713279404.044150:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281327168:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279404.044158:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281327104:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279404.044164:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 625 00000100:00100000:2.0:1713279404.044170:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 624 00000100:00100000:3.0:1713279404.044171:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281327360:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279404.044178:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 626 00000100:00100000:1.0:1713279404.044184:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281327296:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279404.044191:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281327168:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279404.044196:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281327360:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279404.044199:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 233 00000100:00100000:3.0:1713279404.044204:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 625 00000100:00100000:1.0:1713279404.044210:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281327296:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279404.044213:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 234 00000100:00100000:1.0:1713279404.044219:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 626 00000100:00100000:0.0:1713279404.044221:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281327232:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279404.044222:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 235 00000100:00100000:2.0:1713279404.044228:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281327424:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:3.0:1713279404.044229:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279374 00000100:00080000:3.0:1713279404.044233:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279374 00000100:00080000:3.0:1713279404.044235:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279374 00000100:00080000:3.0:1713279404.044237:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279374 00000100:00080000:3.0:1713279404.044240:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279374 00000100:00100000:0.0:1713279404.044242:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281327232:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279404.044249:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 234 00000100:00100000:1.0:1713279404.044257:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 236 00000100:00100000:2.0:1713279404.044257:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281327424:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279404.044262:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281327488:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279404.044277:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 235 00000100:00100000:1.0:1713279404.044282:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281327488:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279404.044289:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 236 00010000:00010000:2.0:1713279404.402745:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279405.138825:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200092928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1713279405.138923:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279405.139075:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092928 00000100:00100000:1.0:1713279405.139090:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092928 00000100:00100000:1.0:1713279405.139167:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99035 00000100:00100000:1.0:1713279405.139180:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200092928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1713279405.139228:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:1.0:1713279405.139315:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200092928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279405.139328:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99035 00000100:00100000:2.0:1713279405.139376:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200092928:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279405.404639:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279406.406738:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279406.818711:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200092992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1713279406.818789:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279406.818843:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200092992 00000100:00100000:2.0:1713279406.818852:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200092992 00000100:00100000:2.0:1713279406.818912:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99036 00000100:00100000:2.0:1713279406.818923:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200092992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279406.818962:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279406.819034:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200092992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279406.819044:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99036 00000100:00100000:1.0:1713279406.819075:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200092992:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279407.408663:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279407.490749:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200093248:0@lo:400:kworker.0 00000100:00100000:2.0:1713279407.490749:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200093056:0@lo:400:kworker.0 00000100:00100000:0.0:1713279407.490759:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200093120:0@lo:400:kworker.0 00000100:00100000:3.0:1713279407.490781:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200093184:0@lo:400:kworker.0 00000100:00100000:2.0:1713279407.490842:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279407.490844:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279407.490857:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279407.490872:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200093504:0@lo:400:kworker.0 00000100:00100000:2.0:1713279407.490872:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200093312:0@lo:400:kworker.0 00000100:00100000:0.0:1713279407.490881:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093248 00000100:00100000:0.0:1713279407.490889:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093248 00000100:00100000:3.0:1713279407.490892:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200093440:0@lo:400:kworker.0 00000100:00100000:2.0:1713279407.490899:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279407.490900:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279407.490914:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200093568:0@lo:400:kworker.0 00000100:00100000:1.0:1713279407.490917:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200093760:0@lo:400:kworker.0 00000100:00100000:3.0:1713279407.490928:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279407.490933:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279407.490940:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093440 00000100:00100000:0.0:1713279407.490943:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093440 00000100:00100000:1.0:1713279407.490948:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093056 00000100:00100000:2.0:1713279407.490951:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200093824:0@lo:400:kworker.0 00000100:00100000:1.0:1713279407.490953:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093056 00000100:00100000:3.0:1713279407.490957:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200093696:0@lo:400:kworker.0 00000100:00100000:0.0:1713279407.490966:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1713279407.490967:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279407.490974:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200093248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279407.490983:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279407.490987:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1713279407.490993:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200093056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279407.491000:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093504 00000100:00100000:2.0:1713279407.491005:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093504 00000100:00100000:3.0:1713279407.491025:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093696 00000100:00100000:3.0:1713279407.491030:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093696 00000100:00100000:2.0:1713279407.491032:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093568 00000100:00100000:0.0:1713279407.491034:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200093248:12345-0@lo:400:kworker.0 Request processed in 59us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279407.491035:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200093056:12345-0@lo:400:kworker.0 Request processed in 41us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279407.491035:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093568 00000100:00100000:1.0:1713279407.491044:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1713279407.491045:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1713279407.491048:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093824 00000100:00100000:2.0:1713279407.491050:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093824 00000100:00100000:3.0:1713279407.491062:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:0.0:1713279407.491067:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1713279407.491067:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1713279407.491069:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200093440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279407.491072:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200093696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279407.491073:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200093504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279407.491086:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1713279407.491091:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200093568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279407.491118:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200093696:12345-0@lo:400:kworker.0 Request processed in 45us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279407.491124:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:1.0:1713279407.491128:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200093568:12345-0@lo:400:kworker.0 Request processed in 36us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279407.491128:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200093440:12345-0@lo:400:kworker.0 Request processed in 59us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279407.491133:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200093504:12345-0@lo:400:kworker.0 Request processed in 58us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279407.491134:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1713279407.491135:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1713279407.491140:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1713279407.491144:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093184 00000100:00100000:0.0:1713279407.491147:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093184 00000100:00100000:1.0:1713279407.491151:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1713279407.491155:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200093824:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279407.491155:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279377 00000100:00080000:3.0:1713279407.491158:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279377 00000100:00080000:3.0:1713279407.491161:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279377 00000100:00080000:3.0:1713279407.491163:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279377 00000100:00100000:0.0:1713279407.491167:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093312 00000100:00100000:0.0:1713279407.491169:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093312 00000100:00100000:2.0:1713279407.491176:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99037 00000100:00100000:1.0:1713279407.491179:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200093824:12345-0@lo:400:kworker.0 Request processed in 23us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279407.491182:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200093184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279407.491185:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1713279407.491187:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99038 00000100:00100000:0.0:1713279407.491192:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200093312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279407.491199:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200093440:0@lo:400:kworker.0 00000100:00100000:1.0:1713279407.491208:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279407.491212:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200093184:12345-0@lo:400:kworker.0 Request processed in 30us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279407.491212:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200093696:0@lo:400:kworker.0 00000100:00100000:2.0:1713279407.491219:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99037 00000100:00100000:0.0:1713279407.491224:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200093312:12345-0@lo:400:kworker.0 Request processed in 31us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279407.491231:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99038 00000100:00100000:3.0:1713279407.491234:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200093184:0@lo:400:kworker.0 00000100:00100000:1.0:1713279407.491238:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200093248:0@lo:400:kworker.0 00000100:00100000:2.0:1713279407.491247:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200093056:0@lo:400:kworker.0 00000100:00100000:1.0:1713279407.491249:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200093504:0@lo:400:kworker.0 00000100:00100000:0.0:1713279407.491252:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093760 00000100:00100000:0.0:1713279407.491255:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093760 00000100:00100000:2.0:1713279407.491258:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200093312:0@lo:400:kworker.0 00000100:00080000:3.0:1713279407.491266:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279377 00000100:00100000:2.0:1713279407.491268:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200093568:0@lo:400:kworker.0 00000100:00100000:2.0:1713279407.491278:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200093824:0@lo:400:kworker.0 00000100:00100000:0.0:1713279407.491282:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1713279407.491286:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200093760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279407.491312:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200093760:12345-0@lo:400:kworker.0 Request processed in 25us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279407.491318:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1713279407.491324:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200093760:0@lo:400:kworker.0 00000100:00100000:0.0:1713279407.491334:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279407.491375:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200093376:0@lo:400:kworker.0 00000100:00100000:2.0:1713279407.491455:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093120 00000100:00100000:0.0:1713279407.491456:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279407.491460:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093120 00000100:00100000:0.0:1713279407.491478:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200093632:0@lo:400:kworker.0 00000100:00100000:2.0:1713279407.491493:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093376 00000100:00100000:2.0:1713279407.491496:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093376 00000100:00100000:0.0:1713279407.491500:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279407.491513:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093632 00000100:00100000:2.0:1713279407.491516:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093632 00000100:00100000:3.0:1713279407.491529:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:0.0:1713279407.491535:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1713279407.491536:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200093120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279407.491541:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200093376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279407.491544:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:2.0:1713279407.491550:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200093632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279407.491581:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200093376:12345-0@lo:400:kworker.0 Request processed in 40us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279407.491588:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1713279407.491591:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200093120:12345-0@lo:400:kworker.0 Request processed in 55us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279407.491592:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200093632:12345-0@lo:400:kworker.0 Request processed in 42us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279407.491598:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1713279407.491602:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1713279407.491607:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200093120:0@lo:400:kworker.0 00000100:00100000:1.0:1713279407.491619:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200093376:0@lo:400:kworker.0 00000100:00080000:3.0:1713279407.491619:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279377 00000100:00100000:1.0:1713279407.491629:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200093632:0@lo:400:kworker.0 00000100:00100000:1.0:1713279407.506631:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200093952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279407.506662:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200093888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279407.506684:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279407.506758:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093952 00000100:00100000:0.0:1713279407.506766:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093952 00000100:00100000:3.0:1713279407.506772:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279407.506805:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200093888 00000100:00100000:0.0:1713279407.506808:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200093888 00000100:00100000:0.0:1713279407.506825:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1713279407.506832:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200093952:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279407.506838:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1713279407.506848:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200093888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1713279407.506860:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279407.506868:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279407.506912:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200093888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279407.506920:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1713279407.506924:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200093952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279407.506931:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200093888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279407.506932:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1713279407.506967:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200093952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279408.226767:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713279408.226793:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200094016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279408.226870:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279408.226937:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094016 00000100:00100000:0.0:1713279408.226948:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094016 00000100:00100000:0.0:1713279408.227003:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1713279408.227012:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200094016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279408.227047:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279408.227121:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200094016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279408.227130:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1713279408.227133:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200094016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279408.242670:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200094080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279408.242715:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279408.242777:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094080 00000100:00100000:2.0:1713279408.242785:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094080 00000100:00100000:2.0:1713279408.242834:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1713279408.242842:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200094080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279408.242859:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279408.242903:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200094080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279408.242910:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1713279408.242927:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200094080:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279408.410692:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279409.051697:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279409.051754:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279409.051785:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279409.051793:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327616 00000100:00100000:0.0:1713279409.051806:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279409.051806:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327616 00000100:00100000:0.0:1713279409.051842:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279409.051854:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327552 00000100:00100000:0.0:1713279409.051858:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279409.051863:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327552 00000100:00100000:2.0:1713279409.051869:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327680 00000100:00100000:2.0:1713279409.051872:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327680 00000100:00100000:0.0:1713279409.051876:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279409.051887:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327872 00000100:00100000:2.0:1713279409.051889:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327872 00000100:00100000:0.0:1713279409.051893:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279409.051905:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327936 00000100:00100000:1.0:1713279409.051906:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 423 00000100:00100000:2.0:1713279409.051907:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327936 00000100:00100000:1.0:1713279409.051915:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281327552:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279409.051925:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 633 00000100:00100000:0.0:1713279409.051931:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279409.051933:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281327616:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279409.051957:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327744 00000100:00100000:0.0:1713279409.051962:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327744 00000100:00100000:3.0:1713279409.051974:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 634 00000100:00100000:1.0:1713279409.051984:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281327552:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 69us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279409.051986:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281327680:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279409.051992:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 423 00000100:00100000:2.0:1713279409.051992:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281327616:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 59us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279409.051993:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281327808 00000100:00100000:0.0:1713279409.051995:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281327808 00000100:00100000:2.0:1713279409.052000:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 633 00000100:00100000:0.0:1713279409.052009:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328000 00000100:00100000:0.0:1713279409.052011:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328000 00000100:00100000:2.0:1713279409.052020:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 635 00000100:00100000:0.0:1713279409.052023:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328064 00000100:00100000:2.0:1713279409.052025:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281327872:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279409.052026:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328064 00000100:00100000:1.0:1713279409.052030:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 241 00000100:00100000:1.0:1713279409.052036:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281327744:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279409.052038:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281327680:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 53us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279409.052042:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:3.0:1713279409.052047:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 634 00000100:00100000:0.0:1713279409.052051:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281327808:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279409.052052:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281327872:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279409.052059:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 635 00000100:00100000:1.0:1713279409.052066:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281327744:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279409.052070:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 636 00000100:00100000:1.0:1713279409.052073:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 241 00000100:00100000:2.0:1713279409.052075:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281327936:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279409.052088:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 243 00000100:00100000:1.0:1713279409.052092:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281328000:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:3.0:1713279409.052092:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279379 00000100:00080000:3.0:1713279409.052097:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279379 00000100:00080000:3.0:1713279409.052099:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279379 00000100:00100000:2.0:1713279409.052100:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281327936:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (206us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279409.052101:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279379 00000100:00080000:3.0:1713279409.052104:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279379 00000100:00100000:0.0:1713279409.052105:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281327808:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 53us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279409.052106:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 636 00000100:00100000:1.0:1713279409.052113:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281328000:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279409.052117:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:3.0:1713279409.052125:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:3.0:1713279409.052130:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281328064:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279409.052133:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 243 00000100:00100000:3.0:1713279409.052154:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281328064:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279409.052161:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 244 00010000:00010000:2.0:1713279409.412644:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279410.146818:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009966b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200094144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1713279410.146906:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279410.146979:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094144 00000100:00100000:3.0:1713279410.146991:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094144 00000100:00100000:3.0:1713279410.147064:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99039 00000100:00100000:3.0:1713279410.147073:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200094144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279410.147112:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279410.147181:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200094144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279410.147193:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99039 00000100:00100000:1.0:1713279410.147245:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009966b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200094144:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279410.414679:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279411.416763:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279411.826705:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200094208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1713279411.826793:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279411.826851:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094208 00000100:00100000:0.0:1713279411.826862:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094208 00000100:00100000:0.0:1713279411.826921:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99040 00000100:00100000:0.0:1713279411.826928:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200094208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713279411.826962:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:0.0:1713279411.827032:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200094208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279411.827039:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99040 00000100:00100000:3.0:1713279411.827097:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200094208:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279412.418710:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279412.498700:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200094272:0@lo:400:kworker.0 00000100:00100000:0.0:1713279412.498721:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200094336:0@lo:400:kworker.0 00000100:00100000:1.0:1713279412.498794:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200094400:0@lo:400:kworker.0 00000100:00100000:0.0:1713279412.498804:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279412.498807:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279412.498811:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200094464:0@lo:400:kworker.0 00000100:00100000:0.0:1713279412.498858:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200094592:0@lo:400:kworker.0 00000100:00100000:1.0:1713279412.498864:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279412.498866:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200094528:0@lo:400:kworker.0 00000100:00100000:3.0:1713279412.498870:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279412.498887:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200094656:0@lo:400:kworker.0 00000100:00100000:0.0:1713279412.498896:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094400 00000100:00100000:2.0:1713279412.498899:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279412.498902:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200094720:0@lo:400:kworker.0 00000100:00100000:0.0:1713279412.498904:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094400 00000100:00100000:1.0:1713279412.498915:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279412.498918:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200094784:0@lo:400:kworker.0 00000100:00100000:3.0:1713279412.498925:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279412.498933:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200094912:0@lo:400:kworker.0 00000100:00100000:0.0:1713279412.498937:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094528 00000100:00100000:3.0:1713279412.498939:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200094976:0@lo:400:kworker.0 00000100:00100000:0.0:1713279412.498940:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094528 00000100:00100000:2.0:1713279412.498947:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279412.498959:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99041 00000100:00100000:3.0:1713279412.498968:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094720 00000100:00100000:0.0:1713279412.498969:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200094400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279412.498973:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094720 00000100:00100000:1.0:1713279412.498979:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279412.498979:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200095040:0@lo:400:kworker.0 00000100:00100000:2.0:1713279412.499004:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279412.499019:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094784 00000100:00100000:1.0:1713279412.499020:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094336 00000100:00100000:3.0:1713279412.499021:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094784 00000100:00100000:1.0:1713279412.499028:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094336 00000100:00100000:3.0:1713279412.499036:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095040 00000100:00100000:2.0:1713279412.499038:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094464 00000100:00100000:3.0:1713279412.499039:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095040 00000100:00100000:2.0:1713279412.499042:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094464 00000100:00100000:0.0:1713279412.499047:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200094400:12345-0@lo:400:kworker.0 Request processed in 76us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279412.499057:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1713279412.499060:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99041 00000100:00100000:1.0:1713279412.499063:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1713279412.499063:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200094720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279412.499066:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094656 00000100:00100000:2.0:1713279412.499070:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094656 00000100:00100000:1.0:1713279412.499073:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200094336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279412.499084:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99042 00000100:00100000:2.0:1713279412.499089:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094912 00000100:00100000:0.0:1713279412.499092:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200094528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279412.499092:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094912 00000100:00100000:3.0:1713279412.499101:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200094720:12345-0@lo:400:kworker.0 Request processed in 37us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279412.499111:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1713279412.499114:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:2.0:1713279412.499123:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200094464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279412.499128:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200094336:12345-0@lo:400:kworker.0 Request processed in 55us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279412.499128:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1713279412.499135:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200094784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279412.499144:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:0.0:1713279412.499150:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200094528:12345-0@lo:400:kworker.0 Request processed in 56us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279412.499160:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99042 00000100:00100000:2.0:1713279412.499170:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200094464:12345-0@lo:400:kworker.0 Request processed in 46us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279412.499177:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1713279412.499179:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200094784:12345-0@lo:400:kworker.0 Request processed in 42us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279412.499183:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:1.0:1713279412.499184:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200094656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279412.499189:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1713279412.499195:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1713279412.499200:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200095040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279412.499204:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:2.0:1713279412.499211:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200094912:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279412.499216:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279382 00000100:00080000:3.0:1713279412.499221:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279382 00000100:00100000:1.0:1713279412.499223:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200094656:12345-0@lo:400:kworker.0 Request processed in 39us (308us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279412.499224:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279382 00000100:00100000:1.0:1713279412.499233:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:0.0:1713279412.499236:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200095040:12345-0@lo:400:kworker.0 Request processed in 35us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279412.499242:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1713279412.499249:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200094912:12345-0@lo:400:kworker.0 Request processed in 37us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279412.499253:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279412.499258:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:1.0:1713279412.499259:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094272 00000100:00100000:0.0:1713279412.499260:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279412.499263:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094272 00000100:00100000:2.0:1713279412.499273:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094592 00000100:00100000:2.0:1713279412.499276:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094592 00000100:00100000:0.0:1713279412.499279:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200094848:0@lo:400:kworker.0 00000100:00100000:2.0:1713279412.499296:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:1.0:1713279412.499298:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1713279412.499299:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279412.499303:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200094592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279412.499304:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200094272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279412.499306:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200094464:0@lo:400:kworker.0 00000100:00100000:0.0:1713279412.499322:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200094336:0@lo:400:kworker.0 00000100:00100000:3.0:1713279412.499324:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200094720:0@lo:400:kworker.0 00000100:00100000:1.0:1713279412.499342:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200094272:12345-0@lo:400:kworker.0 Request processed in 36us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279412.499342:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200094592:12345-0@lo:400:kworker.0 Request processed in 38us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279412.499346:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200094592:0@lo:400:kworker.0 00000100:00100000:1.0:1713279412.499353:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1713279412.499353:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1713279412.499355:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094848 00000100:00100000:0.0:1713279412.499460:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200094528:0@lo:400:kworker.0 00000100:00100000:2.0:1713279412.499465:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200094976 00000100:00100000:0.0:1713279412.499469:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200094784:0@lo:400:kworker.0 00000100:00100000:2.0:1713279412.499469:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094976 00000100:00100000:3.0:1713279412.499473:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200094848 00000100:00100000:0.0:1713279412.499479:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200095040:0@lo:400:kworker.0 00000100:00100000:0.0:1713279412.499486:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200094272:0@lo:400:kworker.0 00000100:00100000:1.0:1713279412.499487:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200094400:0@lo:400:kworker.0 00000100:00100000:2.0:1713279412.499493:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1713279412.499499:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200094976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279412.499502:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200094656:0@lo:400:kworker.0 00000100:00100000:3.0:1713279412.499506:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:3.0:1713279412.499512:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200094848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279412.499514:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200094912:0@lo:400:kworker.0 00000100:00100000:2.0:1713279412.499542:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200094976:12345-0@lo:400:kworker.0 Request processed in 42us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279412.499550:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1713279412.499560:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200094848:12345-0@lo:400:kworker.0 Request processed in 45us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279412.499568:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:0.0:1713279412.499570:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200094848:0@lo:400:kworker.0 00000100:00100000:2.0:1713279412.499580:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200094976:0@lo:400:kworker.0 00000100:00080000:3.0:1713279412.499601:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279382 00000100:00080000:3.0:1713279412.499605:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279382 00000100:00080000:3.0:1713279412.499608:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279382 00000100:00100000:1.0:1713279412.514591:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200095104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279412.514618:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200095168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279412.514652:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279412.514707:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279412.514725:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095104 00000100:00100000:1.0:1713279412.514733:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095168 00000100:00100000:2.0:1713279412.514734:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095104 00000100:00100000:1.0:1713279412.514738:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095168 00000100:00100000:1.0:1713279412.514780:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1713279412.514787:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1713279412.514789:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200095168:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279412.514794:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200095104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1713279412.514822:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279412.514822:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279412.514890:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200095168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279412.514890:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200095104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279412.514901:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1713279412.514911:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1713279412.514959:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200095168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279412.514994:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200095104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279413.234731:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713279413.234755:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009966b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200095232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279413.234819:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279413.234874:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095232 00000100:00100000:2.0:1713279413.234883:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095232 00000100:00100000:2.0:1713279413.234943:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1713279413.234951:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200095232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279413.234985:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279413.235055:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200095232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279413.235066:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1713279413.235145:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009966b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200095232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279413.250812:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200095296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1713279413.250875:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279413.250982:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095296 00000100:00100000:2.0:1713279413.250993:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095296 00000100:00100000:2.0:1713279413.251058:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1713279413.251069:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200095296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279413.251097:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279413.251191:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200095296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279413.251215:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1713279413.251233:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200095296:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279413.420686:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279414.059496:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279414.059574:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279414.059636:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279414.059644:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328192 00000100:00100000:3.0:1713279414.059659:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328192 00000100:00100000:1.0:1713279414.059683:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328128 00000100:00100000:0.0:1713279414.059689:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279414.059690:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328128 00000100:00100000:0.0:1713279414.059714:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279414.059732:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 425 00000100:00100000:3.0:1713279414.059735:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328256 00000100:00100000:3.0:1713279414.059739:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328256 00000100:00100000:1.0:1713279414.059743:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281328128:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279414.059761:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328448 00000100:00100000:3.0:1713279414.059764:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328448 00000100:00100000:0.0:1713279414.059765:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279414.059785:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328320 00000100:00100000:3.0:1713279414.059788:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 643 00000100:00100000:2.0:1713279414.059794:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328320 00000100:00100000:3.0:1713279414.059796:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281328192:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279414.059814:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279414.059827:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281328128:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279414.059839:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 425 00000100:00100000:2.0:1713279414.059842:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328384 00000100:00100000:3.0:1713279414.059843:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281328192:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279414.059845:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328384 00000100:00100000:3.0:1713279414.059852:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 643 00000100:00100000:2.0:1713279414.059858:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328576 00000100:00100000:2.0:1713279414.059860:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328576 00000100:00100000:3.0:1713279414.059868:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 644 00000100:00100000:3.0:1713279414.059876:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281328256:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279414.059878:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 249 00000100:00100000:2.0:1713279414.059887:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281328320:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279414.059890:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 645 00000100:00100000:1.0:1713279414.059898:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281328448:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279414.059899:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279414.059912:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281328256:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279414.059921:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 644 00000100:00100000:2.0:1713279414.059931:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281328320:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 44us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279414.059934:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328512 00000100:00100000:2.0:1713279414.059939:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 249 00000100:00100000:3.0:1713279414.059939:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328512 00000100:00100000:1.0:1713279414.059951:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281328448:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279414.059956:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 250 00000100:00100000:1.0:1713279414.059961:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 645 00000100:00100000:2.0:1713279414.059961:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281328384:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279414.059976:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 646 00000100:00100000:0.0:1713279414.059980:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279414.059984:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281328512:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279414.059985:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281328384:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279414.059992:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 250 00000100:00100000:0.0:1713279414.060025:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328640 00000100:00100000:3.0:1713279414.060029:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281328512:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 44us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279414.060031:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328640 00000100:00100000:3.0:1713279414.060039:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 646 00000100:00100000:0.0:1713279414.060060:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 251 00000100:00080000:3.0:1713279414.060062:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279384 00000100:00100000:0.0:1713279414.060068:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281328576:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:3.0:1713279414.060068:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279384 00000100:00080000:3.0:1713279414.060071:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279384 00000100:00080000:3.0:1713279414.060074:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279384 00000100:00080000:3.0:1713279414.060077:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279384 00000100:00100000:0.0:1713279414.060107:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281328576:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279414.060115:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 251 00000100:00100000:3.0:1713279414.060123:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 252 00000100:00100000:3.0:1713279414.060132:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281328640:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279414.060173:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281328640:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279414.060184:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 252 00010000:00010000:2.0:1713279414.422692:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279415.154710:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200095360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1713279415.154789:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279415.154906:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095360 00000100:00100000:0.0:1713279415.154919:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095360 00000100:00100000:0.0:1713279415.154994:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99043 00000100:00100000:0.0:1713279415.155005:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200095360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1713279415.155053:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:0.0:1713279415.155138:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200095360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279415.155149:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99043 00000100:00100000:2.0:1713279415.155168:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200095360:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279415.424717:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279416.426718:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279416.834629:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713279416.834653:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200095424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279416.834724:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279416.834813:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095424 00000100:00100000:2.0:1713279416.834823:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095424 00000100:00100000:2.0:1713279416.834883:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99044 00000100:00100000:2.0:1713279416.834893:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200095424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279416.834931:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279416.835004:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200095424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279416.835015:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99044 00000100:00100000:0.0:1713279416.835030:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200095424:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279417.428757:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279417.506764:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200095616:0@lo:400:kworker.0 00000100:00100000:0.0:1713279417.506767:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200095488:0@lo:400:kworker.0 00000100:00100000:3.0:1713279417.506770:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200095552:0@lo:400:kworker.0 00000100:00100000:3.0:1713279417.506849:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279417.506852:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279417.506853:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279417.506893:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200095872:0@lo:400:kworker.0 00000100:00100000:3.0:1713279417.506894:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200095808:0@lo:400:kworker.0 00000100:00100000:0.0:1713279417.506904:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200095744:0@lo:400:kworker.0 00000100:00100000:2.0:1713279417.506912:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279417.506938:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279417.506938:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095488 00000100:00100000:3.0:1713279417.506939:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279417.506947:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200096128:0@lo:400:kworker.0 00000100:00100000:1.0:1713279417.506949:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095488 00000100:00100000:0.0:1713279417.506953:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200096000:0@lo:400:kworker.0 00000100:00100000:3.0:1713279417.506961:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200096064:0@lo:400:kworker.0 00000100:00100000:2.0:1713279417.506973:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279417.506975:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279417.506999:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1713279417.507007:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200095488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279417.507010:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279417.507016:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200096256:0@lo:400:kworker.0 00000100:00100000:0.0:1713279417.507034:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279417.507041:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096000 00000100:00100000:3.0:1713279417.507045:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095552 00000100:00100000:2.0:1713279417.507047:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096000 00000100:00100000:0.0:1713279417.507051:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1713279417.507051:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095552 00000100:00100000:0.0:1713279417.507058:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200095680:0@lo:400:kworker.0 00000100:00100000:1.0:1713279417.507065:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200095488:12345-0@lo:400:kworker.0 Request processed in 58us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279417.507072:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1713279417.507074:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279417.507081:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095872 00000100:00100000:3.0:1713279417.507083:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095872 00000100:00100000:0.0:1713279417.507085:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200095936:0@lo:400:kworker.0 00000100:00100000:2.0:1713279417.507085:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096256 00000100:00100000:2.0:1713279417.507090:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096256 00000100:00100000:0.0:1713279417.507100:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279417.507100:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095808 00000100:00100000:3.0:1713279417.507102:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095808 00000100:00080000:1.0:1713279417.507104:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279387 00000100:00080000:1.0:1713279417.507109:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279387 00000100:00080000:1.0:1713279417.507111:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279387 00000100:00100000:2.0:1713279417.507112:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095936 00000100:00080000:1.0:1713279417.507114:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279387 00000100:00100000:0.0:1713279417.507116:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200096192:0@lo:400:kworker.0 00000100:00080000:1.0:1713279417.507116:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279387 00000100:00100000:2.0:1713279417.507116:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095936 00000100:00100000:3.0:1713279417.507117:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096128 00000100:00100000:3.0:1713279417.507120:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096128 00000100:00100000:0.0:1713279417.507130:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279417.507131:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096064 00000100:00100000:1.0:1713279417.507134:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096064 00000100:00100000:3.0:1713279417.507140:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095680 00000100:00100000:3.0:1713279417.507143:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095680 00000100:00100000:2.0:1713279417.507146:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096192 00000100:00100000:2.0:1713279417.507150:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096192 00000100:00100000:1.0:1713279417.507161:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1713279417.507163:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200095488:0@lo:400:kworker.0 00000100:00100000:3.0:1713279417.507167:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1713279417.507169:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200095552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279417.507174:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200095872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279417.507176:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1713279417.507186:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200096000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279417.507211:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:0.0:1713279417.507222:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200095808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279417.507223:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200095872:12345-0@lo:400:kworker.0 Request processed in 49us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279417.507231:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1713279417.507244:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200095552:12345-0@lo:400:kworker.0 Request processed in 73us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279417.507245:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:3.0:1713279417.507250:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200096128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279417.507254:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1713279417.507258:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200096000:12345-0@lo:400:kworker.0 Request processed in 73us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279417.507266:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1713279417.507277:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:3.0:1713279417.507279:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200096128:12345-0@lo:400:kworker.0 Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279417.507282:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200095808:12345-0@lo:400:kworker.0 Request processed in 59us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279417.507284:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200096064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279417.507285:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1713279417.507285:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1713279417.507290:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200096256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279417.507294:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:3.0:1713279417.507299:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1713279417.507303:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200095680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279417.507364:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200096256:12345-0@lo:400:kworker.0 Request processed in 73us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279417.507369:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1713279417.507376:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200096064:12345-0@lo:400:kworker.0 Request processed in 89us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279417.507378:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200095680:12345-0@lo:400:kworker.0 Request processed in 73us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279417.507379:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1713279417.507382:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200095936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279417.507383:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095616 00000100:00100000:1.0:1713279417.507385:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:0.0:1713279417.507389:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095616 00000100:00100000:3.0:1713279417.507389:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:2.0:1713279417.507404:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200095936:12345-0@lo:400:kworker.0 Request processed in 20us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279417.507410:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00080000:1.0:1713279417.507446:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279387 00000100:00080000:1.0:1713279417.507450:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279387 00000100:00100000:0.0:1713279417.507452:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200095744 00000100:00080000:1.0:1713279417.507452:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279387 00000100:00080000:1.0:1713279417.507454:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279387 00000100:00100000:2.0:1713279417.507455:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1713279417.507457:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200095744 00000100:00100000:2.0:1713279417.507461:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200096192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279417.507478:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99045 00000100:00100000:1.0:1713279417.507481:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200095552:0@lo:400:kworker.0 00000100:00100000:0.0:1713279417.507486:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200095616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279417.507496:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200095808:0@lo:400:kworker.0 00000100:00100000:3.0:1713279417.507499:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99046 00000100:00100000:2.0:1713279417.507500:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200096192:12345-0@lo:400:kworker.0 Request processed in 37us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279417.507504:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200095744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279417.507508:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200096064:0@lo:400:kworker.0 00000100:00100000:2.0:1713279417.507509:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1713279417.507534:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200095616:12345-0@lo:400:kworker.0 Request processed in 49us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279417.507536:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200095744:12345-0@lo:400:kworker.0 Request processed in 31us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279417.507541:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99046 00000100:00100000:0.0:1713279417.507546:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99045 00000100:00100000:2.0:1713279417.507547:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200096128:0@lo:400:kworker.0 00000100:00100000:2.0:1713279417.507561:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200095616:0@lo:400:kworker.0 00000100:00100000:2.0:1713279417.507572:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200095872:0@lo:400:kworker.0 00000100:00100000:0.0:1713279417.507605:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200095680:0@lo:400:kworker.0 00000100:00100000:0.0:1713279417.507619:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200095936:0@lo:400:kworker.0 00000100:00100000:0.0:1713279417.507627:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200096192:0@lo:400:kworker.0 00000100:00100000:0.0:1713279417.507634:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200096256:0@lo:400:kworker.0 00000100:00100000:0.0:1713279417.507642:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200095744:0@lo:400:kworker.0 00000100:00100000:0.0:1713279417.507649:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200096000:0@lo:400:kworker.0 00000100:00100000:1.0:1713279417.522678:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200096320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279417.522678:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200096384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279417.522745:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279417.522781:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279417.522819:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096384 00000100:00100000:1.0:1713279417.522824:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096320 00000100:00100000:0.0:1713279417.522830:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096384 00000100:00100000:1.0:1713279417.522830:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096320 00000100:00100000:1.0:1713279417.522880:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1713279417.522888:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200096320:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279417.522898:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1713279417.522907:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200096384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1713279417.522927:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:0.0:1713279417.522928:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279417.522977:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200096320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279417.522986:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1713279417.523003:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200096384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279417.523008:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200096320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279417.523013:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1713279417.523026:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200096384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279418.242669:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200096448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279418.242744:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279418.242810:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096448 00000100:00100000:0.0:1713279418.242820:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096448 00000100:00100000:0.0:1713279418.242877:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1713279418.242885:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200096448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279418.242918:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279418.242977:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200096448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279418.242984:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1713279418.243016:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200096448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279418.258607:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200096512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279418.258644:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279418.258731:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096512 00000100:00100000:1.0:1713279418.258739:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096512 00000100:00100000:1.0:1713279418.258782:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1713279418.258801:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200096512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1713279418.258819:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279418.258882:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200096512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279418.258891:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1713279418.258911:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200096512:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279418.430735:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279419.067541:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279419.067582:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279419.067607:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279419.067627:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279419.067639:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279419.067653:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279419.067664:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279419.067674:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279419.067702:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279419.067717:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328704 00000100:00100000:2.0:1713279419.067717:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328768 00000100:00100000:3.0:1713279419.067717:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328896 00000100:00100000:1.0:1713279419.067733:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328704 00000100:00100000:2.0:1713279419.067734:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328768 00000100:00100000:3.0:1713279419.067734:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328896 00000100:00100000:0.0:1713279419.067736:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328832 00000100:00100000:0.0:1713279419.067745:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328832 00000100:00100000:0.0:1713279419.067803:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329024 00000100:00100000:3.0:1713279419.067804:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281328960 00000100:00100000:0.0:1713279419.067807:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329024 00000100:00100000:3.0:1713279419.067810:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281328960 00000100:00100000:2.0:1713279419.067815:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329088 00000100:00100000:2.0:1713279419.067820:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329088 00000100:00100000:1.0:1713279419.067824:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 427 00000100:00100000:0.0:1713279419.067832:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 653 00000100:00100000:3.0:1713279419.067834:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329152 00000100:00100000:1.0:1713279419.067835:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281328704:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279419.067838:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329152 00000100:00100000:0.0:1713279419.067841:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281328832:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279419.067853:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 654 00000100:00100000:2.0:1713279419.067861:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281328768:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279419.067861:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329216 00000100:00100000:3.0:1713279419.067865:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329216 00000100:00100000:3.0:1713279419.067891:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 257 00000100:00100000:3.0:1713279419.067902:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281328896:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279419.067930:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281328704:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 94us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279419.067931:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281328832:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 89us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279419.067932:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281328768:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 69us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279419.067944:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 653 00000100:00100000:1.0:1713279419.067945:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 427 00000100:00100000:2.0:1713279419.067950:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 654 00000100:00100000:3.0:1713279419.067962:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281328896:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 58us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279419.067963:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 655 00000100:00100000:0.0:1713279419.067969:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281329024:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279419.067973:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 656 00000100:00100000:3.0:1713279419.067973:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 257 00000100:00100000:2.0:1713279419.067981:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281329088:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279419.067996:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 258 00000100:00100000:0.0:1713279419.068000:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281329024:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279419.068004:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281328960:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279419.068005:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 259 00000100:00100000:0.0:1713279419.068008:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 655 00000100:00100000:1.0:1713279419.068013:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281329152:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279419.068019:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281329088:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279419.068029:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 656 00000100:00100000:3.0:1713279419.068045:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281328960:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279419.068051:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281329152:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279419.068056:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 258 00000100:00100000:2.0:1713279419.068064:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 260 00000100:00100000:2.0:1713279419.068072:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281329216:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279419.068077:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 259 00000100:00080000:3.0:1713279419.068087:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279389 00000100:00080000:3.0:1713279419.068092:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279389 00000100:00080000:3.0:1713279419.068097:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279389 00000100:00080000:3.0:1713279419.068100:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279389 00000100:00080000:3.0:1713279419.068104:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279389 00000100:00100000:2.0:1713279419.068115:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281329216:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279419.068125:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 260 00010000:00010000:2.0:1713279419.432756:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279420.162741:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200096576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279420.162857:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279420.163030:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096576 00000100:00100000:1.0:1713279420.163047:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096576 00000100:00100000:1.0:1713279420.163131:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99047 00000100:00100000:1.0:1713279420.163144:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200096576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1713279420.163192:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:1.0:1713279420.163332:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200096576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 163us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279420.163343:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99047 00000100:00100000:0.0:1713279420.163397:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200096576:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279420.434815:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279421.436714:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279421.842615:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713279421.842634:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200096640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1713279421.842688:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279421.842775:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096640 00000100:00100000:2.0:1713279421.842783:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096640 00000100:00100000:2.0:1713279421.842818:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99048 00000100:00100000:2.0:1713279421.842823:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200096640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279421.842848:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279421.842887:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200096640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279421.842891:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99048 00000100:00100000:1.0:1713279421.842913:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200096640:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279422.438754:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279422.514725:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200096704:0@lo:400:kworker.0 00000100:00100000:1.0:1713279422.514744:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200096832:0@lo:400:kworker.0 00000100:00100000:0.0:1713279422.514767:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200096768:0@lo:400:kworker.0 00000100:00100000:3.0:1713279422.514767:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200096896:0@lo:400:kworker.0 00000100:00100000:0.0:1713279422.514838:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279422.514838:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279422.514838:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279422.514871:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096768 00000100:00100000:3.0:1713279422.514881:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096768 00000100:00100000:2.0:1713279422.514893:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200096960:0@lo:400:kworker.0 00000100:00100000:0.0:1713279422.514894:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200097024:0@lo:400:kworker.0 00000100:00100000:1.0:1713279422.514898:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200097088:0@lo:400:kworker.0 00000100:00100000:0.0:1713279422.514938:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279422.514939:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279422.514939:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1713279422.514949:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200096768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279422.514950:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097024 00000100:00100000:1.0:1713279422.514955:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097024 00000100:00100000:0.0:1713279422.514961:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200097280:0@lo:400:kworker.0 00000100:00100000:2.0:1713279422.514965:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200097216:0@lo:400:kworker.0 00000100:00100000:0.0:1713279422.514987:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279422.514997:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097280 00000100:00100000:1.0:1713279422.515000:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097280 00000100:00100000:2.0:1713279422.515003:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279422.515013:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200096768:12345-0@lo:400:kworker.0 Request processed in 63us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279422.515016:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:3.0:1713279422.515024:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1713279422.515034:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200096768:0@lo:400:kworker.0 00000100:00100000:1.0:1713279422.515035:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200097024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279422.515037:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200097472:0@lo:400:kworker.0 00000100:00100000:3.0:1713279422.515045:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:3.0:1713279422.515052:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200097280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279422.515071:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279422.515072:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096704 00000100:00100000:0.0:1713279422.515078:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096704 00000100:00100000:1.0:1713279422.515079:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200097024:12345-0@lo:400:kworker.0 Request processed in 46us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279422.515087:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:3.0:1713279422.515097:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200097280:12345-0@lo:400:kworker.0 Request processed in 43us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279422.515106:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00080000:1.0:1713279422.515107:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279392 00000100:00080000:1.0:1713279422.515111:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279392 00000100:00100000:2.0:1713279422.515112:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096832 00000100:00100000:0.0:1713279422.515118:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1713279422.515120:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096832 00000100:00100000:0.0:1713279422.515125:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200096704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279422.515130:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279422.515138:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097216 00000100:00100000:3.0:1713279422.515143:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097216 00000100:00100000:1.0:1713279422.515144:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200097344:0@lo:400:kworker.0 00000100:00100000:2.0:1713279422.515154:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096960 00000100:00100000:2.0:1713279422.515158:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096960 00000100:00100000:1.0:1713279422.515164:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279422.515176:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200096704:12345-0@lo:400:kworker.0 Request processed in 49us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279422.515176:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097472 00000100:00100000:3.0:1713279422.515180:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097472 00000100:00100000:2.0:1713279422.515185:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99049 00000100:00100000:0.0:1713279422.515186:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1713279422.515194:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200096832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279422.515196:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99050 00000100:00100000:3.0:1713279422.515201:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1713279422.515202:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200096960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279422.515207:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200097216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279422.515220:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097088 00000100:00100000:0.0:1713279422.515225:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097088 00000100:00100000:1.0:1713279422.515237:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200096960:12345-0@lo:400:kworker.0 Request processed in 35us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279422.515244:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99050 00000100:00100000:0.0:1713279422.515249:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097344 00000100:00100000:0.0:1713279422.515253:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097344 00000100:00100000:1.0:1713279422.515267:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1713279422.515272:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200097088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279422.515272:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200097216:12345-0@lo:400:kworker.0 Request processed in 63us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279422.515275:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:0.0:1713279422.515282:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200097344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279422.515286:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200096832:12345-0@lo:400:kworker.0 Request processed in 89us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279422.515323:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1713279422.515329:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99049 00000100:00100000:1.0:1713279422.515335:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200097088:12345-0@lo:400:kworker.0 Request processed in 62us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279422.515341:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:3.0:1713279422.515344:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1713279422.515351:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200097472:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1713279422.515357:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279392 00000100:00080000:1.0:1713279422.515360:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279392 00000100:00080000:1.0:1713279422.515363:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279392 00000100:00100000:0.0:1713279422.515364:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200097344:12345-0@lo:400:kworker.0 Request processed in 81us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279422.515375:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1713279422.515384:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200096832:0@lo:400:kworker.0 00000100:00100000:2.0:1713279422.515390:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200096704:0@lo:400:kworker.0 00000100:00100000:3.0:1713279422.515391:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200097472:12345-0@lo:400:kworker.0 Request processed in 39us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279422.515396:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200097088:0@lo:400:kworker.0 00000100:00100000:3.0:1713279422.515400:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1713279422.515406:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200097344:0@lo:400:kworker.0 00000100:00100000:2.0:1713279422.515408:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200096960:0@lo:400:kworker.0 00000100:00100000:0.0:1713279422.515465:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200097024:0@lo:400:kworker.0 00000100:00100000:0.0:1713279422.515488:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200097280:0@lo:400:kworker.0 00000100:00100000:2.0:1713279422.515489:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200097216:0@lo:400:kworker.0 00000100:00100000:1.0:1713279422.515490:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279422.515507:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200096896 00000100:00100000:1.0:1713279422.515508:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200097152:0@lo:400:kworker.0 00000100:00100000:3.0:1713279422.515511:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200096896 00000100:00100000:2.0:1713279422.515520:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200097472:0@lo:400:kworker.0 00000100:00100000:1.0:1713279422.515530:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279422.515537:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1713279422.515542:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200097408:0@lo:400:kworker.0 00000100:00100000:3.0:1713279422.515545:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200096896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279422.515555:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279422.515576:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097152 00000100:00100000:1.0:1713279422.515579:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097152 00000100:00100000:1.0:1713279422.515614:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097408 00000100:00100000:1.0:1713279422.515616:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097408 00000100:00100000:3.0:1713279422.515621:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200096896:12345-0@lo:400:kworker.0 Request processed in 74us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279422.515631:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1713279422.515637:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1713279422.515642:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200097152:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1713279422.515645:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279392 00000100:00080000:0.0:1713279422.515651:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279392 00000100:00100000:3.0:1713279422.515660:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1713279422.515667:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200097408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279422.515677:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200097152:12345-0@lo:400:kworker.0 Request processed in 34us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279422.515682:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200096896:0@lo:400:kworker.0 00000100:00100000:1.0:1713279422.515684:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1713279422.515701:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200097152:0@lo:400:kworker.0 00000100:00100000:0.0:1713279422.515715:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200097408:0@lo:400:kworker.0 00000100:00100000:3.0:1713279422.515715:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200097408:12345-0@lo:400:kworker.0 Request processed in 47us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279422.515724:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1713279422.530567:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713279422.530580:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200097600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279422.530584:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713279422.530602:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200097536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279422.530619:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279422.530658:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097600 00000100:00100000:3.0:1713279422.530665:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279422.530667:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097600 00000100:00100000:1.0:1713279422.530700:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097536 00000100:00100000:1.0:1713279422.530703:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097536 00000100:00100000:2.0:1713279422.530708:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1713279422.530715:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200097600:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279422.530742:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00002000:00000024:2.0:1713279422.530745:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279422.530749:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200097536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1713279422.530768:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279422.530779:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200097600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279422.530787:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1713279422.530813:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200097536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279422.530820:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1713279422.530824:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200097600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279422.530836:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200097536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279423.250730:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200097664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279423.250818:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279423.250902:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097664 00000100:00100000:1.0:1713279423.250915:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097664 00000100:00100000:1.0:1713279423.250976:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1713279423.250985:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200097664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1713279423.251021:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279423.251088:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200097664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279423.251100:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1713279423.251139:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200097664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279423.266638:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200097728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279423.266680:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279423.266706:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097728 00000100:00100000:1.0:1713279423.266715:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097728 00000100:00100000:1.0:1713279423.266758:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1713279423.266765:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200097728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1713279423.266783:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279423.266855:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200097728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279423.266863:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1713279423.266930:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009089ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200097728:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279423.440709:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279424.075635:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279424.075692:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279424.075733:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279424.075737:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329280 00000100:00100000:2.0:1713279424.075751:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329280 00000100:00100000:0.0:1713279424.075765:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279424.075782:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279424.075800:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279424.075810:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 429 00000100:00100000:0.0:1713279424.075816:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279424.075821:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281329280:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279424.075823:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329344 00000100:00100000:0.0:1713279424.075832:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279424.075833:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329344 00000100:00100000:0.0:1713279424.075866:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279424.075874:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329408 00000100:00100000:3.0:1713279424.075876:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329408 00000100:00100000:1.0:1713279424.075883:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329472 00000100:00100000:1.0:1713279424.075892:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329472 00000100:00100000:3.0:1713279424.075892:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329664 00000100:00100000:3.0:1713279424.075894:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329664 00000100:00080000:0.0:1713279424.075897:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279394 00000100:00100000:2.0:1713279424.075905:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281329280:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00080000:0.0:1713279424.075908:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279394 00000100:00100000:3.0:1713279424.075909:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329600 00000100:00080000:0.0:1713279424.075911:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279394 00000100:00100000:3.0:1713279424.075911:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329600 00000100:00080000:0.0:1713279424.075913:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279394 00000100:00080000:0.0:1713279424.075916:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279394 00000100:00100000:2.0:1713279424.075919:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 429 00000100:00100000:1.0:1713279424.075930:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329536 00000100:00100000:1.0:1713279424.075932:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329536 00000100:00100000:3.0:1713279424.075934:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 663 00000100:00100000:0.0:1713279424.075942:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 664 00000100:00100000:3.0:1713279424.075943:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281329344:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279424.075949:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329792 00000100:00100000:0.0:1713279424.075951:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281329408:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279424.075952:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329792 00000100:00100000:2.0:1713279424.075956:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329728 00000100:00100000:2.0:1713279424.075960:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329728 00000100:00100000:1.0:1713279424.075970:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 265 00000100:00100000:1.0:1713279424.075978:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281329472:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279424.075991:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281329344:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 49us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279424.075992:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 266 00000100:00100000:0.0:1713279424.075997:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281329408:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279424.075998:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281329536:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279424.076000:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 663 00000100:00100000:0.0:1713279424.076010:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 664 00000100:00100000:3.0:1713279424.076016:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 665 00000100:00100000:3.0:1713279424.076021:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281329664:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279424.076023:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281329472:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 44us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279424.076029:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 666 00000100:00100000:2.0:1713279424.076029:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281329536:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279424.076031:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 265 00000100:00100000:0.0:1713279424.076035:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281329600:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279424.076036:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 266 00000100:00100000:3.0:1713279424.076043:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281329664:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279424.076047:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 267 00000100:00100000:3.0:1713279424.076050:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 665 00000100:00100000:1.0:1713279424.076053:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281329792:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279424.076053:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 268 00000100:00100000:2.0:1713279424.076057:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281329728:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279424.076058:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281329600:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279424.076065:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 666 00000100:00100000:1.0:1713279424.076075:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281329792:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279424.076075:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281329728:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 17us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279424.076092:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 267 00000100:00100000:2.0:1713279424.076103:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 268 00000100:00080000:1.0:1713279424.076120:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279394 00000100:00080000:1.0:1713279424.076123:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279394 00010000:00010000:2.0:1713279424.442682:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279425.170655:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200097792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1713279425.170710:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279425.170742:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097792 00000100:00100000:2.0:1713279425.170749:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097792 00000100:00100000:2.0:1713279425.170792:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99051 00000100:00100000:2.0:1713279425.170796:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200097792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279425.170821:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279425.170854:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200097792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279425.170859:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99051 00000100:00100000:1.0:1713279425.170868:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200097792:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279425.444700:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279426.446596:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279426.850619:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200097856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279426.850676:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279426.850739:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097856 00000100:00100000:2.0:1713279426.850746:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097856 00000100:00100000:2.0:1713279426.850789:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99052 00000100:00100000:2.0:1713279426.850794:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200097856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279426.850821:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279426.850861:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200097856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279426.850866:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99052 00000100:00100000:0.0:1713279426.850891:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200097856:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279427.448687:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279427.522695:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713279427.522719:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200098112:0@lo:400:kworker.0 00000100:00100000:2.0:1713279427.522720:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200097984:0@lo:400:kworker.0 00000100:00100000:3.0:1713279427.522731:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200098176:0@lo:400:kworker.0 00000100:00100000:1.0:1713279427.522781:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200098048:0@lo:400:kworker.0 00000100:00100000:0.0:1713279427.522794:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279427.522796:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279427.522831:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200097920:0@lo:400:kworker.0 00000100:00100000:2.0:1713279427.522835:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098112 00000100:00100000:3.0:1713279427.522837:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200098432:0@lo:400:kworker.0 00000100:00100000:1.0:1713279427.522845:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279427.522845:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098112 00000100:00100000:0.0:1713279427.522868:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279427.522869:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279427.522874:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200098304:0@lo:400:kworker.0 00000100:00100000:3.0:1713279427.522889:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200098688:0@lo:400:kworker.0 00000100:00100000:0.0:1713279427.522895:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200098368:0@lo:400:kworker.0 00000100:00100000:1.0:1713279427.522898:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279427.522900:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:3.0:1713279427.522905:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279427.522911:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200098112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279427.522913:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200098560:0@lo:400:kworker.0 00000100:00100000:0.0:1713279427.522926:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279427.522929:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279427.522944:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098432 00000100:00100000:1.0:1713279427.522947:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1713279427.522949:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200098624:0@lo:400:kworker.0 00000100:00100000:3.0:1713279427.522949:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098432 00000100:00100000:1.0:1713279427.522953:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200098240:0@lo:400:kworker.0 00000100:00100000:3.0:1713279427.522978:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098688 00000100:00100000:3.0:1713279427.522981:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098688 00000100:00100000:1.0:1713279427.522990:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279427.522991:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279427.522993:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098368 00000100:00100000:3.0:1713279427.522995:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098368 00000100:00100000:1.0:1713279427.523001:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200098496:0@lo:400:kworker.0 00000100:00100000:2.0:1713279427.523002:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200098112:12345-0@lo:400:kworker.0 Request processed in 90us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279427.523006:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098624 00000100:00100000:3.0:1713279427.523009:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098624 00000100:00100000:2.0:1713279427.523015:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:1.0:1713279427.523020:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279427.523021:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1713279427.523027:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200098432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279427.523040:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200098112:0@lo:400:kworker.0 00000100:00100000:2.0:1713279427.523040:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098304 00000100:00100000:2.0:1713279427.523045:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098304 00000100:00100000:1.0:1713279427.523046:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098560 00000100:00100000:1.0:1713279427.523050:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098560 00000100:00100000:3.0:1713279427.523064:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200098432:12345-0@lo:400:kworker.0 Request processed in 37us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279427.523071:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1713279427.523072:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098240 00000100:00100000:0.0:1713279427.523076:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1713279427.523076:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098496 00000100:00100000:2.0:1713279427.523076:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098240 00000100:00100000:1.0:1713279427.523078:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098496 00000100:00100000:0.0:1713279427.523083:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200098688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279427.523084:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1713279427.523088:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200098368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279427.523094:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1713279427.523101:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200098304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279427.523101:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:2.0:1713279427.523109:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200098560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279427.523114:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200098368:12345-0@lo:400:kworker.0 Request processed in 25us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279427.523119:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1713279427.523122:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200098688:12345-0@lo:400:kworker.0 Request processed in 39us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279427.523127:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1713279427.523133:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1713279427.523133:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200098624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279427.523136:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200098304:12345-0@lo:400:kworker.0 Request processed in 35us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279427.523143:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1713279427.523158:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1713279427.523160:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200098624:12345-0@lo:400:kworker.0 Request processed in 27us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279427.523162:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200098560:12345-0@lo:400:kworker.0 Request processed in 52us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279427.523163:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200098496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279427.523164:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1713279427.523165:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1713279427.523168:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200098240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279427.523174:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1713279427.523184:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200098496:12345-0@lo:400:kworker.0 Request processed in 21us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279427.523190:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1713279427.523192:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200098240:12345-0@lo:400:kworker.0 Request processed in 23us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279427.523198:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00080000:1.0:1713279427.523206:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279397 00000100:00100000:3.0:1713279427.523207:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200098432:0@lo:400:kworker.0 00000100:00100000:2.0:1713279427.523208:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097920 00000100:00080000:1.0:1713279427.523211:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279397 00000100:00100000:2.0:1713279427.523213:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097920 00000100:00080000:1.0:1713279427.523214:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279397 00000100:00100000:0.0:1713279427.523216:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279427.523217:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200098688:0@lo:400:kworker.0 00000100:00080000:1.0:1713279427.523218:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279397 00000100:00080000:1.0:1713279427.523221:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279397 00000100:00100000:0.0:1713279427.523238:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200097984 00000100:00100000:0.0:1713279427.523242:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200097984 00000100:00100000:2.0:1713279427.523247:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1713279427.523290:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1713279427.523295:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200097984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279427.523295:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200097920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279427.523304:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098176 00000100:00100000:3.0:1713279427.523308:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098176 00000100:00100000:3.0:1713279427.523329:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098048 00000100:00100000:3.0:1713279427.523331:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098048 00000100:00100000:1.0:1713279427.523339:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200098240:0@lo:400:kworker.0 00000100:00100000:0.0:1713279427.523342:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200097984:12345-0@lo:400:kworker.0 Request processed in 46us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279427.523344:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99053 00000100:00100000:0.0:1713279427.523350:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1713279427.523351:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200098176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279427.523352:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200097920:12345-0@lo:400:kworker.0 Request processed in 96us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279427.523356:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200098496:0@lo:400:kworker.0 00000100:00100000:2.0:1713279427.523361:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1713279427.523370:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200098304:0@lo:400:kworker.0 00000100:00100000:0.0:1713279427.523377:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200097984:0@lo:400:kworker.0 00000100:00100000:1.0:1713279427.523385:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200098560:0@lo:400:kworker.0 00000100:00100000:3.0:1713279427.523388:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200098176:12345-0@lo:400:kworker.0 Request processed in 39us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279427.523394:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99053 00000100:00100000:0.0:1713279427.523396:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200098368:0@lo:400:kworker.0 00000100:00100000:2.0:1713279427.523404:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99054 00000100:00100000:0.0:1713279427.523406:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200098624:0@lo:400:kworker.0 00000100:00100000:2.0:1713279427.523410:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200098048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279427.523441:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200097920:0@lo:400:kworker.0 00000100:00100000:3.0:1713279427.523471:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200098176:0@lo:400:kworker.0 00000100:00100000:2.0:1713279427.523494:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200098048:12345-0@lo:400:kworker.0 Request processed in 83us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279427.523500:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99054 00000100:00100000:1.0:1713279427.523510:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200098048:0@lo:400:kworker.0 00000100:00100000:0.0:1713279427.538652:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200098752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279427.538665:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200098816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279427.538705:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279427.538745:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279427.538778:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098752 00000100:00100000:2.0:1713279427.538786:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098752 00000100:00100000:2.0:1713279427.538829:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098816 00000100:00100000:2.0:1713279427.538832:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098816 00000100:00100000:3.0:1713279427.538851:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1713279427.538861:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1713279427.538862:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200098752:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279427.538869:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200098816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1713279427.538894:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279427.538894:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:3.0:1713279427.538945:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200098752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279427.538953:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1713279427.538954:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200098816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279427.538962:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1713279427.538983:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200098752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279427.538997:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200098816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279428.258776:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200098880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279428.258855:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279428.258919:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098880 00000100:00100000:2.0:1713279428.258932:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098880 00000100:00100000:2.0:1713279428.258992:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1713279428.259001:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200098880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279428.259037:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279428.259106:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200098880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279428.259113:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1713279428.259156:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200098880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279428.274620:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200098944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279428.274659:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279428.274716:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200098944 00000100:00100000:2.0:1713279428.274724:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200098944 00000100:00100000:2.0:1713279428.274762:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1713279428.274769:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200098944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279428.274785:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279428.274838:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200098944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279428.274845:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1713279428.274881:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200098944:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279428.450764:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279429.083832:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279429.083886:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279429.083922:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279429.083939:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329856 00000100:00100000:0.0:1713279429.083945:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279429.083954:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329856 00000100:00100000:0.0:1713279429.083976:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279429.083993:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279429.084010:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279429.084024:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 431 00000100:00100000:0.0:1713279429.084025:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279429.084034:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329920 00000100:00100000:2.0:1713279429.084036:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281329856:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279429.084044:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329920 00000100:00100000:0.0:1713279429.084060:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279429.084086:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281329984 00000100:00100000:3.0:1713279429.084086:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330048 00000100:00100000:0.0:1713279429.084088:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330176 00000100:00100000:1.0:1713279429.084088:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281329984 00000100:00100000:0.0:1713279429.084094:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330176 00000100:00100000:3.0:1713279429.084095:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330048 00000100:00100000:1.0:1713279429.084103:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330240 00000100:00100000:1.0:1713279429.084106:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330240 00000100:00100000:2.0:1713279429.084115:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281329856:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 81us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279429.084124:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 673 00000100:00100000:2.0:1713279429.084125:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 431 00000100:00100000:0.0:1713279429.084132:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281329920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279429.084132:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330112 00000100:00100000:3.0:1713279429.084135:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330112 00000100:00100000:1.0:1713279429.084139:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 674 00000100:00100000:1.0:1713279429.084148:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281329984:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279429.084149:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330304 00000100:00100000:3.0:1713279429.084151:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330304 00000100:00100000:3.0:1713279429.084165:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330368 00000100:00100000:3.0:1713279429.084167:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330368 00000100:00100000:0.0:1713279429.084178:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281329920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279429.084185:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 273 00000100:00100000:0.0:1713279429.084186:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 673 00000100:00100000:3.0:1713279429.084193:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281330048:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279429.084194:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281329984:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279429.084203:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 674 00000100:00100000:0.0:1713279429.084215:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 675 00000100:00100000:0.0:1713279429.084221:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281330176:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279429.084221:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 676 00000100:00100000:1.0:1713279429.084226:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281330240:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279429.084238:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281330048:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279429.084270:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281330176:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279429.084278:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 675 00000100:00100000:3.0:1713279429.084279:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 273 00000100:00100000:1.0:1713279429.084281:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281330240:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 53us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279429.084288:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 676 00000100:00100000:3.0:1713279429.084296:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 274 00000100:00100000:3.0:1713279429.084301:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281330112:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279429.084305:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 275 00000100:00080000:1.0:1713279429.084307:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279399 00000100:00100000:0.0:1713279429.084310:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281330304:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:1.0:1713279429.084311:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279399 00000100:00080000:1.0:1713279429.084313:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279399 00000100:00080000:1.0:1713279429.084315:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279399 00000100:00080000:1.0:1713279429.084318:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279399 00000100:00100000:3.0:1713279429.084329:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281330112:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279429.084331:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 276 00000100:00100000:0.0:1713279429.084336:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281330304:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279429.084338:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281330368:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279429.084338:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 274 00000100:00100000:0.0:1713279429.084343:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 275 00000100:00100000:1.0:1713279429.084364:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281330368:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279429.084371:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 276 00010000:00010000:2.0:1713279429.452672:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279430.178763:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713279430.178798:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200099008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1713279430.178887:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279430.178955:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099008 00000100:00100000:0.0:1713279430.178968:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099008 00000100:00100000:0.0:1713279430.179034:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99055 00000100:00100000:0.0:1713279430.179043:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200099008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1713279430.179086:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:0.0:1713279430.179156:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200099008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279430.179164:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99055 00000100:00100000:2.0:1713279430.179232:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200099008:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279430.454762:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279431.456735:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279431.858684:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200099072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713279431.858759:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279431.858824:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099072 00000100:00100000:0.0:1713279431.858834:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099072 00000100:00100000:0.0:1713279431.858891:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99056 00000100:00100000:0.0:1713279431.858900:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200099072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713279431.858939:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:0.0:1713279431.859005:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200099072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279431.859013:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99056 00000100:00100000:2.0:1713279431.859067:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200099072:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279432.458721:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279432.530776:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200099200:0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.530784:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200099136:0@lo:400:kworker.0 00000100:00100000:3.0:1713279432.530788:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200099328:0@lo:400:kworker.0 00000100:00100000:1.0:1713279432.530804:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200099264:0@lo:400:kworker.0 00000100:00100000:3.0:1713279432.530877:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279432.530882:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279432.530884:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279432.530921:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200099584:0@lo:400:kworker.0 00000100:00100000:1.0:1713279432.530922:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200099520:0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.530923:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200099392:0@lo:400:kworker.0 00000100:00100000:0.0:1713279432.530929:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099328 00000100:00100000:0.0:1713279432.530939:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099328 00000100:00100000:1.0:1713279432.530950:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279432.530951:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279432.530958:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279432.530966:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200099776:0@lo:400:kworker.0 00000100:00100000:3.0:1713279432.530968:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200099840:0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.530980:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200099648:0@lo:400:kworker.0 00000100:00100000:1.0:1713279432.530988:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279432.530989:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279432.531005:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099520 00000100:00100000:0.0:1713279432.531011:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099520 00000100:00100000:2.0:1713279432.531014:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279432.531026:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099776 00000100:00100000:3.0:1713279432.531028:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099136 00000100:00100000:1.0:1713279432.531031:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099776 00000100:00100000:3.0:1713279432.531034:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099136 00000100:00100000:2.0:1713279432.531045:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200099904:0@lo:400:kworker.0 00000100:00100000:0.0:1713279432.531050:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1713279432.531061:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200099328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279432.531065:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1713279432.531068:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1713279432.531072:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200099136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.531074:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279432.531075:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200099520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.531097:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713279432.531108:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200099712:0@lo:400:kworker.0 00000100:00100000:3.0:1713279432.531118:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200099136:12345-0@lo:400:kworker.0 Request processed in 46us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279432.531123:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200099520:12345-0@lo:400:kworker.0 Request processed in 47us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279432.531126:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1713279432.531131:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:0.0:1713279432.531144:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200099328:12345-0@lo:400:kworker.0 Request processed in 83us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279432.531144:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279432.531145:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1713279432.531149:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200099776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279432.531156:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1713279432.531156:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099584 00000100:00100000:3.0:1713279432.531159:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099584 00000100:00100000:1.0:1713279432.531174:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200099776:12345-0@lo:400:kworker.0 Request processed in 24us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279432.531177:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099712 00000100:00100000:3.0:1713279432.531178:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099840 00000100:00100000:1.0:1713279432.531180:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:3.0:1713279432.531180:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099840 00000100:00100000:0.0:1713279432.531182:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099712 00000100:00100000:2.0:1713279432.531185:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200099136:0@lo:400:kworker.0 00000100:00100000:3.0:1713279432.531193:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099648 00000100:00100000:3.0:1713279432.531195:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099648 00000100:00100000:1.0:1713279432.531199:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099904 00000100:00100000:1.0:1713279432.531202:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099904 00000100:00100000:0.0:1713279432.531210:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1713279432.531211:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1713279432.531215:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200099584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279432.531218:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200099712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279432.531256:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1713279432.531261:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200099840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.531269:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1713279432.531280:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200099648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279432.531282:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200099584:12345-0@lo:400:kworker.0 Request processed in 65us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279432.531289:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1713279432.531292:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200099840:12345-0@lo:400:kworker.0 Request processed in 29us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279432.531298:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1713279432.531302:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1713279432.531307:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200099904:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1713279432.531314:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279402 00000100:00080000:1.0:1713279432.531318:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279402 00000100:00080000:1.0:1713279432.531320:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279402 00000100:00080000:1.0:1713279432.531322:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279402 00000100:00080000:1.0:1713279432.531325:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279402 00000100:00100000:2.0:1713279432.531340:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200099648:12345-0@lo:400:kworker.0 Request processed in 61us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279432.531344:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200099904:12345-0@lo:400:kworker.0 Request processed in 36us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279432.531351:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1713279432.531355:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200099520:0@lo:400:kworker.0 00000100:00100000:3.0:1713279432.531356:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1713279432.531368:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200099776:0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.531384:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099264 00000100:00100000:3.0:1713279432.531385:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279432.531389:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099264 00000100:00100000:1.0:1713279432.531400:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099200 00000100:00100000:3.0:1713279432.531401:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200099456:0@lo:400:kworker.0 00000100:00100000:1.0:1713279432.531403:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099200 00000100:00100000:1.0:1713279432.531451:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:1.0:1713279432.531455:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200099200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.531464:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099392 00000100:00100000:2.0:1713279432.531468:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099392 00000100:00100000:3.0:1713279432.531470:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279432.531490:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200099200:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279432.531496:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1713279432.531496:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99057 00000100:00100000:3.0:1713279432.531503:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200099200:0@lo:400:kworker.0 00000100:00100000:1.0:1713279432.531505:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099456 00000100:00100000:2.0:1713279432.531505:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200099264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279432.531508:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099456 00000100:00100000:1.0:1713279432.531527:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1713279432.531531:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200099456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279432.531556:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200099712:12345-0@lo:400:kworker.0 Request processed in 337us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279432.531564:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200099456:12345-0@lo:400:kworker.0 Request processed in 31us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279432.531564:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200099328:0@lo:400:kworker.0 00000100:00100000:0.0:1713279432.531568:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:1.0:1713279432.531573:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1713279432.531574:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200099264:12345-0@lo:400:kworker.0 Request processed in 68us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279432.531580:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200099584:0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.531585:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99057 00000100:00080000:1.0:1713279432.531590:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279402 00000100:00100000:3.0:1713279432.531593:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200099840:0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.531610:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99058 00000100:00100000:2.0:1713279432.531617:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200099392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279432.531633:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200099456:0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.531662:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200099392:12345-0@lo:400:kworker.0 Request processed in 44us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279432.531671:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99058 00000100:00100000:2.0:1713279432.531708:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200099264:0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.531737:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200099712:0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.531749:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200099904:0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.531760:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200099392:0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.531771:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200099648:0@lo:400:kworker.0 00000100:00100000:2.0:1713279432.546627:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200100032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279432.546640:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200099968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279432.546673:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279432.546721:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279432.546742:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100032 00000100:00100000:2.0:1713279432.546747:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200099968 00000100:00100000:0.0:1713279432.546752:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100032 00000100:00100000:2.0:1713279432.546753:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200099968 00000100:00100000:2.0:1713279432.546797:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1713279432.546803:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200099968:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279432.546806:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1713279432.546813:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200100032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1713279432.546831:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279432.546831:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279432.546882:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200100032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279432.546884:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200099968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279432.546890:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1713279432.546894:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1713279432.546929:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200099968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279432.546945:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200100032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279433.266693:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200100096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279433.266778:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279433.266846:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100096 00000100:00100000:0.0:1713279433.266858:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100096 00000100:00100000:0.0:1713279433.266913:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1713279433.266921:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200100096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279433.266970:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279433.267043:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200100096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279433.267056:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1713279433.267084:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200100096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279433.282594:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713279433.282611:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200100160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1713279433.282662:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279433.282718:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100160 00000100:00100000:0.0:1713279433.282725:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100160 00000100:00100000:0.0:1713279433.282764:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1713279433.282771:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200100160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279433.282788:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279433.282842:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200100160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279433.282850:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1713279433.282883:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200100160:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279433.460730:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279434.091732:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279434.091789:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279434.091820:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279434.091840:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279434.091844:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330496 00000100:00100000:0.0:1713279434.091855:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279434.091860:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330496 00000100:00100000:0.0:1713279434.091871:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279434.091886:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279434.091901:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279434.091909:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330432 00000100:00100000:2.0:1713279434.091918:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330432 00000100:00100000:1.0:1713279434.091921:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330560 00000100:00100000:1.0:1713279434.091926:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330560 00000100:00100000:0.0:1713279434.091943:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279434.091949:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330752 00000100:00100000:1.0:1713279434.091952:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330752 00000100:00100000:2.0:1713279434.091957:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 433 00000100:00100000:2.0:1713279434.091966:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281330432:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279434.091969:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330816 00000100:00100000:0.0:1713279434.091970:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330624 00000100:00100000:1.0:1713279434.091972:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330816 00000100:00100000:0.0:1713279434.091975:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330624 00000100:00100000:1.0:1713279434.091992:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 683 00000100:00100000:1.0:1713279434.091999:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281330496:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279434.092006:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 281 00000100:00100000:0.0:1713279434.092013:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281330624:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279434.092017:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330688 00000100:00100000:3.0:1713279434.092026:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330688 00000100:00100000:2.0:1713279434.092037:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281330432:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279434.092045:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281330496:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279434.092045:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 433 00000100:00100000:0.0:1713279434.092051:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281330624:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279434.092053:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 683 00000100:00100000:3.0:1713279434.092057:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330944 00000100:00100000:0.0:1713279434.092058:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 281 00000100:00100000:3.0:1713279434.092060:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330944 00000100:00100000:1.0:1713279434.092068:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 684 00000100:00100000:0.0:1713279434.092071:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281330880 00000100:00100000:1.0:1713279434.092072:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281330560:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279434.092074:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281330880 00000100:00100000:3.0:1713279434.092080:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 282 00000100:00100000:2.0:1713279434.092088:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 283 00000100:00100000:3.0:1713279434.092089:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281330688:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279434.092093:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281330944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279434.092102:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281330560:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279434.092107:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 284 00000100:00100000:1.0:1713279434.092111:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 684 00000100:00100000:0.0:1713279434.092112:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281330880:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279434.092117:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281330944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279434.092124:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 283 00000100:00100000:1.0:1713279434.092126:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 685 00000100:00100000:3.0:1713279434.092131:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281330688:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279434.092134:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281330752:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279434.092135:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281330880:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279434.092139:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 282 00000100:00100000:0.0:1713279434.092144:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 284 00000100:00100000:0.0:1713279434.092163:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 686 00000100:00100000:0.0:1713279434.092168:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281330816:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279434.092168:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281330752:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279434.092177:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 685 00000100:00100000:0.0:1713279434.092190:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281330816:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279434.092196:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 686 00000100:00080000:3.0:1713279434.092199:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279404 00000100:00080000:3.0:1713279434.092203:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279404 00000100:00080000:3.0:1713279434.092205:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279404 00000100:00080000:3.0:1713279434.092207:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279404 00000100:00080000:3.0:1713279434.092235:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279404 00010000:00010000:2.0:1713279434.462782:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279435.186769:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200100224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279435.186860:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279435.186929:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100224 00000100:00100000:2.0:1713279435.186941:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100224 00000100:00100000:2.0:1713279435.186997:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99059 00000100:00100000:2.0:1713279435.187005:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200100224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279435.187044:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279435.187112:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200100224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279435.187121:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99059 00000100:00100000:3.0:1713279435.187160:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200100224:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279435.464686:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279436.466739:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279436.866689:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200100288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1713279436.866777:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279436.866861:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100288 00000100:00100000:2.0:1713279436.866871:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100288 00000100:00100000:2.0:1713279436.866926:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99060 00000100:00100000:2.0:1713279436.866935:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200100288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279436.866972:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279436.867040:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200100288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279436.867049:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99060 00000100:00100000:3.0:1713279436.867112:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200100288:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279437.468833:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279437.538673:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200100352:0@lo:400:kworker.0 00000100:00100000:1.0:1713279437.538703:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200100416:0@lo:400:kworker.0 00000100:00100000:3.0:1713279437.538715:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200100544:0@lo:400:kworker.0 00000100:00100000:2.0:1713279437.538727:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200100480:0@lo:400:kworker.0 00000100:00100000:0.0:1713279437.538757:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279437.538760:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279437.538785:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100352 00000100:00100000:2.0:1713279437.538787:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279437.538791:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200100672:0@lo:400:kworker.0 00000100:00100000:3.0:1713279437.538793:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100352 00000100:00100000:0.0:1713279437.538798:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200100608:0@lo:400:kworker.0 00000100:00100000:2.0:1713279437.538809:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200100736:0@lo:400:kworker.0 00000100:00100000:1.0:1713279437.538810:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279437.538822:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200100928:0@lo:400:kworker.0 00000100:00100000:0.0:1713279437.538827:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279437.538828:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279437.538841:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1713279437.538842:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100416 00000100:00100000:2.0:1713279437.538845:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200100992:0@lo:400:kworker.0 00000100:00100000:1.0:1713279437.538846:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100416 00000100:00100000:3.0:1713279437.538847:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200100352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279437.538857:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200100864:0@lo:400:kworker.0 00000100:00100000:2.0:1713279437.538858:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279437.538872:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100672 00000100:00100000:1.0:1713279437.538874:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100672 00000100:00100000:0.0:1713279437.538884:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279437.538886:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100736 00000100:00100000:1.0:1713279437.538888:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100736 00000100:00100000:2.0:1713279437.538888:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100480 00000100:00100000:3.0:1713279437.538890:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200100352:12345-0@lo:400:kworker.0 Request processed in 43us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279437.538892:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100480 00000100:00100000:3.0:1713279437.538896:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1713279437.538897:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200101120:0@lo:400:kworker.0 00000100:00100000:1.0:1713279437.538898:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100992 00000100:00100000:1.0:1713279437.538900:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100992 00000100:00100000:0.0:1713279437.538909:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279437.538912:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1713279437.538914:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100608 00000100:00100000:2.0:1713279437.538916:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100608 00000100:00100000:1.0:1713279437.538917:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200100416:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279437.538920:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279407 00000100:00080000:3.0:1713279437.538923:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279407 00000100:00080000:3.0:1713279437.538925:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279407 00000100:00100000:2.0:1713279437.538927:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99061 00000100:00100000:0.0:1713279437.538931:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200100352:0@lo:400:kworker.0 00000100:00100000:2.0:1713279437.538932:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200100480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279437.538935:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:3.0:1713279437.538939:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200100672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279437.538946:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200100416:12345-0@lo:400:kworker.0 Request processed in 28us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279437.538952:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1713279437.538960:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99062 00000100:00100000:1.0:1713279437.538964:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1713279437.538965:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200100672:12345-0@lo:400:kworker.0 Request processed in 24us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279437.538966:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200100608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279437.538966:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200100480:12345-0@lo:400:kworker.0 Request processed in 33us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279437.538967:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200100736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279437.538970:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1713279437.538976:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99061 00000100:00100000:3.0:1713279437.538981:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1713279437.538984:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200100736:12345-0@lo:400:kworker.0 Request processed in 16us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279437.538985:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200100992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279437.538989:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1713279437.538998:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200100608:12345-0@lo:400:kworker.0 Request processed in 32us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279437.539010:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99062 00000100:00100000:3.0:1713279437.539014:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200100992:12345-0@lo:400:kworker.0 Request processed in 29us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279437.539015:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100864 00000100:00100000:1.0:1713279437.539017:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100864 00000100:00100000:2.0:1713279437.539019:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200100480:0@lo:400:kworker.0 00000100:00100000:3.0:1713279437.539019:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1713279437.539028:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200100736:0@lo:400:kworker.0 00000100:00080000:3.0:1713279437.539034:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279407 00000100:00100000:2.0:1713279437.539035:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200100992:0@lo:400:kworker.0 00000100:00100000:1.0:1713279437.539037:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101120 00000100:00100000:1.0:1713279437.539039:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101120 00000100:00100000:0.0:1713279437.539041:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1713279437.539045:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200100864:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279437.539049:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279407 00000100:00100000:1.0:1713279437.539052:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1713279437.539055:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200101120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279437.539061:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279437.539064:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200100864:12345-0@lo:400:kworker.0 Request processed in 18us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279437.539068:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1713279437.539075:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200101120:12345-0@lo:400:kworker.0 Request processed in 19us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279437.539079:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200100800:0@lo:400:kworker.0 00000100:00100000:1.0:1713279437.539080:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1713279437.539089:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200100864:0@lo:400:kworker.0 00000100:00100000:2.0:1713279437.539090:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100544 00000100:00100000:1.0:1713279437.539092:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279437.539093:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100544 00000100:00100000:3.0:1713279437.539095:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279437.539097:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200101120:0@lo:400:kworker.0 00000100:00100000:0.0:1713279437.539104:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200100608:0@lo:400:kworker.0 00000100:00100000:3.0:1713279437.539106:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200101056:0@lo:400:kworker.0 00000100:00100000:2.0:1713279437.539107:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100928 00000100:00100000:2.0:1713279437.539109:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100928 00000100:00100000:1.0:1713279437.539115:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200100416:0@lo:400:kworker.0 00000100:00100000:3.0:1713279437.539118:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279437.539123:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200100672:0@lo:400:kworker.0 00000100:00100000:2.0:1713279437.539123:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1713279437.539127:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:2.0:1713279437.539127:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200100544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279437.539131:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200100928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279437.539138:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200100800 00000100:00100000:1.0:1713279437.539140:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200100800 00000100:00080000:3.0:1713279437.539141:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279407 00000100:00080000:3.0:1713279437.539144:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279407 00000100:00100000:1.0:1713279437.539151:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101056 00000100:00100000:1.0:1713279437.539153:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101056 00000100:00100000:3.0:1713279437.539156:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1713279437.539157:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200100928:12345-0@lo:400:kworker.0 Request processed in 26us (64us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279437.539160:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200100800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279437.539161:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200100544:12345-0@lo:400:kworker.0 Request processed in 33us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279437.539162:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1713279437.539166:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1713279437.539166:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:1.0:1713279437.539169:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200101056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279437.539180:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200100800:12345-0@lo:400:kworker.0 Request processed in 20us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279437.539207:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:3.0:1713279437.539235:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279407 00000100:00100000:1.0:1713279437.539238:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200101056:12345-0@lo:400:kworker.0 Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279437.539243:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1713279437.539253:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200100544:0@lo:400:kworker.0 00000100:00100000:3.0:1713279437.539262:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200100800:0@lo:400:kworker.0 00000100:00100000:1.0:1713279437.539264:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200100928:0@lo:400:kworker.0 00000100:00100000:3.0:1713279437.539269:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200101056:0@lo:400:kworker.0 00000100:00100000:1.0:1713279437.554647:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200101184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279437.554649:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200101248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279437.554693:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279437.554751:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101248 00000100:00100000:1.0:1713279437.554756:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279437.554759:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101248 00000100:00100000:2.0:1713279437.554796:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101184 00000100:00100000:2.0:1713279437.554798:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101184 00000100:00100000:2.0:1713279437.554813:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1713279437.554820:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200101248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279437.554831:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1713279437.554843:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200101184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1713279437.554847:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279437.554864:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279437.554891:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200101248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279437.554898:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1713279437.554911:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200101248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279437.554930:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200101184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279437.554941:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1713279437.554954:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200101184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279438.274733:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200101312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279438.274817:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279438.274881:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101312 00000100:00100000:0.0:1713279438.274893:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101312 00000100:00100000:0.0:1713279438.274956:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1713279438.274965:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200101312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279438.275002:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279438.275071:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200101312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279438.275080:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1713279438.275122:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200101312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279438.290641:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200101376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279438.290696:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279438.290756:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101376 00000100:00100000:2.0:1713279438.290765:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101376 00000100:00100000:2.0:1713279438.290801:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1713279438.290810:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200101376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279438.290827:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279438.290889:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200101376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279438.290896:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1713279438.290949:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200101376:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279438.470681:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279439.099296:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279439.099354:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279439.099387:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279439.099405:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331072 00000100:00100000:3.0:1713279439.099461:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331008 00000100:00100000:0.0:1713279439.099470:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279439.099470:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331072 00000100:00100000:3.0:1713279439.099470:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331008 00000100:00100000:0.0:1713279439.099491:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279439.099506:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279439.099522:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279439.099558:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331200 00000100:00100000:2.0:1713279439.099559:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331136 00000100:00100000:2.0:1713279439.099562:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331136 00000100:00100000:3.0:1713279439.099566:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 435 00000100:00100000:0.0:1713279439.099567:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279439.099568:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331200 00000100:00100000:3.0:1713279439.099578:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281331008:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279439.099580:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331328 00000100:00100000:2.0:1713279439.099582:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331328 00000100:00100000:2.0:1713279439.099592:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331392 00000100:00100000:2.0:1713279439.099594:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331392 00000100:00100000:0.0:1713279439.099602:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279439.099613:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331264 00000100:00100000:2.0:1713279439.099614:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 693 00000100:00100000:1.0:1713279439.099617:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331264 00000100:00100000:2.0:1713279439.099621:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281331072:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279439.099631:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 694 00000100:00100000:0.0:1713279439.099640:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281331136:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279439.099643:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331456 00000100:00100000:1.0:1713279439.099647:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331456 00000100:00100000:3.0:1713279439.099671:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281331008:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 93us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279439.099676:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331520 00000100:00100000:2.0:1713279439.099676:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281331072:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 55us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279439.099680:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331520 00000100:00100000:2.0:1713279439.099684:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 693 00000100:00100000:3.0:1713279439.099684:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 435 00000100:00100000:0.0:1713279439.099690:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281331136:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279439.099698:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 694 00000100:00100000:2.0:1713279439.099702:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 695 00000100:00100000:1.0:1713279439.099705:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 289 00000100:00100000:2.0:1713279439.099706:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281331328:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279439.099715:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281331200:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279439.099716:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 696 00000100:00100000:0.0:1713279439.099721:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281331392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:3.0:1713279439.099721:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279409 00000100:00080000:3.0:1713279439.099726:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279409 00000100:00100000:2.0:1713279439.099728:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281331328:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (237us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279439.099728:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279409 00000100:00080000:3.0:1713279439.099730:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279409 00000100:00080000:3.0:1713279439.099732:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279409 00000100:00100000:2.0:1713279439.099734:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 695 00000100:00100000:0.0:1713279439.099742:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281331392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279439.099745:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 290 00000100:00100000:0.0:1713279439.099749:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 696 00000100:00100000:3.0:1713279439.099751:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281331264:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279439.099761:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 291 00000100:00100000:2.0:1713279439.099766:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281331456:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279439.099770:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281331200:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 53us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279439.099772:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 292 00000100:00100000:0.0:1713279439.099777:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281331520:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279439.099783:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 289 00000100:00100000:3.0:1713279439.099783:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281331264:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279439.099790:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 290 00000100:00100000:2.0:1713279439.099794:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281331456:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279439.099796:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281331520:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 18us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279439.099800:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 291 00000100:00100000:0.0:1713279439.099804:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 292 00010000:00010000:2.0:1713279439.472765:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279440.194803:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713279440.194831:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200101440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279440.194906:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279440.194963:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101440 00000100:00100000:2.0:1713279440.194972:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101440 00000100:00100000:2.0:1713279440.195020:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99063 00000100:00100000:2.0:1713279440.195027:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200101440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279440.195060:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279440.195108:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200101440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279440.195115:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99063 00000100:00100000:0.0:1713279440.195140:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200101440:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279440.474802:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279441.476751:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279441.874599:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200101504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279441.874659:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279441.874728:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101504 00000100:00100000:2.0:1713279441.874736:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101504 00000100:00100000:2.0:1713279441.874779:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99064 00000100:00100000:2.0:1713279441.874785:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200101504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279441.874814:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279441.874857:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200101504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279441.874863:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99064 00000100:00100000:0.0:1713279441.874874:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200101504:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279442.478595:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279442.546605:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200101632:0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.546605:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200101568:0@lo:400:kworker.0 00000100:00100000:1.0:1713279442.546636:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200101696:0@lo:400:kworker.0 00000100:00100000:0.0:1713279442.546669:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279442.546672:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279442.546672:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279442.546691:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200101888:0@lo:400:kworker.0 00000100:00100000:1.0:1713279442.546695:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200101952:0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.546696:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200101824:0@lo:400:kworker.0 00000100:00100000:0.0:1713279442.546708:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279442.546713:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279442.546722:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101632 00000100:00100000:1.0:1713279442.546728:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101632 00000100:00100000:2.0:1713279442.546730:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200102080:0@lo:400:kworker.0 00000100:00100000:0.0:1713279442.546732:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200102144:0@lo:400:kworker.0 00000100:00100000:0.0:1713279442.546750:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279442.546750:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279442.546753:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101568 00000100:00100000:1.0:1713279442.546757:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101888 00000100:00100000:3.0:1713279442.546758:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101568 00000100:00100000:1.0:1713279442.546759:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101888 00000100:00100000:2.0:1713279442.546762:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200102336:0@lo:400:kworker.0 00000100:00100000:0.0:1713279442.546774:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200101760:0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.546776:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279442.546784:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1713279442.546785:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102144 00000100:00100000:1.0:1713279442.546787:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102144 00000100:00100000:3.0:1713279442.546789:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200101568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279442.546792:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279442.546796:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101696 00000100:00100000:2.0:1713279442.546798:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101696 00000100:00100000:0.0:1713279442.546802:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200102016:0@lo:400:kworker.0 00000100:00100000:1.0:1713279442.546802:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101760 00000100:00100000:1.0:1713279442.546804:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101760 00000100:00100000:1.0:1713279442.546815:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1713279442.546815:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101824 00000100:00100000:2.0:1713279442.546816:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101824 00000100:00100000:0.0:1713279442.546817:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279442.546820:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200101632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.546827:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99065 00000100:00100000:3.0:1713279442.546827:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200101568:12345-0@lo:400:kworker.0 Request processed in 38us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279442.546829:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200102272:0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.546831:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200101696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279442.546832:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1713279442.546848:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279442.546853:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200101632:12345-0@lo:400:kworker.0 Request processed in 33us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279442.546853:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1713279442.546855:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200101696:12345-0@lo:400:kworker.0 Request processed in 23us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279442.546856:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200101888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279442.546860:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1713279442.546860:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99065 00000100:00100000:0.0:1713279442.546870:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102080 00000100:00100000:3.0:1713279442.546870:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200101888:12345-0@lo:400:kworker.0 Request processed in 14us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279442.546871:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1713279442.546871:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99066 00000100:00100000:0.0:1713279442.546874:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102080 00000100:00100000:3.0:1713279442.546874:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1713279442.546876:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200102144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.546876:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200101824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279442.546882:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:3.0:1713279442.546885:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200101760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279442.546894:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102336 00000100:00100000:0.0:1713279442.546896:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102336 00000100:00100000:1.0:1713279442.546897:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200102144:12345-0@lo:400:kworker.0 Request processed in 22us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279442.546897:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200101824:12345-0@lo:400:kworker.0 Request processed in 21us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279442.546901:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99066 00000100:00100000:1.0:1713279442.546902:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:3.0:1713279442.546903:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200101760:12345-0@lo:400:kworker.0 Request processed in 16us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279442.546906:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1713279442.546908:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102016 00000100:00100000:0.0:1713279442.546909:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102016 00000100:00100000:2.0:1713279442.546914:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102272 00000100:00080000:3.0:1713279442.546914:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279412 00000100:00080000:3.0:1713279442.546916:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279412 00000100:00100000:2.0:1713279442.546917:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102272 00000100:00080000:3.0:1713279442.546917:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279412 00000100:00100000:1.0:1713279442.546919:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1713279442.546919:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279412 00000100:00100000:0.0:1713279442.546920:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1713279442.546924:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200102080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279442.546928:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1713279442.546929:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200102208:0@lo:400:kworker.0 00000100:00100000:3.0:1713279442.546931:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200102336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.546939:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1713279442.546942:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200102016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279442.546949:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279442.546950:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200102080:12345-0@lo:400:kworker.0 Request processed in 25us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279442.546951:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200102336:12345-0@lo:400:kworker.0 Request processed in 19us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279442.546953:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1713279442.546957:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1713279442.546961:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1713279442.546964:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200102272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.546966:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200102016:12345-0@lo:400:kworker.0 Request processed in 23us (148us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279442.546970:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279412 00000100:00100000:1.0:1713279442.546971:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200101696:0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.546971:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1713279442.546976:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200102272:12345-0@lo:400:kworker.0 Request processed in 11us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279442.546979:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1713279442.546988:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200101952 00000100:00100000:3.0:1713279442.546990:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102208 00000100:00100000:2.0:1713279442.546991:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200101952 00000100:00100000:3.0:1713279442.546993:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102208 00000100:00100000:1.0:1713279442.547005:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200102144:0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.547010:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1713279442.547011:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200101760:0@lo:400:kworker.0 00000100:00100000:1.0:1713279442.547014:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200101632:0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.547015:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200101952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279442.547015:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1713279442.547017:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200102016:0@lo:400:kworker.0 00000100:00100000:3.0:1713279442.547019:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200102208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279442.547022:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200102272:0@lo:400:kworker.0 00000100:00100000:1.0:1713279442.547023:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200101888:0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.547041:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200101952:12345-0@lo:400:kworker.0 Request processed in 27us (121us total) trans 0 rc 0/0 00000100:00080000:0.0:1713279442.547042:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279412 00000100:00100000:3.0:1713279442.547043:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200102208:12345-0@lo:400:kworker.0 Request processed in 24us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279442.547047:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200101952:0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.547047:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:3.0:1713279442.547049:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1713279442.547055:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200102208:0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.547064:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200102080:0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.547072:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200102336:0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.547077:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200101568:0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.547084:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200101824:0@lo:400:kworker.0 00000100:00100000:2.0:1713279442.562529:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200102400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279442.562558:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279442.562578:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200102464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279442.562589:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279442.562590:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102400 00000100:00100000:0.0:1713279442.562595:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102400 00000100:00100000:0.0:1713279442.562612:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102464 00000100:00100000:0.0:1713279442.562614:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102464 00000100:00100000:0.0:1713279442.562622:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1713279442.562626:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200102400:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279442.562629:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1713279442.562635:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200102464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279442.562645:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:1.0:1713279442.562647:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279442.562679:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200102400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279442.562683:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1713279442.562683:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200102464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279442.562690:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1713279442.562709:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200102400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279442.562719:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200102464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279443.282766:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200102528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279443.282845:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279443.282956:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102528 00000100:00100000:2.0:1713279443.282971:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102528 00000100:00100000:2.0:1713279443.283044:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1713279443.283055:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200102528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279443.283097:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279443.283239:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200102528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279443.283253:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1713279443.283280:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200102528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279443.298667:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200102592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279443.298713:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279443.298805:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102592 00000100:00100000:3.0:1713279443.298816:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102592 00000100:00100000:3.0:1713279443.298870:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1713279443.298881:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200102592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1713279443.298903:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279443.298982:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200102592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279443.298995:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1713279443.299017:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200102592:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279443.480774:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279444.107595:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279444.107642:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279444.107664:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279444.107670:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331648 00000100:00100000:0.0:1713279444.107680:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279444.107681:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331648 00000100:00100000:0.0:1713279444.107700:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279444.107713:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279444.107719:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331584 00000100:00100000:2.0:1713279444.107726:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331584 00000100:00100000:3.0:1713279444.107727:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331712 00000100:00100000:0.0:1713279444.107729:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279444.107729:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331712 00000100:00100000:3.0:1713279444.107742:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331904 00000100:00100000:3.0:1713279444.107744:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331904 00000100:00100000:0.0:1713279444.107750:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279444.107753:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331968 00000100:00100000:3.0:1713279444.107755:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331968 00000100:00100000:1.0:1713279444.107762:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331776 00000100:00100000:2.0:1713279444.107768:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 437 00000100:00100000:1.0:1713279444.107769:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331776 00000100:00100000:3.0:1713279444.107769:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 703 00000100:00100000:3.0:1713279444.107775:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281331648:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279444.107776:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281331584:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279444.107788:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279444.107804:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281331840 00000100:00100000:1.0:1713279444.107807:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281331840 00000100:00080000:0.0:1713279444.107818:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279414 00000100:00100000:1.0:1713279444.107819:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332096 00000100:00100000:1.0:1713279444.107821:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332096 00000100:00080000:0.0:1713279444.107823:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279414 00000100:00080000:0.0:1713279444.107826:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279414 00000100:00080000:0.0:1713279444.107828:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279414 00000100:00080000:0.0:1713279444.107831:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279414 00000100:00100000:1.0:1713279444.107832:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332032 00000100:00080000:0.0:1713279444.107833:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279414 00000100:00100000:3.0:1713279444.107833:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281331648:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 57us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279444.107834:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332032 00000100:00080000:0.0:1713279444.107838:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279414 00000100:00100000:2.0:1713279444.107838:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281331584:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 61us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279444.107838:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 703 00000100:00100000:2.0:1713279444.107847:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 437 00000100:00100000:1.0:1713279444.107848:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 297 00000100:00100000:3.0:1713279444.107851:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 704 00000100:00100000:1.0:1713279444.107853:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281331776:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279444.107855:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281331712:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279444.107856:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 298 00000100:00100000:0.0:1713279444.107863:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281331840:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279444.107873:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281331712:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 18us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279444.107878:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 704 00000100:00100000:1.0:1713279444.107884:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281331776:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279444.107884:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 705 00000100:00100000:3.0:1713279444.107888:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281331904:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279444.107890:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 297 00000100:00100000:2.0:1713279444.107890:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 706 00000100:00100000:2.0:1713279444.107897:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281331968:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279444.107899:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281331840:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279444.107900:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 299 00000100:00100000:1.0:1713279444.107903:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281332096:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279444.107903:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281331904:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 14us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279444.107907:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 298 00000100:00100000:3.0:1713279444.107907:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 705 00000100:00100000:1.0:1713279444.107919:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281332096:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 14us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279444.107921:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 300 00000100:00100000:1.0:1713279444.107924:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 299 00000100:00100000:0.0:1713279444.107925:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281332032:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279444.107928:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281331968:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279444.107936:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 706 00000100:00100000:0.0:1713279444.107945:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281332032:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279444.107949:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 300 00010000:00010000:2.0:1713279444.482703:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279445.202733:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200102656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279445.202821:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279445.202885:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102656 00000100:00100000:0.0:1713279445.202896:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102656 00000100:00100000:0.0:1713279445.202950:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99067 00000100:00100000:0.0:1713279445.202959:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200102656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1713279445.202998:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:0.0:1713279445.203064:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200102656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279445.203072:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99067 00000100:00100000:3.0:1713279445.203164:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200102656:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279445.484740:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279446.486784:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279446.882718:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200102720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713279446.882801:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279446.882895:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102720 00000100:00100000:0.0:1713279446.882906:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102720 00000100:00100000:0.0:1713279446.882969:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99068 00000100:00100000:0.0:1713279446.882979:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200102720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713279446.883020:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:0.0:1713279446.883095:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200102720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279446.883105:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99068 00000100:00100000:2.0:1713279446.883201:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200102720:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279447.488636:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279447.554693:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200102784:0@lo:400:kworker.0 00000100:00100000:1.0:1713279447.554704:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200102848:0@lo:400:kworker.0 00000100:00100000:1.0:1713279447.554777:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279447.554788:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279447.554809:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200103104:0@lo:400:kworker.0 00000100:00100000:2.0:1713279447.554825:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200103040:0@lo:400:kworker.0 00000100:00100000:1.0:1713279447.554834:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279447.554838:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102784 00000100:00100000:3.0:1713279447.554849:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102784 00000100:00100000:1.0:1713279447.554853:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200103360:0@lo:400:kworker.0 00000100:00100000:2.0:1713279447.554859:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279447.554862:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102848 00000100:00100000:0.0:1713279447.554870:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102848 00000100:00100000:1.0:1713279447.554877:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279447.554880:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200103296:0@lo:400:kworker.0 00000100:00100000:3.0:1713279447.554897:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1713279447.554903:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103104 00000100:00100000:3.0:1713279447.554904:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200102784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279447.554907:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103104 00000100:00100000:2.0:1713279447.554907:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279447.554909:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103360 00000100:00100000:1.0:1713279447.554913:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103360 00000100:00100000:2.0:1713279447.554924:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200103552:0@lo:400:kworker.0 00000100:00100000:0.0:1713279447.554927:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1713279447.554935:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200102848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279447.554935:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1713279447.554941:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200103104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279447.554948:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279447.554954:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200102784:12345-0@lo:400:kworker.0 Request processed in 50us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279447.554960:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1713279447.554985:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200103104:12345-0@lo:400:kworker.0 Request processed in 43us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279447.554989:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200102784:0@lo:400:kworker.0 00000100:00100000:1.0:1713279447.554994:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1713279447.554995:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200102848:12345-0@lo:400:kworker.0 Request processed in 60us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279447.555004:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1713279447.555008:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200103360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279447.555013:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1713279447.555025:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103296 00000100:00100000:1.0:1713279447.555027:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103552 00000100:00080000:0.0:1713279447.555030:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279417 00000100:00100000:1.0:1713279447.555030:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103552 00000100:00100000:2.0:1713279447.555030:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103296 00000100:00100000:3.0:1713279447.555032:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200103360:12345-0@lo:400:kworker.0 Request processed in 23us (154us total) trans 0 rc 0/0 00000100:00080000:0.0:1713279447.555034:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279417 00000100:00100000:3.0:1713279447.555037:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00080000:0.0:1713279447.555038:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279417 00000100:00080000:0.0:1713279447.555041:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279417 00000100:00100000:0.0:1713279447.555052:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103040 00000100:00100000:0.0:1713279447.555056:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103040 00000100:00100000:1.0:1713279447.555058:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1713279447.555080:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200103552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279447.555083:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1713279447.555083:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200102976:0@lo:400:kworker.0 00000100:00100000:2.0:1713279447.555093:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200103296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279447.555101:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99069 00000100:00100000:0.0:1713279447.555108:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200103040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279447.555110:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279447.555173:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200103232:0@lo:400:kworker.0 00000100:00100000:1.0:1713279447.555174:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200103552:12345-0@lo:400:kworker.0 Request processed in 107us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279447.555186:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1713279447.555192:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200103296:12345-0@lo:400:kworker.0 Request processed in 97us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279447.555198:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200103040:12345-0@lo:400:kworker.0 Request processed in 89us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279447.555198:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279447.555205:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1713279447.555208:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99069 00000100:00100000:1.0:1713279447.555210:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103232 00000100:00100000:3.0:1713279447.555212:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200103488:0@lo:400:kworker.0 00000100:00100000:1.0:1713279447.555214:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103232 00000100:00100000:3.0:1713279447.555228:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1713279447.555232:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279417 00000100:00100000:3.0:1713279447.555243:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1713279447.555245:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103488 00000100:00100000:3.0:1713279447.555249:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200102912:0@lo:400:kworker.0 00000100:00100000:0.0:1713279447.555250:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1713279447.555250:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103488 00000100:00100000:0.0:1713279447.555257:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200103232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279447.555258:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200103040:0@lo:400:kworker.0 00000100:00100000:3.0:1713279447.555265:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279447.555273:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1713279447.555276:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200103296:0@lo:400:kworker.0 00000100:00100000:3.0:1713279447.555277:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200103168:0@lo:400:kworker.0 00000100:00100000:1.0:1713279447.555281:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200103488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279447.555292:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200103552:0@lo:400:kworker.0 00000100:00100000:3.0:1713279447.555300:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279447.555305:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200103232:12345-0@lo:400:kworker.0 Request processed in 46us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279447.555312:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200103424:0@lo:400:kworker.0 00000100:00100000:0.0:1713279447.555315:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1713279447.555318:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200103488:12345-0@lo:400:kworker.0 Request processed in 37us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279447.555328:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1713279447.555328:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102912 00000100:00100000:3.0:1713279447.555328:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279447.555333:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102912 00000100:00080000:0.0:1713279447.555334:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279417 00000100:00100000:0.0:1713279447.555345:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200102976 00000100:00100000:0.0:1713279447.555350:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200102976 00000100:00100000:3.0:1713279447.555351:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200103232:0@lo:400:kworker.0 00000100:00100000:3.0:1713279447.555362:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200103488:0@lo:400:kworker.0 00000100:00100000:2.0:1713279447.555365:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99070 00000100:00100000:0.0:1713279447.555370:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103168 00000100:00100000:2.0:1713279447.555372:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200102912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279447.555374:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103168 00000100:00100000:1.0:1713279447.555377:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200102848:0@lo:400:kworker.0 00000100:00100000:1.0:1713279447.555394:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200103104:0@lo:400:kworker.0 00000100:00100000:0.0:1713279447.555396:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103424 00000100:00100000:0.0:1713279447.555399:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103424 00000100:00100000:3.0:1713279447.555408:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1713279447.555409:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200103360:0@lo:400:kworker.0 00000100:00100000:3.0:1713279447.555456:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200102976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279447.555468:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1713279447.555476:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200103168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279447.555478:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1713279447.555480:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200102912:12345-0@lo:400:kworker.0 Request processed in 103us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279447.555485:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200103424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279447.555492:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99070 00000100:00100000:3.0:1713279447.555493:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200102976:12345-0@lo:400:kworker.0 Request processed in 37us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279447.555499:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1713279447.555530:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200102912:0@lo:400:kworker.0 00000100:00100000:0.0:1713279447.555531:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200103168:12345-0@lo:400:kworker.0 Request processed in 54us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279447.555534:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200103424:12345-0@lo:400:kworker.0 Request processed in 48us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279447.555541:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1713279447.555542:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200103168:0@lo:400:kworker.0 00000100:00100000:1.0:1713279447.555546:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1713279447.555552:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200103424:0@lo:400:kworker.0 00000100:00100000:3.0:1713279447.555562:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200102976:0@lo:400:kworker.0 00000100:00080000:0.0:1713279447.555563:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279417 00000100:00100000:1.0:1713279447.570613:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200103680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279447.570655:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200103616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279447.570666:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279447.570694:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103680 00000100:00100000:3.0:1713279447.570702:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103680 00000100:00100000:0.0:1713279447.570703:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279447.570740:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103616 00000100:00100000:3.0:1713279447.570743:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103616 00000100:00100000:1.0:1713279447.570748:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1713279447.570755:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200103680:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279447.570765:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1713279447.570771:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200103616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1713279447.570785:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279447.570786:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279447.570840:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200103680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279447.570845:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200103616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279447.570847:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1713279447.570856:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1713279447.570903:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200103680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279447.570945:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200103616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279448.290628:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200103744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279448.290707:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279448.290772:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103744 00000100:00100000:3.0:1713279448.290781:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103744 00000100:00100000:3.0:1713279448.290826:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1713279448.290833:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200103744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1713279448.290861:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279448.290915:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200103744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279448.290921:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1713279448.290974:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200103744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279448.306626:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200103808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1713279448.306680:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279448.306715:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103808 00000100:00100000:0.0:1713279448.306725:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103808 00000100:00100000:0.0:1713279448.306787:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1713279448.306797:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200103808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279448.306821:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279448.306889:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200103808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279448.306897:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1713279448.306940:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200103808:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279448.490802:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279449.115370:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279449.115444:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279449.115477:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332160 00000100:00100000:0.0:1713279449.115479:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279449.115487:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332160 00000100:00100000:0.0:1713279449.115499:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279449.115528:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 439 00000100:00100000:0.0:1713279449.115530:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279449.115534:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281332160:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279449.115548:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332224 00000100:00100000:0.0:1713279449.115549:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279449.115554:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332224 00000100:00100000:0.0:1713279449.115567:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279449.115583:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332288 00000100:00100000:1.0:1713279449.115585:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332288 00000100:00100000:3.0:1713279449.115585:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281332160:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279449.115590:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 439 00000100:00100000:1.0:1713279449.115595:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332480 00000100:00100000:0.0:1713279449.115596:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279449.115596:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332480 00000100:00100000:2.0:1713279449.115614:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332352 00000100:00100000:2.0:1713279449.115621:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332352 00000100:00100000:1.0:1713279449.115627:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 713 00000100:00100000:1.0:1713279449.115632:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281332224:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279449.115635:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332416 00000100:00100000:3.0:1713279449.115637:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332416 00000100:00100000:2.0:1713279449.115650:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332608 00000100:00100000:2.0:1713279449.115652:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332608 00000100:00100000:3.0:1713279449.115655:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 305 00000100:00100000:3.0:1713279449.115659:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281332352:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279449.115668:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 306 00000100:00100000:1.0:1713279449.115669:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281332224:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279449.115674:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281332416:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279449.115675:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 713 00000100:00100000:3.0:1713279449.115682:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281332352:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279449.115685:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332544 00000100:00100000:1.0:1713279449.115687:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332544 00000100:00100000:3.0:1713279449.115687:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 305 00000100:00100000:1.0:1713279449.115699:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 714 00000100:00100000:3.0:1713279449.115699:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 307 00000100:00100000:1.0:1713279449.115702:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281332288:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279449.115703:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281332608:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279449.115707:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281332416:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279449.115713:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 306 00000100:00100000:3.0:1713279449.115719:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281332608:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 15us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279449.115724:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 307 00000100:00100000:1.0:1713279449.115730:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281332288:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279449.115732:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 715 00000100:00100000:2.0:1713279449.115736:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281332480:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279449.115739:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 716 00000100:00100000:0.0:1713279449.115756:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279449.115760:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 714 00000100:00100000:3.0:1713279449.115761:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281332544:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279449.115773:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281332480:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279449.115779:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 715 00000100:00100000:3.0:1713279449.115780:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281332544:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 18us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279449.115781:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332672 00000100:00100000:1.0:1713279449.115783:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332672 00000100:00100000:3.0:1713279449.115785:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 716 00000100:00100000:1.0:1713279449.115796:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 308 00000100:00100000:1.0:1713279449.115800:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281332672:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279449.115819:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281332672:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279449.115824:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 308 00000100:00080000:3.0:1713279449.115830:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279419 00000100:00080000:3.0:1713279449.115834:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279419 00000100:00080000:3.0:1713279449.115836:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279419 00000100:00080000:3.0:1713279449.115839:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279419 00000100:00080000:3.0:1713279449.115841:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279419 00010000:00010000:2.0:1713279449.492755:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279450.210746:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200103872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1713279450.210830:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279450.210920:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103872 00000100:00100000:0.0:1713279450.210935:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103872 00000100:00100000:0.0:1713279450.211006:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99071 00000100:00100000:0.0:1713279450.211018:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200103872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1713279450.211078:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:0.0:1713279450.211191:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200103872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 172us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279450.211204:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99071 00000100:00100000:2.0:1713279450.211256:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200103872:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279450.494735:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279451.496711:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279451.890712:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200103936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279451.890788:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279451.890847:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200103936 00000100:00100000:2.0:1713279451.890856:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200103936 00000100:00100000:2.0:1713279451.890906:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99072 00000100:00100000:2.0:1713279451.890912:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200103936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279451.890952:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279451.891023:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200103936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279451.891030:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99072 00000100:00100000:0.0:1713279451.891061:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200103936:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279452.498650:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279452.562677:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200104000:0@lo:400:kworker.0 00000100:00100000:2.0:1713279452.562717:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200104064:0@lo:400:kworker.0 00000100:00100000:1.0:1713279452.562720:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200104128:0@lo:400:kworker.0 00000100:00100000:0.0:1713279452.562721:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200104192:0@lo:400:kworker.0 00000100:00100000:3.0:1713279452.562733:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279452.562756:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200104256:0@lo:400:kworker.0 00000100:00100000:1.0:1713279452.562766:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279452.562766:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279452.562781:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279452.562782:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200104384:0@lo:400:kworker.0 00000100:00100000:0.0:1713279452.562785:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104000 00000100:00100000:0.0:1713279452.562790:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104000 00000100:00100000:2.0:1713279452.562796:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200104320:0@lo:400:kworker.0 00000100:00100000:1.0:1713279452.562801:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279452.562806:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200104512:0@lo:400:kworker.0 00000100:00100000:1.0:1713279452.562832:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200104640:0@lo:400:kworker.0 00000100:00100000:2.0:1713279452.562834:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279452.562842:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1713279452.562847:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200104000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279452.562847:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200104576:0@lo:400:kworker.0 00000100:00100000:1.0:1713279452.562852:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279452.562858:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279452.562866:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279452.562874:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200104768:0@lo:400:kworker.0 00000100:00100000:1.0:1713279452.562877:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104064 00000100:00100000:0.0:1713279452.562881:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200104000:12345-0@lo:400:kworker.0 Request processed in 34us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279452.562881:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104064 00000100:00100000:0.0:1713279452.562885:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1713279452.562892:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279452.562894:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104384 00000100:00100000:2.0:1713279452.562898:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104384 00000100:00100000:1.0:1713279452.562903:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104320 00000100:00100000:1.0:1713279452.562906:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104320 00000100:00100000:0.0:1713279452.562909:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279452.562916:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200104000:0@lo:400:kworker.0 00000100:00100000:2.0:1713279452.562919:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104640 00000100:00100000:2.0:1713279452.562922:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104640 00000100:00100000:0.0:1713279452.562924:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200104448:0@lo:400:kworker.0 00000100:00100000:1.0:1713279452.562940:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104576 00000100:00100000:1.0:1713279452.562943:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104576 00000100:00100000:0.0:1713279452.562945:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279452.562946:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104192 00000100:00100000:2.0:1713279452.562948:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104192 00000100:00100000:0.0:1713279452.562951:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200104704:0@lo:400:kworker.0 00000100:00100000:3.0:1713279452.562955:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104128 00000100:00100000:1.0:1713279452.562957:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1713279452.562958:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104128 00000100:00100000:0.0:1713279452.562960:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279452.562962:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200104064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279452.562964:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:2.0:1713279452.562969:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200104384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279452.562977:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1713279452.562978:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104256 00000100:00100000:0.0:1713279452.562980:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200104320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279452.562980:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104256 00000100:00100000:3.0:1713279452.562993:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99073 00000100:00100000:3.0:1713279452.562997:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200104128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279452.562999:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200104320:12345-0@lo:400:kworker.0 Request processed in 18us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279452.562999:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200104064:12345-0@lo:400:kworker.0 Request processed in 36us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279452.563002:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1713279452.563006:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:2.0:1713279452.563006:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200104384:12345-0@lo:400:kworker.0 Request processed in 36us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279452.563012:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:0.0:1713279452.563014:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200104640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279452.563022:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1713279452.563025:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200104128:12345-0@lo:400:kworker.0 Request processed in 28us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279452.563026:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1713279452.563028:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200104640:12345-0@lo:400:kworker.0 Request processed in 13us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279452.563030:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200104576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279452.563031:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99073 00000100:00100000:0.0:1713279452.563032:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:2.0:1713279452.563038:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:3.0:1713279452.563039:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99074 00000100:00100000:2.0:1713279452.563043:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200104192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279452.563044:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200104256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279452.563047:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104512 00000100:00100000:0.0:1713279452.563049:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104512 00000100:00100000:1.0:1713279452.563053:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200104576:12345-0@lo:400:kworker.0 Request processed in 22us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279452.563057:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1713279452.563062:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104768 00000100:00100000:0.0:1713279452.563064:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104768 00000100:00100000:3.0:1713279452.563065:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200104256:12345-0@lo:400:kworker.0 Request processed in 21us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279452.563069:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99074 00000100:00100000:0.0:1713279452.563072:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104448 00000100:00100000:0.0:1713279452.563074:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104448 00000100:00100000:1.0:1713279452.563075:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104704 00000100:00100000:2.0:1713279452.563077:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200104192:12345-0@lo:400:kworker.0 Request processed in 32us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279452.563078:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104704 00000100:00080000:3.0:1713279452.563079:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279422 00000100:00080000:3.0:1713279452.563100:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279422 00000100:00080000:3.0:1713279452.563102:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279422 00000100:00100000:0.0:1713279452.563104:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00080000:3.0:1713279452.563104:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279422 00000100:00100000:2.0:1713279452.563105:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00080000:3.0:1713279452.563106:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279422 00000100:00100000:0.0:1713279452.563107:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200104512:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279452.563122:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279422 00000100:00100000:0.0:1713279452.563123:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200104512:12345-0@lo:400:kworker.0 Request processed in 17us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279452.563128:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1713279452.563131:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200104768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279452.563135:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1713279452.563137:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200104512:0@lo:400:kworker.0 00000100:00100000:0.0:1713279452.563142:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1713279452.563144:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200104448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279452.563144:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200104256:0@lo:400:kworker.0 00000100:00100000:2.0:1713279452.563152:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1713279452.563157:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200104704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279452.563160:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200104448:12345-0@lo:400:kworker.0 Request processed in 15us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279452.563161:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200104768:12345-0@lo:400:kworker.0 Request processed in 28us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279452.563161:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200104768:0@lo:400:kworker.0 00000100:00100000:0.0:1713279452.563163:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1713279452.563166:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1713279452.563192:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200104704:12345-0@lo:400:kworker.0 Request processed in 34us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279452.563193:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200104192:0@lo:400:kworker.0 00000100:00100000:1.0:1713279452.563193:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200104128:0@lo:400:kworker.0 00000100:00100000:2.0:1713279452.563198:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1713279452.563200:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200104448:0@lo:400:kworker.0 00000100:00100000:1.0:1713279452.563202:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200104384:0@lo:400:kworker.0 00000100:00100000:0.0:1713279452.563206:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200104704:0@lo:400:kworker.0 00000100:00100000:1.0:1713279452.563211:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200104640:0@lo:400:kworker.0 00000100:00100000:2.0:1713279452.563224:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200104064:0@lo:400:kworker.0 00000100:00100000:2.0:1713279452.563234:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200104320:0@lo:400:kworker.0 00000100:00100000:2.0:1713279452.563242:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200104576:0@lo:400:kworker.0 00000100:00100000:3.0:1713279452.578575:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c01bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200104832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279452.578588:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200104896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279452.578613:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279452.578643:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279452.578656:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104832 00000100:00100000:0.0:1713279452.578661:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104832 00000100:00100000:2.0:1713279452.578673:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104896 00000100:00100000:2.0:1713279452.578678:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104896 00000100:00100000:0.0:1713279452.578688:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1713279452.578693:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200104832:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279452.578700:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1713279452.578704:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200104896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1713279452.578712:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279452.578713:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279452.578750:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200104832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279452.578754:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1713279452.578758:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200104896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279452.578762:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1713279452.578763:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c01bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200104832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279452.578787:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200104896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279453.298657:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200104960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279453.298717:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279453.298759:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200104960 00000100:00100000:2.0:1713279453.298767:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200104960 00000100:00100000:2.0:1713279453.298803:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1713279453.298808:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200104960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279453.298849:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279453.298894:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200104960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279453.298903:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1713279453.298918:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200104960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279453.314613:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200105024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279453.314666:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279453.314727:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105024 00000100:00100000:2.0:1713279453.314734:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105024 00000100:00100000:2.0:1713279453.314779:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1713279453.314786:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200105024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279453.314807:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279453.314861:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200105024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279453.314868:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1713279453.314888:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200105024:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279453.500720:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279454.123191:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279454.123234:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279454.123257:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279454.123276:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332736 00000100:00100000:0.0:1713279454.123281:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279454.123290:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332736 00000100:00100000:3.0:1713279454.123292:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332800 00000100:00100000:0.0:1713279454.123297:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279454.123297:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332800 00000100:00100000:0.0:1713279454.123309:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279454.123320:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279454.123332:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332864 00000100:00100000:2.0:1713279454.123333:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 441 00000100:00100000:3.0:1713279454.123334:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332864 00000100:00100000:2.0:1713279454.123339:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281332736:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279454.123341:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279454.123344:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333120 00000100:00100000:3.0:1713279454.123346:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333056 00000100:00100000:3.0:1713279454.123348:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333056 00000100:00100000:1.0:1713279454.123351:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333120 00000100:00100000:3.0:1713279454.123361:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 723 00000100:00100000:3.0:1713279454.123366:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281332800:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279454.123367:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279454.123388:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 724 00000100:00100000:2.0:1713279454.123392:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281332736:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 53us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279454.123396:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281332864:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279454.123398:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 441 00000100:00100000:3.0:1713279454.123399:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281332800:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279454.123405:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 723 00000100:00100000:3.0:1713279454.123457:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 725 00000100:00100000:3.0:1713279454.123461:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281333056:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279454.123463:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332928 00000100:00100000:2.0:1713279454.123466:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332928 00000100:00100000:2.0:1713279454.123483:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281332992 00000100:00100000:3.0:1713279454.123483:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281333056:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279454.123485:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281332864:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 87us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279454.123485:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281332992 00000100:00100000:3.0:1713279454.123487:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 725 00000100:00100000:1.0:1713279454.123495:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 724 00000100:00100000:2.0:1713279454.123495:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333248 00000100:00100000:2.0:1713279454.123497:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333248 00000100:00100000:3.0:1713279454.123502:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 726 00000100:00100000:2.0:1713279454.123505:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333184 00000100:00100000:3.0:1713279454.123505:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281333120:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279454.123506:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333184 00000100:00100000:2.0:1713279454.123518:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 313 00000100:00100000:2.0:1713279454.123522:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281332928:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279454.123525:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281333120:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279454.123527:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 314 00000100:00100000:3.0:1713279454.123530:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 726 00000100:00100000:0.0:1713279454.123536:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 315 00000100:00100000:1.0:1713279454.123536:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281332992:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279454.123543:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281333248:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279454.123547:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281332928:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279454.123548:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 316 00000100:00100000:3.0:1713279454.123551:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281333184:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279454.123553:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 313 00000100:00100000:1.0:1713279454.123568:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281332992:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279454.123568:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281333184:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 16us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279454.123573:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 316 00000100:00100000:0.0:1713279454.123575:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281333248:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279454.123577:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 314 00000100:00100000:0.0:1713279454.123581:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 315 00000100:00080000:3.0:1713279454.123586:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279424 00000100:00080000:3.0:1713279454.123589:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279424 00000100:00080000:3.0:1713279454.123590:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279424 00000100:00080000:3.0:1713279454.123592:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279424 00000100:00080000:3.0:1713279454.123593:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279424 00010000:00010000:2.0:1713279454.502639:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279455.218753:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713279455.218785:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200105088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1713279455.218876:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279455.218945:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105088 00000100:00100000:2.0:1713279455.218957:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105088 00000100:00100000:2.0:1713279455.219018:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99075 00000100:00100000:2.0:1713279455.219026:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200105088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279455.219097:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279455.219164:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200105088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279455.219172:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99075 00000100:00100000:1.0:1713279455.219231:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200105088:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279455.504741:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279456.506638:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279456.898859:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713279456.898893:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200105152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1713279456.898984:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279456.899155:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105152 00000100:00100000:2.0:1713279456.899169:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105152 00000100:00100000:2.0:1713279456.899247:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99076 00000100:00100000:2.0:1713279456.899258:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200105152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279456.899304:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279456.899394:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200105152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279456.899407:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99076 00000100:00100000:3.0:1713279456.899502:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200105152:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279457.508743:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279457.570727:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200105216:0@lo:400:kworker.0 00000100:00100000:0.0:1713279457.570803:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200105280:0@lo:400:kworker.0 00000100:00100000:2.0:1713279457.570809:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279457.570822:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200105408:0@lo:400:kworker.0 00000100:00100000:3.0:1713279457.570829:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200105344:0@lo:400:kworker.0 00000100:00100000:2.0:1713279457.570846:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200105472:0@lo:400:kworker.0 00000100:00100000:0.0:1713279457.570854:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279457.570878:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279457.570886:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279457.570895:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200105536:0@lo:400:kworker.0 00000100:00100000:3.0:1713279457.570903:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105280 00000100:00100000:1.0:1713279457.570906:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200105664:0@lo:400:kworker.0 00000100:00100000:2.0:1713279457.570908:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200105728:0@lo:400:kworker.0 00000100:00100000:3.0:1713279457.570911:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105280 00000100:00100000:0.0:1713279457.570915:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279457.570930:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279457.570932:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200105792:0@lo:400:kworker.0 00000100:00100000:1.0:1713279457.570952:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105216 00000100:00100000:2.0:1713279457.570953:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200105984:0@lo:400:kworker.0 00000100:00100000:1.0:1713279457.570959:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105216 00000100:00100000:0.0:1713279457.570961:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279457.570962:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105408 00000100:00100000:3.0:1713279457.570966:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105408 00000100:00100000:2.0:1713279457.570974:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279457.570988:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105536 00000100:00100000:3.0:1713279457.570991:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105536 00000100:00100000:0.0:1713279457.570999:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105792 00000100:00100000:0.0:1713279457.571004:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105792 00000100:00100000:2.0:1713279457.571007:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1713279457.571012:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1713279457.571015:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200105280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279457.571022:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200105216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279457.571037:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:0.0:1713279457.571044:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:0.0:1713279457.571077:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200105536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279457.571090:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200105408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279457.571113:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200105280:12345-0@lo:400:kworker.0 Request processed in 96us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279457.571121:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:0.0:1713279457.571122:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200105536:12345-0@lo:400:kworker.0 Request processed in 45us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279457.571123:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200105216:12345-0@lo:400:kworker.0 Request processed in 98us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279457.571130:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:1.0:1713279457.571135:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1713279457.571141:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:3.0:1713279457.571145:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200105408:12345-0@lo:400:kworker.0 Request processed in 99us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279457.571146:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200105792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279457.571153:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:0.0:1713279457.571156:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105728 00000100:00100000:0.0:1713279457.571160:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105728 00000100:00080000:1.0:1713279457.571171:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279427 00000100:00100000:2.0:1713279457.571174:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200105792:12345-0@lo:400:kworker.0 Request processed in 27us (212us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279457.571176:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279427 00000100:00100000:0.0:1713279457.571180:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105984 00000100:00080000:1.0:1713279457.571180:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279427 00000100:00100000:2.0:1713279457.571180:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:0.0:1713279457.571183:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105984 00000100:00100000:3.0:1713279457.571185:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1713279457.571201:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279427 00000100:00100000:0.0:1713279457.571203:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1713279457.571205:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200105600:0@lo:400:kworker.0 00000100:00100000:0.0:1713279457.571208:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200105728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279457.571215:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279457.571221:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200105280:0@lo:400:kworker.0 00000100:00100000:3.0:1713279457.571226:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279457.571234:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200105536:0@lo:400:kworker.0 00000100:00100000:0.0:1713279457.571242:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200105728:12345-0@lo:400:kworker.0 Request processed in 34us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279457.571244:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200105920:0@lo:400:kworker.0 00000100:00100000:3.0:1713279457.571244:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200105856:0@lo:400:kworker.0 00000100:00100000:2.0:1713279457.571245:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200105792:0@lo:400:kworker.0 00000100:00100000:0.0:1713279457.571249:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1713279457.571259:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105664 00000100:00100000:3.0:1713279457.571260:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279457.571262:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105664 00000100:00100000:2.0:1713279457.571271:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105600 00000100:00100000:2.0:1713279457.571275:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105600 00000100:00100000:1.0:1713279457.571277:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279457.571280:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1713279457.571284:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200105984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279457.571287:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105472 00000100:00100000:3.0:1713279457.571290:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105472 00000100:00100000:2.0:1713279457.571295:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105856 00000100:00100000:2.0:1713279457.571298:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105856 00000100:00100000:0.0:1713279457.571307:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200105984:12345-0@lo:400:kworker.0 Request processed in 23us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279457.571310:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105344 00000100:00100000:3.0:1713279457.571313:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105344 00000100:00100000:0.0:1713279457.571314:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1713279457.571315:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1713279457.571317:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200105408:0@lo:400:kworker.0 00000100:00100000:2.0:1713279457.571319:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200105600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279457.571321:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200105920 00000100:00100000:0.0:1713279457.571324:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200105920 00000100:00100000:3.0:1713279457.571327:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99077 00000100:00100000:3.0:1713279457.571332:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200105472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279457.571338:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1713279457.571343:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200105664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279457.571350:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1713279457.571353:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200105600:12345-0@lo:400:kworker.0 Request processed in 32us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279457.571359:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200105920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279457.571363:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:3.0:1713279457.571366:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200105472:12345-0@lo:400:kworker.0 Request processed in 33us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279457.571371:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200105664:12345-0@lo:400:kworker.0 Request processed in 27us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279457.571373:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99077 00000100:00100000:0.0:1713279457.571379:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1713279457.571379:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1713279457.571384:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200105856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279457.571384:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99078 00000100:00100000:3.0:1713279457.571388:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200105344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279457.571406:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200105920:12345-0@lo:400:kworker.0 Request processed in 47us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279457.571451:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1713279457.571453:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200105856:12345-0@lo:400:kworker.0 Request processed in 68us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279457.571461:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:3.0:1713279457.571462:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200105344:12345-0@lo:400:kworker.0 Request processed in 70us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279457.571469:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99078 00000100:00080000:1.0:1713279457.571482:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279427 00000100:00080000:1.0:1713279457.571487:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279427 00000100:00080000:1.0:1713279457.571491:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279427 00000100:00100000:2.0:1713279457.571494:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200105472:0@lo:400:kworker.0 00000100:00100000:2.0:1713279457.571507:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200105728:0@lo:400:kworker.0 00000100:00100000:3.0:1713279457.571511:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200105344:0@lo:400:kworker.0 00000100:00100000:2.0:1713279457.571517:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200105984:0@lo:400:kworker.0 00000100:00100000:1.0:1713279457.571518:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200105664:0@lo:400:kworker.0 00000100:00100000:3.0:1713279457.571522:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200105600:0@lo:400:kworker.0 00000100:00100000:2.0:1713279457.571525:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200105216:0@lo:400:kworker.0 00000100:00100000:3.0:1713279457.571532:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200105856:0@lo:400:kworker.0 00000100:00100000:1.0:1713279457.571534:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200105920:0@lo:400:kworker.0 00000100:00100000:1.0:1713279457.586574:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713279457.586580:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200106048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279457.586590:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200106112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279457.586624:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279457.586649:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106048 00000100:00100000:2.0:1713279457.586658:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106048 00000100:00100000:1.0:1713279457.586663:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279457.586725:0:14142:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106112 00000100:00100000:2.0:1713279457.586729:0:14142:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106112 00000100:00100000:0.0:1713279457.586739:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1713279457.586754:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200106048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279457.586755:0:14142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1713279457.586762:0:14142:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200106112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279457.586791:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279457.586791:0:14142:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279457.586850:0:14142:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200106112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279457.586858:0:14142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1713279457.586876:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200106048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279457.586889:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1713279457.586891:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200106112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279457.586899:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200106048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279458.306748:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713279458.306786:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200106176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279458.306881:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279458.306948:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106176 00000100:00100000:2.0:1713279458.306961:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106176 00000100:00100000:2.0:1713279458.307011:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1713279458.307020:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200106176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279458.307090:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279458.307184:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200106176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279458.307192:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1713279458.307239:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200106176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279458.322679:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801219bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200106240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279458.322778:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279458.322866:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106240 00000100:00100000:0.0:1713279458.322879:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106240 00000100:00100000:0.0:1713279458.322946:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1713279458.322957:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200106240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279458.322986:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279458.323070:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200106240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279458.323078:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1713279458.323140:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801219bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200106240:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279458.510892:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279459.131592:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279459.131675:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279459.131710:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333312 00000100:00100000:2.0:1713279459.131723:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333312 00000100:00100000:0.0:1713279459.131746:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279459.131773:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279459.131794:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279459.131811:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279459.131821:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 443 00000100:00100000:2.0:1713279459.131829:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281333312:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279459.131839:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279459.131854:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333376 00000100:00100000:3.0:1713279459.131868:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333376 00000100:00100000:0.0:1713279459.131870:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00080000:1.0:1713279459.131873:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279429 00000100:00080000:1.0:1713279459.131883:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279429 00000100:00100000:1.0:1713279459.131910:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333440 00000100:00100000:2.0:1713279459.131915:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281333312:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 84us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279459.131916:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333440 00000100:00100000:2.0:1713279459.131923:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 443 00000100:00100000:3.0:1713279459.131925:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333696 00000100:00100000:3.0:1713279459.131928:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333696 00000100:00100000:3.0:1713279459.131954:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333632 00000100:00100000:3.0:1713279459.131957:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333632 00000100:00100000:1.0:1713279459.131959:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 733 00000100:00100000:2.0:1713279459.131965:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333504 00000100:00100000:1.0:1713279459.131966:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281333376:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279459.131969:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333504 00000100:00100000:3.0:1713279459.131982:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 734 00000100:00100000:2.0:1713279459.131989:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333568 00000100:00100000:2.0:1713279459.131991:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333568 00000100:00100000:3.0:1713279459.131992:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281333696:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279459.132021:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333824 00000100:00100000:2.0:1713279459.132023:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333824 00000100:00100000:1.0:1713279459.132029:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281333376:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 61us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279459.132055:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 733 00000100:00100000:2.0:1713279459.132058:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 321 00000100:00100000:2.0:1713279459.132064:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281333504:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279459.132075:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 735 00000100:00100000:1.0:1713279459.132079:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281333440:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279459.132101:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281333696:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 109us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279459.132103:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281333504:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279459.132104:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281333440:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279459.132108:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 321 00000100:00100000:3.0:1713279459.132110:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 734 00000100:00100000:1.0:1713279459.132119:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 735 00000100:00100000:2.0:1713279459.132119:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 322 00000100:00100000:2.0:1713279459.132123:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281333568:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279459.132130:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279459.132131:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 736 00000100:00100000:3.0:1713279459.132136:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281333632:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279459.132140:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281333568:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 17us (346us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279459.132143:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279429 00000100:00100000:2.0:1713279459.132145:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 322 00000100:00080000:1.0:1713279459.132146:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279429 00000100:00080000:1.0:1713279459.132148:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279429 00000100:00080000:1.0:1713279459.132150:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279429 00000100:00100000:2.0:1713279459.132152:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333760 00000100:00100000:2.0:1713279459.132154:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333760 00000100:00100000:3.0:1713279459.132162:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281333632:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279459.132169:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 736 00000100:00100000:1.0:1713279459.132178:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 323 00000100:00100000:1.0:1713279459.132182:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281333824:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279459.132190:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 324 00000100:00100000:2.0:1713279459.132196:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281333760:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279459.132209:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281333824:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279459.132214:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 323 00000100:00100000:2.0:1713279459.132227:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281333760:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (102us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279459.132229:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279429 00000100:00100000:2.0:1713279459.132232:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 324 00010000:00010000:2.0:1713279459.512771:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279460.226823:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200106304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279460.226934:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279460.227006:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106304 00000100:00100000:2.0:1713279460.227020:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106304 00000100:00100000:2.0:1713279460.227121:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99079 00000100:00100000:2.0:1713279460.227131:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200106304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279460.227183:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279460.227256:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200106304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279460.227275:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99079 00000100:00100000:3.0:1713279460.227300:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200106304:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279460.514927:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279461.516821:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279461.906929:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200106368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279461.907008:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279461.907150:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106368 00000100:00100000:2.0:1713279461.907176:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106368 00000100:00100000:2.0:1713279461.907254:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99080 00000100:00100000:2.0:1713279461.907265:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200106368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279461.907310:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279461.907381:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200106368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279461.907390:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99080 00000100:00100000:0.0:1713279461.907477:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200106368:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279462.518738:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279462.578729:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200106624:0@lo:400:kworker.0 00000100:00100000:2.0:1713279462.578742:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200106432:0@lo:400:kworker.0 00000100:00100000:1.0:1713279462.578755:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200106496:0@lo:400:kworker.0 00000100:00100000:1.0:1713279462.578827:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279462.578827:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279462.578837:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200106560:0@lo:400:kworker.0 00000100:00100000:2.0:1713279462.578857:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200106688:0@lo:400:kworker.0 00000100:00100000:1.0:1713279462.578859:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200106752:0@lo:400:kworker.0 00000100:00100000:0.0:1713279462.578878:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279462.578888:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279462.578912:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106496 00000100:00100000:2.0:1713279462.578921:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200106944:0@lo:400:kworker.0 00000100:00100000:1.0:1713279462.578923:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106496 00000100:00100000:0.0:1713279462.578931:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200106880:0@lo:400:kworker.0 00000100:00100000:3.0:1713279462.578944:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279462.578946:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279462.578962:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200107200:0@lo:400:kworker.0 00000100:00100000:0.0:1713279462.578970:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279462.578982:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106624 00000100:00100000:2.0:1713279462.578985:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279462.578986:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106624 00000100:00100000:3.0:1713279462.578993:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200106816:0@lo:400:kworker.0 00000100:00100000:0.0:1713279462.579004:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200107136:0@lo:400:kworker.0 00000100:00100000:1.0:1713279462.579041:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:2.0:1713279462.579048:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106432 00000100:00100000:1.0:1713279462.579052:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200106496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279462.579054:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106432 00000100:00100000:3.0:1713279462.579064:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279462.579080:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279462.579084:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200107072:0@lo:400:kworker.0 00000100:00100000:2.0:1713279462.579091:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1713279462.579098:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200106432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279462.579111:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279462.579120:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200106496:12345-0@lo:400:kworker.0 Request processed in 68us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279462.579128:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106944 00000100:00100000:1.0:1713279462.579128:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1713279462.579135:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106944 00000100:00100000:2.0:1713279462.579141:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200106432:12345-0@lo:400:kworker.0 Request processed in 43us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279462.579147:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106816 00000100:00100000:2.0:1713279462.579148:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1713279462.579151:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106816 00000100:00100000:3.0:1713279462.579172:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107072 00000100:00100000:0.0:1713279462.579173:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106880 00000100:00100000:1.0:1713279462.579176:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1713279462.579178:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106880 00000100:00100000:1.0:1713279462.579180:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200106624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279462.579180:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107200 00000100:00100000:3.0:1713279462.579181:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107072 00000100:00100000:2.0:1713279462.579184:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107200 00000100:00100000:0.0:1713279462.579199:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107136 00000100:00100000:0.0:1713279462.579202:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107136 00000100:00100000:2.0:1713279462.579207:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1713279462.579211:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200106624:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279462.579212:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200106944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279462.579218:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1713279462.579231:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1713279462.579232:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:2.0:1713279462.579240:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200106944:12345-0@lo:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279462.579241:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200106880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279462.579241:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200106816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279462.579246:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1713279462.579247:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1713279462.579252:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200107072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279462.579259:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1713279462.579263:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200107200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279462.579289:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200107200:12345-0@lo:400:kworker.0 Request processed in 26us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279462.579296:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1713279462.579305:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200107072:12345-0@lo:400:kworker.0 Request processed in 52us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279462.579305:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1713279462.579307:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200106880:12345-0@lo:400:kworker.0 Request processed in 64us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279462.579309:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200107136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279462.579311:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1713279462.579318:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200106816:12345-0@lo:400:kworker.0 Request processed in 77us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279462.579319:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1713279462.579328:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:2.0:1713279462.579330:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200107136:12345-0@lo:400:kworker.0 Request processed in 20us (253us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279462.579333:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279432 00000100:00080000:1.0:1713279462.579337:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279432 00000100:00100000:2.0:1713279462.579337:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:1.0:1713279462.579340:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279432 00000100:00080000:1.0:1713279462.579342:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279432 00000100:00100000:2.0:1713279462.579357:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106688 00000100:00100000:1.0:1713279462.579359:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279462.579360:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106688 00000100:00100000:1.0:1713279462.579375:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200107008:0@lo:400:kworker.0 00000100:00100000:3.0:1713279462.579377:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106752 00000100:00100000:2.0:1713279462.579379:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200106560 00000100:00100000:3.0:1713279462.579381:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106752 00000100:00100000:2.0:1713279462.579382:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200106560 00000100:00100000:0.0:1713279462.579385:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200107136:0@lo:400:kworker.0 00000100:00100000:1.0:1713279462.579395:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279462.579397:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99081 00000100:00100000:2.0:1713279462.579402:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200106688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279462.579403:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200106624:0@lo:400:kworker.0 00000100:00100000:3.0:1713279462.579412:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107008 00000100:00100000:1.0:1713279462.579456:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200106496:0@lo:400:kworker.0 00000100:00100000:0.0:1713279462.579458:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200106880:0@lo:400:kworker.0 00000100:00100000:2.0:1713279462.579476:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200106688:12345-0@lo:400:kworker.0 Request processed in 72us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279462.579477:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107008 00000100:00100000:2.0:1713279462.579483:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99081 00000100:00100000:1.0:1713279462.579487:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:1.0:1713279462.579494:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200106752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279462.579495:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99082 00000100:00100000:2.0:1713279462.579499:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200106560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279462.579507:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:3.0:1713279462.579513:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200107008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279462.579524:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200106560:12345-0@lo:400:kworker.0 Request processed in 24us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279462.579530:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99082 00000100:00100000:1.0:1713279462.579533:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200106752:12345-0@lo:400:kworker.0 Request processed in 38us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279462.579539:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:0.0:1713279462.579550:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200106560:0@lo:400:kworker.0 00000100:00100000:3.0:1713279462.579551:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200107008:12345-0@lo:400:kworker.0 Request processed in 38us (155us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279462.579559:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279432 00000100:00100000:3.0:1713279462.579559:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1713279462.579563:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200106432:0@lo:400:kworker.0 00000100:00100000:0.0:1713279462.579571:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200106816:0@lo:400:kworker.0 00000100:00100000:2.0:1713279462.579574:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200106688:0@lo:400:kworker.0 00000100:00100000:1.0:1713279462.579578:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200106752:0@lo:400:kworker.0 00000100:00100000:2.0:1713279462.579585:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200106944:0@lo:400:kworker.0 00000100:00100000:0.0:1713279462.579588:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200107072:0@lo:400:kworker.0 00000100:00100000:1.0:1713279462.579590:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200107008:0@lo:400:kworker.0 00000100:00100000:2.0:1713279462.579595:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200107200:0@lo:400:kworker.0 00000100:00100000:3.0:1713279462.594609:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200107328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279462.594653:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279462.594691:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200107264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279462.594723:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107328 00000100:00100000:1.0:1713279462.594731:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107328 00000100:00100000:0.0:1713279462.594745:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279462.594794:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107264 00000100:00100000:1.0:1713279462.594797:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107264 00000100:00100000:1.0:1713279462.594813:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1713279462.594820:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200107328:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279462.594843:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00002000:00000024:1.0:1713279462.594852:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:3.0:1713279462.594852:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200107264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1713279462.594878:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279462.594920:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200107328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279462.594928:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1713279462.594937:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200107264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279462.594946:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1713279462.594965:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200107264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279462.595003:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200107328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279463.314605:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713279463.314626:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200107392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279463.314683:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279463.314723:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107392 00000100:00100000:0.0:1713279463.314730:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107392 00000100:00100000:0.0:1713279463.314768:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1713279463.314773:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200107392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279463.314798:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279463.314837:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200107392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279463.314841:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1713279463.314868:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200107392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279463.330633:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200107456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279463.330679:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279463.330717:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107456 00000100:00100000:0.0:1713279463.330723:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107456 00000100:00100000:0.0:1713279463.330757:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1713279463.330762:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200107456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279463.330776:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279463.330815:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200107456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279463.330820:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1713279463.330868:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200107456:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279463.520784:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279464.139283:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279464.139324:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279464.139373:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279464.139393:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279464.139457:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279464.139465:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333952 00000100:00100000:0.0:1713279464.139474:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279464.139475:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281333888 00000100:00100000:1.0:1713279464.139476:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334080 00000100:00100000:3.0:1713279464.139476:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333952 00000100:00100000:1.0:1713279464.139483:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334080 00000100:00100000:2.0:1713279464.139483:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281333888 00000100:00100000:0.0:1713279464.139498:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279464.139522:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279464.139522:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334016 00000100:00100000:3.0:1713279464.139524:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334016 00000100:00100000:2.0:1713279464.139528:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 445 00000100:00100000:2.0:1713279464.139535:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281333888:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279464.139537:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334144 00000100:00100000:1.0:1713279464.139541:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334144 00000100:00100000:3.0:1713279464.139546:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334272 00000100:00100000:3.0:1713279464.139548:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334272 00000100:00100000:3.0:1713279464.139560:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334208 00000100:00100000:3.0:1713279464.139562:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334208 00000100:00100000:1.0:1713279464.139564:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334400 00000100:00100000:1.0:1713279464.139567:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334400 00000100:00100000:0.0:1713279464.139571:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279464.139578:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 743 00000100:00100000:3.0:1713279464.139584:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281333952:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279464.139588:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334336 00000100:00100000:1.0:1713279464.139591:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334336 00000100:00100000:2.0:1713279464.139600:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281333888:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 64us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279464.139607:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 445 00000100:00100000:0.0:1713279464.139611:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 744 00000100:00100000:1.0:1713279464.139612:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 329 00000100:00100000:1.0:1713279464.139620:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281334080:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279464.139623:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281334016:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279464.139627:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281333952:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279464.139634:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 743 00000100:00100000:2.0:1713279464.139646:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 745 00000100:00100000:3.0:1713279464.139651:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 746 00000100:00100000:2.0:1713279464.139652:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281334272:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279464.139656:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281334208:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279464.139666:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281334080:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279464.139674:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281334016:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279464.139675:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 329 00000100:00100000:2.0:1713279464.139675:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281334272:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279464.139677:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281334208:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279464.139683:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 746 00000100:00100000:0.0:1713279464.139689:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 744 00000100:00100000:1.0:1713279464.139691:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 330 00000100:00100000:1.0:1713279464.139698:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281334144:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279464.139698:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 745 00000100:00100000:3.0:1713279464.139702:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 331 00000100:00100000:3.0:1713279464.139706:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281334400:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279464.139722:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 332 00000100:00100000:2.0:1713279464.139727:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281334336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279464.139730:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281334144:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279464.139739:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 330 00000100:00100000:3.0:1713279464.139739:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281334400:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279464.139746:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 331 00000100:00100000:2.0:1713279464.139747:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281334336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 18us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279464.139753:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 332 00000100:00080000:1.0:1713279464.139765:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279434 00000100:00080000:1.0:1713279464.139770:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279434 00000100:00080000:1.0:1713279464.139772:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279434 00000100:00080000:1.0:1713279464.139775:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279434 00000100:00080000:1.0:1713279464.139778:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279434 00010000:00010000:2.0:1713279464.522733:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279465.234874:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200107520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279465.234956:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279465.235054:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107520 00000100:00100000:3.0:1713279465.235066:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107520 00000100:00100000:3.0:1713279465.235129:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99083 00000100:00100000:3.0:1713279465.235137:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200107520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279465.235179:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279465.235243:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200107520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279465.235251:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99083 00000100:00100000:0.0:1713279465.235318:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200107520:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279465.524628:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279466.526804:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279466.914877:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200107584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279466.914956:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279466.915047:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107584 00000100:00100000:3.0:1713279466.915058:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107584 00000100:00100000:3.0:1713279466.915129:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99084 00000100:00100000:3.0:1713279466.915142:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200107584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1713279466.915188:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:3.0:1713279466.915275:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200107584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279466.915288:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99084 00000100:00100000:0.0:1713279466.915316:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200107584:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279467.528776:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279467.586719:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200107648:0@lo:400:kworker.0 00000100:00100000:3.0:1713279467.586720:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200107712:0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.586725:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200107840:0@lo:400:kworker.0 00000100:00100000:0.0:1713279467.586732:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200107776:0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.586817:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279467.586821:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279467.586830:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279467.586844:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107840 00000100:00100000:3.0:1713279467.586855:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107840 00000100:00100000:1.0:1713279467.586861:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200108096:0@lo:400:kworker.0 00000100:00100000:2.0:1713279467.586863:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200107904:0@lo:400:kworker.0 00000100:00100000:0.0:1713279467.586867:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200108032:0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.586885:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279467.586900:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200108352:0@lo:400:kworker.0 00000100:00100000:2.0:1713279467.586906:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279467.586906:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1713279467.586907:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279467.586914:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200107840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.586917:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279467.586932:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200108160:0@lo:400:kworker.0 00000100:00100000:0.0:1713279467.586934:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200108288:0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.586952:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108096 00000100:00100000:1.0:1713279467.586958:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108096 00000100:00100000:2.0:1713279467.586968:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279467.586973:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279467.587025:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200108416:0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.587028:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108352 00000100:00100000:1.0:1713279467.587032:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108352 00000100:00100000:3.0:1713279467.587034:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200107840:12345-0@lo:400:kworker.0 Request processed in 115us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279467.587047:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279467.587047:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1713279467.587058:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108160 00000100:00100000:1.0:1713279467.587061:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108160 00000100:00100000:0.0:1713279467.587068:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108416 00000100:00100000:3.0:1713279467.587070:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108032 00000100:00100000:3.0:1713279467.587075:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108032 00000100:00100000:0.0:1713279467.587076:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108416 00000100:00100000:1.0:1713279467.587078:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1713279467.587084:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200108096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279467.587085:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107648 00000100:00100000:2.0:1713279467.587091:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107648 00000100:00100000:3.0:1713279467.587102:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108288 00000100:00100000:3.0:1713279467.587107:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108288 00000100:00100000:0.0:1713279467.587114:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1713279467.587121:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1713279467.587123:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200108096:12345-0@lo:400:kworker.0 Request processed in 37us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279467.587125:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200108352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.587130:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1713279467.587130:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200107648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279467.587131:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:3.0:1713279467.587139:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200108032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.587145:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1713279467.587149:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200108160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.587192:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200108160:12345-0@lo:400:kworker.0 Request processed in 42us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279467.587196:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200107648:12345-0@lo:400:kworker.0 Request processed in 64us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279467.587197:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200108352:12345-0@lo:400:kworker.0 Request processed in 73us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279467.587198:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1713279467.587202:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200108032:12345-0@lo:400:kworker.0 Request processed in 62us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279467.587206:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1713279467.587208:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1713279467.587211:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200108416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279467.587213:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1713279467.587214:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1713279467.587230:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:1.0:1713279467.587232:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200108416:12345-0@lo:400:kworker.0 Request processed in 20us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279467.587235:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200108288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.587242:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:1.0:1713279467.587258:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279437 00000100:00080000:1.0:1713279467.587262:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279437 00000100:00080000:1.0:1713279467.587264:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279437 00000100:00100000:2.0:1713279467.587266:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107776 00000100:00100000:3.0:1713279467.587266:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200108288:12345-0@lo:400:kworker.0 Request processed in 31us (294us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279467.587267:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279437 00000100:00100000:2.0:1713279467.587273:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107776 00000100:00100000:3.0:1713279467.587273:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1713279467.587290:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200108032:0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.587295:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200107840:0@lo:400:kworker.0 00000100:00100000:2.0:1713279467.587302:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107904 00000100:00100000:3.0:1713279467.587302:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279467.587305:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107904 00000100:00100000:1.0:1713279467.587306:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200108096:0@lo:400:kworker.0 00000100:00100000:0.0:1713279467.587309:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200108288:0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.587316:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200108352:0@lo:400:kworker.0 00000100:00100000:3.0:1713279467.587318:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200107968:0@lo:400:kworker.0 00000100:00100000:2.0:1713279467.587321:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99085 00000100:00100000:2.0:1713279467.587327:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200107776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279467.587337:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279467.587347:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200108224:0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.587356:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99086 00000100:00100000:1.0:1713279467.587361:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200107904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279467.587363:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279467.587372:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200107776:12345-0@lo:400:kworker.0 Request processed in 44us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279467.587378:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99085 00000100:00100000:0.0:1713279467.587384:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200107776:0@lo:400:kworker.0 00000100:00100000:3.0:1713279467.587385:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107712 00000100:00100000:3.0:1713279467.587388:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107712 00000100:00100000:1.0:1713279467.587390:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200107904:12345-0@lo:400:kworker.0 Request processed in 28us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279467.587397:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99086 00000100:00100000:3.0:1713279467.587404:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200107968 00000100:00100000:2.0:1713279467.587406:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200107648:0@lo:400:kworker.0 00000100:00100000:3.0:1713279467.587406:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200107968 00000100:00080000:0.0:1713279467.587456:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279437 00000100:00100000:2.0:1713279467.587461:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200107904:0@lo:400:kworker.0 00000100:00100000:2.0:1713279467.587472:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200108160:0@lo:400:kworker.0 00000100:00100000:2.0:1713279467.587480:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200108416:0@lo:400:kworker.0 00000100:00100000:3.0:1713279467.587494:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1713279467.587499:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200107712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.587524:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108224 00000100:00100000:1.0:1713279467.587529:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108224 00000100:00100000:2.0:1713279467.587533:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1713279467.587534:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200107712:12345-0@lo:400:kworker.0 Request processed in 34us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279467.587541:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200107968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279467.587541:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:1.0:1713279467.587568:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:3.0:1713279467.587572:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200107712:0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.587574:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200108224:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1713279467.587589:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279437 00000100:00100000:2.0:1713279467.587595:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200107968:12345-0@lo:400:kworker.0 Request processed in 51us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279467.587597:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200107968:0@lo:400:kworker.0 00000100:00100000:2.0:1713279467.587606:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:1.0:1713279467.587608:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200108224:12345-0@lo:400:kworker.0 Request processed in 34us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279467.587614:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200108224:0@lo:400:kworker.0 00000100:00100000:1.0:1713279467.587615:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1713279467.602564:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713279467.602578:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200108480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279467.602617:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279467.602644:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713279467.602650:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108480 00000100:00100000:0.0:1713279467.602651:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800825a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200108544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279467.602658:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108480 00000100:00100000:0.0:1713279467.602668:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279467.602684:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108544 00000100:00100000:3.0:1713279467.602686:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108544 00000100:00100000:0.0:1713279467.602692:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1713279467.602700:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200108480:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279467.602718:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1713279467.602726:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200108544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1713279467.602728:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279467.602743:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279467.602775:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200108480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279467.602782:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1713279467.602800:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200108544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279467.602806:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200108480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279467.602808:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1713279467.602821:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800825a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200108544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279468.322744:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200108608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279468.322825:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279468.322939:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108608 00000100:00100000:3.0:1713279468.322952:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108608 00000100:00100000:3.0:1713279468.323082:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1713279468.323093:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200108608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1713279468.323148:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279468.323235:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200108608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279468.323248:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1713279468.323269:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200108608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279468.338598:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200108672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1713279468.338653:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279468.338721:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108672 00000100:00100000:3.0:1713279468.338730:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108672 00000100:00100000:3.0:1713279468.338785:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1713279468.338795:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200108672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1713279468.338819:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279468.338889:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200108672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279468.338901:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1713279468.338951:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200108672:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279468.530772:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279469.147370:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279469.147453:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334528 00000100:00100000:0.0:1713279469.147455:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279469.147462:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334528 00000100:00100000:0.0:1713279469.147477:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279469.147492:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279469.147502:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334592 00000100:00100000:3.0:1713279469.147504:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334592 00000100:00100000:0.0:1713279469.147512:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279469.147519:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 753 00000100:00100000:0.0:1713279469.147524:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279469.147525:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281334528:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279469.147526:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334464 00000100:00100000:2.0:1713279469.147532:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334464 00000100:00100000:0.0:1713279469.147536:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279469.147548:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279469.147569:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 447 00000100:00100000:0.0:1713279469.147577:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279469.147577:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281334464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279469.147582:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281334528:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 57us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279469.147588:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 753 00000100:00100000:1.0:1713279469.147592:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334656 00000100:00100000:3.0:1713279469.147598:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334848 00000100:00100000:1.0:1713279469.147599:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334656 00000100:00100000:3.0:1713279469.147600:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334848 00000100:00100000:3.0:1713279469.147610:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334784 00000100:00100000:3.0:1713279469.147612:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334784 00000100:00100000:2.0:1713279469.147614:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281334464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279469.147621:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 754 00000100:00100000:1.0:1713279469.147625:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334720 00000100:00100000:3.0:1713279469.147625:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281334592:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279469.147627:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334720 00000100:00100000:2.0:1713279469.147627:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 447 00000100:00100000:1.0:1713279469.147637:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334976 00000100:00100000:1.0:1713279469.147638:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334976 00000100:00100000:3.0:1713279469.147642:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281334592:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 16us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279469.147646:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 754 00000100:00100000:1.0:1713279469.147648:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281334912 00000100:00100000:1.0:1713279469.147649:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281334912 00000100:00100000:3.0:1713279469.147652:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 755 00000100:00100000:3.0:1713279469.147655:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281334848:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279469.147661:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 337 00000100:00100000:2.0:1713279469.147665:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 756 00000100:00100000:1.0:1713279469.147667:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281334656:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279469.147671:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281334784:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279469.147674:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281334848:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 18us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279469.147679:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 755 00000100:00100000:0.0:1713279469.147683:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 338 00000100:00100000:0.0:1713279469.147690:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281334720:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:3.0:1713279469.147690:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279439 00000100:00080000:3.0:1713279469.147693:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279439 00000100:00080000:3.0:1713279469.147695:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279439 00000100:00080000:3.0:1713279469.147696:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279439 00000100:00100000:1.0:1713279469.147698:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281334656:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (205us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279469.147698:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279439 00000100:00100000:2.0:1713279469.147701:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281334784:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279469.147704:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 337 00000100:00100000:2.0:1713279469.147709:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 756 00000100:00100000:1.0:1713279469.147716:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 339 00000100:00100000:0.0:1713279469.147718:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281334720:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279469.147719:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281334976:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279469.147724:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 338 00000100:00100000:0.0:1713279469.147735:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 340 00000100:00100000:0.0:1713279469.147738:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281334912:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279469.147738:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281334976:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 18us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279469.147743:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 339 00000100:00100000:0.0:1713279469.147754:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281334912:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 14us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279469.147758:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 340 00010000:00010000:2.0:1713279469.532714:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279470.242709:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713279470.242740:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200108736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1713279470.242824:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279470.243007:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108736 00000100:00100000:2.0:1713279470.243020:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108736 00000100:00100000:2.0:1713279470.243082:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99087 00000100:00100000:2.0:1713279470.243090:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200108736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279470.243129:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279470.243186:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200108736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279470.243194:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99087 00000100:00100000:1.0:1713279470.243222:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200108736:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279470.534566:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279471.536721:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279471.922884:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713279471.922923:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200108800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279471.923068:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279471.923141:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108800 00000100:00100000:2.0:1713279471.923154:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108800 00000100:00100000:2.0:1713279471.923215:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99088 00000100:00100000:2.0:1713279471.923224:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200108800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279471.923263:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279471.923368:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200108800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279471.923381:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99088 00000100:00100000:0.0:1713279471.923448:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200108800:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279472.538816:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279472.594758:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200109056:0@lo:400:kworker.0 00000100:00100000:3.0:1713279472.594791:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200108992:0@lo:400:kworker.0 00000100:00100000:1.0:1713279472.594806:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200108928:0@lo:400:kworker.0 00000100:00100000:0.0:1713279472.594815:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200108864:0@lo:400:kworker.0 00000100:00100000:3.0:1713279472.594854:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279472.594856:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279472.594894:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279472.594894:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200109248:0@lo:400:kworker.0 00000100:00100000:2.0:1713279472.594919:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200109312:0@lo:400:kworker.0 00000100:00100000:1.0:1713279472.594927:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200109184:0@lo:400:kworker.0 00000100:00100000:0.0:1713279472.594937:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279472.594971:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279472.595015:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200109504:0@lo:400:kworker.0 00000100:00100000:1.0:1713279472.595021:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279472.595023:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200109120:0@lo:400:kworker.0 00000100:00100000:2.0:1713279472.595025:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279472.595038:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200109440:0@lo:400:kworker.0 00000100:00100000:3.0:1713279472.595038:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279472.595047:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200109568:0@lo:400:kworker.0 00000100:00100000:0.0:1713279472.595058:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279472.595062:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279472.595068:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279472.595078:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200109376:0@lo:400:kworker.0 00000100:00100000:3.0:1713279472.595079:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109056 00000100:00100000:3.0:1713279472.595088:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109056 00000100:00100000:1.0:1713279472.595096:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108928 00000100:00100000:2.0:1713279472.595100:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109248 00000100:00100000:1.0:1713279472.595101:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108928 00000100:00100000:0.0:1713279472.595103:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279472.595106:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109248 00000100:00100000:0.0:1713279472.595121:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200109632:0@lo:400:kworker.0 00000100:00100000:3.0:1713279472.595123:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109184 00000100:00100000:1.0:1713279472.595126:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109504 00000100:00100000:3.0:1713279472.595126:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109184 00000100:00100000:1.0:1713279472.595129:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109504 00000100:00100000:0.0:1713279472.595137:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279472.595141:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109440 00000100:00100000:2.0:1713279472.595144:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109440 00000100:00100000:3.0:1713279472.595146:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1713279472.595153:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:3.0:1713279472.595154:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200109056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279472.595160:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200108928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279472.595172:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:2.0:1713279472.595181:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200109248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279472.595186:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108864 00000100:00100000:0.0:1713279472.595196:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108864 00000100:00100000:1.0:1713279472.595206:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200108928:12345-0@lo:400:kworker.0 Request processed in 45us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279472.595208:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200109056:12345-0@lo:400:kworker.0 Request processed in 55us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279472.595214:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:3.0:1713279472.595219:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1713279472.595231:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1713279472.595238:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200109184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279472.595238:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:2.0:1713279472.595242:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200109248:12345-0@lo:400:kworker.0 Request processed in 59us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279472.595243:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1713279472.595244:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200109504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279472.595250:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200108864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279472.595255:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:1.0:1713279472.595260:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200109184:12345-0@lo:400:kworker.0 Request processed in 23us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279472.595266:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1713279472.595269:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200109504:12345-0@lo:400:kworker.0 Request processed in 25us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279472.595275:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:1.0:1713279472.595279:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:1.0:1713279472.595284:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200109440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279472.595295:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109312 00000100:00100000:3.0:1713279472.595299:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109312 00000100:00100000:0.0:1713279472.595302:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200108864:12345-0@lo:400:kworker.0 Request processed in 51us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279472.595307:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200109440:12345-0@lo:400:kworker.0 Request processed in 22us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279472.595307:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109568 00000100:00100000:0.0:1713279472.595310:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1713279472.595312:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109568 00000100:00100000:1.0:1713279472.595314:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1713279472.595319:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109376 00000100:00100000:3.0:1713279472.595322:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109376 00000100:00100000:2.0:1713279472.595341:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109632 00000100:00100000:3.0:1713279472.595344:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1713279472.595345:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109632 00000100:00100000:3.0:1713279472.595350:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200109312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279472.595352:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1713279472.595358:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200109568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279472.595363:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200108928:0@lo:400:kworker.0 00000100:00100000:2.0:1713279472.595372:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1713279472.595373:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200109184:0@lo:400:kworker.0 00000100:00100000:3.0:1713279472.595377:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200109312:12345-0@lo:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279472.595381:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200109376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279472.595382:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200109440:0@lo:400:kworker.0 00000100:00100000:3.0:1713279472.595384:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1713279472.595392:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200109568:12345-0@lo:400:kworker.0 Request processed in 33us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279472.595394:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1713279472.595402:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1713279472.595402:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200109632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279472.595467:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200108992 00000100:00100000:1.0:1713279472.595472:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200108992 00000100:00100000:3.0:1713279472.595482:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200109632:12345-0@lo:400:kworker.0 Request processed in 81us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279472.595489:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200108864:0@lo:400:kworker.0 00000100:00100000:3.0:1713279472.595492:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1713279472.595496:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200109376:12345-0@lo:400:kworker.0 Request processed in 111us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279472.595504:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109120 00000100:00100000:2.0:1713279472.595507:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1713279472.595508:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200109376:0@lo:400:kworker.0 00000100:00100000:1.0:1713279472.595509:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109120 00000100:00080000:3.0:1713279472.595517:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279442 00000100:00100000:0.0:1713279472.595521:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200109632:0@lo:400:kworker.0 00000100:00080000:3.0:1713279472.595521:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279442 00000100:00080000:3.0:1713279472.595523:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279442 00000100:00080000:3.0:1713279472.595526:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279442 00000100:00080000:3.0:1713279472.595528:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279442 00000100:00100000:1.0:1713279472.595533:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99089 00000100:00100000:1.0:1713279472.595541:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200108992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279472.595554:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200109248:0@lo:400:kworker.0 00000100:00100000:2.0:1713279472.595557:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99090 00000100:00100000:3.0:1713279472.595565:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200109504:0@lo:400:kworker.0 00000100:00100000:2.0:1713279472.595567:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200109120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279472.595607:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200108992:12345-0@lo:400:kworker.0 Request processed in 64us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279472.595614:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200108992:0@lo:400:kworker.0 00000100:00100000:1.0:1713279472.595617:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99089 00000100:00100000:2.0:1713279472.595629:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200109120:12345-0@lo:400:kworker.0 Request processed in 62us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279472.595640:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99090 00000100:00100000:0.0:1713279472.595641:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200109120:0@lo:400:kworker.0 00000100:00100000:2.0:1713279472.595689:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200109312:0@lo:400:kworker.0 00000100:00100000:2.0:1713279472.595707:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200109568:0@lo:400:kworker.0 00000100:00100000:2.0:1713279472.595721:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200109056:0@lo:400:kworker.0 00000100:00100000:2.0:1713279472.610627:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200109696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279472.610663:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200109760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279472.610676:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279472.610727:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279472.610776:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109696 00000100:00100000:0.0:1713279472.610784:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109696 00000100:00100000:1.0:1713279472.610812:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109760 00000100:00100000:1.0:1713279472.610821:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109760 00000100:00100000:0.0:1713279472.610835:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1713279472.610844:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200109696:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279472.610860:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1713279472.610870:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200109760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1713279472.610878:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:1.0:1713279472.610898:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279472.610982:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200109696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279472.610991:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1713279472.611002:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200109696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279472.611020:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200109760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279472.611032:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1713279472.611070:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200109760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279473.330694:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200109824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279473.330752:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279473.330783:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109824 00000100:00100000:1.0:1713279473.330790:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109824 00000100:00100000:1.0:1713279473.330820:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1713279473.330824:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200109824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1713279473.330847:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279473.330878:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200109824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279473.330882:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1713279473.330896:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200109824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279473.346616:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713279473.346628:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200109888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279473.346655:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279473.346690:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109888 00000100:00100000:1.0:1713279473.346695:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109888 00000100:00100000:1.0:1713279473.346714:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1713279473.346718:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200109888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1713279473.346730:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279473.346768:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200109888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279473.346772:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1713279473.346791:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200109888:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279473.540683:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279474.155189:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279474.155228:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279474.155254:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279474.155280:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279474.155289:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335040 00000100:00100000:0.0:1713279474.155296:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279474.155296:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335104 00000100:00100000:1.0:1713279474.155297:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335040 00000100:00100000:2.0:1713279474.155301:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335104 00000100:00100000:0.0:1713279474.155314:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279474.155315:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335232 00000100:00100000:3.0:1713279474.155321:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335232 00000100:00100000:0.0:1713279474.155329:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279474.155335:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335168 00000100:00100000:1.0:1713279474.155336:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 449 00000100:00100000:2.0:1713279474.155337:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335168 00000100:00100000:1.0:1713279474.155341:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281335040:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279474.155344:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335296 00000100:00100000:0.0:1713279474.155346:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279474.155347:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335360 00000100:00100000:3.0:1713279474.155347:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335296 00000100:00100000:2.0:1713279474.155348:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335360 00000100:00100000:2.0:1713279474.155357:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335424 00000100:00100000:2.0:1713279474.155359:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335424 00000100:00100000:3.0:1713279474.155360:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335488 00000100:00100000:3.0:1713279474.155362:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335488 00000100:00100000:2.0:1713279474.155369:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 763 00000100:00100000:2.0:1713279474.155373:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281335104:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279474.155377:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 345 00000100:00100000:3.0:1713279474.155382:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281335232:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279474.155385:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279474.155390:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281335040:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 49us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279474.155395:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 449 00000100:00100000:2.0:1713279474.155403:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281335104:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279474.155407:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 763 00000100:00100000:2.0:1713279474.155458:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 764 00000100:00100000:3.0:1713279474.155459:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281335232:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279474.155461:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281335168:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279474.155466:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 345 00000100:00100000:1.0:1713279474.155475:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 765 00000100:00100000:3.0:1713279474.155476:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335552 00000100:00100000:2.0:1713279474.155477:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281335168:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 15us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279474.155478:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335552 00000100:00100000:1.0:1713279474.155481:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281335360:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279474.155482:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 764 00000100:00100000:2.0:1713279474.155488:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 766 00000100:00100000:2.0:1713279474.155490:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281335424:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279474.155493:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 346 00000100:00100000:3.0:1713279474.155497:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281335296:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279474.155501:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281335424:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 9us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279474.155504:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 766 00000100:00100000:1.0:1713279474.155510:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281335360:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279474.155515:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 765 00000100:00100000:2.0:1713279474.155516:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 347 00000100:00100000:2.0:1713279474.155519:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281335488:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279474.155523:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281335296:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279474.155530:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 346 00000100:00100000:2.0:1713279474.155533:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281335488:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 13us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279474.155537:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 347 00000100:00100000:3.0:1713279474.155540:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 348 00000100:00100000:3.0:1713279474.155544:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281335552:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:2.0:1713279474.155559:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279444 00000100:00080000:2.0:1713279474.155562:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279444 00000100:00080000:2.0:1713279474.155563:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279444 00000100:00080000:2.0:1713279474.155564:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279444 00000100:00080000:2.0:1713279474.155565:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279444 00000100:00100000:3.0:1713279474.155569:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281335552:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279474.155575:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 348 00010000:00010000:2.0:1713279474.542851:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279475.250803:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713279475.250832:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200109952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279475.250909:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279475.251004:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200109952 00000100:00100000:2.0:1713279475.251026:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200109952 00000100:00100000:2.0:1713279475.251113:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99091 00000100:00100000:2.0:1713279475.251124:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200109952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279475.251179:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279475.251286:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200109952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 163us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279475.251295:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99091 00000100:00100000:3.0:1713279475.251478:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200109952:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279475.544783:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279476.546744:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279476.930874:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713279476.930905:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200110016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279476.931017:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279476.931076:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110016 00000100:00100000:2.0:1713279476.931089:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110016 00000100:00100000:2.0:1713279476.931149:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99092 00000100:00100000:2.0:1713279476.931159:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200110016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279476.931202:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279476.931275:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200110016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279476.931284:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99092 00000100:00100000:0.0:1713279476.931339:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200110016:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279477.548815:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279477.602674:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200110080:0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.602674:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200110272:0@lo:400:kworker.0 00000100:00100000:1.0:1713279477.602735:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279477.602735:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279477.602737:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200110208:0@lo:400:kworker.0 00000100:00100000:2.0:1713279477.602737:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200110144:0@lo:400:kworker.0 00000100:00100000:1.0:1713279477.602754:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200110336:0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.602755:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200110528:0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.602771:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279477.602781:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200110784:0@lo:400:kworker.0 00000100:00100000:1.0:1713279477.602783:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279477.602807:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200110592:0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.602809:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279477.602826:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279477.602827:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279477.602829:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279477.602838:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200110848:0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.602842:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110528 00000100:00100000:3.0:1713279477.602847:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110528 00000100:00100000:3.0:1713279477.602873:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110784 00000100:00100000:3.0:1713279477.602874:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110784 00000100:00100000:2.0:1713279477.602880:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200110400:0@lo:400:kworker.0 00000100:00100000:0.0:1713279477.602883:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200110464:0@lo:400:kworker.0 00000100:00100000:1.0:1713279477.602883:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279477.602883:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110592 00000100:00100000:3.0:1713279477.602884:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110592 00000100:00100000:3.0:1713279477.602892:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110848 00000100:00100000:3.0:1713279477.602893:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110848 00000100:00100000:3.0:1713279477.602904:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1713279477.602907:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279477.602926:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1713279477.602932:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200110784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.602932:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200110528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279477.602952:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200110656:0@lo:400:kworker.0 00000100:00100000:0.0:1713279477.602955:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110080 00000100:00100000:0.0:1713279477.602963:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110080 00000100:00100000:3.0:1713279477.602971:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200110528:12345-0@lo:400:kworker.0 Request processed in 62us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279477.602973:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200110784:12345-0@lo:400:kworker.0 Request processed in 41us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279477.602975:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1713279477.602977:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279477.602979:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1713279477.602985:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1713279477.602987:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200110592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279477.602992:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1713279477.602996:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200110848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.603004:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200110592:12345-0@lo:400:kworker.0 Request processed in 16us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279477.603007:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1713279477.603011:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00080000:2.0:1713279477.603011:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279447 00000100:00100000:1.0:1713279477.603013:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200110848:12345-0@lo:400:kworker.0 Request processed in 16us (130us total) trans 0 rc 0/0 00000100:00080000:2.0:1713279477.603016:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279447 00000100:00100000:1.0:1713279477.603018:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1713279477.603019:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200110080:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1713279477.603019:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279447 00000100:00100000:3.0:1713279477.603024:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110336 00000100:00100000:3.0:1713279477.603025:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110336 00000100:00100000:1.0:1713279477.603033:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110272 00000100:00100000:1.0:1713279477.603036:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110272 00000100:00100000:3.0:1713279477.603038:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110208 00000100:00100000:2.0:1713279477.603040:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110144 00000100:00100000:3.0:1713279477.603040:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110208 00000100:00100000:2.0:1713279477.603045:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110144 00000100:00100000:3.0:1713279477.603048:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99093 00000100:00100000:3.0:1713279477.603051:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200110336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279477.603057:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110400 00000100:00100000:1.0:1713279477.603059:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110400 00000100:00100000:0.0:1713279477.603070:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200110080:12345-0@lo:400:kworker.0 Request processed in 49us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279477.603073:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200110336:12345-0@lo:400:kworker.0 Request processed in 22us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279477.603074:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110656 00000100:00100000:2.0:1713279477.603076:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110656 00000100:00100000:0.0:1713279477.603078:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1713279477.603078:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99093 00000100:00100000:1.0:1713279477.603082:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:3.0:1713279477.603083:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99094 00000100:00100000:1.0:1713279477.603086:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200110272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.603086:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200110208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279477.603095:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:3.0:1713279477.603099:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200110208:12345-0@lo:400:kworker.0 Request processed in 12us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279477.603101:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200110144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.603102:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99094 00000100:00100000:1.0:1713279477.603108:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200110272:12345-0@lo:400:kworker.0 Request processed in 22us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279477.603114:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:0.0:1713279477.603119:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1713279477.603125:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200110400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.603126:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200110272:0@lo:400:kworker.0 00000100:00100000:1.0:1713279477.603127:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1713279477.603131:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200110656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.603132:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200110528:0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.603138:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200110784:0@lo:400:kworker.0 00000100:00100000:2.0:1713279477.603143:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200110144:12345-0@lo:400:kworker.0 Request processed in 42us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279477.603156:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00100000:0.0:1713279477.603158:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200110400:12345-0@lo:400:kworker.0 Request processed in 33us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279477.603160:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200110656:12345-0@lo:400:kworker.0 Request processed in 27us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279477.603165:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:1.0:1713279477.603170:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00080000:2.0:1713279477.603179:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279447 00000100:00100000:1.0:1713279477.603203:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200110080:0@lo:400:kworker.0 00000100:00100000:0.0:1713279477.603206:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279477.603213:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200110336:0@lo:400:kworker.0 00000100:00100000:1.0:1713279477.603221:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200110592:0@lo:400:kworker.0 00000100:00100000:2.0:1713279477.603222:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200110144:0@lo:400:kworker.0 00000100:00100000:0.0:1713279477.603224:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200110720:0@lo:400:kworker.0 00000100:00100000:1.0:1713279477.603228:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200110848:0@lo:400:kworker.0 00000100:00100000:2.0:1713279477.603241:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200110400:0@lo:400:kworker.0 00000100:00100000:0.0:1713279477.603245:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279477.603259:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200110656:0@lo:400:kworker.0 00000100:00100000:1.0:1713279477.603270:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110464 00000100:00100000:1.0:1713279477.603273:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110464 00000100:00100000:3.0:1713279477.603288:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110720 00000100:00100000:3.0:1713279477.603291:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110720 00000100:00080000:2.0:1713279477.603293:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279447 00000100:00100000:1.0:1713279477.603294:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1713279477.603295:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200110208:0@lo:400:kworker.0 00000100:00100000:1.0:1713279477.603298:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200110464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.603305:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:3.0:1713279477.603308:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200110720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.603329:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200110720:12345-0@lo:400:kworker.0 Request processed in 20us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279477.603330:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200110464:12345-0@lo:400:kworker.0 Request processed in 31us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279477.603332:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1713279477.603336:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1713279477.603337:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200110464:0@lo:400:kworker.0 00000100:00100000:0.0:1713279477.603348:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200110720:0@lo:400:kworker.0 00000100:00100000:3.0:1713279477.618612:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200110912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279477.618626:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200110976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279477.618664:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279477.618683:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110976 00000100:00100000:1.0:1713279477.618690:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110976 00000100:00100000:1.0:1713279477.618722:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1713279477.618723:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279477.618727:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200110976:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279477.618746:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200110912 00000100:00100000:0.0:1713279477.618749:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200110912 00002000:00000024:1.0:1713279477.618752:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279477.618765:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1713279477.618768:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200110912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1713279477.618778:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279477.618784:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200110976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279477.618788:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1713279477.618799:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200110912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279477.618806:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1713279477.618833:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200110976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279477.618840:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200110912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279478.338706:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200111040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279478.338800:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279478.338875:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111040 00000100:00100000:0.0:1713279478.338885:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111040 00000100:00100000:0.0:1713279478.338995:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1713279478.339004:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200111040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279478.339039:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279478.339104:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200111040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279478.339113:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1713279478.339171:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200111040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279478.354639:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713279478.354659:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200111104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1713279478.354704:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279478.354763:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111104 00000100:00100000:0.0:1713279478.354771:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111104 00000100:00100000:0.0:1713279478.354809:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1713279478.354817:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200111104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279478.354833:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279478.354885:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200111104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279478.354893:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1713279478.354967:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200111104:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279478.550720:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279479.163552:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279479.163624:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279479.163672:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279479.163710:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335616 00000100:00100000:0.0:1713279479.163722:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279479.163724:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335616 00000100:00100000:0.0:1713279479.163753:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279479.163763:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335680 00000100:00100000:3.0:1713279479.163770:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335744 00000100:00100000:1.0:1713279479.163773:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335680 00000100:00100000:3.0:1713279479.163781:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335744 00000100:00100000:0.0:1713279479.163784:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279479.163786:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 451 00000100:00100000:2.0:1713279479.163796:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281335616:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279479.163814:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279479.163815:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335936 00000100:00100000:1.0:1713279479.163818:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335936 00000100:00100000:3.0:1713279479.163827:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336000 00000100:00100000:3.0:1713279479.163832:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336000 00000100:00100000:1.0:1713279479.163839:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 773 00000100:00100000:0.0:1713279479.163841:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279479.163848:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281335680:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279479.163863:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 774 00000100:00100000:2.0:1713279479.163870:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281335616:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 76us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279479.163874:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281335744:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279479.163879:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 451 00000100:00100000:1.0:1713279479.163933:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281335680:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 85us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279479.163941:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 773 00000100:00100000:0.0:1713279479.163942:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00080000:2.0:1713279479.163956:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279449 00000100:00100000:1.0:1713279479.163959:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 775 00000100:00080000:2.0:1713279479.163961:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279449 00000100:00080000:2.0:1713279479.163963:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279449 00000100:00100000:1.0:1713279479.163964:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281335936:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279479.163979:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 776 00000100:00100000:3.0:1713279479.163979:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281335744:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 103us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279479.163985:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281336000:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279479.163991:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281335936:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279479.163993:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 774 00000100:00100000:1.0:1713279479.163999:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 775 00000100:00100000:1.0:1713279479.164021:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335808 00000100:00100000:1.0:1713279479.164025:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335808 00000100:00100000:2.0:1713279479.164031:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281336000:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279479.164042:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 776 00000100:00100000:1.0:1713279479.164049:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281335872 00000100:00100000:1.0:1713279479.164052:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281335872 00000100:00100000:1.0:1713279479.164065:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336064 00000100:00100000:1.0:1713279479.164067:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336064 00000100:00100000:1.0:1713279479.164080:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336128 00000100:00100000:1.0:1713279479.164082:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336128 00000100:00100000:2.0:1713279479.164087:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 353 00000100:00100000:2.0:1713279479.164093:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281335808:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279479.164096:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 354 00000100:00100000:3.0:1713279479.164107:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281335872:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279479.164112:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 355 00000100:00100000:1.0:1713279479.164118:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281336064:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279479.164118:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281335808:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279479.164126:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 353 00000100:00100000:2.0:1713279479.164139:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 356 00000100:00100000:2.0:1713279479.164144:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281336128:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279479.164145:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281336064:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279479.164152:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 355 00000100:00100000:3.0:1713279479.164160:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281335872:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 52us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279479.164166:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281336128:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (228us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279479.164172:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279449 00000100:00100000:3.0:1713279479.164172:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 354 00000100:00080000:1.0:1713279479.164176:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279449 00000100:00100000:2.0:1713279479.164183:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 356 00010000:00010000:2.0:1713279479.552722:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279480.258762:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200111168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279480.258848:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279480.258950:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111168 00000100:00100000:0.0:1713279480.258960:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111168 00000100:00100000:0.0:1713279480.259003:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99095 00000100:00100000:0.0:1713279480.259011:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200111168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1713279480.259049:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:0.0:1713279480.259117:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200111168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279480.259125:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99095 00000100:00100000:3.0:1713279480.259165:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200111168:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279480.554634:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279481.556736:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279481.938714:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713279481.938747:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200111232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1713279481.938836:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279481.938925:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111232 00000100:00100000:0.0:1713279481.938935:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111232 00000100:00100000:0.0:1713279481.938988:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99096 00000100:00100000:0.0:1713279481.938995:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200111232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713279481.939030:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:0.0:1713279481.939097:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200111232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279481.939105:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99096 00000100:00100000:3.0:1713279481.939158:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200111232:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279482.558720:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279482.610765:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200111488:0@lo:400:kworker.0 00000100:00100000:2.0:1713279482.610765:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200111360:0@lo:400:kworker.0 00000100:00100000:3.0:1713279482.610768:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200111424:0@lo:400:kworker.0 00000100:00100000:1.0:1713279482.610783:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200111296:0@lo:400:kworker.0 00000100:00100000:3.0:1713279482.610868:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279482.610870:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279482.610917:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279482.610924:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111424 00000100:00100000:3.0:1713279482.610928:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200111680:0@lo:400:kworker.0 00000100:00100000:2.0:1713279482.610932:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200111616:0@lo:400:kworker.0 00000100:00100000:0.0:1713279482.610935:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111424 00000100:00100000:1.0:1713279482.610948:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200111552:0@lo:400:kworker.0 00000100:00100000:3.0:1713279482.610952:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279482.610974:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200111936:0@lo:400:kworker.0 00000100:00100000:2.0:1713279482.610976:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111360 00000100:00100000:2.0:1713279482.610983:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111360 00000100:00100000:3.0:1713279482.610992:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279482.610995:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99097 00000100:00100000:1.0:1713279482.610996:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279482.611006:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200111424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279482.611019:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200111808:0@lo:400:kworker.0 00000100:00100000:2.0:1713279482.611025:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111680 00000100:00100000:3.0:1713279482.611028:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111936 00000100:00100000:2.0:1713279482.611029:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111680 00000100:00100000:3.0:1713279482.611033:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111936 00000100:00100000:1.0:1713279482.611051:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279482.611065:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:3.0:1713279482.611072:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:2.0:1713279482.611075:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200111360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279482.611076:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200112064:0@lo:400:kworker.0 00000100:00100000:3.0:1713279482.611079:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200111680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279482.611089:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200111424:12345-0@lo:400:kworker.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279482.611101:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99097 00000100:00100000:1.0:1713279482.611106:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279482.611117:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200111680:12345-0@lo:400:kworker.0 Request processed in 37us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279482.611122:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111552 00000100:00100000:3.0:1713279482.611124:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1713279482.611128:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111552 00000100:00100000:3.0:1713279482.611141:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:2.0:1713279482.611143:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200111360:12345-0@lo:400:kworker.0 Request processed in 67us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279482.611145:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200111936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279482.611150:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99098 00000100:00100000:0.0:1713279482.611155:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200111552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279482.611156:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1713279482.611159:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111296 00000100:00100000:1.0:1713279482.611167:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111296 00000100:00100000:3.0:1713279482.611167:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200111936:12345-0@lo:400:kworker.0 Request processed in 20us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279482.611173:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:2.0:1713279482.611197:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279482.611198:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200111552:12345-0@lo:400:kworker.0 Request processed in 40us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279482.611203:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111808 00000100:00100000:0.0:1713279482.611204:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99098 00000100:00100000:3.0:1713279482.611206:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111808 00000100:00100000:1.0:1713279482.611212:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1713279482.611221:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200111296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279482.611222:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200111872:0@lo:400:kworker.0 00000100:00100000:0.0:1713279482.611226:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279482.611226:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112064 00000100:00100000:3.0:1713279482.611229:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112064 00000100:00100000:3.0:1713279482.611245:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1713279482.611246:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200111744:0@lo:400:kworker.0 00000100:00100000:3.0:1713279482.611250:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200111808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279482.611258:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279482.611272:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279482.611274:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200111296:12345-0@lo:400:kworker.0 Request processed in 53us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279482.611281:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200111808:12345-0@lo:400:kworker.0 Request processed in 31us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279482.611282:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1713279482.611285:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200112000:0@lo:400:kworker.0 00000100:00100000:3.0:1713279482.611292:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1713279482.611300:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279482.611300:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111744 00000100:00100000:3.0:1713279482.611302:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111744 00000100:00100000:2.0:1713279482.611307:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200111360:0@lo:400:kworker.0 00000100:00080000:1.0:1713279482.611315:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279452 00000100:00100000:3.0:1713279482.611315:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112000 00000100:00100000:3.0:1713279482.611318:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112000 00000100:00080000:1.0:1713279482.611319:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279452 00000100:00080000:1.0:1713279482.611322:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279452 00000100:00080000:1.0:1713279482.611324:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279452 00000100:00080000:1.0:1713279482.611326:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279452 00000100:00100000:0.0:1713279482.611328:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1713279482.611333:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1713279482.611334:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200112064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279482.611338:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200111744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279482.611339:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1713279482.611344:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200112000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279482.611349:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111616 00000100:00100000:2.0:1713279482.611354:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111616 00000100:00100000:0.0:1713279482.611369:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200112064:12345-0@lo:400:kworker.0 Request processed in 34us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279482.611372:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200111744:12345-0@lo:400:kworker.0 Request processed in 33us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279482.611375:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1713279482.611378:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200112000:12345-0@lo:400:kworker.0 Request processed in 34us (77us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279482.611379:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1713279482.611385:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1713279482.611387:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111488 00000100:00100000:2.0:1713279482.611391:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111488 00000100:00100000:3.0:1713279482.611401:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200111872 00000100:00100000:3.0:1713279482.611405:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200111872 00000100:00100000:2.0:1713279482.611412:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:0.0:1713279482.611443:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200111424:0@lo:400:kworker.0 00000100:00100000:1.0:1713279482.611448:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200111296:0@lo:400:kworker.0 00000100:00100000:0.0:1713279482.611458:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200111680:0@lo:400:kworker.0 00000100:00100000:1.0:1713279482.611461:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200111552:0@lo:400:kworker.0 00000100:00100000:2.0:1713279482.611467:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200111616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279482.611468:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200111936:0@lo:400:kworker.0 00000100:00100000:1.0:1713279482.611472:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200111808:0@lo:400:kworker.0 00000100:00100000:3.0:1713279482.611476:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:3.0:1713279482.611481:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200111488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279482.611482:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200112064:0@lo:400:kworker.0 00000100:00100000:0.0:1713279482.611500:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200111744:0@lo:400:kworker.0 00000100:00100000:0.0:1713279482.611510:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200112000:0@lo:400:kworker.0 00000100:00100000:1.0:1713279482.611516:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1713279482.611520:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200111488:12345-0@lo:400:kworker.0 Request processed in 38us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279482.611522:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200111872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279482.611526:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:0.0:1713279482.611528:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200111488:0@lo:400:kworker.0 00000100:00100000:2.0:1713279482.611532:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200111616:12345-0@lo:400:kworker.0 Request processed in 65us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279482.611544:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:1.0:1713279482.611572:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200111872:12345-0@lo:400:kworker.0 Request processed in 49us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279482.611578:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00080000:2.0:1713279482.611584:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279452 00000100:00100000:2.0:1713279482.611613:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200111616:0@lo:400:kworker.0 00000100:00100000:2.0:1713279482.611638:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200111872:0@lo:400:kworker.0 00000100:00100000:3.0:1713279482.626587:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095a69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200112128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279482.626615:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200112192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279482.626631:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279482.626663:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279482.626690:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112128 00000100:00100000:0.0:1713279482.626697:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112128 00000100:00100000:3.0:1713279482.626697:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112192 00000100:00100000:3.0:1713279482.626703:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112192 00000100:00100000:0.0:1713279482.626738:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1713279482.626745:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200112128:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279482.626748:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1713279482.626755:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200112192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1713279482.626773:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279482.626775:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279482.626823:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200112128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279482.626830:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1713279482.626832:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200112192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279482.626850:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1713279482.626853:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095a69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200112128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279482.626924:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200112192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279483.346667:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200112256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279483.346749:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279483.346814:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112256 00000100:00100000:3.0:1713279483.346824:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112256 00000100:00100000:3.0:1713279483.346912:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1713279483.346920:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200112256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1713279483.346954:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279483.347017:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200112256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279483.347025:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1713279483.347053:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200112256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279483.362563:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200112320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1713279483.362612:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279483.362660:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112320 00000100:00100000:3.0:1713279483.362665:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112320 00000100:00100000:3.0:1713279483.362696:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1713279483.362705:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200112320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1713279483.362723:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279483.362782:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200112320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279483.362792:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1713279483.362835:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200112320:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279483.560854:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279484.171299:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279484.171362:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279484.171395:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336256 00000100:00100000:0.0:1713279484.171397:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279484.171405:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336256 00000100:00100000:3.0:1713279484.171462:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336192 00000100:00100000:1.0:1713279484.171466:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336384 00000100:00100000:3.0:1713279484.171468:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336192 00000100:00100000:1.0:1713279484.171471:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336384 00000100:00100000:0.0:1713279484.171483:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279484.171494:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336320 00000100:00100000:2.0:1713279484.171497:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336320 00000100:00100000:1.0:1713279484.171498:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 361 00000100:00100000:3.0:1713279484.171498:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 453 00000100:00100000:1.0:1713279484.171504:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281336384:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279484.171504:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281336192:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279484.171505:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279484.171518:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336512 00000100:00100000:2.0:1713279484.171521:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336512 00000100:00100000:0.0:1713279484.171529:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279484.171538:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 783 00000100:00100000:2.0:1713279484.171544:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281336256:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279484.171560:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281336384:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 57us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279484.171563:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281336192:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 60us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279484.171565:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 361 00000100:00100000:3.0:1713279484.171568:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 453 00000100:00100000:0.0:1713279484.171571:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279484.171574:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281336256:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279484.171579:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 783 00000100:00100000:1.0:1713279484.171583:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336448 00000100:00100000:1.0:1713279484.171585:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336448 00000100:00100000:2.0:1713279484.171591:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784 00000100:00100000:2.0:1713279484.171595:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281336320:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279484.171595:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785 00000100:00100000:1.0:1713279484.171597:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336640 00000100:00100000:1.0:1713279484.171598:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336640 00000100:00100000:3.0:1713279484.171598:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281336512:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279484.171606:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 362 00000100:00100000:1.0:1713279484.171609:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281336448:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279484.171614:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281336320:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 18us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279484.171614:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281336512:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 15us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279484.171617:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785 00000100:00100000:2.0:1713279484.171620:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784 00000100:00100000:1.0:1713279484.171625:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281336448:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 15us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279484.171629:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 362 00000100:00080000:2.0:1713279484.171631:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279454 00000100:00100000:0.0:1713279484.171633:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279484.171634:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 363 00000100:00080000:2.0:1713279484.171634:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279454 00000100:00100000:1.0:1713279484.171636:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281336640:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:2.0:1713279484.171636:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279454 00000100:00080000:2.0:1713279484.171637:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279454 00000100:00080000:2.0:1713279484.171639:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279454 00000100:00100000:2.0:1713279484.171647:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336576 00000100:00100000:1.0:1713279484.171649:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281336640:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 12us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279484.171650:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336576 00000100:00100000:1.0:1713279484.171652:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 363 00000100:00100000:1.0:1713279484.171666:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 786 00000100:00100000:1.0:1713279484.171669:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281336576:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:2.0:1713279484.171673:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279454 00000100:00100000:1.0:1713279484.171682:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281336576:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 12us (51us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279484.171685:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 786 00000100:00100000:2.0:1713279484.171789:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279484.171851:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336704 00000100:00100000:0.0:1713279484.171882:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336704 00000100:00080000:2.0:1713279484.171930:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279454 00000100:00100000:0.0:1713279484.171948:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 364 00000100:00100000:0.0:1713279484.171956:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281336704:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279484.172035:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281336704:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279484.172044:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 364 00010000:00010000:2.0:1713279484.562628:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279485.266727:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200112384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1713279485.266813:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279485.266912:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112384 00000100:00100000:3.0:1713279485.266924:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112384 00000100:00100000:3.0:1713279485.267001:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99099 00000100:00100000:3.0:1713279485.267010:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200112384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279485.267066:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279485.267136:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200112384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279485.267146:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99099 00000100:00100000:2.0:1713279485.267175:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200112384:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279485.564793:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279486.566681:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279486.946825:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713279486.946884:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200112448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1713279486.946961:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279486.947042:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112448 00000100:00100000:0.0:1713279486.947057:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112448 00000100:00100000:0.0:1713279486.947135:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99100 00000100:00100000:0.0:1713279486.947146:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200112448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713279486.947195:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:0.0:1713279486.947289:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200112448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279486.947301:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99100 00000100:00100000:3.0:1713279486.947342:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200112448:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279487.568659:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279487.618806:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200112704:0@lo:400:kworker.0 00000100:00100000:0.0:1713279487.618807:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200112512:0@lo:400:kworker.0 00000100:00100000:3.0:1713279487.618809:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200112640:0@lo:400:kworker.0 00000100:00100000:2.0:1713279487.618811:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200112576:0@lo:400:kworker.0 00000100:00100000:2.0:1713279487.618922:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279487.618931:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279487.618933:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279487.618952:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200112832:0@lo:400:kworker.0 00000100:00100000:0.0:1713279487.618967:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200112768:0@lo:400:kworker.0 00000100:00100000:3.0:1713279487.618967:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200112896:0@lo:400:kworker.0 00000100:00100000:2.0:1713279487.618971:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279487.618983:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200113088:0@lo:400:kworker.0 00000100:00100000:0.0:1713279487.618991:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279487.618999:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279487.619005:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200113024:0@lo:400:kworker.0 00000100:00100000:3.0:1713279487.619020:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112576 00000100:00100000:0.0:1713279487.619024:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279487.619028:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112576 00000100:00100000:1.0:1713279487.619034:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279487.619035:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200113280:0@lo:400:kworker.0 00000100:00100000:2.0:1713279487.619035:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112832 00000100:00100000:2.0:1713279487.619039:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112832 00000100:00100000:0.0:1713279487.619055:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279487.619056:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200112960:0@lo:400:kworker.0 00000100:00100000:2.0:1713279487.619079:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112704 00000100:00100000:3.0:1713279487.619079:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113088 00000100:00100000:2.0:1713279487.619081:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112704 00000100:00100000:1.0:1713279487.619082:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279487.619083:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113088 00000100:00100000:0.0:1713279487.619085:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112512 00000100:00100000:1.0:1713279487.619094:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200113216:0@lo:400:kworker.0 00000100:00100000:2.0:1713279487.619096:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1713279487.619099:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112512 00000100:00100000:2.0:1713279487.619103:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200112576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279487.619108:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279487.619118:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1713279487.619126:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200112832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279487.619132:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1713279487.619138:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200112512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279487.619140:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:1.0:1713279487.619147:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200112704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279487.619147:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200112576:12345-0@lo:400:kworker.0 Request processed in 43us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279487.619154:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:2.0:1713279487.619169:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1713279487.619173:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200113088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279487.619179:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200112512:12345-0@lo:400:kworker.0 Request processed in 41us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279487.619187:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1713279487.619189:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200112704:12345-0@lo:400:kworker.0 Request processed in 40us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279487.619192:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200112832:12345-0@lo:400:kworker.0 Request processed in 61us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279487.619195:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200113088:12345-0@lo:400:kworker.0 Request processed in 21us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279487.619197:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:2.0:1713279487.619201:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1713279487.619207:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:0.0:1713279487.619214:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113024 00000100:00100000:0.0:1713279487.619217:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113024 00000100:00080000:2.0:1713279487.619218:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279457 00000100:00080000:2.0:1713279487.619222:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279457 00000100:00100000:1.0:1713279487.619224:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113280 00000100:00080000:2.0:1713279487.619224:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279457 00000100:00100000:1.0:1713279487.619228:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113280 00000100:00100000:2.0:1713279487.619237:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112640 00000100:00100000:0.0:1713279487.619238:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112960 00000100:00100000:2.0:1713279487.619239:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112640 00000100:00100000:0.0:1713279487.619240:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112960 00000100:00100000:3.0:1713279487.619241:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113216 00000100:00100000:3.0:1713279487.619246:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113216 00000100:00100000:1.0:1713279487.619254:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1713279487.619257:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112768 00000100:00100000:0.0:1713279487.619260:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1713279487.619260:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112768 00000100:00100000:1.0:1713279487.619261:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200113024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279487.619265:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200113280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279487.619273:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99101 00000100:00100000:2.0:1713279487.619278:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200112640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279487.619303:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1713279487.619304:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200112640:12345-0@lo:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279487.619310:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200113280:12345-0@lo:400:kworker.0 Request processed in 28us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279487.619310:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200113024:12345-0@lo:400:kworker.0 Request processed in 30us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279487.619311:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99101 00000100:00100000:3.0:1713279487.619313:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200112960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279487.619317:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1713279487.619321:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1713279487.619322:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99102 00000100:00100000:2.0:1713279487.619325:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200112768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279487.619329:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1713279487.619333:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200113216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279487.619347:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200112768:12345-0@lo:400:kworker.0 Request processed in 20us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279487.619352:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99102 00000100:00100000:1.0:1713279487.619357:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200113216:12345-0@lo:400:kworker.0 Request processed in 24us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279487.619363:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1713279487.619368:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200112512:0@lo:400:kworker.0 00000100:00080000:2.0:1713279487.619368:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279457 00000100:00100000:3.0:1713279487.619370:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200112960:12345-0@lo:400:kworker.0 Request processed in 57us (284us total) trans 0 rc 0/0 00000100:00080000:2.0:1713279487.619371:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279457 00000100:00100000:0.0:1713279487.619381:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200112768:0@lo:400:kworker.0 00000100:00100000:3.0:1713279487.619381:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1713279487.619389:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200112576:0@lo:400:kworker.0 00000100:00100000:0.0:1713279487.619392:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200113024:0@lo:400:kworker.0 00000100:00100000:1.0:1713279487.619395:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200112704:0@lo:400:kworker.0 00000100:00100000:2.0:1713279487.619399:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200112832:0@lo:400:kworker.0 00000100:00100000:0.0:1713279487.619400:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200113280:0@lo:400:kworker.0 00000100:00100000:1.0:1713279487.619405:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200112960:0@lo:400:kworker.0 00000100:00100000:2.0:1713279487.619407:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200113088:0@lo:400:kworker.0 00000100:00100000:1.0:1713279487.619437:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200113216:0@lo:400:kworker.0 00000100:00100000:3.0:1713279487.619476:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279487.619527:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200113152:0@lo:400:kworker.0 00000100:00100000:0.0:1713279487.619540:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200112896 00000100:00100000:0.0:1713279487.619545:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200112896 00000100:00100000:3.0:1713279487.619561:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279487.619585:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113152 00000100:00100000:0.0:1713279487.619588:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113152 00000100:00080000:2.0:1713279487.619596:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279457 00000100:00100000:3.0:1713279487.619597:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200112640:0@lo:400:kworker.0 00000100:00100000:0.0:1713279487.619603:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:0.0:1713279487.619607:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200112896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279487.619613:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:2.0:1713279487.619618:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200113152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279487.619650:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200112896:12345-0@lo:400:kworker.0 Request processed in 41us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279487.619654:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200113152:12345-0@lo:400:kworker.0 Request processed in 35us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279487.619656:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:2.0:1713279487.619669:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1713279487.619674:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200112896:0@lo:400:kworker.0 00000100:00100000:3.0:1713279487.619689:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200113152:0@lo:400:kworker.0 00000100:00100000:2.0:1713279487.634588:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200113408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279487.634632:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200113344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279487.634638:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279487.634679:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113408 00000100:00100000:3.0:1713279487.634682:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279487.634685:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113408 00000100:00100000:2.0:1713279487.634708:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113344 00000100:00100000:2.0:1713279487.634711:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113344 00000100:00100000:0.0:1713279487.634720:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1713279487.634730:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200113408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279487.634736:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1713279487.634741:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200113344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279487.634766:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279487.634766:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279487.634816:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200113344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279487.634818:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200113408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279487.634822:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1713279487.634827:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1713279487.634895:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200113408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279487.634911:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200113344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279488.354720:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009661b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200113472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279488.354788:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279488.354875:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113472 00000100:00100000:0.0:1713279488.354886:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113472 00000100:00100000:0.0:1713279488.354945:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1713279488.354954:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200113472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279488.354991:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279488.355062:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200113472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279488.355072:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1713279488.355096:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009661b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200113472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279488.370554:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200113536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279488.370580:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279488.370622:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113536 00000100:00100000:0.0:1713279488.370627:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113536 00000100:00100000:0.0:1713279488.370651:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1713279488.370656:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200113536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279488.370667:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279488.370691:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200113536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279488.370695:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1713279488.370702:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200113536:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279488.570721:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279489.179182:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279489.179232:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279489.179263:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336832 00000100:00100000:0.0:1713279489.179264:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279489.179273:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336832 00000100:00100000:0.0:1713279489.179280:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279489.179291:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279489.179300:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279489.179312:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336768 00000100:00100000:0.0:1713279489.179315:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279489.179317:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336768 00000100:00100000:2.0:1713279489.179317:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336896 00000100:00100000:3.0:1713279489.179319:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281336960 00000100:00100000:2.0:1713279489.179320:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336896 00000100:00100000:3.0:1713279489.179323:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281336960 00000100:00100000:0.0:1713279489.179324:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279489.179334:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337088 00000100:00100000:2.0:1713279489.179336:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337088 00000100:00100000:1.0:1713279489.179343:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 455 00000100:00100000:3.0:1713279489.179344:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337024 00000100:00100000:0.0:1713279489.179347:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279489.179347:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337152 00000100:00100000:3.0:1713279489.179347:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337024 00000100:00100000:1.0:1713279489.179348:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281336768:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279489.179349:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337152 00000100:00100000:3.0:1713279489.179359:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337216 00000100:00100000:2.0:1713279489.179361:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 793 00000100:00100000:3.0:1713279489.179361:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337216 00000100:00100000:0.0:1713279489.179362:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337280 00000100:00100000:0.0:1713279489.179365:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337280 00000100:00100000:2.0:1713279489.179366:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281336832:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279489.179373:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 369 00000100:00100000:3.0:1713279489.179377:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281336960:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279489.179384:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 370 00000100:00100000:0.0:1713279489.179388:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281337024:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279489.179393:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281336768:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279489.179398:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 455 00000100:00100000:3.0:1713279489.179402:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281336960:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279489.179406:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281336832:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279489.179407:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 369 00000100:00100000:2.0:1713279489.179412:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 793 00000100:00100000:0.0:1713279489.179446:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281337024:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279489.179450:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 371 00000100:00100000:2.0:1713279489.179452:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 794 00000100:00100000:0.0:1713279489.179454:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 370 00000100:00100000:1.0:1713279489.179454:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281337216:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279489.179456:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281336896:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279489.179461:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 372 00000100:00100000:3.0:1713279489.179465:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281337280:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279489.179470:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281337216:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 16us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279489.179474:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 371 00000100:00100000:0.0:1713279489.179475:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 795 00000100:00100000:0.0:1713279489.179478:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281337088:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279489.179481:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281336896:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279489.179481:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281337280:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 16us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279489.179486:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 796 00000100:00100000:3.0:1713279489.179487:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 372 00000100:00100000:2.0:1713279489.179488:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 794 00000100:00100000:1.0:1713279489.179489:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281337152:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279489.179494:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281337088:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 15us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279489.179498:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 795 00000100:00080000:2.0:1713279489.179500:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279459 00000100:00100000:1.0:1713279489.179501:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281337152:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 12us (176us total) trans 0 rc 0/0 00000100:00080000:2.0:1713279489.179503:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279459 00000100:00100000:1.0:1713279489.179504:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 796 00000100:00080000:2.0:1713279489.179504:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279459 00000100:00080000:2.0:1713279489.179506:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279459 00000100:00080000:2.0:1713279489.179508:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279459 00010000:00010000:2.0:1713279489.572757:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279490.274625:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200113600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279490.274700:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279490.274751:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113600 00000100:00100000:0.0:1713279490.274761:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113600 00000100:00100000:0.0:1713279490.274850:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99103 00000100:00100000:0.0:1713279490.274856:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200113600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1713279490.274904:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:0.0:1713279490.274954:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200113600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279490.274959:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99103 00000100:00100000:3.0:1713279490.274985:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200113600:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279490.574704:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279491.576867:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279491.954767:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200113664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279491.954884:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279491.954970:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113664 00000100:00100000:2.0:1713279491.954984:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113664 00000100:00100000:2.0:1713279491.955061:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99104 00000100:00100000:2.0:1713279491.955073:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200113664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279491.955123:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279491.955207:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200113664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279491.955217:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99104 00000100:00100000:0.0:1713279491.955273:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200113664:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279492.578584:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279492.626689:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200113728:0@lo:400:kworker.0 00000100:00100000:3.0:1713279492.626689:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200113856:0@lo:400:kworker.0 00000100:00100000:0.0:1713279492.626694:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200113792:0@lo:400:kworker.0 00000100:00100000:0.0:1713279492.626748:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279492.626748:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279492.626749:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279492.626769:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200114048:0@lo:400:kworker.0 00000100:00100000:2.0:1713279492.626769:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200113984:0@lo:400:kworker.0 00000100:00100000:3.0:1713279492.626771:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200114112:0@lo:400:kworker.0 00000100:00100000:0.0:1713279492.626781:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279492.626784:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279492.626792:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200114240:0@lo:400:kworker.0 00000100:00100000:0.0:1713279492.626797:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200114304:0@lo:400:kworker.0 00000100:00100000:3.0:1713279492.626798:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113792 00000100:00100000:3.0:1713279492.626819:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113792 00000100:00100000:2.0:1713279492.626820:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279492.626822:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279492.626830:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200114496:0@lo:400:kworker.0 00000100:00100000:1.0:1713279492.626834:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114048 00000100:00100000:1.0:1713279492.626839:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114048 00000100:00100000:2.0:1713279492.626840:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279492.626845:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113856 00000100:00100000:3.0:1713279492.626847:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114304 00000100:00100000:0.0:1713279492.626848:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113856 00000100:00100000:3.0:1713279492.626848:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114304 00000100:00100000:2.0:1713279492.626850:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1713279492.626853:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200113920:0@lo:400:kworker.0 00000100:00100000:3.0:1713279492.626861:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:2.0:1713279492.626863:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279492.626864:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113984 00000100:00100000:0.0:1713279492.626865:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113984 00000100:00100000:3.0:1713279492.626865:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200113792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279492.626867:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113920 00000100:00100000:1.0:1713279492.626869:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113920 00000100:00100000:2.0:1713279492.626869:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200114176:0@lo:400:kworker.0 00000100:00100000:0.0:1713279492.626874:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99105 00000100:00100000:0.0:1713279492.626878:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200113856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279492.626878:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279492.626879:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1713279492.626883:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200114304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279492.626884:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200114432:0@lo:400:kworker.0 00000100:00100000:2.0:1713279492.626893:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279492.626899:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200113792:12345-0@lo:400:kworker.0 Request processed in 33us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279492.626903:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200113856:12345-0@lo:400:kworker.0 Request processed in 25us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279492.626903:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:0.0:1713279492.626907:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99105 00000100:00100000:2.0:1713279492.626909:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200113728 00000100:00100000:1.0:1713279492.626911:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200114304:12345-0@lo:400:kworker.0 Request processed in 29us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279492.626911:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200113728 00000100:00100000:3.0:1713279492.626912:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1713279492.626914:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99106 00000100:00100000:3.0:1713279492.626914:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200114048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279492.626915:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:0.0:1713279492.626916:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200113984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279492.626923:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1713279492.626925:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200113920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279492.626929:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1713279492.626930:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200114048:12345-0@lo:400:kworker.0 Request processed in 15us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279492.626933:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200113984:12345-0@lo:400:kworker.0 Request processed in 16us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279492.626933:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200113728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279492.626934:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1713279492.626936:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99106 00000100:00100000:1.0:1713279492.626937:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200113920:12345-0@lo:400:kworker.0 Request processed in 12us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279492.626941:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:0.0:1713279492.626945:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114240 00000100:00100000:0.0:1713279492.626947:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114240 00000100:00100000:3.0:1713279492.626948:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114496 00000100:00100000:3.0:1713279492.626950:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114496 00000100:00100000:2.0:1713279492.626951:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200113728:12345-0@lo:400:kworker.0 Request processed in 17us (203us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279492.626952:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279462 00000100:00080000:1.0:1713279492.626954:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279462 00000100:00100000:2.0:1713279492.626954:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00080000:1.0:1713279492.626956:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279462 00000100:00080000:1.0:1713279492.626957:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279462 00000100:00100000:0.0:1713279492.626959:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114176 00000100:00100000:0.0:1713279492.626960:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114176 00000100:00100000:3.0:1713279492.626963:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114432 00000100:00100000:3.0:1713279492.626964:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114432 00000100:00100000:0.0:1713279492.626972:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1713279492.626975:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200114240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279492.626975:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1713279492.626978:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1713279492.626978:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200114496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279492.626982:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200114176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279492.626982:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1713279492.626985:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200114432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279492.626990:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200114240:12345-0@lo:400:kworker.0 Request processed in 15us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279492.626994:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1713279492.626994:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200114496:12345-0@lo:400:kworker.0 Request processed in 15us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279492.626997:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1713279492.626998:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200114176:12345-0@lo:400:kworker.0 Request processed in 16us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279492.626999:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200114432:12345-0@lo:400:kworker.0 Request processed in 14us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279492.627001:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1713279492.627003:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00080000:1.0:1713279492.627010:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279462 00000100:00080000:1.0:1713279492.627012:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279462 00000100:00100000:3.0:1713279492.627015:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279492.627019:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200113792:0@lo:400:kworker.0 00000100:00100000:2.0:1713279492.627022:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200113920:0@lo:400:kworker.0 00000100:00100000:3.0:1713279492.627023:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200114368:0@lo:400:kworker.0 00000100:00100000:0.0:1713279492.627025:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200114048:0@lo:400:kworker.0 00000100:00100000:2.0:1713279492.627027:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200114176:0@lo:400:kworker.0 00000100:00100000:0.0:1713279492.627030:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200114304:0@lo:400:kworker.0 00000100:00100000:2.0:1713279492.627032:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200114432:0@lo:400:kworker.0 00000100:00100000:3.0:1713279492.627033:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279492.627036:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200113728:0@lo:400:kworker.0 00000100:00100000:2.0:1713279492.627041:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200113984:0@lo:400:kworker.0 00000100:00100000:1.0:1713279492.627046:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114112 00000100:00100000:2.0:1713279492.627046:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200114240:0@lo:400:kworker.0 00000100:00100000:3.0:1713279492.627047:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200113856:0@lo:400:kworker.0 00000100:00100000:1.0:1713279492.627049:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114112 00000100:00100000:2.0:1713279492.627051:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200114496:0@lo:400:kworker.0 00000100:00100000:3.0:1713279492.627058:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114368 00000100:00080000:0.0:1713279492.627060:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279462 00000100:00100000:3.0:1713279492.627060:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114368 00000100:00100000:1.0:1713279492.627070:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00080000:0.0:1713279492.627071:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279462 00000100:00100000:1.0:1713279492.627074:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200114112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279492.627076:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:2.0:1713279492.627079:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200114368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279492.627097:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200114368:12345-0@lo:400:kworker.0 Request processed in 17us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279492.627100:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200114112:12345-0@lo:400:kworker.0 Request processed in 26us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279492.627100:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1713279492.627105:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:3.0:1713279492.627112:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200114112:0@lo:400:kworker.0 00000100:00100000:3.0:1713279492.627121:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200114368:0@lo:400:kworker.0 00000100:00100000:2.0:1713279492.642531:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1713279492.642544:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200114624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279492.642579:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279492.642604:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200114560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279492.642617:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279492.642638:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114624 00000100:00100000:0.0:1713279492.642645:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114624 00000100:00100000:3.0:1713279492.642666:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114560 00000100:00100000:3.0:1713279492.642671:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114560 00000100:00100000:0.0:1713279492.642687:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1713279492.642705:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200114624:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279492.642719:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1713279492.642726:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200114560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1713279492.642738:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279492.642741:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279492.642792:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200114624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279492.642792:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200114560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279492.642800:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1713279492.642818:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1713279492.642827:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200114624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279492.642843:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200114560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279493.362679:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200114688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279493.362772:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279493.362868:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114688 00000100:00100000:2.0:1713279493.362879:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114688 00000100:00100000:2.0:1713279493.362943:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1713279493.362955:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200114688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279493.362998:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279493.363077:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200114688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279493.363086:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1713279493.363156:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200114688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279493.378710:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200114752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279493.378764:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279493.378874:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114752 00000100:00100000:0.0:1713279493.378883:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114752 00000100:00100000:0.0:1713279493.378927:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1713279493.378934:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200114752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279493.378951:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279493.379005:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200114752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279493.379013:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1713279493.379055:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200114752:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279493.580864:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279494.186933:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279494.186972:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279494.186991:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279494.187005:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337408 00000100:00100000:0.0:1713279494.187007:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279494.187015:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337408 00000100:00100000:0.0:1713279494.187016:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279494.187026:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279494.187038:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279494.187047:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337536 00000100:00100000:0.0:1713279494.187048:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279494.187051:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337536 00000100:00100000:2.0:1713279494.187054:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337344 00000100:00100000:2.0:1713279494.187059:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337344 00000100:00100000:1.0:1713279494.187061:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337472 00000100:00100000:1.0:1713279494.187064:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337472 00000100:00100000:0.0:1713279494.187069:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279494.187073:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337600 00000100:00100000:3.0:1713279494.187074:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337600 00000100:00080000:0.0:1713279494.187079:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279464 00000100:00100000:1.0:1713279494.187079:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337664 00000100:00100000:1.0:1713279494.187080:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337664 00000100:00080000:0.0:1713279494.187082:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279464 00000100:00100000:3.0:1713279494.187082:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337792 00000100:00080000:0.0:1713279494.187083:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279464 00000100:00100000:3.0:1713279494.187083:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337792 00000100:00080000:0.0:1713279494.187084:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279464 00000100:00100000:2.0:1713279494.187085:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 457 00000100:00080000:0.0:1713279494.187086:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279464 00000100:00100000:2.0:1713279494.187090:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281337344:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279494.187092:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337856 00000100:00100000:1.0:1713279494.187093:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337728 00000100:00100000:3.0:1713279494.187093:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337856 00000100:00100000:1.0:1713279494.187095:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337728 00000100:00100000:0.0:1713279494.187101:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 377 00000100:00100000:0.0:1713279494.187106:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281337536:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279494.187106:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 378 00000100:00100000:1.0:1713279494.187110:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 803 00000100:00100000:3.0:1713279494.187110:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281337600:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279494.187116:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281337408:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279494.187133:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281337536:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279494.187138:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 377 00000100:00100000:2.0:1713279494.187138:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281337344:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279494.187141:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281337600:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279494.187142:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 457 00000100:00100000:3.0:1713279494.187146:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 378 00000100:00100000:1.0:1713279494.187148:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281337408:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279494.187149:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 379 00000100:00100000:0.0:1713279494.187152:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281337792:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279494.187154:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 380 00000100:00100000:3.0:1713279494.187156:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281337856:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279494.187158:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 803 00000100:00100000:0.0:1713279494.187163:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281337792:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 11us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279494.187165:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 804 00000100:00100000:0.0:1713279494.187167:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 379 00000100:00100000:2.0:1713279494.187169:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281337472:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279494.187169:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281337856:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 11us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279494.187171:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 805 00000100:00100000:3.0:1713279494.187173:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 380 00000100:00100000:1.0:1713279494.187174:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281337664:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279494.187180:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 806 00000100:00100000:0.0:1713279494.187183:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281337728:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279494.187184:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281337472:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 16us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279494.187188:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 804 00000100:00100000:0.0:1713279494.187197:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281337728:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 12us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279494.187197:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281337664:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279494.187203:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 805 00000100:00100000:0.0:1713279494.187205:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 806 00000100:00080000:0.0:1713279494.187213:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279464 00000100:00080000:0.0:1713279494.187215:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279464 00010000:00010000:2.0:1713279494.582604:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279495.282852:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200114816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279495.282932:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279495.282996:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114816 00000100:00100000:2.0:1713279495.283007:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114816 00000100:00100000:2.0:1713279495.283062:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99107 00000100:00100000:2.0:1713279495.283071:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200114816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279495.283112:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279495.283180:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200114816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279495.283188:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99107 00000100:00100000:3.0:1713279495.283222:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200114816:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279495.584728:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279496.586775:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279496.962856:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200114880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1713279496.962950:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279496.963106:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114880 00000100:00100000:2.0:1713279496.963118:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114880 00000100:00100000:2.0:1713279496.963179:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99108 00000100:00100000:2.0:1713279496.963188:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200114880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279496.963225:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279496.963295:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200114880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279496.963303:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99108 00000100:00100000:1.0:1713279496.963360:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200114880:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279497.588625:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279497.634709:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200115008:0@lo:400:kworker.0 00000100:00100000:3.0:1713279497.634759:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200115072:0@lo:400:kworker.0 00000100:00100000:2.0:1713279497.634761:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200115136:0@lo:400:kworker.0 00000100:00100000:3.0:1713279497.634853:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279497.634855:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279497.634877:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200114944:0@lo:400:kworker.0 00000100:00100000:3.0:1713279497.634879:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200115328:0@lo:400:kworker.0 00000100:00100000:3.0:1713279497.634913:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279497.634914:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200115264:0@lo:400:kworker.0 00000100:00100000:2.0:1713279497.634914:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279497.634916:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115008 00000100:00100000:1.0:1713279497.634926:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115008 00000100:00100000:3.0:1713279497.634929:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200115584:0@lo:400:kworker.0 00000100:00100000:2.0:1713279497.634932:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200115200:0@lo:400:kworker.0 00000100:00100000:0.0:1713279497.634944:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279497.634948:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279497.634961:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200114944 00000100:00100000:2.0:1713279497.634965:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200115456:0@lo:400:kworker.0 00000100:00100000:3.0:1713279497.634965:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200114944 00000100:00100000:1.0:1713279497.634967:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115328 00000100:00100000:0.0:1713279497.634970:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200115520:0@lo:400:kworker.0 00000100:00100000:1.0:1713279497.634971:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115328 00000100:00100000:2.0:1713279497.634979:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279497.634988:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115264 00000100:00100000:1.0:1713279497.634990:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115264 00000100:00100000:2.0:1713279497.634991:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200115712:0@lo:400:kworker.0 00000100:00100000:0.0:1713279497.634997:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279497.634997:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1713279497.635003:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200114944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279497.635009:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115520 00000100:00100000:2.0:1713279497.635010:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279497.635011:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115520 00000100:00100000:1.0:1713279497.635042:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:1.0:1713279497.635049:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200115008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279497.635056:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1713279497.635061:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200114944:12345-0@lo:400:kworker.0 Request processed in 58us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279497.635062:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115072 00000100:00100000:0.0:1713279497.635065:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200115328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279497.635079:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1713279497.635080:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115072 00000100:00100000:1.0:1713279497.635104:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200115008:12345-0@lo:400:kworker.0 Request processed in 56us (251us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279497.635104:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279467 00000100:00080000:3.0:1713279497.635108:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279467 00000100:00080000:3.0:1713279497.635110:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279467 00000100:00100000:1.0:1713279497.635111:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:2.0:1713279497.635111:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115200 00000100:00100000:2.0:1713279497.635114:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115200 00000100:00100000:3.0:1713279497.635121:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115456 00000100:00100000:1.0:1713279497.635123:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1713279497.635124:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200115328:12345-0@lo:400:kworker.0 Request processed in 58us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279497.635124:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115456 00000100:00100000:1.0:1713279497.635127:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200115264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279497.635134:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99109 00000100:00100000:0.0:1713279497.635135:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1713279497.635152:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115712 00000100:00100000:2.0:1713279497.635153:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200115072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279497.635154:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115712 00000100:00100000:1.0:1713279497.635159:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200115264:12345-0@lo:400:kworker.0 Request processed in 31us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279497.635162:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:1.0:1713279497.635166:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1713279497.635166:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1713279497.635169:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200115520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279497.635170:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200115456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279497.635191:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1713279497.635195:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200115712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279497.635205:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200115456:12345-0@lo:400:kworker.0 Request processed in 34us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279497.635207:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200115072:12345-0@lo:400:kworker.0 Request processed in 52us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279497.635212:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1713279497.635214:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200115520:12345-0@lo:400:kworker.0 Request processed in 43us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279497.635216:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99109 00000100:00100000:1.0:1713279497.635217:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200115712:12345-0@lo:400:kworker.0 Request processed in 21us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279497.635222:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1713279497.635223:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00080000:3.0:1713279497.635227:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279467 00000100:00080000:3.0:1713279497.635230:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279467 00000100:00100000:2.0:1713279497.635234:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99110 00000100:00100000:3.0:1713279497.635236:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279497.635240:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200115200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279497.635260:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115584 00000100:00100000:0.0:1713279497.635266:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115584 00000100:00100000:3.0:1713279497.635270:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200115072:0@lo:400:kworker.0 00000100:00100000:2.0:1713279497.635275:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200115200:12345-0@lo:400:kworker.0 Request processed in 34us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279497.635281:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200115328:0@lo:400:kworker.0 00000100:00100000:2.0:1713279497.635282:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99110 00000100:00100000:0.0:1713279497.635300:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00080000:3.0:1713279497.635300:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279467 00000100:00100000:0.0:1713279497.635307:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200115584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279497.635313:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200114944:0@lo:400:kworker.0 00000100:00100000:2.0:1713279497.635326:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200115200:0@lo:400:kworker.0 00000100:00100000:2.0:1713279497.635337:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200115456:0@lo:400:kworker.0 00000100:00100000:2.0:1713279497.635349:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200115712:0@lo:400:kworker.0 00000100:00100000:0.0:1713279497.635371:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200115584:12345-0@lo:400:kworker.0 Request processed in 61us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279497.635380:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:3.0:1713279497.635392:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200115584:0@lo:400:kworker.0 00000100:00100000:0.0:1713279497.635451:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200115264:0@lo:400:kworker.0 00000100:00100000:0.0:1713279497.635462:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200115520:0@lo:400:kworker.0 00000100:00100000:0.0:1713279497.635470:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200115008:0@lo:400:kworker.0 00000100:00100000:0.0:1713279497.635493:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279497.635516:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200115392:0@lo:400:kworker.0 00000100:00100000:0.0:1713279497.635535:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279497.635544:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200115648:0@lo:400:kworker.0 00000100:00100000:1.0:1713279497.635550:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115392 00000100:00100000:2.0:1713279497.635550:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115136 00000100:00100000:0.0:1713279497.635555:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279497.635555:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115392 00000100:00100000:2.0:1713279497.635555:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115136 00000100:00100000:1.0:1713279497.635577:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115648 00000100:00100000:1.0:1713279497.635579:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115648 00000100:00100000:2.0:1713279497.635581:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:2.0:1713279497.635586:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200115136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279497.635591:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1713279497.635595:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200115392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279497.635598:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1713279497.635604:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200115648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279497.635633:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200115392:12345-0@lo:400:kworker.0 Request processed in 37us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279497.635633:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200115136:12345-0@lo:400:kworker.0 Request processed in 46us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279497.635638:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1713279497.635639:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:0.0:1713279497.635642:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200115136:0@lo:400:kworker.0 00000100:00100000:3.0:1713279497.635646:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200115648:12345-0@lo:400:kworker.0 Request processed in 42us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279497.635651:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200115392:0@lo:400:kworker.0 00000100:00100000:3.0:1713279497.635652:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1713279497.635658:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200115648:0@lo:400:kworker.0 00000100:00080000:3.0:1713279497.635669:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279467 00000100:00080000:3.0:1713279497.635671:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279467 00000100:00100000:3.0:1713279497.650640:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f1d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200115840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279497.650661:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200115776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279497.650687:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279497.650737:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279497.650752:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115840 00000100:00100000:0.0:1713279497.650759:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115840 00000100:00100000:0.0:1713279497.650828:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115776 00000100:00100000:0.0:1713279497.650833:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115776 00000100:00100000:3.0:1713279497.650842:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1713279497.650859:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200115840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279497.650876:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1713279497.650885:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200115776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1713279497.650887:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:0.0:1713279497.650904:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:3.0:1713279497.650924:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200115840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279497.650931:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1713279497.650965:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200115776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279497.650965:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f1d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200115840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279497.650973:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1713279497.650998:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200115776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279498.370663:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713279498.370693:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f1d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200115904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279498.370805:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279498.370885:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115904 00000100:00100000:0.0:1713279498.370897:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115904 00000100:00100000:0.0:1713279498.370963:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1713279498.370974:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200115904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279498.371014:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279498.371098:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200115904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279498.371109:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1713279498.371142:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f1d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200115904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279498.386668:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200115968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1713279498.386719:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279498.386941:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200115968 00000100:00100000:0.0:1713279498.386949:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200115968 00000100:00100000:0.0:1713279498.387000:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1713279498.387011:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200115968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279498.387033:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279498.387075:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200115968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279498.387082:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1713279498.387106:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200115968:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279498.590719:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279499.195632:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279499.195698:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279499.195736:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279499.195822:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279499.195842:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337984 00000100:00100000:0.0:1713279499.195843:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279499.195860:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337984 00000100:00100000:0.0:1713279499.195866:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279499.195866:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338112 00000100:00100000:3.0:1713279499.195866:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281337920 00000100:00100000:3.0:1713279499.195878:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281337920 00000100:00100000:2.0:1713279499.195879:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338112 00000100:00100000:0.0:1713279499.195886:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279499.195906:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279499.195929:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338048 00000100:00100000:1.0:1713279499.195932:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338048 00000100:00100000:2.0:1713279499.195933:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338176 00000100:00100000:2.0:1713279499.195938:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338176 00000100:00100000:3.0:1713279499.195943:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 459 00000100:00100000:1.0:1713279499.195946:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338240 00000100:00100000:1.0:1713279499.195949:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338240 00000100:00100000:0.0:1713279499.195950:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279499.195956:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281337920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279499.195962:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338368 00000100:00100000:1.0:1713279499.195965:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 813 00000100:00100000:2.0:1713279499.195966:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338368 00000100:00100000:1.0:1713279499.195972:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281337984:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279499.195989:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338432 00000100:00100000:2.0:1713279499.195997:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 385 00000100:00100000:0.0:1713279499.196000:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338432 00000100:00100000:2.0:1713279499.196005:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281338112:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279499.196050:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 386 00000100:00100000:1.0:1713279499.196052:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281337984:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 79us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279499.196056:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281338112:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279499.196056:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281337920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 100us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279499.196060:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281338176:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279499.196061:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 813 00000100:00100000:2.0:1713279499.196069:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 385 00000100:00100000:3.0:1713279499.196069:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 459 00000100:00100000:1.0:1713279499.196078:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338304 00000100:00100000:1.0:1713279499.196081:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338304 00000100:00100000:2.0:1713279499.196093:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 387 00000100:00100000:1.0:1713279499.196096:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 814 00000100:00100000:1.0:1713279499.196102:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281338048:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279499.196102:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281338368:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279499.196123:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 815 00000100:00100000:3.0:1713279499.196131:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281338240:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279499.196137:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281338176:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 77us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279499.196142:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281338048:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279499.196146:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 386 00000100:00100000:2.0:1713279499.196149:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281338368:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279499.196150:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 814 00000100:00100000:2.0:1713279499.196160:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 387 00000100:00100000:1.0:1713279499.196161:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 816 00000100:00100000:3.0:1713279499.196164:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281338240:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279499.196166:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281338304:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279499.196168:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 388 00000100:00100000:0.0:1713279499.196176:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281338432:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279499.196177:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 815 00000100:00100000:1.0:1713279499.196187:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281338304:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279499.196194:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 816 00000100:00100000:0.0:1713279499.196199:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281338432:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279499.196207:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 388 00000100:00080000:1.0:1713279499.196211:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279469 00000100:00080000:1.0:1713279499.196215:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279469 00000100:00080000:1.0:1713279499.196217:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279469 00000100:00080000:1.0:1713279499.196219:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279469 00000100:00080000:1.0:1713279499.196222:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279469 00010000:00010000:2.0:1713279499.592871:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279500.290731:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713279500.290787:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200116032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279500.290874:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279500.290956:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116032 00000100:00100000:2.0:1713279500.290969:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116032 00000100:00100000:2.0:1713279500.291035:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99111 00000100:00100000:2.0:1713279500.291043:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200116032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279500.291083:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279500.291152:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200116032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279500.291164:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99111 00000100:00100000:3.0:1713279500.291214:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200116032:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279500.594920:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279501.596938:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279501.970653:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200116096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1713279501.970719:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279501.970833:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116096 00000100:00100000:2.0:1713279501.970844:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116096 00000100:00100000:2.0:1713279501.970902:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99112 00000100:00100000:2.0:1713279501.970912:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200116096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279501.970948:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279501.971013:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200116096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279501.971021:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99112 00000100:00100000:3.0:1713279501.971039:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200116096:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279502.598691:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279502.642723:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200116224:0@lo:400:kworker.0 00000100:00100000:0.0:1713279502.642769:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200116160:0@lo:400:kworker.0 00000100:00100000:2.0:1713279502.642789:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200116352:0@lo:400:kworker.0 00000100:00100000:3.0:1713279502.642842:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279502.642844:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279502.642876:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116224 00000100:00100000:0.0:1713279502.642885:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200116416:0@lo:400:kworker.0 00000100:00100000:2.0:1713279502.642886:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116224 00000100:00100000:3.0:1713279502.642891:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200116480:0@lo:400:kworker.0 00000100:00100000:0.0:1713279502.642916:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279502.642927:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279502.642941:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200116672:0@lo:400:kworker.0 00000100:00100000:2.0:1713279502.642947:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116480 00000100:00100000:2.0:1713279502.642953:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116480 00000100:00100000:3.0:1713279502.642953:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200116736:0@lo:400:kworker.0 00000100:00100000:0.0:1713279502.642974:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279502.642984:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279502.642997:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200116928:0@lo:400:kworker.0 00000100:00100000:2.0:1713279502.643005:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116736 00000100:00100000:2.0:1713279502.643010:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116736 00000100:00080000:1.0:1713279502.643011:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279472 00000100:00100000:0.0:1713279502.643024:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279502.643027:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116160 00000100:00100000:3.0:1713279502.643033:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116160 00000100:00100000:2.0:1713279502.643035:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:2.0:1713279502.643045:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200116224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279502.643046:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:1.0:1713279502.643055:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200116480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279502.643067:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116672 00000100:00100000:0.0:1713279502.643073:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116672 00000100:00100000:3.0:1713279502.643073:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:3.0:1713279502.643081:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200116160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279502.643107:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116928 00000100:00100000:0.0:1713279502.643110:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116928 00000100:00100000:0.0:1713279502.643133:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1713279502.643138:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200116480:12345-0@lo:400:kworker.0 Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279502.643143:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200116672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279502.643145:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200116224:12345-0@lo:400:kworker.0 Request processed in 97us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279502.643146:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200116160:12345-0@lo:400:kworker.0 Request processed in 64us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279502.643151:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:3.0:1713279502.643156:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1713279502.643157:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1713279502.643176:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:1.0:1713279502.643181:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200116736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279502.643198:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200116672:12345-0@lo:400:kworker.0 Request processed in 54us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279502.643206:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116416 00000100:00100000:1.0:1713279502.643207:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200116736:12345-0@lo:400:kworker.0 Request processed in 26us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279502.643211:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116416 00000100:00100000:1.0:1713279502.643214:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00100000:0.0:1713279502.643216:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1713279502.643230:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200116224:0@lo:400:kworker.0 00000100:00100000:1.0:1713279502.643234:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200116288:0@lo:400:kworker.0 00000100:00100000:0.0:1713279502.643237:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1713279502.643243:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200116480:0@lo:400:kworker.0 00000100:00100000:2.0:1713279502.643244:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99113 00000100:00100000:0.0:1713279502.643245:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200116928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279502.643252:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200116416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279502.643253:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200116736:0@lo:400:kworker.0 00000100:00100000:1.0:1713279502.643258:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279502.643274:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200116544:0@lo:400:kworker.0 00000100:00100000:0.0:1713279502.643287:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200116928:12345-0@lo:400:kworker.0 Request processed in 43us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279502.643292:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116288 00000100:00100000:0.0:1713279502.643294:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1713279502.643294:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279502.643296:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116288 00000100:00100000:1.0:1713279502.643306:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200116800:0@lo:400:kworker.0 00000100:00100000:2.0:1713279502.643307:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200116416:12345-0@lo:400:kworker.0 Request processed in 54us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279502.643319:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99113 00000100:00100000:1.0:1713279502.643320:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279502.643331:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200116160:0@lo:400:kworker.0 00000100:00100000:3.0:1713279502.643337:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99114 00000100:00100000:0.0:1713279502.643343:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200116416:0@lo:400:kworker.0 00000100:00100000:3.0:1713279502.643343:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200116288:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1713279502.643346:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279472 00000100:00080000:1.0:1713279502.643350:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279472 00000100:00100000:0.0:1713279502.643352:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200116672:0@lo:400:kworker.0 00000100:00080000:1.0:1713279502.643352:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279472 00000100:00100000:1.0:1713279502.643358:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116544 00000100:00100000:2.0:1713279502.643358:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279502.643361:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200116928:0@lo:400:kworker.0 00000100:00100000:1.0:1713279502.643363:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116544 00000100:00100000:2.0:1713279502.643382:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200116608:0@lo:400:kworker.0 00000100:00100000:1.0:1713279502.643386:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116800 00000100:00100000:1.0:1713279502.643388:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116800 00000100:00100000:3.0:1713279502.643388:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200116288:12345-0@lo:400:kworker.0 Request processed in 45us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279502.643395:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99114 00000100:00100000:1.0:1713279502.643400:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116352 00000100:00100000:1.0:1713279502.643402:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116352 00000100:00100000:0.0:1713279502.643404:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:0.0:1713279502.643409:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200116544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279502.643444:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:1.0:1713279502.643449:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200116800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279502.643464:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279502.643479:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200116544:12345-0@lo:400:kworker.0 Request processed in 68us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279502.643486:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200116800:12345-0@lo:400:kworker.0 Request processed in 36us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279502.643489:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:2.0:1713279502.643492:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200116864:0@lo:400:kworker.0 00000100:00100000:0.0:1713279502.643495:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:3.0:1713279502.643499:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200116352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279502.643506:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:2.0:1713279502.643522:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279502.643531:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116608 00000100:00100000:1.0:1713279502.643534:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116608 00000100:00100000:0.0:1713279502.643545:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116864 00000100:00100000:0.0:1713279502.643549:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116864 00000100:00100000:1.0:1713279502.643552:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1713279502.643557:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200116608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279502.643559:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200116352:12345-0@lo:400:kworker.0 Request processed in 60us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279502.643564:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200116352:0@lo:400:kworker.0 00000100:00100000:0.0:1713279502.643569:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1713279502.643570:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:0.0:1713279502.643574:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200116864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279502.643584:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200116608:12345-0@lo:400:kworker.0 Request processed in 26us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279502.643591:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1713279502.643592:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200116608:0@lo:400:kworker.0 00000100:00100000:0.0:1713279502.643603:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200116864:12345-0@lo:400:kworker.0 Request processed in 28us (81us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279502.643603:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279472 00000100:00080000:1.0:1713279502.643606:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279472 00000100:00080000:1.0:1713279502.643608:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279472 00000100:00100000:2.0:1713279502.643608:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200116864:0@lo:400:kworker.0 00000100:00100000:0.0:1713279502.643609:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1713279502.643628:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200116288:0@lo:400:kworker.0 00000100:00100000:1.0:1713279502.643639:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200116544:0@lo:400:kworker.0 00000100:00100000:1.0:1713279502.643647:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200116800:0@lo:400:kworker.0 00000100:00100000:1.0:1713279502.658579:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713279502.658580:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713279502.658596:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200117056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279502.658596:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200116992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279502.658640:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279502.658666:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117056 00000100:00100000:3.0:1713279502.658671:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279502.658675:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117056 00000100:00100000:0.0:1713279502.658721:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200116992 00000100:00100000:0.0:1713279502.658724:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200116992 00000100:00100000:3.0:1713279502.658726:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1713279502.658734:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200117056:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279502.658764:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1713279502.658771:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200116992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1713279502.658785:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:0.0:1713279502.658789:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279502.658838:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200116992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279502.658840:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200117056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279502.658845:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1713279502.658850:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1713279502.658879:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200116992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279502.658881:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200117056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279503.378724:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200117120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279503.378828:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279503.378915:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117120 00000100:00100000:3.0:1713279503.378928:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117120 00000100:00100000:3.0:1713279503.378996:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1713279503.379008:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200117120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1713279503.379051:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279503.379131:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200117120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279503.379143:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1713279503.379174:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200117120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279503.394681:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200117184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1713279503.394770:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279503.394844:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117184 00000100:00100000:3.0:1713279503.394853:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117184 00000100:00100000:3.0:1713279503.394909:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1713279503.394920:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200117184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1713279503.394957:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279503.395035:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200117184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279503.395048:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1713279503.395072:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200117184:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279503.600786:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279504.203566:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279504.203617:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279504.203646:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279504.203663:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338496 00000100:00100000:0.0:1713279504.203673:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279504.203674:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338496 00000100:00100000:0.0:1713279504.203705:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279504.203722:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279504.203768:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338560 00000100:00100000:3.0:1713279504.203768:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 461 00000100:00100000:0.0:1713279504.203771:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279504.203778:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136be4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281338496:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279504.203780:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338560 00000100:00100000:0.0:1713279504.203788:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279504.203824:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279504.203834:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338624 00000100:00080000:1.0:1713279504.203837:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279474 00000100:00100000:2.0:1713279504.203839:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338624 00000100:00080000:1.0:1713279504.203848:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279474 00000100:00100000:3.0:1713279504.203850:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136be4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281338496:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 73us (294us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279504.203852:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279474 00000100:00100000:3.0:1713279504.203859:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 461 00000100:00100000:2.0:1713279504.203862:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338816 00000100:00100000:2.0:1713279504.203865:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338816 00000100:00100000:1.0:1713279504.203876:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338880 00000100:00100000:1.0:1713279504.203884:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338880 00000100:00100000:2.0:1713279504.203889:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 823 00000100:00100000:2.0:1713279504.203897:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281338560:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279504.203898:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 824 00000100:00100000:3.0:1713279504.203904:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281338624:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279504.203931:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281338624:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279504.203936:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 825 00000100:00100000:1.0:1713279504.203947:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281338816:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279504.203948:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281338560:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 50us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279504.203950:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 824 00000100:00100000:2.0:1713279504.203956:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 823 00000100:00100000:3.0:1713279504.203970:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 826 00000100:00100000:3.0:1713279504.203975:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281338880:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279504.204010:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281338880:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279504.204013:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338688 00000100:00100000:3.0:1713279504.204017:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 826 00000100:00100000:0.0:1713279504.204022:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338688 00000100:00100000:1.0:1713279504.204023:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281338816:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 73us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279504.204036:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 825 00000100:00100000:0.0:1713279504.204065:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338752 00000100:00080000:1.0:1713279504.204067:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279474 00000100:00100000:3.0:1713279504.204068:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281338944 00000100:00100000:0.0:1713279504.204070:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338752 00000100:00080000:1.0:1713279504.204072:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279474 00000100:00100000:3.0:1713279504.204072:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281338944 00000100:00080000:1.0:1713279504.204075:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279474 00000100:00080000:1.0:1713279504.204079:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279474 00000100:00100000:2.0:1713279504.204080:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339008 00000100:00080000:1.0:1713279504.204083:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279474 00000100:00100000:2.0:1713279504.204084:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339008 00000100:00100000:0.0:1713279504.204100:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 393 00000100:00100000:3.0:1713279504.204107:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 394 00000100:00100000:0.0:1713279504.204111:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281338688:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279504.204113:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281338752:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279504.204123:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 395 00000100:00100000:2.0:1713279504.204130:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 396 00000100:00100000:1.0:1713279504.204131:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281338944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279504.204136:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281339008:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279504.204146:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281338752:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279504.204152:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 394 00000100:00100000:0.0:1713279504.204165:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281338688:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 54us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279504.204168:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281339008:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279504.204175:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 393 00000100:00100000:1.0:1713279504.204180:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281338944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279504.204180:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 396 00000100:00100000:1.0:1713279504.204191:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 395 00000100:00080000:1.0:1713279504.204215:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279474 00010000:00010000:2.0:1713279504.602804:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279505.298749:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200117248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1713279505.298834:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279505.298899:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117248 00000100:00100000:3.0:1713279505.298910:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117248 00000100:00100000:3.0:1713279505.298968:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99115 00000100:00100000:3.0:1713279505.298976:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200117248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279505.299016:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279505.299085:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200117248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279505.299093:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99115 00000100:00100000:2.0:1713279505.299133:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200117248:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279505.604804:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279506.606684:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279506.978661:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200117312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279506.978759:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279506.978825:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117312 00000100:00100000:3.0:1713279506.978834:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117312 00000100:00100000:3.0:1713279506.978888:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99116 00000100:00100000:3.0:1713279506.978896:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200117312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1713279506.978940:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:3.0:1713279506.979008:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200117312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279506.979018:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99116 00000100:00100000:0.0:1713279506.979038:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200117312:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279507.608741:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279507.650670:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200117568:0@lo:400:kworker.0 00000100:00100000:3.0:1713279507.650684:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200117504:0@lo:400:kworker.0 00000100:00100000:2.0:1713279507.650690:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200117376:0@lo:400:kworker.0 00000100:00100000:1.0:1713279507.650729:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200117440:0@lo:400:kworker.0 00000100:00100000:0.0:1713279507.650786:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279507.650787:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279507.650806:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279507.650813:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117568 00000100:00100000:3.0:1713279507.650818:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200117760:0@lo:400:kworker.0 00000100:00100000:1.0:1713279507.650821:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117568 00000100:00100000:0.0:1713279507.650830:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200117824:0@lo:400:kworker.0 00000100:00100000:2.0:1713279507.650840:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200117632:0@lo:400:kworker.0 00000100:00100000:3.0:1713279507.650841:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279507.650854:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279507.650864:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117760 00000100:00100000:3.0:1713279507.650864:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090eb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200118016:0@lo:400:kworker.0 00000100:00100000:1.0:1713279507.650867:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117760 00000100:00100000:0.0:1713279507.650870:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200118080:0@lo:400:kworker.0 00000100:00100000:2.0:1713279507.650875:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279507.650884:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279507.650888:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279507.650892:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118016 00000100:00100000:1.0:1713279507.650896:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118016 00000100:00100000:2.0:1713279507.650896:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200117888:0@lo:400:kworker.0 00000100:00100000:0.0:1713279507.650902:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713279507.650908:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200118144:0@lo:400:kworker.0 00000100:00100000:1.0:1713279507.650923:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:2.0:1713279507.650929:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279507.650933:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:1.0:1713279507.650934:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200117568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279507.650939:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117824 00000100:00100000:0.0:1713279507.650944:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117824 00000100:00100000:3.0:1713279507.650944:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200117760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279507.650973:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118080 00000100:00100000:0.0:1713279507.650976:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118080 00000100:00100000:2.0:1713279507.650981:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117376 00000100:00100000:0.0:1713279507.650988:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117888 00000100:00100000:2.0:1713279507.650988:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117376 00000100:00100000:0.0:1713279507.650990:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117888 00000100:00100000:1.0:1713279507.650999:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200117568:12345-0@lo:400:kworker.0 Request processed in 66us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279507.651001:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200117760:12345-0@lo:400:kworker.0 Request processed in 58us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279507.651006:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1713279507.651009:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:0.0:1713279507.651012:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200117824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279507.651013:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:1.0:1713279507.651028:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1713279507.651029:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1713279507.651033:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200118016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279507.651039:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200117376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279507.651046:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1713279507.651050:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200117824:12345-0@lo:400:kworker.0 Request processed in 37us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279507.651051:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200118080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279507.651057:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1713279507.651059:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200118016:12345-0@lo:400:kworker.0 Request processed in 25us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279507.651065:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:0.0:1713279507.651071:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1713279507.651075:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200117888:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1713279507.651085:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279477 00000100:00080000:1.0:1713279507.651089:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279477 00000100:00100000:3.0:1713279507.651089:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200118080:12345-0@lo:400:kworker.0 Request processed in 37us (200us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279507.651091:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279477 00000100:00080000:1.0:1713279507.651093:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279477 00000100:00100000:3.0:1713279507.651095:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1713279507.651103:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279507.651103:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200117376:12345-0@lo:400:kworker.0 Request processed in 63us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279507.651104:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200117888:12345-0@lo:400:kworker.0 Request processed in 28us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279507.651111:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1713279507.651119:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200117696:0@lo:400:kworker.0 00000100:00100000:3.0:1713279507.651121:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117504 00000100:00100000:2.0:1713279507.651122:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1713279507.651126:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117504 00000100:00100000:0.0:1713279507.651130:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117632 00000100:00100000:0.0:1713279507.651133:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117632 00000100:00100000:1.0:1713279507.651139:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279507.651148:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200117952:0@lo:400:kworker.0 00000100:00100000:3.0:1713279507.651153:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99117 00000100:00100000:3.0:1713279507.651158:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200117504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279507.651163:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279507.651168:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99118 00000100:00100000:2.0:1713279507.651171:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117440 00000100:00100000:0.0:1713279507.651172:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200117632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279507.651177:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117440 00000100:00100000:3.0:1713279507.651188:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200117504:12345-0@lo:400:kworker.0 Request processed in 29us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279507.651191:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117696 00000100:00100000:1.0:1713279507.651194:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117696 00000100:00100000:3.0:1713279507.651195:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99117 00000100:00100000:0.0:1713279507.651202:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200117632:12345-0@lo:400:kworker.0 Request processed in 28us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279507.651203:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200117952 00000100:00100000:2.0:1713279507.651207:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200117952 00000100:00100000:0.0:1713279507.651208:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99118 00000100:00100000:3.0:1713279507.651216:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:1.0:1713279507.651222:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:3.0:1713279507.651223:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200117440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279507.651227:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200117696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279507.651232:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279507.651254:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200117440:12345-0@lo:400:kworker.0 Request processed in 31us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279507.651255:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:1.0:1713279507.651258:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200117696:12345-0@lo:400:kworker.0 Request processed in 30us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279507.651261:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200117824:0@lo:400:kworker.0 00000100:00100000:3.0:1713279507.651261:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:1.0:1713279507.651264:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:2.0:1713279507.651264:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200117952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279507.651273:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200118080:0@lo:400:kworker.0 00000100:00100000:0.0:1713279507.651282:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200117568:0@lo:400:kworker.0 00000100:00080000:1.0:1713279507.651284:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279477 00000100:00100000:3.0:1713279507.651293:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200117440:0@lo:400:kworker.0 00000100:00100000:3.0:1713279507.651308:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200117696:0@lo:400:kworker.0 00000100:00100000:0.0:1713279507.651309:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118144 00000100:00100000:0.0:1713279507.651312:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118144 00000100:00100000:2.0:1713279507.651318:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200117952:12345-0@lo:400:kworker.0 Request processed in 54us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279507.651319:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200117952:0@lo:400:kworker.0 00000100:00080000:1.0:1713279507.651324:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279477 00000100:00100000:2.0:1713279507.651330:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:0.0:1713279507.651334:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1713279507.651339:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200118144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279507.651349:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090eb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200118016:0@lo:400:kworker.0 00000100:00100000:3.0:1713279507.651359:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200117504:0@lo:400:kworker.0 00000100:00100000:3.0:1713279507.651367:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200117760:0@lo:400:kworker.0 00000100:00100000:2.0:1713279507.651372:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200117376:0@lo:400:kworker.0 00000100:00100000:0.0:1713279507.651373:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200118144:12345-0@lo:400:kworker.0 Request processed in 32us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279507.651379:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1713279507.651390:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200117632:0@lo:400:kworker.0 00000100:00100000:1.0:1713279507.651403:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200118144:0@lo:400:kworker.0 00000100:00100000:2.0:1713279507.651406:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200117888:0@lo:400:kworker.0 00000100:00100000:2.0:1713279507.666566:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200118272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279507.666606:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279507.666649:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200118208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279507.666677:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118272 00000100:00100000:0.0:1713279507.666686:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118272 00000100:00100000:3.0:1713279507.666690:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279507.666758:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118208 00000100:00100000:0.0:1713279507.666761:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118208 00000100:00100000:1.0:1713279507.666781:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1713279507.666791:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200118272:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279507.666793:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1713279507.666800:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200118208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1713279507.666822:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:0.0:1713279507.666824:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279507.666872:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200118272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279507.666880:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1713279507.666886:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200118208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279507.666894:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200118272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279507.666895:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1713279507.666924:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200118208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279508.386757:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200118336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279508.386847:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279508.387020:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118336 00000100:00100000:0.0:1713279508.387032:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118336 00000100:00100000:0.0:1713279508.387093:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1713279508.387101:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200118336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279508.387141:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279508.387212:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200118336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279508.387220:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1713279508.387264:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200118336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279508.402637:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200118400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1713279508.402692:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279508.402785:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118400 00000100:00100000:0.0:1713279508.402794:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118400 00000100:00100000:0.0:1713279508.402837:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1713279508.402844:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200118400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279508.402863:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279508.402915:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200118400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279508.402922:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1713279508.402986:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200118400:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279508.610761:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279509.210926:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279509.210971:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279509.211000:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339136 00000100:00100000:0.0:1713279509.211001:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279509.211008:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339136 00000100:00100000:0.0:1713279509.211019:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279509.211036:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339072 00000100:00100000:2.0:1713279509.211043:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339072 00000100:00100000:0.0:1713279509.211044:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279509.211045:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339200 00000100:00100000:1.0:1713279509.211047:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339200 00000100:00100000:0.0:1713279509.211058:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279509.211062:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339392 00000100:00100000:1.0:1713279509.211064:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339392 00000100:00100000:0.0:1713279509.211070:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279509.211073:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 463 00000100:00100000:1.0:1713279509.211076:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 833 00000100:00100000:2.0:1713279509.211080:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281339072:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279509.211081:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279509.211082:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281339136:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279509.211101:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339456 00000100:00100000:0.0:1713279509.211106:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279509.211106:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339456 00000100:00100000:3.0:1713279509.211128:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 834 00000100:00100000:1.0:1713279509.211130:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281339136:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279509.211133:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281339072:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 52us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279509.211133:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281339200:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279509.211137:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 833 00000100:00100000:2.0:1713279509.211139:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 463 00000100:00100000:1.0:1713279509.211151:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 835 00000100:00100000:1.0:1713279509.211155:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281339392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279509.211158:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281339200:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279509.211162:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 834 00000100:00100000:3.0:1713279509.211170:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 836 00000100:00100000:3.0:1713279509.211172:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281339456:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279509.211178:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281339392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279509.211185:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 835 00000100:00100000:3.0:1713279509.211185:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281339456:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 11us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279509.211189:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 836 00000100:00080000:1.0:1713279509.211199:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279479 00000100:00080000:1.0:1713279509.211201:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279479 00000100:00100000:2.0:1713279509.211201:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339264 00000100:00080000:1.0:1713279509.211202:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279479 00000100:00100000:2.0:1713279509.211205:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339264 00000100:00100000:3.0:1713279509.211211:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339328 00000100:00100000:3.0:1713279509.211213:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339328 00000100:00080000:1.0:1713279509.211215:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279479 00000100:00080000:1.0:1713279509.211216:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279479 00000100:00100000:3.0:1713279509.211225:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339520 00000100:00100000:3.0:1713279509.211226:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339520 00000100:00100000:2.0:1713279509.211231:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339584 00000100:00100000:2.0:1713279509.211233:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339584 00000100:00100000:0.0:1713279509.211236:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 401 00000100:00100000:1.0:1713279509.211242:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 402 00000100:00100000:0.0:1713279509.211243:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281339328:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279509.211246:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281339264:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279509.211249:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 403 00000100:00100000:3.0:1713279509.211252:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281339520:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279509.211255:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 404 00000100:00100000:2.0:1713279509.211260:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281339584:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279509.211265:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281339264:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279509.211269:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 402 00000100:00100000:3.0:1713279509.211271:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281339520:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 18us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279509.211273:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281339328:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279509.211275:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 403 00000100:00100000:0.0:1713279509.211279:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 401 00000100:00080000:3.0:1713279509.211284:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279479 00000100:00100000:2.0:1713279509.211285:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281339584:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (178us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279509.211286:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279479 00000100:00100000:2.0:1713279509.211291:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 404 00010000:00010000:2.0:1713279509.612755:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279510.306564:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713279510.306581:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200118464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279510.306630:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279510.306667:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118464 00000100:00100000:2.0:1713279510.306674:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118464 00000100:00100000:2.0:1713279510.306724:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99119 00000100:00100000:2.0:1713279510.306729:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200118464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279510.306754:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279510.306793:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200118464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279510.306798:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99119 00000100:00100000:0.0:1713279510.306821:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200118464:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279510.614642:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279511.616741:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279511.986768:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713279511.986796:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200118528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1713279511.986872:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279511.986914:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118528 00000100:00100000:2.0:1713279511.986927:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118528 00000100:00100000:2.0:1713279511.986976:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99120 00000100:00100000:2.0:1713279511.986984:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200118528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279511.987022:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279511.987096:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200118528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279511.987105:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99120 00000100:00100000:3.0:1713279511.987137:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200118528:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279512.618755:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279512.658663:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200118784:0@lo:400:kworker.0 00000100:00100000:0.0:1713279512.658665:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090eb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200118592:0@lo:400:kworker.0 00000100:00100000:3.0:1713279512.658700:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200118656:0@lo:400:kworker.0 00000100:00100000:2.0:1713279512.658714:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200118720:0@lo:400:kworker.0 00000100:00100000:0.0:1713279512.658772:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279512.658772:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279512.658775:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279512.658807:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118592 00000100:00100000:0.0:1713279512.658816:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200118848:0@lo:400:kworker.0 00000100:00100000:3.0:1713279512.658816:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118592 00000100:00100000:1.0:1713279512.658817:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200119040:0@lo:400:kworker.0 00000100:00100000:2.0:1713279512.658819:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200118976:0@lo:400:kworker.0 00000100:00100000:0.0:1713279512.658846:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279512.658849:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279512.658850:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279512.658861:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200119104:0@lo:400:kworker.0 00000100:00100000:1.0:1713279512.658866:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200119296:0@lo:400:kworker.0 00000100:00100000:3.0:1713279512.658867:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1713279512.658870:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200119232:0@lo:400:kworker.0 00000100:00100000:3.0:1713279512.658874:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200118592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279512.658879:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279512.658888:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279512.658895:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200119360:0@lo:400:kworker.0 00000100:00100000:1.0:1713279512.658896:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118784 00000100:00100000:1.0:1713279512.658901:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118784 00000100:00100000:0.0:1713279512.658915:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279512.658927:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200118592:12345-0@lo:400:kworker.0 Request processed in 52us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279512.658930:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118976 00000100:00100000:2.0:1713279512.658931:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119040 00000100:00100000:1.0:1713279512.658933:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118976 00000100:00100000:3.0:1713279512.658935:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1713279512.658936:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119040 00000100:00100000:1.0:1713279512.658948:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119232 00000100:00100000:0.0:1713279512.658949:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090eb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200118592:0@lo:400:kworker.0 00000100:00100000:1.0:1713279512.658950:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119232 00000100:00100000:2.0:1713279512.658963:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119104 00000100:00080000:3.0:1713279512.658964:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279482 00000100:00100000:2.0:1713279512.658966:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119104 00000100:00100000:1.0:1713279512.658967:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00080000:3.0:1713279512.658968:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279482 00000100:00080000:3.0:1713279512.658971:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279482 00000100:00100000:1.0:1713279512.658973:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200118784:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279512.658973:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279482 00000100:00100000:2.0:1713279512.658978:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119360 00000100:00100000:2.0:1713279512.658980:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119360 00000100:00100000:0.0:1713279512.658986:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1713279512.658986:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1713279512.658991:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200118976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279512.658993:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200119040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279512.659001:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1713279512.659007:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200119104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279512.659008:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200118784:12345-0@lo:400:kworker.0 Request processed in 35us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279512.659015:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:3.0:1713279512.659026:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200118976:12345-0@lo:400:kworker.0 Request processed in 34us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279512.659031:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:1.0:1713279512.659039:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200119232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279512.659039:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:0.0:1713279512.659040:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200119040:12345-0@lo:400:kworker.0 Request processed in 43us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279512.659047:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1713279512.659051:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200119104:12345-0@lo:400:kworker.0 Request processed in 43us (170us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279512.659056:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279482 00000100:00100000:2.0:1713279512.659058:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1713279512.659063:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200119232:12345-0@lo:400:kworker.0 Request processed in 27us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279512.659065:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279512.659066:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1713279512.659070:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:0.0:1713279512.659072:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200119360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279512.659078:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118656 00000100:00100000:3.0:1713279512.659080:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200118912:0@lo:400:kworker.0 00000100:00100000:1.0:1713279512.659081:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118656 00000100:00100000:0.0:1713279512.659096:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200119360:12345-0@lo:400:kworker.0 Request processed in 24us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279512.659096:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:1.0:1713279512.659102:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200118656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279512.659103:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1713279512.659103:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279512.659107:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200118976:0@lo:400:kworker.0 00000100:00100000:3.0:1713279512.659115:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200119168:0@lo:400:kworker.0 00000100:00100000:2.0:1713279512.659119:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200119232:0@lo:400:kworker.0 00000100:00100000:0.0:1713279512.659122:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118720 00000100:00100000:0.0:1713279512.659126:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118720 00000100:00100000:1.0:1713279512.659126:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200118656:12345-0@lo:400:kworker.0 Request processed in 25us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279512.659132:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:3.0:1713279512.659133:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279512.659142:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118912 00000100:00100000:2.0:1713279512.659143:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119168 00000100:00100000:1.0:1713279512.659145:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118912 00000100:00100000:2.0:1713279512.659146:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119168 00000100:00100000:0.0:1713279512.659150:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200118848 00000100:00100000:0.0:1713279512.659152:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200118848 00000100:00100000:3.0:1713279512.659159:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200118656:0@lo:400:kworker.0 00000100:00100000:1.0:1713279512.659164:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:0.0:1713279512.659167:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99121 00000100:00100000:1.0:1713279512.659168:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200118912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279512.659170:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:0.0:1713279512.659172:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200118720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279512.659176:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200119168:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279512.659183:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279482 00000100:00100000:1.0:1713279512.659201:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200118912:12345-0@lo:400:kworker.0 Request processed in 31us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279512.659202:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99122 00000100:00100000:3.0:1713279512.659208:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200118848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279512.659209:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:0.0:1713279512.659211:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200118720:12345-0@lo:400:kworker.0 Request processed in 36us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279512.659213:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200119168:12345-0@lo:400:kworker.0 Request processed in 37us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279512.659217:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99121 00000100:00100000:2.0:1713279512.659224:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1713279512.659238:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279512.659238:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200118848:12345-0@lo:400:kworker.0 Request processed in 30us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279512.659245:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99122 00000100:00100000:0.0:1713279512.659248:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200118848:0@lo:400:kworker.0 00000100:00100000:2.0:1713279512.659256:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200118720:0@lo:400:kworker.0 00000100:00100000:0.0:1713279512.659261:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200119104:0@lo:400:kworker.0 00000100:00100000:1.0:1713279512.659265:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200118784:0@lo:400:kworker.0 00000100:00100000:0.0:1713279512.659272:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200119360:0@lo:400:kworker.0 00000100:00100000:3.0:1713279512.659273:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200118912:0@lo:400:kworker.0 00000100:00100000:1.0:1713279512.659276:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200119040:0@lo:400:kworker.0 00000100:00100000:3.0:1713279512.659283:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200119168:0@lo:400:kworker.0 00000100:00100000:1.0:1713279512.659301:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119296 00000100:00100000:1.0:1713279512.659304:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119296 00000100:00100000:1.0:1713279512.659324:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00080000:3.0:1713279512.659326:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279482 00000100:00100000:1.0:1713279512.659329:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200119296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279512.659376:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200119296:12345-0@lo:400:kworker.0 Request processed in 46us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279512.659382:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1713279512.659453:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200119296:0@lo:400:kworker.0 00000100:00100000:2.0:1713279512.674556:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200119488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279512.674595:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279512.674601:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713279512.674623:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200119424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279512.674641:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119488 00000100:00100000:0.0:1713279512.674650:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119488 00000100:00100000:1.0:1713279512.674702:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279512.674742:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119424 00000100:00100000:0.0:1713279512.674746:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119424 00000100:00100000:2.0:1713279512.674757:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1713279512.674764:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200119488:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279512.674773:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1713279512.674781:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200119424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1713279512.674794:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:0.0:1713279512.674801:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279512.674837:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200119488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279512.674844:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1713279512.674861:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200119424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279512.674866:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200119488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279512.674869:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1713279512.674902:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200119424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279513.394769:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200119552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279513.394847:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279513.394959:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119552 00000100:00100000:0.0:1713279513.394972:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119552 00000100:00100000:0.0:1713279513.395045:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1713279513.395056:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200119552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279513.395096:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279513.395173:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200119552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279513.395181:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1713279513.395222:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200119552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279513.410701:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200119616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1713279513.410745:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279513.410822:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119616 00000100:00100000:0.0:1713279513.410829:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119616 00000100:00100000:0.0:1713279513.410860:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1713279513.410867:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200119616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279513.410883:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279513.410938:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200119616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279513.410945:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1713279513.410981:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200119616:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279513.620740:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279514.219535:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279514.219607:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279514.219682:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279514.219692:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339712 00000100:00100000:2.0:1713279514.219706:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339712 00000100:00100000:0.0:1713279514.219731:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279514.219739:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339648 00000100:00100000:3.0:1713279514.219748:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339648 00000100:00100000:0.0:1713279514.219760:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279514.219785:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279514.219785:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339776 00000100:00100000:2.0:1713279514.219789:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339776 00000100:00100000:3.0:1713279514.219795:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 465 00000100:00100000:3.0:1713279514.219803:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281339648:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279514.219808:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339968 00000100:00100000:0.0:1713279514.219810:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279514.219811:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339968 00000100:00100000:1.0:1713279514.219825:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339840 00000100:00100000:2.0:1713279514.219829:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 843 00000100:00100000:1.0:1713279514.219834:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339840 00000100:00100000:2.0:1713279514.219836:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281339712:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279514.219838:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279514.219873:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281339904 00000100:00100000:3.0:1713279514.219875:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281339648:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279514.219876:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281339904 00000100:00100000:3.0:1713279514.219884:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 465 00000100:00100000:2.0:1713279514.219886:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281339712:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 49us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279514.219890:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340096 00000100:00100000:1.0:1713279514.219893:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340096 00000100:00100000:2.0:1713279514.219894:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 843 00000100:00100000:2.0:1713279514.219911:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340032 00000100:00100000:1.0:1713279514.219912:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 409 00000100:00100000:2.0:1713279514.219914:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340032 00000100:00100000:0.0:1713279514.219915:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00080000:3.0:1713279514.219916:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279484 00000100:00080000:3.0:1713279514.219920:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279484 00000100:00100000:1.0:1713279514.219921:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281339840:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:3.0:1713279514.219922:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279484 00000100:00080000:3.0:1713279514.219925:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279484 00000100:00080000:3.0:1713279514.219927:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279484 00000100:00100000:2.0:1713279514.219931:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 844 00000100:00100000:2.0:1713279514.219936:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281339776:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279514.219948:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340160 00000100:00100000:3.0:1713279514.219951:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340160 00000100:00100000:1.0:1713279514.219966:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281339840:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279514.219966:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281339776:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279514.219972:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 844 00000100:00100000:1.0:1713279514.219974:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 409 00000100:00100000:2.0:1713279514.219982:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 845 00000100:00100000:2.0:1713279514.219986:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281339968:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279514.219989:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 410 00000100:00100000:1.0:1713279514.219994:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 411 00000100:00100000:3.0:1713279514.219995:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281339904:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279514.219999:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281340096:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279514.220008:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281339968:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279514.220015:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 845 00000100:00100000:1.0:1713279514.220022:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281340096:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279514.220024:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 846 00000100:00100000:2.0:1713279514.220028:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281340032:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279514.220033:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 411 00000100:00100000:3.0:1713279514.220036:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281339904:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279514.220043:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 412 00000100:00100000:1.0:1713279514.220048:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281340160:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279514.220048:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 410 00000100:00100000:2.0:1713279514.220050:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281340032:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279514.220056:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 846 00000100:00100000:1.0:1713279514.220067:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281340160:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279514.220074:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 412 00000100:00080000:3.0:1713279514.220076:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279484 00010000:00010000:2.0:1713279514.622835:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279515.314711:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713279515.314737:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200119680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1713279515.314821:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279515.314928:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119680 00000100:00100000:3.0:1713279515.314940:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119680 00000100:00100000:3.0:1713279515.315000:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99123 00000100:00100000:3.0:1713279515.315009:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200119680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279515.315049:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279515.315116:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200119680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279515.315125:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99123 00000100:00100000:1.0:1713279515.315168:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200119680:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279515.624615:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279516.626766:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279516.994799:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713279516.994823:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200119744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279516.994898:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279516.994962:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119744 00000100:00100000:3.0:1713279516.994972:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119744 00000100:00100000:3.0:1713279516.995027:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99124 00000100:00100000:3.0:1713279516.995036:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200119744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1713279516.995074:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:3.0:1713279516.995141:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200119744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279516.995149:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99124 00000100:00100000:0.0:1713279516.995177:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200119744:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279517.628746:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279517.666739:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200119808:0@lo:400:kworker.0 00000100:00100000:2.0:1713279517.666760:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e90b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200120000:0@lo:400:kworker.0 00000100:00100000:1.0:1713279517.666791:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009234c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200119872:0@lo:400:kworker.0 00000100:00100000:3.0:1713279517.666794:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200119936:0@lo:400:kworker.0 00000100:00100000:0.0:1713279517.666824:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279517.666826:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279517.666853:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279517.666873:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200120064:0@lo:400:kworker.0 00000100:00100000:3.0:1713279517.666942:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279517.666950:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200120128:0@lo:400:kworker.0 00000100:00100000:2.0:1713279517.666952:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200120256:0@lo:400:kworker.0 00000100:00100000:0.0:1713279517.666959:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279517.666973:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200120192:0@lo:400:kworker.0 00000100:00100000:1.0:1713279517.666976:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279517.666978:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200120320:0@lo:400:kworker.0 00000100:00100000:2.0:1713279517.666987:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279517.666989:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200120384:0@lo:400:kworker.0 00000100:00100000:0.0:1713279517.667006:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279517.667006:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279517.667011:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200120512:0@lo:400:kworker.0 00000100:00100000:1.0:1713279517.667024:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120000 00000100:00100000:0.0:1713279517.667025:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200120576:0@lo:400:kworker.0 00000100:00100000:3.0:1713279517.667026:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200120448:0@lo:400:kworker.0 00000100:00100000:1.0:1713279517.667032:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120000 00000100:00100000:2.0:1713279517.667033:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279517.667045:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279517.667053:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119936 00000100:00100000:0.0:1713279517.667059:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119936 00000100:00100000:1.0:1713279517.667070:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119872 00000100:00100000:2.0:1713279517.667071:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120256 00000100:00100000:1.0:1713279517.667072:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119872 00000100:00100000:2.0:1713279517.667077:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120256 00000100:00100000:3.0:1713279517.667079:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200119808 00000100:00100000:3.0:1713279517.667085:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200119808 00000100:00100000:0.0:1713279517.667086:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120064 00000100:00100000:1.0:1713279517.667086:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120128 00000100:00100000:0.0:1713279517.667088:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120064 00000100:00100000:1.0:1713279517.667089:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120128 00000100:00100000:1.0:1713279517.667102:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120192 00000100:00100000:0.0:1713279517.667104:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99125 00000100:00100000:1.0:1713279517.667104:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120192 00000100:00100000:2.0:1713279517.667108:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120320 00000100:00100000:2.0:1713279517.667110:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120320 00000100:00100000:0.0:1713279517.667111:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac449c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200119936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279517.667117:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120448 00000100:00100000:1.0:1713279517.667119:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120448 00000100:00100000:3.0:1713279517.667120:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1713279517.667125:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120512 00000100:00100000:2.0:1713279517.667127:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120512 00000100:00100000:3.0:1713279517.667129:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200119808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279517.667134:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:1.0:1713279517.667140:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200120000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279517.667142:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1713279517.667148:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200120256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279517.667166:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac449c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200119936:12345-0@lo:400:kworker.0 Request processed in 54us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279517.667174:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99125 00000100:00100000:1.0:1713279517.667186:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200120000:12345-0@lo:400:kworker.0 Request processed in 45us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279517.667198:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:2.0:1713279517.667199:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200120256:12345-0@lo:400:kworker.0 Request processed in 45us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279517.667201:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200119808:12345-0@lo:400:kworker.0 Request processed in 66us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279517.667206:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1713279517.667213:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:3.0:1713279517.667214:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1713279517.667217:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200119872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279517.667221:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1713279517.667226:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200120320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279517.667244:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200119872:12345-0@lo:400:kworker.0 Request processed in 26us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279517.667249:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200120320:12345-0@lo:400:kworker.0 Request processed in 22us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279517.667250:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00080000:3.0:1713279517.667254:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279487 00000100:00100000:2.0:1713279517.667256:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1713279517.667259:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00080000:3.0:1713279517.667260:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279487 00000100:00100000:1.0:1713279517.667263:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200120128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279517.667264:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00080000:3.0:1713279517.667264:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279487 00000100:00080000:3.0:1713279517.667267:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279487 00000100:00100000:2.0:1713279517.667268:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200120512:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279517.667271:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279487 00000100:00100000:1.0:1713279517.667285:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200120128:12345-0@lo:400:kworker.0 Request processed in 21us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279517.667291:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200120512:12345-0@lo:400:kworker.0 Request processed in 22us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279517.667293:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1713279517.667296:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1713279517.667298:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:3.0:1713279517.667302:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200120192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279517.667307:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:1.0:1713279517.667311:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200120448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279517.667335:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200120448:12345-0@lo:400:kworker.0 Request processed in 23us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279517.667341:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1713279517.667354:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99126 00000100:00100000:3.0:1713279517.667356:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200120192:12345-0@lo:400:kworker.0 Request processed in 53us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279517.667362:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200120064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279517.667367:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1713279517.667390:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200120512:0@lo:400:kworker.0 00000100:00100000:3.0:1713279517.667401:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279517.667402:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e90b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200120000:0@lo:400:kworker.0 00000100:00100000:2.0:1713279517.667409:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200120064:12345-0@lo:400:kworker.0 Request processed in 45us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279517.667438:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200120256:0@lo:400:kworker.0 00000100:00100000:2.0:1713279517.667472:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99126 00000100:00100000:3.0:1713279517.667491:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200119872:0@lo:400:kworker.0 00000100:00100000:3.0:1713279517.667503:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200120128:0@lo:400:kworker.0 00000100:00100000:2.0:1713279517.667510:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120384 00000100:00100000:2.0:1713279517.667516:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120384 00000100:00080000:3.0:1713279517.667532:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279487 00000100:00100000:2.0:1713279517.667565:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:2.0:1713279517.667573:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200120384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279517.667575:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200119936:0@lo:400:kworker.0 00000100:00100000:0.0:1713279517.667588:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200120192:0@lo:400:kworker.0 00000100:00100000:0.0:1713279517.667597:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200120448:0@lo:400:kworker.0 00000100:00100000:0.0:1713279517.667619:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279517.667659:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120576 00000100:00100000:1.0:1713279517.667665:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120576 00000100:00100000:0.0:1713279517.667676:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009234e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200119808:0@lo:400:kworker.0 00000100:00100000:2.0:1713279517.667676:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200120384:12345-0@lo:400:kworker.0 Request processed in 100us (273us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279517.667680:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279487 00000100:00100000:2.0:1713279517.667688:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:0.0:1713279517.667692:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200120064:0@lo:400:kworker.0 00000100:00100000:1.0:1713279517.667693:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1713279517.667698:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200120576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279517.667706:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200120320:0@lo:400:kworker.0 00000100:00100000:3.0:1713279517.667713:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200120384:0@lo:400:kworker.0 00000100:00100000:1.0:1713279517.667737:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200120576:12345-0@lo:400:kworker.0 Request processed in 38us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279517.667743:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1713279517.667758:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200120576:0@lo:400:kworker.0 00000100:00100000:0.0:1713279517.682727:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200120704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279517.682728:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200120640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279517.682798:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279517.682830:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120704 00000100:00100000:2.0:1713279517.682837:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120704 00000100:00100000:2.0:1713279517.682875:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1713279517.682881:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200120704:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279517.682889:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1713279517.682911:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279517.682915:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120640 00000100:00100000:0.0:1713279517.682922:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120640 00000100:00100000:0.0:1713279517.682949:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1713279517.682956:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200120640:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279517.682970:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200120704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (171us total) trans 0 rc 0/0 00002000:00000024:0.0:1713279517.682972:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279517.682977:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1713279517.683007:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200120640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279517.683015:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1713279517.683050:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200120640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279517.683092:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200120704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279518.402585:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200120768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279518.402676:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279518.402724:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120768 00000100:00100000:0.0:1713279518.402732:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120768 00000100:00100000:0.0:1713279518.402783:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1713279518.402796:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200120768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279518.402827:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279518.402884:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200120768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279518.402892:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:1.0:1713279518.402922:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200120768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279518.418596:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200120832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279518.418656:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279518.418677:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120832 00000100:00100000:2.0:1713279518.418685:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120832 00000100:00100000:2.0:1713279518.418718:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1713279518.418724:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200120832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279518.418744:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279518.418788:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200120832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279518.418794:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1713279518.418815:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200120832:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279518.630746:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279519.227550:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279519.227618:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279519.227657:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340224 00000100:00100000:3.0:1713279519.227680:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340224 00000100:00100000:0.0:1713279519.227695:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279519.227730:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 467 00000100:00100000:3.0:1713279519.227739:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281340224:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279519.227745:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279519.227765:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340288 00000100:00100000:0.0:1713279519.227771:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279519.227774:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340288 00000100:00100000:1.0:1713279519.227790:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340352 00000100:00100000:1.0:1713279519.227801:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340352 00000100:00100000:3.0:1713279519.227804:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281340224:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 65us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279519.227811:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 467 00000100:00100000:2.0:1713279519.227817:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 853 00000100:00100000:2.0:1713279519.227825:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281340288:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279519.227844:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 854 00000100:00080000:3.0:1713279519.227849:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279489 00000100:00100000:1.0:1713279519.227854:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281340352:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:3.0:1713279519.227854:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279489 00000100:00080000:3.0:1713279519.227856:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279489 00000100:00100000:2.0:1713279519.227871:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281340288:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279519.227878:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 853 00000100:00100000:3.0:1713279519.227883:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340416 00000100:00100000:3.0:1713279519.227887:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340416 00000100:00100000:1.0:1713279519.227903:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281340352:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279519.227910:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340480 00000100:00100000:3.0:1713279519.227912:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340480 00000100:00100000:1.0:1713279519.227914:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 854 00000100:00100000:2.0:1713279519.227919:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 417 00000100:00100000:2.0:1713279519.227924:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281340416:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279519.227939:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 418 00000100:00100000:3.0:1713279519.227944:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281340480:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279519.227948:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281340416:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279519.227954:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 417 00000100:00100000:3.0:1713279519.227973:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281340480:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279519.227979:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 418 00000100:00080000:3.0:1713279519.227992:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279489 00000100:00080000:3.0:1713279519.227994:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279489 00000100:00100000:3.0:1713279519.228022:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279519.228055:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279519.228079:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279519.228089:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340544 00000100:00100000:0.0:1713279519.228093:0:15749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340608 00000100:00100000:1.0:1713279519.228096:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340544 00000100:00100000:0.0:1713279519.228101:0:15749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340608 00000100:00100000:3.0:1713279519.228119:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279519.228131:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340736 00000100:00080000:3.0:1713279519.228134:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279489 00000100:00100000:1.0:1713279519.228135:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 855 00000100:00100000:2.0:1713279519.228136:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340736 00000100:00080000:3.0:1713279519.228137:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279489 00000100:00100000:1.0:1713279519.228144:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281340544:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279519.228146:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 856 00000100:00100000:0.0:1713279519.228156:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281340608:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279519.228165:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340672 00000100:00080000:3.0:1713279519.228165:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279489 00000100:00100000:2.0:1713279519.228168:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340672 00000100:00080000:3.0:1713279519.228182:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279489 00000100:00100000:2.0:1713279519.228186:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 419 00000100:00100000:2.0:1713279519.228191:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281340736:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279519.228198:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281340544:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279519.228215:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281340608:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 50us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279519.228221:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 855 00000100:00100000:0.0:1713279519.228227:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 856 00000100:00100000:2.0:1713279519.228229:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281340736:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279519.228235:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 419 00000100:00100000:1.0:1713279519.228252:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 420 00000100:00100000:1.0:1713279519.228262:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281340672:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279519.228335:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281340672:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 71us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279519.228347:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 420 00010000:00010000:2.0:1713279519.632688:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279520.322801:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200120896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279520.322885:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279520.322947:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120896 00000100:00100000:0.0:1713279520.322960:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120896 00000100:00100000:0.0:1713279520.323021:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99127 00000100:00100000:0.0:1713279520.323030:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200120896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1713279520.323069:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:0.0:1713279520.323139:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200120896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279520.323147:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99127 00000100:00100000:3.0:1713279520.323192:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200120896:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279520.634844:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279521.636778:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279522.002804:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200120960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279522.002886:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279522.002959:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200120960 00000100:00100000:2.0:1713279522.002974:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200120960 00000100:00100000:2.0:1713279522.003034:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99128 00000100:00100000:2.0:1713279522.003043:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200120960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279522.003080:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279522.003149:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200120960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279522.003158:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99128 00000100:00100000:0.0:1713279522.003186:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200120960:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279522.638829:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279522.674663:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200121088:0@lo:400:kworker.0 00000100:00100000:2.0:1713279522.674664:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200121024:0@lo:400:kworker.0 00000100:00100000:3.0:1713279522.674695:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200121152:0@lo:400:kworker.0 00000100:00100000:0.0:1713279522.674750:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279522.674756:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279522.674760:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279522.674811:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200121344:0@lo:400:kworker.0 00000100:00100000:2.0:1713279522.674811:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200121280:0@lo:400:kworker.0 00000100:00100000:3.0:1713279522.674818:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200121408:0@lo:400:kworker.0 00000100:00100000:1.0:1713279522.674825:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121088 00000100:00100000:0.0:1713279522.674834:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279522.674838:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121088 00000100:00100000:2.0:1713279522.674847:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279522.674860:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279522.674861:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200121600:0@lo:400:kworker.0 00000100:00100000:2.0:1713279522.674877:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200121536:0@lo:400:kworker.0 00000100:00100000:0.0:1713279522.674884:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279522.674889:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200121664:0@lo:400:kworker.0 00000100:00100000:1.0:1713279522.674892:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121344 00000100:00100000:1.0:1713279522.674897:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121344 00000100:00100000:2.0:1713279522.674910:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279522.674916:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121152 00000100:00100000:0.0:1713279522.674922:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121152 00000100:00100000:3.0:1713279522.674923:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279522.674931:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200121792:0@lo:400:kworker.0 00000100:00100000:1.0:1713279522.674938:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121408 00000100:00100000:1.0:1713279522.674942:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121408 00000100:00100000:0.0:1713279522.674950:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121280 00000100:00100000:0.0:1713279522.674952:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121280 00000100:00100000:3.0:1713279522.674953:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1713279522.674958:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279522.674964:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200121216:0@lo:400:kworker.0 00000100:00100000:1.0:1713279522.674968:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121600 00000100:00100000:0.0:1713279522.674971:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99129 00000100:00100000:1.0:1713279522.674971:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121600 00000100:00100000:0.0:1713279522.674978:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200121152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279522.674995:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279522.674996:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121664 00000100:00100000:1.0:1713279522.675000:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121664 00000100:00100000:2.0:1713279522.675008:0:15485:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121216 00000100:00100000:2.0:1713279522.675014:0:15485:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121216 00000100:00100000:3.0:1713279522.675019:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200121472:0@lo:400:kworker.0 00000100:00100000:1.0:1713279522.675025:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:0.0:1713279522.675030:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200121152:12345-0@lo:400:kworker.0 Request processed in 51us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279522.675036:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200121088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279522.675038:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99129 00000100:00100000:2.0:1713279522.675050:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:3.0:1713279522.675052:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279522.675053:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99130 00000100:00100000:0.0:1713279522.675059:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200121280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279522.675062:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200121344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279522.675073:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200121728:0@lo:400:kworker.0 00000100:00100000:0.0:1713279522.675094:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200121280:12345-0@lo:400:kworker.0 Request processed in 36us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279522.675101:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99130 00000100:00100000:3.0:1713279522.675102:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279522.675111:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200121088:12345-0@lo:400:kworker.0 Request processed in 74us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279522.675123:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:2.0:1713279522.675128:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200121344:12345-0@lo:400:kworker.0 Request processed in 68us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279522.675130:0:15749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:0.0:1713279522.675138:0:15749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200121408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279522.675139:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:3.0:1713279522.675148:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200121152:0@lo:400:kworker.0 00000100:00100000:1.0:1713279522.675149:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:1.0:1713279522.675156:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200121600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279522.675161:0:15485:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:2.0:1713279522.675168:0:15485:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200121664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279522.675195:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121024 00000100:00100000:3.0:1713279522.675201:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121024 00000100:00100000:1.0:1713279522.675204:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200121600:12345-0@lo:400:kworker.0 Request processed in 46us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279522.675209:0:15749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_031:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200121408:12345-0@lo:400:kworker.0 Request processed in 69us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279522.675212:0:15485:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_021:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200121664:12345-0@lo:400:kworker.0 Request processed in 43us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279522.675215:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:0.0:1713279522.675221:0:15749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:2.0:1713279522.675227:0:15485:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:1.0:1713279522.675233:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:1.0:1713279522.675239:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200121216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279522.675245:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1713279522.675254:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200121024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279522.675258:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121536 00000100:00100000:2.0:1713279522.675263:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121536 00000100:00100000:0.0:1713279522.675284:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200121600:0@lo:400:kworker.0 00000100:00100000:1.0:1713279522.675287:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200121216:12345-0@lo:400:kworker.0 Request processed in 47us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279522.675293:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:2.0:1713279522.675293:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121792 00000100:00100000:2.0:1713279522.675299:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121792 00000100:00100000:0.0:1713279522.675302:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200121088:0@lo:400:kworker.0 00000100:00100000:3.0:1713279522.675310:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200121024:12345-0@lo:400:kworker.0 Request processed in 54us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279522.675317:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200121344:0@lo:400:kworker.0 00000100:00100000:2.0:1713279522.675318:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121472 00000100:00100000:2.0:1713279522.675322:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121472 00000100:00100000:3.0:1713279522.675322:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1713279522.675332:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121728 00000100:00100000:1.0:1713279522.675336:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121728 00000100:00100000:2.0:1713279522.675345:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1713279522.675352:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200121536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279522.675356:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200121024:0@lo:400:kworker.0 00000100:00080000:3.0:1713279522.675360:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279492 00000100:00100000:1.0:1713279522.675361:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1713279522.675365:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200121792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279522.675366:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200121280:0@lo:400:kworker.0 00000100:00080000:3.0:1713279522.675367:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279492 00000100:00080000:3.0:1713279522.675371:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279492 00000100:00080000:3.0:1713279522.675374:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279492 00000100:00080000:3.0:1713279522.675378:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279492 00000100:00100000:0.0:1713279522.675389:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200121216:0@lo:400:kworker.0 00000100:00100000:0.0:1713279522.675399:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200121408:0@lo:400:kworker.0 00000100:00100000:1.0:1713279522.675405:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200121792:12345-0@lo:400:kworker.0 Request processed in 37us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279522.675406:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200121536:12345-0@lo:400:kworker.0 Request processed in 51us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279522.675406:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1713279522.675409:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200121664:0@lo:400:kworker.0 00000100:00100000:1.0:1713279522.675440:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1713279522.675453:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1713279522.675457:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200121728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279522.675464:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1713279522.675468:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200121536:0@lo:400:kworker.0 00000100:00100000:0.0:1713279522.675478:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200121792:0@lo:400:kworker.0 00000100:00100000:1.0:1713279522.675486:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200121728:12345-0@lo:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279522.675493:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1713279522.675498:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200121728:0@lo:400:kworker.0 00000100:00100000:3.0:1713279522.675499:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200121472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279522.675558:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200121472:12345-0@lo:400:kworker.0 Request processed in 141us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279522.675569:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1713279522.675570:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200121472:0@lo:400:kworker.0 00000100:00100000:3.0:1713279522.690581:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713279522.690593:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713279522.690620:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200121856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279522.690630:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200121920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279522.690666:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279522.690707:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279522.690780:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121856 00000100:00100000:2.0:1713279522.690785:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121920 00000100:00100000:0.0:1713279522.690791:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121856 00000100:00100000:2.0:1713279522.690794:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121920 00000100:00100000:0.0:1713279522.690840:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1713279522.690848:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200121856:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279522.690849:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1713279522.690857:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200121920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1713279522.690878:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279522.690879:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279522.690931:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200121856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279522.690941:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1713279522.690956:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200121856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279522.690959:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200121920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279522.690971:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1713279522.690989:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200121920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279523.410694:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200121984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279523.410775:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279523.410841:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200121984 00000100:00100000:0.0:1713279523.410854:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200121984 00000100:00100000:0.0:1713279523.410916:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1713279523.410924:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200121984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279523.410962:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279523.411051:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200121984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279523.411063:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1713279523.411077:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200121984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279523.426758:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713279523.426781:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200122048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279523.426836:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279523.426890:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122048 00000100:00100000:2.0:1713279523.426899:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122048 00000100:00100000:2.0:1713279523.426933:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1713279523.426940:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200122048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279523.426957:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279523.427003:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200122048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279523.427010:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1713279523.427024:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200122048:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279523.640749:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279524.235549:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279524.235656:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279524.235694:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279524.235705:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340864 00000100:00100000:2.0:1713279524.235718:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340864 00000100:00100000:0.0:1713279524.235728:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279524.235750:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279524.235770:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279524.235773:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340928 00000100:00100000:2.0:1713279524.235775:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340928 00000100:00100000:3.0:1713279524.235782:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340992 00000100:00100000:0.0:1713279524.235788:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279524.235791:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341120 00000100:00100000:3.0:1713279524.235792:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340992 00000100:00100000:2.0:1713279524.235793:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341120 00000100:00100000:1.0:1713279524.235803:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281340800 00000100:00100000:0.0:1713279524.235805:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279524.235812:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 863 00000100:00100000:1.0:1713279524.235813:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281340800 00000100:00100000:2.0:1713279524.235821:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281340864:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279524.235829:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341056 00000100:00100000:3.0:1713279524.235832:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341056 00000100:00100000:0.0:1713279524.235843:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279524.235850:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341248 00000100:00100000:3.0:1713279524.235853:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341248 00000100:00100000:1.0:1713279524.235857:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 469 00000100:00100000:1.0:1713279524.235864:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281340800:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279524.235865:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341312 00000100:00100000:3.0:1713279524.235867:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341312 00000100:00100000:0.0:1713279524.235869:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341184 00000100:00100000:0.0:1713279524.235875:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341184 00000100:00100000:3.0:1713279524.235885:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 425 00000100:00100000:3.0:1713279524.235893:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281340992:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279524.235900:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281340864:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 79us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279524.235905:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 864 00000100:00100000:1.0:1713279524.235907:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281340800:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279524.235913:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281340928:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279524.235916:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 469 00000100:00100000:2.0:1713279524.235921:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 863 00000100:00100000:2.0:1713279524.235941:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 865 00000100:00100000:3.0:1713279524.235942:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281340992:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279524.235946:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281341120:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279524.235954:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 425 00000100:00100000:0.0:1713279524.235957:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281340928:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279524.235965:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 864 00000100:00100000:1.0:1713279524.235967:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 426 00000100:00100000:2.0:1713279524.235971:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281341120:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279524.235975:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281341056:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279524.235976:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 427 00000100:00100000:2.0:1713279524.235978:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 865 00000100:00100000:0.0:1713279524.235983:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 866 00000100:00100000:3.0:1713279524.235985:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281341248:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279524.235988:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281341184:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279524.236001:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281341056:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279524.236008:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 428 00000100:00100000:0.0:1713279524.236016:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281341184:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279524.236016:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 426 00000100:00100000:2.0:1713279524.236017:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281341312:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279524.236024:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 866 00000100:00100000:3.0:1713279524.236031:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281341248:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 44us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279524.236038:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281341312:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279524.236043:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 427 00000100:00100000:2.0:1713279524.236048:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 428 00000100:00080000:3.0:1713279524.236071:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279494 00000100:00080000:3.0:1713279524.236077:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279494 00000100:00080000:3.0:1713279524.236081:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279494 00000100:00080000:3.0:1713279524.236085:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279494 00000100:00080000:3.0:1713279524.236088:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279494 00010000:00010000:2.0:1713279524.642754:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279525.330819:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713279525.330848:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200122112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1713279525.330924:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279525.331006:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122112 00000100:00100000:0.0:1713279525.331026:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122112 00000100:00100000:0.0:1713279525.331108:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99131 00000100:00100000:0.0:1713279525.331119:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200122112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1713279525.331173:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:0.0:1713279525.331277:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200122112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279525.331286:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99131 00000100:00100000:2.0:1713279525.331334:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200122112:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279525.644730:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279526.646898:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279527.010933:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200122176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279527.011042:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279527.011107:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122176 00000100:00100000:2.0:1713279527.011122:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122176 00000100:00100000:2.0:1713279527.011191:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99132 00000100:00100000:2.0:1713279527.011202:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200122176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279527.011247:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279527.011320:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200122176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279527.011329:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99132 00000100:00100000:0.0:1713279527.011386:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200122176:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279527.648679:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279527.682771:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200122240:0@lo:400:kworker.0 00000100:00100000:0.0:1713279527.682782:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200122368:0@lo:400:kworker.0 00000100:00100000:1.0:1713279527.682860:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200122432:0@lo:400:kworker.0 00000100:00100000:0.0:1713279527.682862:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279527.682862:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200122304:0@lo:400:kworker.0 00000100:00100000:2.0:1713279527.682864:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279527.682906:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200122624:0@lo:400:kworker.0 00000100:00100000:2.0:1713279527.682908:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200122496:0@lo:400:kworker.0 00000100:00100000:1.0:1713279527.682934:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279527.682947:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279527.682961:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122240 00000100:00100000:0.0:1713279527.682969:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122240 00000100:00100000:3.0:1713279527.682976:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122432 00000100:00100000:3.0:1713279527.682986:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122432 00000100:00100000:2.0:1713279527.682989:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200122752:0@lo:400:kworker.0 00000100:00100000:1.0:1713279527.682996:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200122688:0@lo:400:kworker.0 00000100:00100000:0.0:1713279527.683013:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1713279527.683016:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279527.683020:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200122240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279527.683037:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200123008:0@lo:400:kworker.0 00000100:00100000:1.0:1713279527.683038:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279527.683052:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:3.0:1713279527.683063:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200122432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279527.683065:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200122944:0@lo:400:kworker.0 00000100:00100000:2.0:1713279527.683065:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279527.683067:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200122240:12345-0@lo:400:kworker.0 Request processed in 47us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279527.683072:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1713279527.683094:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200122240:0@lo:400:kworker.0 00000100:00100000:1.0:1713279527.683095:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279527.683100:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279527.683118:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200122880:0@lo:400:kworker.0 00000100:00100000:2.0:1713279527.683127:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122752 00000100:00100000:2.0:1713279527.683131:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122752 00000100:00100000:0.0:1713279527.683134:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279527.683143:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122624 00000100:00100000:1.0:1713279527.683149:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122624 00000100:00100000:2.0:1713279527.683156:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122688 00000100:00100000:3.0:1713279527.683158:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200122432:12345-0@lo:400:kworker.0 Request processed in 93us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279527.683159:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122688 00000100:00100000:0.0:1713279527.683162:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123008 00000100:00100000:0.0:1713279527.683164:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123008 00000100:00100000:3.0:1713279527.683170:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1713279527.683172:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122944 00000100:00100000:2.0:1713279527.683174:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122944 00000100:00100000:1.0:1713279527.683179:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122880 00000100:00100000:0.0:1713279527.683181:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1713279527.683181:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122880 00000100:00100000:0.0:1713279527.683185:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200122752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279527.683190:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1713279527.683194:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200122688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279527.683201:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1713279527.683208:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200122752:12345-0@lo:400:kworker.0 Request processed in 23us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279527.683210:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200122624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279527.683214:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1713279527.683216:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:1.0:1713279527.683222:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200122880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279527.683224:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200122688:12345-0@lo:400:kworker.0 Request processed in 30us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279527.683225:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1713279527.683228:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008acce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200123008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279527.683229:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1713279527.683238:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1713279527.683241:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200122944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279527.683252:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008acce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200123008:12345-0@lo:400:kworker.0 Request processed in 24us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279527.683256:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1713279527.683262:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200122944:12345-0@lo:400:kworker.0 Request processed in 20us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279527.683266:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1713279527.683276:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200122880:12345-0@lo:400:kworker.0 Request processed in 53us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279527.683279:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200122624:12345-0@lo:400:kworker.0 Request processed in 67us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279527.683283:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1713279527.683287:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200122752:0@lo:400:kworker.0 00000100:00100000:3.0:1713279527.683290:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1713279527.683293:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122368 00000100:00100000:0.0:1713279527.683294:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200123008:0@lo:400:kworker.0 00000100:00100000:2.0:1713279527.683295:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122368 00000100:00100000:2.0:1713279527.683310:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122496 00000100:00100000:2.0:1713279527.683312:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122496 00000100:00100000:1.0:1713279527.683319:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99133 00000100:00080000:3.0:1713279527.683319:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279497 00000100:00100000:1.0:1713279527.683326:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200122368:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279527.683326:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279497 00000100:00100000:0.0:1713279527.683329:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99134 00000100:00080000:3.0:1713279527.683330:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279497 00000100:00100000:0.0:1713279527.683333:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008acce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200122496:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279527.683335:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279497 00000100:00100000:2.0:1713279527.683357:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200122624:0@lo:400:kworker.0 00000100:00100000:3.0:1713279527.683361:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279527.683383:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200122368:12345-0@lo:400:kworker.0 Request processed in 56us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279527.683386:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008acce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200122496:12345-0@lo:400:kworker.0 Request processed in 51us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279527.683390:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99133 00000100:00100000:2.0:1713279527.683392:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200122880:0@lo:400:kworker.0 00000100:00100000:0.0:1713279527.683395:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99134 00000100:00100000:2.0:1713279527.683405:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200122368:0@lo:400:kworker.0 00000100:00100000:3.0:1713279527.683463:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200122560:0@lo:400:kworker.0 00000100:00100000:1.0:1713279527.683473:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200122432:0@lo:400:kworker.0 00000100:00100000:0.0:1713279527.683476:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200122496:0@lo:400:kworker.0 00000100:00100000:1.0:1713279527.683487:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200122688:0@lo:400:kworker.0 00000100:00100000:3.0:1713279527.683494:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279527.683499:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200122944:0@lo:400:kworker.0 00000100:00100000:3.0:1713279527.683518:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200122816:0@lo:400:kworker.0 00000100:00100000:0.0:1713279527.683526:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122304 00000100:00100000:0.0:1713279527.683530:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122304 00000100:00100000:3.0:1713279527.683544:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279527.683616:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122560 00000100:00100000:0.0:1713279527.683619:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122560 00000100:00100000:1.0:1713279527.683621:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200122816 00000100:00100000:1.0:1713279527.683625:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200122816 00000100:00100000:0.0:1713279527.683639:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1713279527.683643:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200122304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279527.683646:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1713279527.683652:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200122560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279527.683655:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1713279527.683660:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200122816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279527.683676:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200122304:12345-0@lo:400:kworker.0 Request processed in 31us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279527.683680:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:2.0:1713279527.683683:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200122560:12345-0@lo:400:kworker.0 Request processed in 31us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279527.683687:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00080000:0.0:1713279527.683695:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279497 00000100:00100000:1.0:1713279527.683700:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200122816:12345-0@lo:400:kworker.0 Request processed in 39us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279527.683705:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200122304:0@lo:400:kworker.0 00000100:00100000:1.0:1713279527.683707:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:3.0:1713279527.683720:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200122560:0@lo:400:kworker.0 00000100:00100000:3.0:1713279527.683729:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200122816:0@lo:400:kworker.0 00000100:00100000:3.0:1713279527.698624:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200123072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279527.698648:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200123136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279527.698675:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279527.698727:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279527.698786:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123072 00000100:00100000:0.0:1713279527.698793:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123072 00000100:00100000:1.0:1713279527.698807:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123136 00000100:00100000:1.0:1713279527.698818:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123136 00000100:00100000:0.0:1713279527.698834:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1713279527.698840:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200123072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279527.698870:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279527.698877:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1713279527.698887:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200123136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279527.698909:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200123072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279527.698915:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00002000:00000024:1.0:1713279527.698915:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:3.0:1713279527.698949:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200123072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279527.698996:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200123136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279527.699008:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1713279527.699021:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012bbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200123136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279528.418826:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200123200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279528.418926:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279528.419017:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123200 00000100:00100000:2.0:1713279528.419032:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123200 00000100:00100000:2.0:1713279528.419104:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1713279528.419114:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200123200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279528.419160:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279528.419263:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200123200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279528.419272:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1713279528.419322:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200123200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279528.434743:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bbbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200123264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279528.434804:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279528.434873:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123264 00000100:00100000:2.0:1713279528.434885:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123264 00000100:00100000:2.0:1713279528.434927:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1713279528.434938:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200123264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279528.434962:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279528.435040:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200123264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279528.435052:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:0.0:1713279528.435080:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012bbbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200123264:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279528.650735:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279529.243888:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279529.243955:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279529.243995:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279529.244026:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279529.244047:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279529.244065:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279529.244067:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341440 00000100:00100000:0.0:1713279529.244084:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279529.244086:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341440 00000100:00100000:3.0:1713279529.244097:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341568 00000100:00100000:0.0:1713279529.244100:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279529.244105:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341376 00000100:00100000:3.0:1713279529.244108:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341568 00000100:00100000:2.0:1713279529.244119:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341376 00000100:00100000:0.0:1713279529.244141:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279529.244160:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341504 00000100:00100000:1.0:1713279529.244164:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341504 00000100:00100000:3.0:1713279529.244166:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341632 00000100:00100000:3.0:1713279529.244172:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341632 00000100:00100000:1.0:1713279529.244182:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341696 00000100:00100000:2.0:1713279529.244183:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 471 00000100:00100000:1.0:1713279529.244185:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341696 00000100:00100000:0.0:1713279529.244191:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341760 00000100:00100000:2.0:1713279529.244194:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281341376:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279529.244197:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341760 00000100:00100000:3.0:1713279529.244200:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341824 00000100:00100000:3.0:1713279529.244204:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341824 00000100:00100000:1.0:1713279529.244211:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 873 00000100:00100000:1.0:1713279529.244219:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281341440:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279529.244229:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341888 00000100:00100000:3.0:1713279529.244233:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341888 00000100:00100000:0.0:1713279529.244238:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 874 00000100:00100000:0.0:1713279529.244246:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281341504:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279529.244258:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 433 00000100:00100000:3.0:1713279529.244270:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281341568:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279529.244284:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281341376:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 91us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279529.244293:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 471 00000100:00100000:1.0:1713279529.244300:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281341440:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 81us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279529.244309:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281341504:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279529.244309:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 873 00000100:00100000:0.0:1713279529.244319:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 874 00000100:00100000:3.0:1713279529.244324:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281341568:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 56us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279529.244329:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 875 00000100:00100000:3.0:1713279529.244333:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 433 00000100:00100000:1.0:1713279529.244334:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281341696:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279529.244338:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 876 00000100:00100000:0.0:1713279529.244344:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281341760:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279529.244352:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 434 00000100:00100000:1.0:1713279529.244357:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281341696:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279529.244358:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281341632:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279529.244360:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 435 00000100:00100000:1.0:1713279529.244365:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 875 00000100:00100000:2.0:1713279529.244367:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281341824:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279529.244375:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281341760:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279529.244383:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 876 00000100:00100000:3.0:1713279529.244383:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281341632:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279529.244391:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 434 00000100:00100000:2.0:1713279529.244399:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281341824:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279529.244407:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 436 00000100:00100000:1.0:1713279529.244461:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281341888:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279529.244484:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 435 00000100:00100000:1.0:1713279529.244488:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281341888:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 74us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279529.244495:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 436 00000100:00080000:1.0:1713279529.244518:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279499 00000100:00080000:1.0:1713279529.244521:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279499 00000100:00080000:1.0:1713279529.244525:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279499 00000100:00080000:1.0:1713279529.244528:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279499 00000100:00080000:1.0:1713279529.244530:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279499 00010000:00010000:2.0:1713279529.652864:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279530.338777:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200123328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279530.338874:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279530.339047:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123328 00000100:00100000:1.0:1713279530.339065:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123328 00000100:00100000:1.0:1713279530.339149:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99135 00000100:00100000:1.0:1713279530.339157:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200123328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1713279530.339206:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:1.0:1713279530.339302:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200123328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279530.339311:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99135 00000100:00100000:3.0:1713279530.339361:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200123328:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279530.654849:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279531.656822:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279532.018874:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200123392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279532.018998:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279532.019133:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123392 00000100:00100000:1.0:1713279532.019149:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123392 00000100:00100000:1.0:1713279532.019218:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99136 00000100:00100000:1.0:1713279532.019228:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200123392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1713279532.019276:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:1.0:1713279532.019335:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200123392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279532.019344:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99136 00000100:00100000:0.0:1713279532.019385:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200123392:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279532.658864:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279532.690755:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bbbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200123456:0@lo:400:kworker.0 00000100:00100000:0.0:1713279532.690763:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200123520:0@lo:400:kworker.0 00000100:00100000:0.0:1713279532.690856:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279532.690857:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200123648:0@lo:400:kworker.0 00000100:00100000:2.0:1713279532.690859:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279532.690899:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200123584:0@lo:400:kworker.0 00000100:00100000:0.0:1713279532.690902:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200123776:0@lo:400:kworker.0 00000100:00100000:2.0:1713279532.690905:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200123712:0@lo:400:kworker.0 00000100:00100000:1.0:1713279532.690909:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279532.690935:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123456 00000100:00100000:0.0:1713279532.690945:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123456 00000100:00100000:1.0:1713279532.690949:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200123904:0@lo:400:kworker.0 00000100:00100000:2.0:1713279532.690966:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279532.690976:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279532.690993:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200124160:0@lo:400:kworker.0 00000100:00100000:2.0:1713279532.690995:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200123968:0@lo:400:kworker.0 00000100:00100000:0.0:1713279532.690997:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1713279532.691003:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279532.691005:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200123456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279532.691007:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279532.691021:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279532.691037:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123520 00000100:00100000:1.0:1713279532.691041:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123520 00000100:00100000:2.0:1713279532.691043:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200124224:0@lo:400:kworker.0 00000100:00100000:3.0:1713279532.691048:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200123840:0@lo:400:kworker.0 00000100:00100000:0.0:1713279532.691054:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200123456:12345-0@lo:400:kworker.0 Request processed in 50us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279532.691063:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279532.691065:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1713279532.691067:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123648 00000100:00100000:1.0:1713279532.691069:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123648 00000100:00100000:3.0:1713279532.691072:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279532.691087:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123840 00000100:00100000:3.0:1713279532.691088:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200124096:0@lo:400:kworker.0 00000100:00100000:1.0:1713279532.691089:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123840 00000100:00100000:2.0:1713279532.691094:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012bbbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200123456:0@lo:400:kworker.0 00000100:00100000:0.0:1713279532.691101:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123712 00000100:00100000:0.0:1713279532.691104:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123712 00000100:00100000:3.0:1713279532.691105:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279532.691107:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:1.0:1713279532.691113:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200123520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279532.691122:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123584 00000100:00100000:0.0:1713279532.691125:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123584 00000100:00100000:0.0:1713279532.691138:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99137 00000100:00100000:0.0:1713279532.691142:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200123712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279532.691145:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200123520:12345-0@lo:400:kworker.0 Request processed in 32us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279532.691151:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123904 00000100:00100000:1.0:1713279532.691156:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:3.0:1713279532.691156:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124096 00000100:00100000:2.0:1713279532.691157:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123904 00000100:00100000:3.0:1713279532.691163:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124096 00000100:00100000:1.0:1713279532.691168:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1713279532.691171:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200123712:12345-0@lo:400:kworker.0 Request processed in 28us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279532.691172:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200123648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279532.691176:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99137 00000100:00100000:0.0:1713279532.691185:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99138 00000100:00100000:0.0:1713279532.691188:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200123584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279532.691195:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200123648:12345-0@lo:400:kworker.0 Request processed in 22us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279532.691198:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124160 00000100:00100000:1.0:1713279532.691201:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:2.0:1713279532.691202:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124160 00000100:00100000:3.0:1713279532.691209:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1713279532.691214:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200123584:12345-0@lo:400:kworker.0 Request processed in 25us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279532.691216:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:3.0:1713279532.691218:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200123840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279532.691220:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99138 00000100:00100000:1.0:1713279532.691221:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200124096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279532.691222:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123968 00000100:00100000:2.0:1713279532.691224:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123968 00000100:00100000:2.0:1713279532.691237:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124224 00000100:00100000:2.0:1713279532.691239:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124224 00000100:00100000:1.0:1713279532.691241:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200124096:12345-0@lo:400:kworker.0 Request processed in 20us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279532.691246:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1713279532.691249:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1713279532.691255:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200123904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279532.691256:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00080000:1.0:1713279532.691261:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279502 00000100:00100000:2.0:1713279532.691262:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200124160:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1713279532.691266:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279502 00000100:00080000:1.0:1713279532.691268:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279502 00000100:00080000:1.0:1713279532.691271:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279502 00000100:00100000:3.0:1713279532.691271:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200123840:12345-0@lo:400:kworker.0 Request processed in 52us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279532.691279:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200123904:12345-0@lo:400:kworker.0 Request processed in 24us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279532.691279:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:1.0:1713279532.691283:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1713279532.691287:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1713279532.691288:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200123968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279532.691297:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200124160:12345-0@lo:400:kworker.0 Request processed in 35us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279532.691305:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1713279532.691307:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200123968:12345-0@lo:400:kworker.0 Request processed in 19us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279532.691313:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:1.0:1713279532.691319:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1713279532.691321:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200124224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279532.691331:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279532.691342:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200123776 00000100:00100000:1.0:1713279532.691345:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200123776 00000100:00100000:0.0:1713279532.691349:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200124032:0@lo:400:kworker.0 00000100:00100000:2.0:1713279532.691356:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200123712:0@lo:400:kworker.0 00000100:00100000:3.0:1713279532.691357:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200124224:12345-0@lo:400:kworker.0 Request processed in 37us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279532.691365:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:3.0:1713279532.691365:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1713279532.691367:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279532.691369:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200123776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279532.691369:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200123968:0@lo:400:kworker.0 00000100:00100000:2.0:1713279532.691380:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200124224:0@lo:400:kworker.0 00000100:00100000:0.0:1713279532.691387:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012bbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200123520:0@lo:400:kworker.0 00000100:00100000:3.0:1713279532.691389:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124032 00000100:00100000:1.0:1713279532.691390:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200123776:12345-0@lo:400:kworker.0 Request processed in 20us (59us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279532.691392:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124032 00000100:00100000:1.0:1713279532.691397:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1713279532.691404:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200123776:0@lo:400:kworker.0 00000100:00100000:1.0:1713279532.691443:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:1.0:1713279532.691447:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200124032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279532.691474:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200124032:12345-0@lo:400:kworker.0 Request processed in 27us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279532.691479:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00080000:1.0:1713279532.691491:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279502 00000100:00100000:0.0:1713279532.691494:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200124032:0@lo:400:kworker.0 00000100:00100000:1.0:1713279532.691509:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200123648:0@lo:400:kworker.0 00000100:00100000:1.0:1713279532.691520:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200123904:0@lo:400:kworker.0 00000100:00100000:1.0:1713279532.691549:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200124160:0@lo:400:kworker.0 00000100:00100000:3.0:1713279532.691560:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200123584:0@lo:400:kworker.0 00000100:00100000:3.0:1713279532.691575:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200123840:0@lo:400:kworker.0 00000100:00100000:3.0:1713279532.691587:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200124096:0@lo:400:kworker.0 00000100:00100000:2.0:1713279532.706599:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713279532.706615:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200124288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279532.706615:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200124352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279532.706670:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279532.706703:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124288 00000100:00100000:3.0:1713279532.706709:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124288 00000100:00100000:3.0:1713279532.706751:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1713279532.706757:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200124288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1713279532.706786:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:3.0:1713279532.706841:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200124288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279532.706848:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1713279532.706874:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279532.706897:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200124288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279532.706928:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124352 00000100:00100000:0.0:1713279532.706938:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124352 00000100:00100000:0.0:1713279532.706972:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1713279532.706979:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200124352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279532.707002:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279532.707070:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200124352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279532.707078:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1713279532.707121:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200124352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279533.426717:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200124416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279533.426829:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279533.426992:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124416 00000100:00100000:0.0:1713279533.427006:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124416 00000100:00100000:0.0:1713279533.427081:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1713279533.427095:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200124416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279533.427148:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279533.427235:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200124416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279533.427245:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1713279533.427304:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200124416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279533.442661:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713279533.442684:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200124480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279533.442744:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279533.442787:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124480 00000100:00100000:2.0:1713279533.442798:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124480 00000100:00100000:2.0:1713279533.442875:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1713279533.442886:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200124480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279533.442908:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279533.442977:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200124480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279533.442987:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1713279533.443045:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200124480:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279533.660829:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279534.251698:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279534.251755:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279534.251795:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279534.251809:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281341952 00000100:00100000:2.0:1713279534.251825:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281341952 00000100:00100000:0.0:1713279534.251827:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279534.251850:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279534.251870:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279534.251880:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342016 00000100:00100000:0.0:1713279534.251889:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279534.251891:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342016 00000100:00100000:2.0:1713279534.251896:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 473 00000100:00100000:0.0:1713279534.251906:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279534.251906:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281341952:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279534.251943:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342080 00000100:00100000:0.0:1713279534.251947:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279534.251948:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342080 00000100:00100000:3.0:1713279534.251964:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342144 00000100:00100000:1.0:1713279534.251977:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342272 00000100:00100000:1.0:1713279534.251982:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342272 00000100:00100000:3.0:1713279534.251982:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342144 00000100:00100000:0.0:1713279534.251988:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342336 00000100:00100000:0.0:1713279534.251994:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342336 00000100:00100000:2.0:1713279534.251996:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281341952:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 90us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279534.252016:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 473 00000100:00100000:1.0:1713279534.252023:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 883 00000100:00100000:1.0:1713279534.252034:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281342016:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279534.252043:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 884 00000100:00100000:0.0:1713279534.252051:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281342080:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279534.252063:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342208 00000100:00100000:2.0:1713279534.252064:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342400 00000100:00100000:3.0:1713279534.252066:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342208 00000100:00100000:2.0:1713279534.252068:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342400 00000100:00100000:3.0:1713279534.252086:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342464 00000100:00100000:3.0:1713279534.252088:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342464 00000100:00100000:1.0:1713279534.252096:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281342016:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 60us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279534.252096:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 441 00000100:00100000:0.0:1713279534.252097:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281342080:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279534.252103:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281342144:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279534.252106:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 884 00000100:00100000:1.0:1713279534.252113:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 883 00000100:00100000:3.0:1713279534.252116:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 442 00000100:00100000:0.0:1713279534.252122:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 885 00000100:00100000:3.0:1713279534.252126:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281342208:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279534.252128:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281342272:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279534.252132:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281342144:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279534.252136:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 886 00000100:00100000:2.0:1713279534.252140:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 441 00000100:00100000:1.0:1713279534.252146:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281342336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279534.252152:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281342272:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279534.252154:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 443 00000100:00100000:2.0:1713279534.252158:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281342400:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279534.252159:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 885 00000100:00100000:2.0:1713279534.252202:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281342400:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279534.252202:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281342208:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 77us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279534.252210:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 442 00000100:00100000:1.0:1713279534.252215:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281342336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 67us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279534.252218:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 443 00000100:00100000:1.0:1713279534.252227:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 886 00000100:00100000:3.0:1713279534.252228:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 444 00000100:00100000:3.0:1713279534.252234:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281342464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279534.252257:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281342464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (310us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279534.252259:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279504 00000100:00100000:3.0:1713279534.252263:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 444 00000100:00080000:1.0:1713279534.252265:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279504 00000100:00080000:1.0:1713279534.252269:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279504 00000100:00080000:1.0:1713279534.252273:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279504 00000100:00080000:1.0:1713279534.252277:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279504 00010000:00010000:2.0:1713279534.662761:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279535.346800:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713279535.346835:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200124544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279535.346914:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279535.346988:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124544 00000100:00100000:2.0:1713279535.347003:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124544 00000100:00100000:2.0:1713279535.347075:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99139 00000100:00100000:2.0:1713279535.347085:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200124544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279535.347136:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279535.347237:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200124544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279535.347250:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99139 00000100:00100000:3.0:1713279535.347300:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200124544:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279535.664814:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279536.666921:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279537.026963:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200124608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279537.027089:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279537.027153:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124608 00000100:00100000:2.0:1713279537.027170:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124608 00000100:00100000:2.0:1713279537.027241:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99140 00000100:00100000:2.0:1713279537.027271:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200124608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279537.027327:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279537.027408:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200124608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279537.027449:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99140 00000100:00100000:0.0:1713279537.027470:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200124608:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279537.668864:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279537.698806:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200124672:0@lo:400:kworker.0 00000100:00100000:0.0:1713279537.698808:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200124864:0@lo:400:kworker.0 00000100:00100000:1.0:1713279537.698834:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200124800:0@lo:400:kworker.0 00000100:00100000:3.0:1713279537.698834:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200124736:0@lo:400:kworker.0 00000100:00100000:0.0:1713279537.698927:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279537.698930:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279537.698949:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279537.698961:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124864 00000100:00100000:2.0:1713279537.698969:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200124928:0@lo:400:kworker.0 00000100:00100000:3.0:1713279537.698969:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124864 00000100:00100000:0.0:1713279537.698970:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200125120:0@lo:400:kworker.0 00000100:00100000:1.0:1713279537.698987:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200125056:0@lo:400:kworker.0 00000100:00100000:0.0:1713279537.698998:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279537.698998:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279537.699017:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:2.0:1713279537.699020:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200125184:0@lo:400:kworker.0 00000100:00100000:0.0:1713279537.699024:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200125376:0@lo:400:kworker.0 00000100:00100000:3.0:1713279537.699025:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200124864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279537.699031:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279537.699038:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279537.699053:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200125312:0@lo:400:kworker.0 00000100:00100000:0.0:1713279537.699059:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124800 00000100:00100000:2.0:1713279537.699068:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200125440:0@lo:400:kworker.0 00000100:00100000:0.0:1713279537.699069:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124800 00000100:00100000:3.0:1713279537.699085:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200124864:12345-0@lo:400:kworker.0 Request processed in 60us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279537.699093:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279537.699094:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1713279537.699095:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279537.699109:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124928 00000100:00100000:3.0:1713279537.699110:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125056 00000100:00100000:0.0:1713279537.699111:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124928 00000100:00100000:3.0:1713279537.699113:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125056 00000100:00100000:2.0:1713279537.699126:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124672 00000100:00100000:0.0:1713279537.699130:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99141 00000100:00100000:2.0:1713279537.699131:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124672 00000100:00100000:3.0:1713279537.699135:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125312 00000100:00100000:0.0:1713279537.699138:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200124800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279537.699138:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125312 00000100:00100000:1.0:1713279537.699151:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1713279537.699161:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200125056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279537.699167:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1713279537.699172:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:2.0:1713279537.699173:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200124672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279537.699177:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200125312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279537.699208:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200124800:12345-0@lo:400:kworker.0 Request processed in 69us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279537.699217:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99141 00000100:00100000:3.0:1713279537.699223:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200125312:12345-0@lo:400:kworker.0 Request processed in 45us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279537.699228:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200125056:12345-0@lo:400:kworker.0 Request processed in 67us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279537.699230:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200124672:12345-0@lo:400:kworker.0 Request processed in 56us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279537.699230:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1713279537.699234:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99142 00000100:00100000:0.0:1713279537.699239:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200124928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279537.699243:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1713279537.699244:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:3.0:1713279537.699252:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125120 00000100:00100000:3.0:1713279537.699255:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125120 00000100:00100000:0.0:1713279537.699266:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200124928:12345-0@lo:400:kworker.0 Request processed in 27us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279537.699272:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99142 00000100:00100000:3.0:1713279537.699281:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125184 00000100:00080000:1.0:1713279537.699283:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279507 00000100:00100000:3.0:1713279537.699284:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125184 00000100:00100000:2.0:1713279537.699285:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125440 00000100:00100000:2.0:1713279537.699289:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125440 00000100:00080000:1.0:1713279537.699290:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279507 00000100:00100000:0.0:1713279537.699298:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00080000:1.0:1713279537.699298:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279507 00000100:00080000:1.0:1713279537.699302:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279507 00000100:00100000:0.0:1713279537.699303:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200125120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279537.699306:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1713279537.699312:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200125184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279537.699323:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1713279537.699328:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200125440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279537.699337:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200125120:12345-0@lo:400:kworker.0 Request processed in 33us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279537.699340:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200124800:0@lo:400:kworker.0 00000100:00100000:0.0:1713279537.699343:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1713279537.699346:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200125184:12345-0@lo:400:kworker.0 Request processed in 32us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279537.699353:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1713279537.699359:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200125056:0@lo:400:kworker.0 00000100:00100000:2.0:1713279537.699360:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200125440:12345-0@lo:400:kworker.0 Request processed in 30us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279537.699367:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1713279537.699375:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200125312:0@lo:400:kworker.0 00000100:00100000:0.0:1713279537.699377:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279537.699380:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279537.699390:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125376 00000100:00100000:2.0:1713279537.699393:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125376 00000100:00100000:3.0:1713279537.699397:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200124992:0@lo:400:kworker.0 00000100:00100000:0.0:1713279537.699451:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200124864:0@lo:400:kworker.0 00000100:00080000:1.0:1713279537.699454:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279507 00000100:00100000:0.0:1713279537.699466:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200125120:0@lo:400:kworker.0 00000100:00100000:2.0:1713279537.699469:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1713279537.699473:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200125376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279537.699480:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279537.699523:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200125248:0@lo:400:kworker.0 00000100:00100000:0.0:1713279537.699526:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124736 00000100:00100000:0.0:1713279537.699530:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124736 00000100:00100000:2.0:1713279537.699544:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200125376:12345-0@lo:400:kworker.0 Request processed in 69us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279537.699549:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279537.699552:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1713279537.699557:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200124992 00000100:00100000:0.0:1713279537.699559:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200124992 00000100:00100000:0.0:1713279537.699578:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125248 00000100:00100000:0.0:1713279537.699581:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125248 00000100:00100000:1.0:1713279537.699583:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200125376:0@lo:400:kworker.0 00000100:00100000:2.0:1713279537.699588:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200125440:0@lo:400:kworker.0 00000100:00100000:3.0:1713279537.699592:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:2.0:1713279537.699598:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200124672:0@lo:400:kworker.0 00000100:00100000:3.0:1713279537.699599:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200124736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279537.699609:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200124928:0@lo:400:kworker.0 00000100:00100000:0.0:1713279537.699615:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1713279537.699620:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200125184:0@lo:400:kworker.0 00000100:00100000:0.0:1713279537.699622:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200124992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279537.699625:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:3.0:1713279537.699632:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200124736:12345-0@lo:400:kworker.0 Request processed in 33us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279537.699637:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200125248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279537.699639:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:0.0:1713279537.699662:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200124992:12345-0@lo:400:kworker.0 Request processed in 40us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279537.699669:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:3.0:1713279537.699684:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200124736:0@lo:400:kworker.0 00000100:00100000:1.0:1713279537.699692:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200125248:12345-0@lo:400:kworker.0 Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279537.699701:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200124992:0@lo:400:kworker.0 00000100:00100000:1.0:1713279537.699704:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:3.0:1713279537.699711:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200125248:0@lo:400:kworker.0 00000100:00080000:1.0:1713279537.699733:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279507 00000100:00100000:1.0:1713279537.714665:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200125568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279537.714692:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200125504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279537.714710:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279537.714768:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279537.714794:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125568 00000100:00100000:2.0:1713279537.714802:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125568 00000100:00100000:2.0:1713279537.714844:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125504 00000100:00100000:2.0:1713279537.714847:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125504 00000100:00100000:1.0:1713279537.714853:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1713279537.714863:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200125568:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279537.714871:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:2.0:1713279537.714879:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200125504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1713279537.714895:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279537.714900:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279537.714954:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200125568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279537.714956:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200125504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279537.714963:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1713279537.714969:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1713279537.715007:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200125568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279537.715042:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008d307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200125504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279538.434751:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200125632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279538.434846:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279538.434914:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125632 00000100:00100000:2.0:1713279538.434926:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125632 00000100:00100000:2.0:1713279538.434998:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1713279538.435007:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200125632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279538.435058:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279538.435152:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200125632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279538.435166:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1713279538.435189:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200125632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279538.450651:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200125696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1713279538.450763:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279538.450912:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125696 00000100:00100000:2.0:1713279538.450921:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125696 00000100:00100000:2.0:1713279538.450971:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1713279538.450978:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200125696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279538.450997:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279538.451057:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200125696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279538.451064:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1713279538.451114:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200125696:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279538.670869:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279539.259664:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279539.259725:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279539.259762:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279539.259786:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279539.259803:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342592 00000100:00100000:0.0:1713279539.259809:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279539.259822:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342592 00000100:00100000:0.0:1713279539.259826:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279539.259855:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279539.259877:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279539.259877:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342528 00000100:00100000:2.0:1713279539.259887:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342528 00000100:00100000:1.0:1713279539.259902:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342656 00000100:00100000:1.0:1713279539.259907:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342656 00000100:00100000:0.0:1713279539.259915:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279539.259935:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 475 00000100:00100000:1.0:1713279539.259936:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342848 00000100:00100000:1.0:1713279539.259941:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342848 00000100:00100000:2.0:1713279539.259944:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281342528:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279539.259947:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342976 00000100:00100000:3.0:1713279539.259950:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342720 00000100:00100000:0.0:1713279539.259953:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342976 00000100:00100000:1.0:1713279539.259963:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342912 00000100:00100000:1.0:1713279539.259967:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342912 00000100:00100000:3.0:1713279539.259967:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342720 00000100:00100000:0.0:1713279539.259986:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281342784 00000100:00100000:0.0:1713279539.259989:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281342784 00000100:00100000:1.0:1713279539.259994:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 893 00000100:00100000:1.0:1713279539.260006:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281342592:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279539.260007:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343040 00000100:00100000:0.0:1713279539.260009:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343040 00000100:00100000:2.0:1713279539.260035:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281342528:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 91us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279539.260038:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 449 00000100:00100000:2.0:1713279539.260045:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 475 00000100:00100000:0.0:1713279539.260047:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 450 00000100:00100000:3.0:1713279539.260049:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281342976:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279539.260055:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281342784:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279539.260073:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281342592:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279539.260084:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 893 00000100:00100000:2.0:1713279539.260092:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 451 00000100:00100000:0.0:1713279539.260097:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281342784:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279539.260100:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281342720:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279539.260106:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 450 00000100:00100000:1.0:1713279539.260110:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 894 00000100:00100000:1.0:1713279539.260118:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281342656:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279539.260121:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 452 00000100:00100000:0.0:1713279539.260126:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281343040:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279539.260148:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281342720:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279539.260150:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281343040:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279539.260154:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281342976:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 102us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279539.260157:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 452 00000100:00100000:1.0:1713279539.260162:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281342656:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279539.260163:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 451 00000100:00100000:3.0:1713279539.260172:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 449 00000100:00100000:1.0:1713279539.260174:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 894 00000100:00100000:0.0:1713279539.260181:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 895 00000100:00100000:0.0:1713279539.260186:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281342848:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279539.260194:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 896 00000100:00100000:1.0:1713279539.260202:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281342912:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279539.260212:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281342848:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279539.260219:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 895 00000100:00100000:1.0:1713279539.260234:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281342912:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279539.260244:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 896 00000100:00080000:0.0:1713279539.260274:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279509 00000100:00080000:0.0:1713279539.260278:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279509 00000100:00080000:0.0:1713279539.260281:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279509 00000100:00080000:0.0:1713279539.260283:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279509 00000100:00080000:0.0:1713279539.260285:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279509 00010000:00010000:2.0:1713279539.672789:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279540.354918:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200125760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279540.355043:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279540.355203:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125760 00000100:00100000:1.0:1713279540.355218:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125760 00000100:00100000:1.0:1713279540.355286:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99143 00000100:00100000:1.0:1713279540.355296:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200125760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1713279540.355345:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:1.0:1713279540.355466:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200125760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279540.355505:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99143 00000100:00100000:0.0:1713279540.355538:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200125760:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279540.674809:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279541.676885:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279542.034908:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200125824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1713279542.035027:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279542.035139:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125824 00000100:00100000:2.0:1713279542.035154:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125824 00000100:00100000:2.0:1713279542.035229:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99144 00000100:00100000:2.0:1713279542.035240:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200125824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279542.035310:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279542.035496:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200125824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 254us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279542.035509:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99144 00000100:00100000:1.0:1713279542.035557:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200125824:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279542.678808:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279542.706773:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f38b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200125952:0@lo:400:kworker.0 00000100:00100000:0.0:1713279542.706775:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200125888:0@lo:400:kworker.0 00000100:00100000:1.0:1713279542.706786:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200126080:0@lo:400:kworker.0 00000100:00100000:3.0:1713279542.706867:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279542.706874:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279542.706906:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125952 00000100:00100000:1.0:1713279542.706917:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125952 00000100:00100000:0.0:1713279542.706918:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200126144:0@lo:400:kworker.0 00000100:00100000:3.0:1713279542.706920:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200126208:0@lo:400:kworker.0 00000100:00100000:3.0:1713279542.706946:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279542.706947:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279542.706963:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200126400:0@lo:400:kworker.0 00000100:00100000:3.0:1713279542.706964:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200126464:0@lo:400:kworker.0 00000100:00100000:1.0:1713279542.706972:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126208 00000100:00100000:1.0:1713279542.706977:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126208 00000100:00100000:2.0:1713279542.706980:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200125888 00000100:00100000:3.0:1713279542.706986:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279542.706987:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279542.706992:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200125888 00000100:00100000:0.0:1713279542.707003:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200126656:0@lo:400:kworker.0 00000100:00100000:1.0:1713279542.707014:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126464 00000100:00100000:1.0:1713279542.707020:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126464 00000100:00100000:0.0:1713279542.707021:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279542.707045:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1713279542.707046:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00080000:0.0:1713279542.707051:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279512 00000100:00080000:0.0:1713279542.707056:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279512 00000100:00100000:1.0:1713279542.707057:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200125952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279542.707057:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200125888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279542.707065:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:0.0:1713279542.707070:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126400 00000100:00100000:0.0:1713279542.707077:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126400 00000100:00100000:3.0:1713279542.707079:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200126208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279542.707115:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126656 00000100:00100000:0.0:1713279542.707117:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126656 00000100:00100000:0.0:1713279542.707135:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1713279542.707141:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200126400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279542.707171:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200125952:12345-0@lo:400:kworker.0 Request processed in 112us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279542.707173:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200125888:12345-0@lo:400:kworker.0 Request processed in 117us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279542.707181:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200126208:12345-0@lo:400:kworker.0 Request processed in 102us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279542.707188:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1713279542.707192:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200126400:12345-0@lo:400:kworker.0 Request processed in 43us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279542.707193:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:0.0:1713279542.707202:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1713279542.707202:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:0.0:1713279542.707216:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1713279542.707221:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200126656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279542.707221:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:1.0:1713279542.707230:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200126464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279542.707243:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200126656:12345-0@lo:400:kworker.0 Request processed in 21us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279542.707250:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00080000:0.0:1713279542.707268:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279512 00000100:00080000:0.0:1713279542.707270:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279512 00000100:00100000:2.0:1713279542.707270:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200125888:0@lo:400:kworker.0 00000100:00100000:1.0:1713279542.707281:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200126464:12345-0@lo:400:kworker.0 Request processed in 50us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279542.707282:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200126016:0@lo:400:kworker.0 00000100:00100000:3.0:1713279542.707287:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f38b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200125952:0@lo:400:kworker.0 00000100:00100000:1.0:1713279542.707292:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:2.0:1713279542.707294:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200126400:0@lo:400:kworker.0 00000100:00100000:0.0:1713279542.707305:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279542.707307:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200126208:0@lo:400:kworker.0 00000100:00100000:2.0:1713279542.707316:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200126656:0@lo:400:kworker.0 00000100:00100000:0.0:1713279542.707322:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200126272:0@lo:400:kworker.0 00000100:00100000:3.0:1713279542.707325:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200126464:0@lo:400:kworker.0 00000100:00100000:1.0:1713279542.707331:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279542.707347:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126144 00000100:00100000:0.0:1713279542.707351:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126144 00000100:00100000:1.0:1713279542.707359:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200126336:0@lo:400:kworker.0 00000100:00100000:0.0:1713279542.707376:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126016 00000100:00100000:0.0:1713279542.707378:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126016 00000100:00100000:2.0:1713279542.707384:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99145 00000100:00100000:1.0:1713279542.707388:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279542.707395:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200126144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279542.707395:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99146 00000100:00100000:1.0:1713279542.707402:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200126592:0@lo:400:kworker.0 00000100:00100000:3.0:1713279542.707404:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200126016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279542.707446:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279542.707453:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279542.707493:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200126528:0@lo:400:kworker.0 00000100:00100000:0.0:1713279542.707522:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279542.707522:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126080 00000100:00100000:1.0:1713279542.707526:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126080 00000100:00100000:2.0:1713279542.707546:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200126144:12345-0@lo:400:kworker.0 Request processed in 149us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279542.707550:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126272 00000100:00100000:1.0:1713279542.707553:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126272 00000100:00100000:3.0:1713279542.707555:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200126016:12345-0@lo:400:kworker.0 Request processed in 149us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279542.707559:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200126016:0@lo:400:kworker.0 00000100:00100000:2.0:1713279542.707559:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99145 00000100:00100000:1.0:1713279542.707570:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126528 00000100:00100000:3.0:1713279542.707570:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99146 00000100:00100000:1.0:1713279542.707573:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126528 00000100:00100000:1.0:1713279542.707591:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:1.0:1713279542.707597:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200126080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279542.707599:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1713279542.707605:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200126272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279542.707608:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200126144:0@lo:400:kworker.0 00000100:00100000:3.0:1713279542.707609:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126336 00000100:00100000:3.0:1713279542.707616:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126336 00000100:00100000:1.0:1713279542.707636:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200126080:12345-0@lo:400:kworker.0 Request processed in 37us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279542.707644:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200126272:12345-0@lo:400:kworker.0 Request processed in 38us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279542.707644:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1713279542.707649:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126592 00000100:00100000:0.0:1713279542.707651:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:3.0:1713279542.707653:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126592 00000100:00100000:1.0:1713279542.707657:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1713279542.707662:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200126528:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1713279542.707676:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279512 00000100:00100000:3.0:1713279542.707677:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00080000:0.0:1713279542.707679:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279512 00000100:00080000:0.0:1713279542.707681:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279512 00000100:00100000:3.0:1713279542.707685:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200126336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279542.707687:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200126528:12345-0@lo:400:kworker.0 Request processed in 24us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279542.707694:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1713279542.707699:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1713279542.707700:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200126272:0@lo:400:kworker.0 00000100:00100000:2.0:1713279542.707710:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200126592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279542.707714:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200126528:0@lo:400:kworker.0 00000100:00100000:1.0:1713279542.707733:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200126080:0@lo:400:kworker.0 00000100:00100000:3.0:1713279542.707738:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200126336:12345-0@lo:400:kworker.0 Request processed in 52us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279542.707747:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200126336:0@lo:400:kworker.0 00000100:00100000:3.0:1713279542.707749:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:2.0:1713279542.707756:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200126592:12345-0@lo:400:kworker.0 Request processed in 48us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279542.707758:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200126592:0@lo:400:kworker.0 00000100:00100000:2.0:1713279542.707764:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1713279542.722587:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713279542.722599:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200126720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279542.722606:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713279542.722619:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200126784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279542.722633:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279542.722662:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126720 00000100:00100000:3.0:1713279542.722665:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279542.722674:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126720 00000100:00100000:1.0:1713279542.722696:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126784 00000100:00100000:1.0:1713279542.722706:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126784 00000100:00100000:2.0:1713279542.722737:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1713279542.722748:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200126720:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279542.722755:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1713279542.722762:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200126784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1713279542.722789:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279542.722790:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279542.722864:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200126784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279542.722868:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200126720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279542.722872:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1713279542.722880:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1713279542.722901:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200126784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279542.722906:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200126720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279543.442732:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200126848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279543.442808:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279543.442863:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126848 00000100:00100000:2.0:1713279543.442878:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126848 00000100:00100000:2.0:1713279543.442939:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1713279543.442946:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200126848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279543.442994:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279543.443078:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200126848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279543.443085:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:3.0:1713279543.443135:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200126848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279543.458631:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200126912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279543.458668:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279543.458692:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126912 00000100:00100000:2.0:1713279543.458701:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126912 00000100:00100000:2.0:1713279543.458739:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1713279543.458744:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200126912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279543.458765:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279543.458819:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200126912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279543.458824:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1713279543.458865:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200126912:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279543.680818:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279544.267363:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279544.267486:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279544.267496:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343168 00000100:00100000:3.0:1713279544.267511:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343168 00000100:00100000:0.0:1713279544.267539:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279544.267560:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279544.267576:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279544.267592:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279544.267602:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343104 00000100:00100000:3.0:1713279544.267605:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343232 00000100:00100000:0.0:1713279544.267606:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279544.267609:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343232 00000100:00100000:2.0:1713279544.267617:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343104 00000100:00100000:0.0:1713279544.267620:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00080000:1.0:1713279544.267629:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279514 00000100:00080000:1.0:1713279544.267636:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279514 00000100:00100000:3.0:1713279544.267638:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343424 00000100:00080000:1.0:1713279544.267639:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279514 00000100:00100000:3.0:1713279544.267640:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343424 00000100:00100000:1.0:1713279544.267655:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343488 00000100:00100000:1.0:1713279544.267661:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343488 00000100:00100000:0.0:1713279544.267662:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279544.267666:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 903 00000100:00100000:3.0:1713279544.267674:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281343168:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279544.267681:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 477 00000100:00100000:0.0:1713279544.267684:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343296 00000100:00100000:0.0:1713279544.267688:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343296 00000100:00100000:2.0:1713279544.267689:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281343104:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279544.267695:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 904 00000100:00100000:1.0:1713279544.267702:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281343232:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279544.267727:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 457 00000100:00100000:0.0:1713279544.267733:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281343296:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279544.267754:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281343168:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 80us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279544.267762:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281343232:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 60us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279544.267762:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 903 00000100:00100000:1.0:1713279544.267769:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 904 00000100:00100000:3.0:1713279544.267778:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 905 00000100:00100000:2.0:1713279544.267782:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281343104:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 92us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279544.267782:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281343424:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279544.267783:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281343296:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 49us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279544.267784:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 906 00000100:00100000:1.0:1713279544.267788:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281343488:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279544.267791:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 457 00000100:00100000:2.0:1713279544.267791:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 477 00000100:00100000:3.0:1713279544.267804:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281343424:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279544.267810:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281343488:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279544.267810:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 905 00000100:00100000:1.0:1713279544.267816:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 906 00000100:00100000:3.0:1713279544.267832:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343360 00000100:00100000:3.0:1713279544.267835:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343360 00000100:00100000:1.0:1713279544.267838:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343552 00000100:00100000:2.0:1713279544.267839:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343616 00000100:00100000:1.0:1713279544.267841:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343552 00000100:00100000:2.0:1713279544.267843:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343616 00000100:00100000:3.0:1713279544.267855:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 458 00000100:00100000:3.0:1713279544.267860:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281343360:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279544.267863:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 459 00000100:00100000:1.0:1713279544.267867:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281343552:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279544.267876:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 460 00000100:00100000:2.0:1713279544.267882:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281343616:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279544.267882:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281343360:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279544.267888:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 458 00000100:00100000:1.0:1713279544.267889:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281343552:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279544.267896:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 459 00000100:00100000:2.0:1713279544.267908:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281343616:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (245us total) trans 0 rc 0/0 00000100:00080000:1.0:1713279544.267910:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279514 00000100:00080000:1.0:1713279544.267913:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279514 00000100:00100000:2.0:1713279544.267915:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 460 00000100:00080000:1.0:1713279544.267916:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279514 00000100:00080000:1.0:1713279544.267917:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279514 00010000:00010000:2.0:1713279544.682768:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279545.362762:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200126976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279545.362838:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279545.362913:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200126976 00000100:00100000:3.0:1713279545.362926:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200126976 00000100:00100000:3.0:1713279545.362997:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99147 00000100:00100000:3.0:1713279545.363009:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200126976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279545.363067:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279545.363145:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200126976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279545.363153:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99147 00000100:00100000:0.0:1713279545.363190:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200126976:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279545.684839:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279546.686780:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279547.042777:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200127040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713279547.042864:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279547.042949:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127040 00000100:00100000:3.0:1713279547.042964:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127040 00000100:00100000:3.0:1713279547.043039:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99148 00000100:00100000:3.0:1713279547.043052:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200127040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1713279547.043102:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:3.0:1713279547.043194:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200127040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279547.043207:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99148 00000100:00100000:2.0:1713279547.043234:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200127040:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279547.688748:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279547.714672:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200127104:0@lo:400:kworker.0 00000100:00100000:2.0:1713279547.714686:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200127296:0@lo:400:kworker.0 00000100:00100000:1.0:1713279547.714701:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200127168:0@lo:400:kworker.0 00000100:00100000:0.0:1713279547.714707:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200127232:0@lo:400:kworker.0 00000100:00100000:3.0:1713279547.714758:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279547.714767:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279547.714784:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200127360:0@lo:400:kworker.0 00000100:00100000:2.0:1713279547.714798:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127168 00000100:00100000:1.0:1713279547.714804:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200127424:0@lo:400:kworker.0 00000100:00100000:0.0:1713279547.714806:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279547.714809:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127168 00000100:00100000:3.0:1713279547.714828:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127104 00000100:00100000:3.0:1713279547.714833:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127104 00000100:00100000:1.0:1713279547.714840:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279547.714844:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200127488:0@lo:400:kworker.0 00000100:00100000:2.0:1713279547.714857:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127424 00000100:00100000:2.0:1713279547.714861:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127424 00000100:00100000:3.0:1713279547.714867:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1713279547.714869:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200127680:0@lo:400:kworker.0 00000100:00100000:3.0:1713279547.714874:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200127104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279547.714877:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279547.714883:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:2.0:1713279547.714889:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200127168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279547.714897:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200127744:0@lo:400:kworker.0 00000100:00100000:1.0:1713279547.714901:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279547.714916:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200127104:12345-0@lo:400:kworker.0 Request processed in 41us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279547.714922:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1713279547.714935:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279547.714950:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200127168:12345-0@lo:400:kworker.0 Request processed in 59us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279547.714953:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127488 00000100:00100000:3.0:1713279547.714957:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127488 00000100:00100000:2.0:1713279547.714961:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:1.0:1713279547.714962:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200127168:0@lo:400:kworker.0 00000100:00100000:3.0:1713279547.714974:0:15481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127680 00000100:00100000:3.0:1713279547.714976:0:15481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127680 00000100:00100000:0.0:1713279547.714978:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127744 00000100:00100000:2.0:1713279547.714985:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:0.0:1713279547.714986:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127744 00000100:00100000:2.0:1713279547.714992:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200127424:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1713279547.714993:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279517 00000100:00080000:1.0:1713279547.714999:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279517 00000100:00080000:1.0:1713279547.715002:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279517 00000100:00100000:3.0:1713279547.715005:0:15481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:3.0:1713279547.715010:0:15481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200127488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279547.715028:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:0.0:1713279547.715036:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:1.0:1713279547.715038:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200127680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279547.715046:0:15481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200127488:12345-0@lo:400:kworker.0 Request processed in 33us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279547.715048:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200127744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279547.715050:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200127424:12345-0@lo:400:kworker.0 Request processed in 51us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279547.715053:0:15481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:2.0:1713279547.715061:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:3.0:1713279547.715076:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127232 00000100:00100000:3.0:1713279547.715078:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127232 00000100:00100000:1.0:1713279547.715094:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200127680:12345-0@lo:400:kworker.0 Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279547.715099:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99149 00000100:00100000:0.0:1713279547.715100:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200127744:12345-0@lo:400:kworker.0 Request processed in 55us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279547.715104:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200127232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279547.715106:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:0.0:1713279547.715112:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:2.0:1713279547.715116:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200127424:0@lo:400:kworker.0 00000100:00100000:3.0:1713279547.715130:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200127232:12345-0@lo:400:kworker.0 Request processed in 26us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279547.715135:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200127680:0@lo:400:kworker.0 00000100:00100000:3.0:1713279547.715136:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99149 00000100:00100000:0.0:1713279547.715144:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279547.715145:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279547.715159:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127360 00000100:00100000:3.0:1713279547.715162:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127360 00000100:00100000:1.0:1713279547.715169:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200127552:0@lo:400:kworker.0 00000100:00100000:0.0:1713279547.715175:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200127616:0@lo:400:kworker.0 00000100:00100000:3.0:1713279547.715177:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99150 00000100:00100000:3.0:1713279547.715181:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200127360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279547.715204:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279547.715230:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200127360:12345-0@lo:400:kworker.0 Request processed in 48us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279547.715235:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99150 00000100:00100000:1.0:1713279547.715242:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200127808:0@lo:400:kworker.0 00000100:00100000:0.0:1713279547.715246:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200127232:0@lo:400:kworker.0 00000100:00100000:3.0:1713279547.715256:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127552 00000100:00100000:3.0:1713279547.715258:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127552 00000100:00100000:0.0:1713279547.715259:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200127488:0@lo:400:kworker.0 00000100:00100000:1.0:1713279547.715263:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279547.715271:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200127744:0@lo:400:kworker.0 00000100:00100000:3.0:1713279547.715288:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127808 00000100:00100000:3.0:1713279547.715290:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127808 00000100:00100000:1.0:1713279547.715294:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1713279547.715299:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200127552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279547.715301:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279547.715303:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1713279547.715307:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200127808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279547.715319:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127616 00000100:00100000:0.0:1713279547.715321:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200127872:0@lo:400:kworker.0 00000100:00100000:2.0:1713279547.715325:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127616 00000100:00100000:1.0:1713279547.715329:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200127552:12345-0@lo:400:kworker.0 Request processed in 30us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279547.715335:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1713279547.715338:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200127808:12345-0@lo:400:kworker.0 Request processed in 30us (74us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279547.715344:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1713279547.715345:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279547.715347:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1713279547.715351:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200127616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279547.715354:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127872 00000100:00100000:2.0:1713279547.715358:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127872 00000100:00100000:0.0:1713279547.715366:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200127104:0@lo:400:kworker.0 00000100:00100000:1.0:1713279547.715370:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200127616:12345-0@lo:400:kworker.0 Request processed in 18us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279547.715374:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1713279547.715379:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200127360:0@lo:400:kworker.0 00000100:00100000:1.0:1713279547.715384:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1713279547.715387:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200127872:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1713279547.715398:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279517 00000100:00100000:0.0:1713279547.715400:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200127616:0@lo:400:kworker.0 00000100:00100000:1.0:1713279547.715402:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200127872:12345-0@lo:400:kworker.0 Request processed in 14us (58us total) trans 0 rc 0/0 00000100:00080000:2.0:1713279547.715402:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279517 00000100:00100000:1.0:1713279547.715407:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1713279547.715412:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200127872:0@lo:400:kworker.0 00000100:00100000:1.0:1713279547.715418:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127296 00000100:00100000:1.0:1713279547.715421:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127296 00000100:00100000:1.0:1713279547.715502:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:1.0:1713279547.715506:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200127296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279547.715534:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200127296:12345-0@lo:400:kworker.0 Request processed in 28us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279547.715538:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200127552:0@lo:400:kworker.0 00000100:00100000:1.0:1713279547.715539:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:0.0:1713279547.715551:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200127808:0@lo:400:kworker.0 00000100:00100000:0.0:1713279547.715573:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200127296:0@lo:400:kworker.0 00000100:00100000:3.0:1713279547.730584:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200127936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279547.730631:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279547.730661:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200127936 00000100:00100000:1.0:1713279547.730663:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200128000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279547.730669:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200127936 00000100:00100000:1.0:1713279547.730696:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279547.730737:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128000 00000100:00100000:2.0:1713279547.730743:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128000 00000100:00100000:0.0:1713279547.730744:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1713279547.730753:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200127936:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279547.730766:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:3.0:1713279547.730773:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200128000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279547.730780:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279547.730788:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279547.730822:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200127936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279547.730828:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1713279547.730837:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200128000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279547.730843:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1713279547.730847:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200127936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279547.730870:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200128000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279548.450713:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713279548.450743:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200128064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279548.450825:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279548.450881:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128064 00000100:00100000:3.0:1713279548.450890:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128064 00000100:00100000:3.0:1713279548.450959:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1713279548.450967:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200128064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1713279548.451002:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279548.451064:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200128064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279548.451072:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1713279548.451127:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200128064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279548.466698:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200128128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1713279548.466737:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279548.466872:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128128 00000100:00100000:3.0:1713279548.466881:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128128 00000100:00100000:3.0:1713279548.466926:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1713279548.466933:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200128128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1713279548.466951:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279548.467005:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200128128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279548.467017:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1713279548.467046:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200128128:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279548.690717:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279549.275499:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279549.275542:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279549.275567:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343680 00000100:00100000:0.0:1713279549.275570:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279549.275579:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343680 00000100:00100000:0.0:1713279549.275589:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279549.275604:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279549.275629:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279549.275630:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343872 00000100:00100000:2.0:1713279549.275634:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 479 00000100:00100000:3.0:1713279549.275639:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343872 00000100:00100000:2.0:1713279549.275642:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281343680:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279549.275644:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279549.275651:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343744 00000100:00100000:0.0:1713279549.275658:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279549.275659:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343744 00000100:00100000:3.0:1713279549.275677:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343936 00000100:00100000:3.0:1713279549.275680:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343936 00000100:00100000:1.0:1713279549.275692:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281343808 00000100:00100000:3.0:1713279549.275693:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344128 00000100:00100000:1.0:1713279549.275695:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281343808 00000100:00100000:3.0:1713279549.275695:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344128 00000100:00100000:0.0:1713279549.275696:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279549.275707:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344192 00000100:00100000:3.0:1713279549.275709:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344192 00000100:00100000:1.0:1713279549.275710:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344000 00000100:00100000:2.0:1713279549.275710:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281343680:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 68us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279549.275712:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344000 00000100:00100000:2.0:1713279549.275718:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 479 00000100:00100000:1.0:1713279549.275724:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344064 00000100:00100000:1.0:1713279549.275726:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344064 00000100:00100000:3.0:1713279549.275726:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 465 00000100:00100000:3.0:1713279549.275733:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281343872:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279549.275742:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 913 00000100:00100000:1.0:1713279549.275749:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281343744:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:2.0:1713279549.275749:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279519 00000100:00080000:2.0:1713279549.275753:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279519 00000100:00080000:2.0:1713279549.275755:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279519 00000100:00080000:2.0:1713279549.275757:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279519 00000100:00080000:2.0:1713279549.275759:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279519 00000100:00100000:3.0:1713279549.275773:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281343872:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279549.275774:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 466 00000100:00100000:2.0:1713279549.275779:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281343936:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279549.275780:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 465 00000100:00100000:3.0:1713279549.275793:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 467 00000100:00100000:3.0:1713279549.275797:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281344128:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279549.275818:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281343744:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 65us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279549.275818:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281343936:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279549.275819:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281344128:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279549.275824:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 466 00000100:00100000:1.0:1713279549.275830:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 913 00000100:00100000:3.0:1713279549.275830:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 467 00000100:00100000:2.0:1713279549.275837:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 468 00000100:00100000:2.0:1713279549.275842:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281344192:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279549.275852:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 914 00000100:00100000:1.0:1713279549.275859:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009234e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281343808:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279549.275862:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281344192:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279549.275868:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 468 00000100:00100000:2.0:1713279549.275884:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 915 00000100:00100000:2.0:1713279549.275889:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281344000:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279549.275898:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009234e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281343808:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279549.275907:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 914 00000100:00100000:2.0:1713279549.275908:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281344000:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 18us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279549.275913:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 915 00000100:00100000:1.0:1713279549.275919:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 916 00000100:00100000:1.0:1713279549.275924:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281344064:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279549.275953:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281344064:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279549.275959:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 916 00010000:00010000:2.0:1713279549.692729:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279550.370648:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c01b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200128192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1713279550.370710:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279550.370783:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128192 00000100:00100000:3.0:1713279550.370792:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128192 00000100:00100000:3.0:1713279550.370836:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99151 00000100:00100000:3.0:1713279550.370841:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200128192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279550.370871:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279550.370914:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200128192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279550.370922:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99151 00000100:00100000:2.0:1713279550.370946:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c01b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200128192:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279550.694657:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279551.696743:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279552.050715:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200128256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1713279552.050791:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279552.050852:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128256 00000100:00100000:3.0:1713279552.050864:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128256 00000100:00100000:3.0:1713279552.050925:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99152 00000100:00100000:3.0:1713279552.050933:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200128256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1713279552.050969:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:3.0:1713279552.051034:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200128256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279552.051042:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99152 00000100:00100000:1.0:1713279552.051090:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200128256:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279552.698640:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279552.722656:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200128320:0@lo:400:kworker.0 00000100:00100000:0.0:1713279552.722670:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200128384:0@lo:400:kworker.0 00000100:00100000:3.0:1713279552.722683:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200128448:0@lo:400:kworker.0 00000100:00100000:1.0:1713279552.722712:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200128512:0@lo:400:kworker.0 00000100:00100000:2.0:1713279552.722715:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279552.722720:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279552.722720:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279552.722736:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200128704:0@lo:400:kworker.0 00000100:00100000:2.0:1713279552.722738:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200128576:0@lo:400:kworker.0 00000100:00100000:0.0:1713279552.722741:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200128640:0@lo:400:kworker.0 00000100:00100000:1.0:1713279552.722747:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279552.722753:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279552.722758:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128448 00000100:00100000:2.0:1713279552.722763:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200128832:0@lo:400:kworker.0 00000100:00100000:3.0:1713279552.722763:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128448 00000100:00100000:0.0:1713279552.722766:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279552.722767:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200128768:0@lo:400:kworker.0 00000100:00100000:2.0:1713279552.722776:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279552.722784:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200128896:0@lo:400:kworker.0 00000100:00100000:2.0:1713279552.722784:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200129088:0@lo:400:kworker.0 00000100:00100000:1.0:1713279552.722786:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279552.722786:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128576 00000100:00100000:3.0:1713279552.722787:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128576 00000100:00100000:2.0:1713279552.722794:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279552.722797:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99153 00000100:00100000:1.0:1713279552.722799:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200129024:0@lo:400:kworker.0 00000100:00100000:3.0:1713279552.722801:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200128448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279552.722806:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279552.722812:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128320 00000100:00100000:2.0:1713279552.722815:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128320 00000100:00100000:1.0:1713279552.722817:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279552.722831:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128384 00000100:00100000:3.0:1713279552.722832:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200128448:12345-0@lo:400:kworker.0 Request processed in 31us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279552.722833:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713279552.722835:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128384 00000100:00100000:2.0:1713279552.722835:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1713279552.722837:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99153 00000100:00100000:1.0:1713279552.722838:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200128960:0@lo:400:kworker.0 00000100:00100000:2.0:1713279552.722839:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200128320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279552.722845:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99154 00000100:00100000:3.0:1713279552.722847:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200128576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279552.722856:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279552.722857:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128512 00000100:00100000:0.0:1713279552.722859:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128512 00000100:00100000:2.0:1713279552.722860:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200128320:12345-0@lo:400:kworker.0 Request processed in 21us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279552.722860:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200128576:12345-0@lo:400:kworker.0 Request processed in 12us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279552.722864:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1713279552.722864:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99154 00000100:00100000:0.0:1713279552.722871:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128640 00000100:00100000:0.0:1713279552.722873:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128640 00000100:00100000:3.0:1713279552.722874:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128832 00000100:00100000:3.0:1713279552.722875:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128832 00000100:00100000:1.0:1713279552.722877:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128896 00000100:00100000:1.0:1713279552.722880:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128896 00000100:00100000:2.0:1713279552.722883:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128960 00000100:00100000:2.0:1713279552.722885:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128960 00000100:00100000:0.0:1713279552.722886:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:3.0:1713279552.722887:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128768 00000100:00100000:3.0:1713279552.722888:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128768 00000100:00100000:0.0:1713279552.722891:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200128384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279552.722894:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129088 00000100:00100000:3.0:1713279552.722895:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129088 00000100:00100000:2.0:1713279552.722898:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:2.0:1713279552.722900:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200128512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279552.722902:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129024 00000100:00100000:3.0:1713279552.722903:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129024 00000100:00100000:1.0:1713279552.722905:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:1.0:1713279552.722910:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c01b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200128640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279552.722910:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1713279552.722912:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200128832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279552.722921:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200128512:12345-0@lo:400:kworker.0 Request processed in 20us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279552.722925:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200128384:12345-0@lo:400:kworker.0 Request processed in 33us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279552.722925:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:3.0:1713279552.722927:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200128832:12345-0@lo:400:kworker.0 Request processed in 14us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279552.722930:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1713279552.722931:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:3.0:1713279552.722935:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1713279552.722937:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200128768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279552.722939:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c01b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200128640:12345-0@lo:400:kworker.0 Request processed in 29us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279552.722939:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:2.0:1713279552.722941:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200128960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279552.722943:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:1.0:1713279552.722946:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:0.0:1713279552.722948:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200128896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279552.722948:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200128768:12345-0@lo:400:kworker.0 Request processed in 10us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279552.722951:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1713279552.722954:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:2.0:1713279552.722956:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200128960:12345-0@lo:400:kworker.0 Request processed in 14us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279552.722956:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200129088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279552.722960:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:1.0:1713279552.722967:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1713279552.722969:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200128896:12345-0@lo:400:kworker.0 Request processed in 21us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279552.722969:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200129088:12345-0@lo:400:kworker.0 Request processed in 12us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279552.722972:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200129024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279552.722972:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1713279552.722974:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00080000:2.0:1713279552.722977:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279522 00000100:00080000:2.0:1713279552.722979:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279522 00000100:00080000:2.0:1713279552.722981:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279522 00000100:00080000:2.0:1713279552.722982:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279522 00000100:00080000:2.0:1713279552.722983:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279522 00000100:00100000:3.0:1713279552.722991:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279552.722997:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200128704 00000100:00100000:1.0:1713279552.722997:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200129024:12345-0@lo:400:kworker.0 Request processed in 25us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279552.723000:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200128704 00000100:00100000:2.0:1713279552.723001:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200128576:0@lo:400:kworker.0 00000100:00100000:1.0:1713279552.723006:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1713279552.723006:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200128448:0@lo:400:kworker.0 00000100:00100000:2.0:1713279552.723007:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200128832:0@lo:400:kworker.0 00000100:00100000:2.0:1713279552.723012:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200129088:0@lo:400:kworker.0 00000100:00100000:0.0:1713279552.723016:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:2.0:1713279552.723018:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200128320:0@lo:400:kworker.0 00000100:00100000:0.0:1713279552.723020:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200128704:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1713279552.723030:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279522 00000100:00100000:1.0:1713279552.723035:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200128960:0@lo:400:kworker.0 00000100:00100000:0.0:1713279552.723045:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200128704:12345-0@lo:400:kworker.0 Request processed in 24us (52us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279552.723045:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200128512:0@lo:400:kworker.0 00000100:00100000:3.0:1713279552.723049:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200128704:0@lo:400:kworker.0 00000100:00100000:0.0:1713279552.723050:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:1.0:1713279552.723053:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200128768:0@lo:400:kworker.0 00000100:00100000:1.0:1713279552.723061:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200129024:0@lo:400:kworker.0 00000100:00100000:0.0:1713279552.723071:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200128896:0@lo:400:kworker.0 00000100:00100000:0.0:1713279552.723080:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200128384:0@lo:400:kworker.0 00000100:00100000:0.0:1713279552.723087:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200128640:0@lo:400:kworker.0 00000100:00100000:1.0:1713279552.738543:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713279552.738543:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713279552.738554:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200129152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279552.738554:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200129216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279552.738595:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279552.738614:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279552.738630:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129216 00000100:00100000:3.0:1713279552.738636:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129216 00000100:00100000:0.0:1713279552.738639:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129152 00000100:00100000:0.0:1713279552.738643:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129152 00000100:00100000:3.0:1713279552.738670:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1713279552.738676:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200129216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279552.738678:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1713279552.738682:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200129152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279552.738699:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279552.738699:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:3.0:1713279552.738734:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200129216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279552.738738:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200129152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279552.738740:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1713279552.738743:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1713279552.738746:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200129216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279552.738757:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200129152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279553.458672:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200129280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279553.458750:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279553.458811:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129280 00000100:00100000:3.0:1713279553.458823:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129280 00000100:00100000:3.0:1713279553.458885:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1713279553.458893:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200129280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1713279553.458929:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279553.458994:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200129280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279553.459002:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1713279553.459038:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200129280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279553.474660:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200129344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279553.474700:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279553.474795:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129344 00000100:00100000:3.0:1713279553.474804:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129344 00000100:00100000:3.0:1713279553.474846:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1713279553.474853:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200129344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1713279553.474870:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:3.0:1713279553.474922:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200129344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279553.474930:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1713279553.474980:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200129344:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279553.700854:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279554.283571:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279554.283615:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279554.283664:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279554.283665:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344256 00000100:00100000:2.0:1713279554.283678:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344256 00000100:00100000:0.0:1713279554.283694:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279554.283714:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279554.283750:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 481 00000100:00100000:0.0:1713279554.283754:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279554.283759:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281344256:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279554.283770:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279554.283772:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344320 00000100:00100000:1.0:1713279554.283781:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344320 00000100:00100000:0.0:1713279554.283784:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279554.283796:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344384 00000100:00100000:3.0:1713279554.283804:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344384 00000100:00100000:0.0:1713279554.283811:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279554.283816:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344576 00000100:00100000:1.0:1713279554.283818:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344576 00000100:00100000:2.0:1713279554.283825:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281344256:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279554.283832:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 481 00000100:00100000:3.0:1713279554.283837:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344640 00000100:00100000:3.0:1713279554.283840:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344640 00000100:00100000:1.0:1713279554.283848:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 923 00000100:00100000:1.0:1713279554.283855:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281344320:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:2.0:1713279554.283861:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279524 00000100:00080000:2.0:1713279554.283864:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279524 00000100:00080000:2.0:1713279554.283867:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279524 00000100:00100000:3.0:1713279554.283869:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 924 00000100:00100000:3.0:1713279554.283876:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281344384:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279554.283882:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 925 00000100:00100000:2.0:1713279554.283887:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281344576:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279554.283898:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281344320:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279554.283905:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 923 00000100:00100000:3.0:1713279554.283916:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281344384:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279554.283921:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 926 00000100:00100000:2.0:1713279554.283924:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281344576:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279554.283926:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 924 00000100:00100000:1.0:1713279554.283927:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281344640:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279554.283943:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 925 00000100:00100000:1.0:1713279554.283945:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281344640:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279554.283951:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 926 00000100:00100000:3.0:1713279554.283962:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344448 00000100:00100000:3.0:1713279554.283965:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344448 00000100:00100000:1.0:1713279554.283971:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344512 00000100:00100000:1.0:1713279554.283974:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344512 00000100:00100000:2.0:1713279554.283977:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344704 00000100:00100000:0.0:1713279554.283980:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344768 00000100:00100000:2.0:1713279554.283980:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344704 00000100:00100000:0.0:1713279554.283986:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344768 00000100:00100000:1.0:1713279554.283994:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 473 00000100:00100000:1.0:1713279554.283998:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009966b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281344448:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279554.284004:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 474 00000100:00100000:2.0:1713279554.284008:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 475 00000100:00100000:3.0:1713279554.284009:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281344512:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279554.284014:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801219b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281344704:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279554.284022:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009966b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281344448:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279554.284025:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 476 00000100:00100000:1.0:1713279554.284029:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 473 00000100:00100000:0.0:1713279554.284032:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281344768:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279554.284034:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281344512:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279554.284037:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801219b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281344704:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279554.284040:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 474 00000100:00100000:2.0:1713279554.284044:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 475 00000100:00080000:3.0:1713279554.284057:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279524 00000100:00080000:3.0:1713279554.284060:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279524 00000100:00100000:0.0:1713279554.284067:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281344768:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279554.284074:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 476 00010000:00010000:2.0:1713279554.702703:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279555.378699:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200129408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279555.378783:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279555.378867:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129408 00000100:00100000:2.0:1713279555.378879:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129408 00000100:00100000:2.0:1713279555.378944:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99155 00000100:00100000:2.0:1713279555.378952:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200129408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279555.378992:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279555.379059:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200129408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279555.379067:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99155 00000100:00100000:1.0:1713279555.379202:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200129408:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279555.704719:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279556.706757:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279557.058620:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200129472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1713279557.058693:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279557.058749:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129472 00000100:00100000:2.0:1713279557.058765:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129472 00000100:00100000:2.0:1713279557.058817:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99156 00000100:00100000:2.0:1713279557.058823:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200129472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279557.058855:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279557.058910:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200129472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279557.058919:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99156 00000100:00100000:3.0:1713279557.058959:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200129472:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279557.708762:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279557.730661:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200129600:0@lo:400:kworker.0 00000100:00100000:1.0:1713279557.730686:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200129728:0@lo:400:kworker.0 00000100:00100000:0.0:1713279557.730691:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200129664:0@lo:400:kworker.0 00000100:00100000:2.0:1713279557.730691:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200129536:0@lo:400:kworker.0 00000100:00100000:3.0:1713279557.730765:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279557.730767:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279557.730768:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279557.730812:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200129792:0@lo:400:kworker.0 00000100:00100000:0.0:1713279557.730815:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200129920:0@lo:400:kworker.0 00000100:00100000:3.0:1713279557.730816:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200129856:0@lo:400:kworker.0 00000100:00100000:1.0:1713279557.730834:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279557.730875:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129536 00000100:00100000:3.0:1713279557.730876:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279557.730879:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279557.730880:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200129984:0@lo:400:kworker.0 00000100:00100000:0.0:1713279557.730884:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129536 00000100:00100000:2.0:1713279557.730905:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200130048:0@lo:400:kworker.0 00000100:00100000:3.0:1713279557.730911:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200130112:0@lo:400:kworker.0 00000100:00100000:1.0:1713279557.730912:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279557.730927:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200130240:0@lo:400:kworker.0 00000100:00100000:0.0:1713279557.730937:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:3.0:1713279557.730938:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279557.730940:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279557.730947:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200129536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279557.730953:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129600 00000100:00100000:1.0:1713279557.730958:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129600 00000100:00100000:2.0:1713279557.730962:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200130304:0@lo:400:kworker.0 00000100:00100000:3.0:1713279557.730970:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129728 00000100:00100000:3.0:1713279557.730975:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129728 00000100:00100000:1.0:1713279557.730986:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129856 00000100:00100000:2.0:1713279557.730986:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279557.730988:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129856 00000100:00100000:3.0:1713279557.730998:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130112 00000100:00100000:0.0:1713279557.731000:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200129536:12345-0@lo:400:kworker.0 Request processed in 53us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279557.731000:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130112 00000100:00100000:1.0:1713279557.731007:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:0.0:1713279557.731010:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1713279557.731014:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200129600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279557.731019:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:2.0:1713279557.731020:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200129536:0@lo:400:kworker.0 00000100:00100000:3.0:1713279557.731025:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200129728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279557.731049:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129664 00000100:00100000:0.0:1713279557.731053:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129664 00000100:00100000:1.0:1713279557.731055:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200129600:12345-0@lo:400:kworker.0 Request processed in 41us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279557.731055:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:1.0:1713279557.731065:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00100000:2.0:1713279557.731065:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200129856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279557.731066:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200129728:12345-0@lo:400:kworker.0 Request processed in 37us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279557.731073:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:0.0:1713279557.731080:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129792 00000100:00100000:1.0:1713279557.731080:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:0.0:1713279557.731083:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129792 00000100:00100000:1.0:1713279557.731084:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200130112:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279557.731094:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279527 00000100:00080000:3.0:1713279557.731098:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279527 00000100:00100000:0.0:1713279557.731104:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99157 00000100:00100000:1.0:1713279557.731110:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200130112:12345-0@lo:400:kworker.0 Request processed in 24us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279557.731111:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200129664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279557.731117:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:2.0:1713279557.731120:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200129856:12345-0@lo:400:kworker.0 Request processed in 57us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279557.731124:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200130112:0@lo:400:kworker.0 00000100:00100000:2.0:1713279557.731130:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:1.0:1713279557.731134:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129984 00000100:00100000:3.0:1713279557.731135:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200129600:0@lo:400:kworker.0 00000100:00100000:1.0:1713279557.731137:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129984 00000100:00100000:3.0:1713279557.731145:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200129856:0@lo:400:kworker.0 00000100:00100000:0.0:1713279557.731150:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200129664:12345-0@lo:400:kworker.0 Request processed in 38us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279557.731157:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130048 00000100:00100000:0.0:1713279557.731159:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99157 00000100:00100000:1.0:1713279557.731159:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130048 00000100:00100000:2.0:1713279557.731163:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130304 00000100:00100000:2.0:1713279557.731167:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130304 00000100:00100000:3.0:1713279557.731172:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1713279557.731173:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99158 00000100:00100000:1.0:1713279557.731176:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1713279557.731177:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200129984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279557.731180:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200129792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279557.731181:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200130048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279557.731195:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1713279557.731202:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200130304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279557.731211:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200129984:12345-0@lo:400:kworker.0 Request processed in 33us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279557.731215:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200130048:12345-0@lo:400:kworker.0 Request processed in 33us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279557.731217:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1713279557.731222:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1713279557.731224:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200129792:12345-0@lo:400:kworker.0 Request processed in 42us (343us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279557.731233:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279527 00000100:00100000:0.0:1713279557.731234:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99158 00000100:00100000:2.0:1713279557.731235:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200130304:12345-0@lo:400:kworker.0 Request processed in 33us (249us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279557.731236:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279527 00000100:00100000:1.0:1713279557.731242:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279557.731243:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1713279557.731254:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130240 00000100:00100000:3.0:1713279557.731257:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130240 00000100:00100000:1.0:1713279557.731270:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200129728:0@lo:400:kworker.0 00000100:00100000:0.0:1713279557.731275:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279557.731275:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:1.0:1713279557.731280:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200129984:0@lo:400:kworker.0 00000100:00100000:3.0:1713279557.731280:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200130240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279557.731296:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200130176:0@lo:400:kworker.0 00000100:00100000:2.0:1713279557.731305:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200129792:0@lo:400:kworker.0 00000100:00100000:3.0:1713279557.731312:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200130240:12345-0@lo:400:kworker.0 Request processed in 31us (69us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279557.731319:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1713279557.731320:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200130048:0@lo:400:kworker.0 00000100:00100000:0.0:1713279557.731326:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1713279557.731329:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279527 00000100:00100000:2.0:1713279557.731333:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200130304:0@lo:400:kworker.0 00000100:00100000:1.0:1713279557.731341:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200130240:0@lo:400:kworker.0 00000100:00100000:0.0:1713279557.731353:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200129664:0@lo:400:kworker.0 00000100:00100000:0.0:1713279557.731456:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200129920 00000100:00100000:0.0:1713279557.731462:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200129920 00000100:00100000:0.0:1713279557.731507:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130176 00000100:00100000:0.0:1713279557.731509:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130176 00000100:00080000:3.0:1713279557.731510:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279527 00000100:00100000:0.0:1713279557.731531:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:0.0:1713279557.731539:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200129920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279557.731580:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1713279557.731591:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200130176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279557.731592:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200129920:12345-0@lo:400:kworker.0 Request processed in 51us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279557.731602:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:0.0:1713279557.731636:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200129920:0@lo:400:kworker.0 00000100:00100000:1.0:1713279557.731643:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200130176:12345-0@lo:400:kworker.0 Request processed in 53us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279557.731650:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200130176:0@lo:400:kworker.0 00000100:00100000:1.0:1713279557.731653:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:0.0:1713279557.746599:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200130432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279557.746628:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200130368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279557.746646:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279557.746697:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279557.746737:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130432 00000100:00100000:2.0:1713279557.746743:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130432 00000100:00100000:1.0:1713279557.746755:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130368 00000100:00100000:1.0:1713279557.746762:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130368 00000100:00100000:2.0:1713279557.746784:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1713279557.746791:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200130432:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279557.746792:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1713279557.746799:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200130368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1713279557.746819:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:1.0:1713279557.746820:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279557.746872:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200130368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279557.746878:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200130432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279557.746885:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:2.0:1713279557.746893:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1713279557.746903:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200130368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279557.746930:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200130432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279558.466606:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200130496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279558.466671:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279558.466721:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130496 00000100:00100000:2.0:1713279558.466729:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130496 00000100:00100000:2.0:1713279558.466768:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1713279558.466774:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200130496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279558.466798:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279558.466828:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200130496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279558.466833:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1713279558.466853:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200130496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279558.482584:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200130560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1713279558.482633:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279558.482670:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130560 00000100:00100000:2.0:1713279558.482676:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130560 00000100:00100000:2.0:1713279558.482706:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1713279558.482711:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200130560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279558.482730:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279558.482765:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200130560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279558.482772:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1713279558.482792:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200130560:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279558.710623:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279559.291468:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279559.291498:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279559.291527:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344896 00000100:00100000:0.0:1713279559.291529:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279559.291537:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344896 00000100:00100000:2.0:1713279559.291555:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344960 00000100:00100000:2.0:1713279559.291561:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344960 00000100:00100000:0.0:1713279559.291562:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279559.291580:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279559.291584:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 933 00000100:00100000:1.0:1713279559.291592:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281344896:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279559.291592:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 934 00000100:00100000:0.0:1713279559.291597:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279559.291599:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281344960:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279559.291616:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281344832 00000100:00100000:0.0:1713279559.291620:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279559.291622:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281344832 00000100:00100000:0.0:1713279559.291637:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279559.291657:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 483 00000100:00100000:3.0:1713279559.291664:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281344832:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279559.291665:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281344960:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 65us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279559.291668:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281344896:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279559.291672:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 934 00000100:00100000:1.0:1713279559.291676:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 933 00000100:00100000:2.0:1713279559.291687:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345216 00000100:00100000:1.0:1713279559.291690:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345152 00000100:00100000:2.0:1713279559.291690:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345216 00000100:00100000:1.0:1713279559.291694:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345152 00000100:00100000:3.0:1713279559.291701:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281344832:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279559.291708:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 935 00000100:00100000:3.0:1713279559.291709:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 483 00000100:00100000:2.0:1713279559.291713:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281345216:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279559.291714:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 936 00000100:00100000:0.0:1713279559.291715:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279559.291719:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281345152:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:3.0:1713279559.291737:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279529 00000100:00100000:2.0:1713279559.291739:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281345216:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (140us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279559.291740:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279529 00000100:00080000:3.0:1713279559.291741:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279529 00000100:00100000:2.0:1713279559.291745:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 935 00000100:00100000:1.0:1713279559.291749:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281345152:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279559.291750:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345088 00000100:00100000:3.0:1713279559.291753:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345088 00000100:00100000:1.0:1713279559.291756:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 936 00000100:00100000:2.0:1713279559.291765:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345024 00000100:00100000:2.0:1713279559.291768:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345024 00000100:00100000:3.0:1713279559.291771:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345280 00000100:00100000:3.0:1713279559.291773:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345280 00000100:00100000:1.0:1713279559.291778:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345344 00000100:00100000:1.0:1713279559.291782:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345344 00000100:00100000:2.0:1713279559.291804:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 481 00000100:00100000:2.0:1713279559.291809:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281345088:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279559.291811:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 482 00000100:00100000:3.0:1713279559.291814:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281345024:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279559.291817:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 483 00000100:00100000:1.0:1713279559.291822:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281345280:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279559.291832:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 484 00000100:00100000:2.0:1713279559.291833:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281345088:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279559.291834:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281345024:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279559.291837:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281345344:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279559.291838:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 481 00000100:00100000:3.0:1713279559.291841:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 482 00000100:00100000:1.0:1713279559.291846:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281345280:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (209us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279559.291851:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279529 00000100:00080000:3.0:1713279559.291852:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279529 00000100:00100000:1.0:1713279559.291855:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 483 00000100:00100000:0.0:1713279559.291858:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281345344:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279559.291864:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 484 00010000:00010000:2.0:1713279559.712714:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279560.386737:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200130624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279560.386824:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279560.386959:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130624 00000100:00100000:2.0:1713279560.386971:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130624 00000100:00100000:2.0:1713279560.387035:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99159 00000100:00100000:2.0:1713279560.387045:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200130624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279560.387088:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279560.387156:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200130624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279560.387164:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99159 00000100:00100000:3.0:1713279560.387216:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200130624:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279560.714734:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279561.716705:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279562.066688:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200130688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279562.066765:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279562.066821:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130688 00000100:00100000:2.0:1713279562.066832:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130688 00000100:00100000:2.0:1713279562.066886:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99160 00000100:00100000:2.0:1713279562.066895:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200130688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279562.066933:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279562.066993:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200130688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279562.067002:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99160 00000100:00100000:0.0:1713279562.067033:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200130688:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279562.718832:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279562.738731:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200130816:0@lo:400:kworker.0 00000100:00100000:0.0:1713279562.738767:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200130944:0@lo:400:kworker.0 00000100:00100000:2.0:1713279562.738767:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200130752:0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.738776:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200130880:0@lo:400:kworker.0 00000100:00100000:3.0:1713279562.738824:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279562.738876:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130816 00000100:00100000:2.0:1713279562.738883:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279562.738887:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130816 00000100:00100000:3.0:1713279562.738888:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200131072:0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.738890:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279562.738917:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279562.738921:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200131008:0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.738925:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200131136:0@lo:400:kworker.0 00000100:00100000:3.0:1713279562.738938:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200131328:0@lo:400:kworker.0 00000100:00100000:0.0:1713279562.738939:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131072 00000100:00100000:0.0:1713279562.738943:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131072 00000100:00100000:2.0:1713279562.738959:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279562.738962:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279562.738974:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131328 00000100:00100000:1.0:1713279562.738977:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130880 00000100:00100000:0.0:1713279562.738978:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131328 00000100:00100000:2.0:1713279562.738979:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200131264:0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.738983:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130880 00000100:00100000:0.0:1713279562.739003:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:2.0:1713279562.739009:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279562.739011:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:0.0:1713279562.739013:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200130816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.739016:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131008 00000100:00100000:1.0:1713279562.739018:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131008 00000100:00100000:3.0:1713279562.739018:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200131072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279562.739026:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200131520:0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.739036:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99161 00000100:00100000:1.0:1713279562.739042:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200130880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279562.739051:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279562.739065:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200131072:12345-0@lo:400:kworker.0 Request processed in 47us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279562.739073:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00100000:0.0:1713279562.739079:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200130816:12345-0@lo:400:kworker.0 Request processed in 65us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279562.739087:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200130880:12345-0@lo:400:kworker.0 Request processed in 45us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279562.739091:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:2.0:1713279562.739093:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130752 00000100:00100000:1.0:1713279562.739095:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99161 00000100:00100000:3.0:1713279562.739096:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:2.0:1713279562.739100:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130752 00000100:00100000:3.0:1713279562.739101:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200131328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.739110:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99162 00000100:00100000:1.0:1713279562.739114:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200131008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279562.739120:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131264 00000100:00100000:0.0:1713279562.739124:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131264 00000100:00100000:3.0:1713279562.739126:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200131328:12345-0@lo:400:kworker.0 Request processed in 25us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279562.739134:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:2.0:1713279562.739136:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1713279562.739142:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200131008:12345-0@lo:400:kworker.0 Request processed in 27us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279562.739144:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200130752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.739148:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99162 00000100:00100000:0.0:1713279562.739150:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131520 00000100:00100000:0.0:1713279562.739153:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131520 00000100:00100000:3.0:1713279562.739173:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200131328:0@lo:400:kworker.0 00000100:00100000:0.0:1713279562.739176:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1713279562.739182:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1713279562.739184:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200131264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279562.739185:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200130816:0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.739187:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200131520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279562.739190:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200130752:12345-0@lo:400:kworker.0 Request processed in 46us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279562.739194:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200131072:0@lo:400:kworker.0 00000100:00100000:2.0:1713279562.739201:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1713279562.739215:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200131520:12345-0@lo:400:kworker.0 Request processed in 28us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279562.739221:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1713279562.739225:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200131264:12345-0@lo:400:kworker.0 Request processed in 41us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279562.739235:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1713279562.739239:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279562.739251:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200130752:0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.739255:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200131392:0@lo:400:kworker.0 00000100:00080000:0.0:1713279562.739257:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279532 00000100:00080000:0.0:1713279562.739263:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279532 00000100:00100000:3.0:1713279562.739264:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131136 00000100:00080000:0.0:1713279562.739266:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279532 00000100:00100000:2.0:1713279562.739267:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200131008:0@lo:400:kworker.0 00000100:00100000:3.0:1713279562.739268:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131136 00000100:00080000:0.0:1713279562.739270:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279532 00000100:00100000:1.0:1713279562.739274:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1713279562.739275:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279532 00000100:00100000:2.0:1713279562.739281:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200131264:0@lo:400:kworker.0 00000100:00100000:0.0:1713279562.739289:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279562.739291:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131392 00000100:00100000:3.0:1713279562.739294:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131392 00000100:00100000:1.0:1713279562.739298:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200130880:0@lo:400:kworker.0 00000100:00100000:2.0:1713279562.739298:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200131520:0@lo:400:kworker.0 00000100:00100000:3.0:1713279562.739310:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200130944 00000100:00100000:3.0:1713279562.739313:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200130944 00000100:00100000:0.0:1713279562.739314:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200131200:0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.739357:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:1.0:1713279562.739363:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200131136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279562.739386:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1713279562.739389:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279562.739392:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200131392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.739397:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200131136:12345-0@lo:400:kworker.0 Request processed in 34us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279562.739404:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00100000:0.0:1713279562.739441:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200131456:0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.739448:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:1.0:1713279562.739453:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800825a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200130944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279562.739457:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131200 00000100:00100000:2.0:1713279562.739463:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131200 00000100:00100000:3.0:1713279562.739471:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200131392:12345-0@lo:400:kworker.0 Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279562.739475:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279562.739479:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:1.0:1713279562.739482:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800825a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200130944:12345-0@lo:400:kworker.0 Request processed in 28us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279562.739488:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00100000:2.0:1713279562.739493:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131456 00000100:00100000:2.0:1713279562.739497:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131456 00000100:00100000:0.0:1713279562.739513:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200130944:0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.739516:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200131136:0@lo:400:kworker.0 00000100:00100000:2.0:1713279562.739519:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1713279562.739526:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200131392:0@lo:400:kworker.0 00000100:00100000:2.0:1713279562.739526:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200131200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279562.739533:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00080000:0.0:1713279562.739536:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279532 00000100:00100000:3.0:1713279562.739538:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200131456:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1713279562.739540:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279532 00000100:00080000:0.0:1713279562.739543:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279532 00000100:00100000:3.0:1713279562.739623:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200131456:12345-0@lo:400:kworker.0 Request processed in 82us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279562.739624:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200131200:12345-0@lo:400:kworker.0 Request processed in 94us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279562.739628:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1713279562.739634:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1713279562.739649:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200131200:0@lo:400:kworker.0 00000100:00100000:1.0:1713279562.739658:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200131456:0@lo:400:kworker.0 00000100:00100000:3.0:1713279562.754545:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713279562.754561:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200131584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279562.754589:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713279562.754606:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279562.754608:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200131648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279562.754637:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131584 00000100:00100000:2.0:1713279562.754646:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131584 00000100:00100000:0.0:1713279562.754654:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279562.754695:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131648 00000100:00100000:2.0:1713279562.754700:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131648 00000100:00100000:1.0:1713279562.754709:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1713279562.754719:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200131584:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279562.754726:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1713279562.754733:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200131648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1713279562.754751:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279562.754754:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:3.0:1713279562.754810:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200131648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279562.754817:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1713279562.754821:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200131584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279562.754829:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1713279562.754875:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200131648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279562.754875:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200131584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279563.474784:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200131712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279563.474865:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279563.474948:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131712 00000100:00100000:1.0:1713279563.474960:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131712 00000100:00100000:1.0:1713279563.475036:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1713279563.475049:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200131712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1713279563.475095:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279563.475175:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200131712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279563.475188:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1713279563.475221:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200131712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279563.490646:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200131776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279563.490707:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279563.490785:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131776 00000100:00100000:1.0:1713279563.490792:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131776 00000100:00100000:1.0:1713279563.490837:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1713279563.490844:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200131776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1713279563.490863:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279563.490915:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200131776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279563.490922:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1713279563.490984:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200131776:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279563.720886:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279564.299604:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279564.299660:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279564.299695:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279564.299709:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345472 00000100:00100000:0.0:1713279564.299715:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279564.299720:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345472 00000100:00100000:3.0:1713279564.299733:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345408 00000100:00100000:3.0:1713279564.299741:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345408 00000100:00100000:0.0:1713279564.299745:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279564.299764:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345536 00000100:00100000:0.0:1713279564.299765:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279564.299765:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345536 00000100:00100000:1.0:1713279564.299767:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345728 00000100:00100000:1.0:1713279564.299772:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345728 00000100:00100000:2.0:1713279564.299782:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 943 00000100:00100000:3.0:1713279564.299784:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 485 00000100:00100000:0.0:1713279564.299786:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279564.299789:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281345472:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279564.299792:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281345408:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279564.299801:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 944 00000100:00100000:0.0:1713279564.299806:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279564.299807:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281345536:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279564.299846:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281345472:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 57us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279564.299852:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 943 00000100:00100000:1.0:1713279564.299855:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281345536:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 49us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279564.299856:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281345408:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279564.299857:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279564.299861:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 944 00000100:00100000:3.0:1713279564.299865:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 485 00000100:00100000:2.0:1713279564.299866:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345792 00000100:00100000:2.0:1713279564.299868:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345792 00000100:00100000:1.0:1713279564.299873:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 945 00000100:00100000:1.0:1713279564.299877:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281345728:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279564.299881:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 946 00000100:00100000:2.0:1713279564.299885:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281345792:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279564.299894:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281345728:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 15us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279564.299901:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 945 00000100:00100000:2.0:1713279564.299905:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281345792:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279564.299910:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 946 00000100:00100000:2.0:1713279564.299928:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345600 00000100:00100000:2.0:1713279564.299930:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345600 00000100:00100000:1.0:1713279564.299933:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345856 00000100:00100000:3.0:1713279564.299933:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345664 00000100:00100000:1.0:1713279564.299936:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345856 00000100:00100000:3.0:1713279564.299938:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345664 00000100:00100000:2.0:1713279564.299946:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345920 00000100:00100000:2.0:1713279564.299947:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345920 00000100:00100000:1.0:1713279564.299952:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 489 00000100:00100000:1.0:1713279564.299956:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281345600:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:0.0:1713279564.299969:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279534 00000100:00100000:3.0:1713279564.299970:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 490 00000100:00080000:0.0:1713279564.299974:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279534 00000100:00080000:0.0:1713279564.299975:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279534 00000100:00100000:2.0:1713279564.299975:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 491 00000100:00080000:0.0:1713279564.299977:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279534 00000100:00100000:3.0:1713279564.299977:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281345856:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279564.299978:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281345600:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (284us total) trans 0 rc 0/0 00000100:00080000:0.0:1713279564.299979:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279534 00000100:00100000:2.0:1713279564.299979:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281345664:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279564.299983:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 489 00000100:00100000:0.0:1713279564.299992:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 492 00000100:00100000:0.0:1713279564.299998:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281345920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279564.299999:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281345664:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279564.300005:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 491 00000100:00100000:3.0:1713279564.300012:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281345856:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279564.300020:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 490 00000100:00100000:0.0:1713279564.300028:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281345920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279564.300033:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 492 00010000:00010000:2.0:1713279564.722692:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279565.394729:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713279565.394757:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200131840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1713279565.394830:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279565.394922:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131840 00000100:00100000:3.0:1713279565.394932:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131840 00000100:00100000:3.0:1713279565.394995:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99163 00000100:00100000:3.0:1713279565.395004:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200131840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279565.395044:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279565.395111:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200131840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279565.395124:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99163 00000100:00100000:2.0:1713279565.395160:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200131840:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279565.724710:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279566.726783:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279567.074709:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713279567.074736:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200131904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279567.074807:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279567.074864:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131904 00000100:00100000:3.0:1713279567.074874:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131904 00000100:00100000:3.0:1713279567.074915:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99164 00000100:00100000:3.0:1713279567.074923:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200131904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1713279567.074959:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:3.0:1713279567.075037:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200131904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279567.075048:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99164 00000100:00100000:0.0:1713279567.075090:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200131904:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279567.728774:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279567.746744:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200132096:0@lo:400:kworker.0 00000100:00100000:2.0:1713279567.746744:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200132160:0@lo:400:kworker.0 00000100:00100000:3.0:1713279567.746756:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200132032:0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.746837:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279567.746837:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279567.746870:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132096 00000100:00100000:0.0:1713279567.746878:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200132352:0@lo:400:kworker.0 00000100:00100000:3.0:1713279567.746881:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132096 00000100:00100000:2.0:1713279567.746885:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200132416:0@lo:400:kworker.0 00000100:00100000:1.0:1713279567.746901:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132160 00000100:00100000:0.0:1713279567.746907:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279567.746909:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132160 00000100:00100000:2.0:1713279567.746914:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279567.746926:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200132608:0@lo:400:kworker.0 00000100:00100000:2.0:1713279567.746935:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200132672:0@lo:400:kworker.0 00000100:00100000:3.0:1713279567.746939:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99165 00000100:00100000:1.0:1713279567.746943:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132352 00000100:00100000:1.0:1713279567.746946:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132352 00000100:00100000:3.0:1713279567.746950:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200132096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.746953:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279567.746958:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279567.746971:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132608 00000100:00100000:1.0:1713279567.746973:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132608 00000100:00100000:2.0:1713279567.746978:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1713279567.746987:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200131968:0@lo:400:kworker.0 00000100:00100000:1.0:1713279567.746990:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:1.0:1713279567.746997:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200132160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.747003:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132416 00000100:00100000:0.0:1713279567.747009:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132416 00000100:00100000:2.0:1713279567.747025:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279567.747039:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200132096:12345-0@lo:400:kworker.0 Request processed in 88us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279567.747046:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132672 00000100:00100000:2.0:1713279567.747048:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200132224:0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.747050:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132672 00000100:00100000:3.0:1713279567.747051:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99165 00000100:00100000:1.0:1713279567.747054:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200132160:12345-0@lo:400:kworker.0 Request processed in 56us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279567.747061:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:0.0:1713279567.747074:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1713279567.747076:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:1.0:1713279567.747080:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200132352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.747084:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200132416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279567.747088:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279567.747088:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1713279567.747098:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200132672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279567.747121:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200132352:12345-0@lo:400:kworker.0 Request processed in 40us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279567.747127:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1713279567.747127:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200132480:0@lo:400:kworker.0 00000100:00100000:1.0:1713279567.747137:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1713279567.747141:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200132416:12345-0@lo:400:kworker.0 Request processed in 57us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279567.747142:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200132608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.747153:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1713279567.747154:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200132672:12345-0@lo:400:kworker.0 Request processed in 56us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279567.747157:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279567.747166:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1713279567.747167:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200132608:12345-0@lo:400:kworker.0 Request processed in 24us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279567.747172:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132480 00000100:00100000:1.0:1713279567.747173:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1713279567.747176:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132480 00000100:00100000:2.0:1713279567.747177:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200132736:0@lo:400:kworker.0 00000100:00080000:1.0:1713279567.747190:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279537 00000100:00080000:1.0:1713279567.747194:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279537 00000100:00080000:1.0:1713279567.747197:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279537 00000100:00100000:2.0:1713279567.747202:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279567.747204:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:3.0:1713279567.747213:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132736 00000100:00100000:3.0:1713279567.747219:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132736 00000100:00100000:0.0:1713279567.747224:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200132480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279567.747239:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200132160:0@lo:400:kworker.0 00000100:00100000:1.0:1713279567.747249:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200131968 00000100:00100000:1.0:1713279567.747252:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200131968 00000100:00100000:2.0:1713279567.747256:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200132416:0@lo:400:kworker.0 00000100:00100000:3.0:1713279567.747256:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1713279567.747264:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200132736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.747265:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200132480:12345-0@lo:400:kworker.0 Request processed in 53us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279567.747270:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200132672:0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.747275:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1713279567.747319:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1713279567.747324:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200131968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279567.747352:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200132480:0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.747355:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200132096:0@lo:400:kworker.0 00000100:00100000:3.0:1713279567.747369:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200132736:12345-0@lo:400:kworker.0 Request processed in 103us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279567.747370:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200132736:0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.747371:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200132352:0@lo:400:kworker.0 00000100:00100000:1.0:1713279567.747372:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200131968:12345-0@lo:400:kworker.0 Request processed in 47us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279567.747378:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1713279567.747381:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1713279567.747385:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200132608:0@lo:400:kworker.0 00000100:00100000:2.0:1713279567.747389:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200131968:0@lo:400:kworker.0 00000100:00080000:1.0:1713279567.747402:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279537 00000100:00080000:1.0:1713279567.747405:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279537 00000100:00100000:2.0:1713279567.747460:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279567.747480:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132032 00000100:00100000:3.0:1713279567.747482:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132224 00000100:00100000:1.0:1713279567.747485:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132032 00000100:00100000:2.0:1713279567.747487:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200132288:0@lo:400:kworker.0 00000100:00100000:3.0:1713279567.747489:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132224 00000100:00100000:1.0:1713279567.747512:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:1.0:1713279567.747517:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200132032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279567.747521:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279567.747521:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99166 00000100:00100000:3.0:1713279567.747529:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200132224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.747551:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132288 00000100:00100000:2.0:1713279567.747555:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200132544:0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.747557:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132288 00000100:00100000:1.0:1713279567.747561:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200132032:12345-0@lo:400:kworker.0 Request processed in 43us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279567.747567:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:2.0:1713279567.747584:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279567.747588:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1713279567.747592:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132544 00000100:00100000:3.0:1713279567.747592:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200132224:12345-0@lo:400:kworker.0 Request processed in 62us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279567.747593:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200132288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.747596:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132544 00000100:00100000:3.0:1713279567.747602:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99166 00000100:00100000:0.0:1713279567.747618:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1713279567.747621:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200132032:0@lo:400:kworker.0 00000100:00100000:1.0:1713279567.747622:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200132288:12345-0@lo:400:kworker.0 Request processed in 28us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279567.747627:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200132544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279567.747632:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:2.0:1713279567.747651:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200132288:0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.747672:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200132544:12345-0@lo:400:kworker.0 Request processed in 44us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279567.747674:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200132544:0@lo:400:kworker.0 00000100:00100000:0.0:1713279567.747682:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00080000:0.0:1713279567.747701:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279537 00000100:00100000:2.0:1713279567.747703:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200132224:0@lo:400:kworker.0 00000100:00100000:3.0:1713279567.762646:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200132864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279567.762648:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200132800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279567.762704:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279567.762752:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279567.762776:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132800 00000100:00100000:2.0:1713279567.762784:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132800 00000100:00100000:3.0:1713279567.762800:0:10045:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132864 00000100:00100000:3.0:1713279567.762806:0:10045:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132864 00000100:00100000:2.0:1713279567.762831:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1713279567.762839:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200132800:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279567.762840:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1713279567.762848:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200132864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1713279567.762873:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279567.762876:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:3.0:1713279567.762946:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200132864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279567.762957:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200132800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279567.762957:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1713279567.762976:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1713279567.762999:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200132864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279567.763019:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200132800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279568.482686:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713279568.482714:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200132928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279568.482791:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279568.482849:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132928 00000100:00100000:2.0:1713279568.482861:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132928 00000100:00100000:2.0:1713279568.482919:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1713279568.482927:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200132928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279568.482962:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279568.483025:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200132928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279568.483032:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1713279568.483080:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200132928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279568.498699:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200132992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279568.498751:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279568.498809:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200132992 00000100:00100000:2.0:1713279568.498816:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200132992 00000100:00100000:2.0:1713279568.498852:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1713279568.498858:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200132992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279568.498875:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279568.498924:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200132992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279568.498931:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1713279568.498962:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200132992:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279568.730721:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279569.307515:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279569.307580:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279569.307610:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346048 00000100:00100000:2.0:1713279569.307623:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346048 00000100:00100000:0.0:1713279569.307630:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279569.307674:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279569.307682:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346112 00000100:00100000:3.0:1713279569.307684:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281345984 00000100:00100000:2.0:1713279569.307686:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346112 00000100:00100000:3.0:1713279569.307694:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281345984 00000100:00100000:0.0:1713279569.307697:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279569.307718:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346304 00000100:00100000:2.0:1713279569.307722:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346304 00000100:00100000:1.0:1713279569.307724:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346176 00000100:00100000:1.0:1713279569.307733:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346176 00000100:00100000:0.0:1713279569.307739:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279569.307745:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 487 00000100:00100000:2.0:1713279569.307749:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 953 00000100:00100000:3.0:1713279569.307758:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281345984:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279569.307760:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281346048:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279569.307767:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279569.307778:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346432 00000100:00100000:1.0:1713279569.307782:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346432 00000100:00100000:0.0:1713279569.307791:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279569.307803:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346240 00000100:00100000:1.0:1713279569.307807:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346240 00000100:00100000:1.0:1713279569.307830:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 497 00000100:00100000:2.0:1713279569.307838:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281346048:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 78us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279569.307840:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281346176:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279569.307844:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281345984:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 87us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279569.307846:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279569.307850:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 953 00000100:00100000:3.0:1713279569.307856:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 487 00000100:00100000:2.0:1713279569.307871:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346368 00000100:00100000:2.0:1713279569.307875:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346368 00000100:00100000:1.0:1713279569.307892:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281346176:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279569.307897:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 954 00000100:00100000:1.0:1713279569.307903:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 497 00000100:00100000:2.0:1713279569.307905:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281346112:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279569.307907:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 955 00000100:00100000:3.0:1713279569.307917:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281346304:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279569.307919:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346496 00000100:00100000:1.0:1713279569.307924:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346496 00000100:00100000:2.0:1713279569.307942:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281346112:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279569.307949:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 498 00000100:00100000:2.0:1713279569.307951:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 954 00000100:00100000:1.0:1713279569.307957:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281346432:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279569.307959:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281346304:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279569.307968:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 956 00000100:00100000:2.0:1713279569.307975:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281346368:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279569.307984:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 955 00000100:00100000:1.0:1713279569.307999:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281346432:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279569.308008:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281346368:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279569.308010:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 498 00000100:00100000:2.0:1713279569.308018:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 956 00000100:00100000:3.0:1713279569.308023:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 499 00000100:00100000:3.0:1713279569.308032:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281346240:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:0.0:1713279569.308041:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279539 00000100:00100000:1.0:1713279569.308042:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 500 00000100:00080000:0.0:1713279569.308046:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279539 00000100:00080000:0.0:1713279569.308050:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279539 00000100:00100000:1.0:1713279569.308050:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281346496:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:0.0:1713279569.308053:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279539 00000100:00080000:0.0:1713279569.308056:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279539 00000100:00100000:3.0:1713279569.308081:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281346240:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279569.308085:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281346496:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279569.308092:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 499 00000100:00100000:1.0:1713279569.308098:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 500 00010000:00010000:2.0:1713279569.732741:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279570.402651:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713279570.402698:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200133056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1713279570.402782:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279570.402864:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133056 00000100:00100000:3.0:1713279570.402884:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133056 00000100:00100000:3.0:1713279570.402937:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99167 00000100:00100000:3.0:1713279570.402945:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200133056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279570.402985:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279570.403049:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200133056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279570.403057:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99167 00000100:00100000:1.0:1713279570.403129:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200133056:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279570.734803:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713279571.736773:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279572.082821:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713279572.082848:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200133120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279572.082925:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279572.083002:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133120 00000100:00100000:3.0:1713279572.083016:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133120 00000100:00100000:3.0:1713279572.083088:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99168 00000100:00100000:3.0:1713279572.083101:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200133120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1713279572.083149:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:3.0:1713279572.083237:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200133120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279572.083251:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99168 00000100:00100000:0.0:1713279572.083302:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200133120:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279572.738712:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279572.754668:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200133376:0@lo:400:kworker.0 00000100:00100000:3.0:1713279572.754681:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200133184:0@lo:400:kworker.0 00000100:00100000:0.0:1713279572.754684:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200133248:0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.754762:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279572.754762:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279572.754767:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200133312:0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.754790:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200133632:0@lo:400:kworker.0 00000100:00100000:0.0:1713279572.754798:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279572.754809:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200133440:0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.754813:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279572.754822:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200133568:0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.754825:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200133888:0@lo:400:kworker.0 00000100:00100000:0.0:1713279572.754847:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279572.754848:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279572.754852:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279572.754860:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200133824:0@lo:400:kworker.0 00000100:00100000:0.0:1713279572.754879:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279572.754879:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200133696:0@lo:400:kworker.0 00000100:00100000:2.0:1713279572.754891:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133184 00000100:00100000:1.0:1713279572.754897:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133376 00000100:00100000:2.0:1713279572.754902:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133184 00000100:00100000:1.0:1713279572.754903:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133376 00000100:00100000:0.0:1713279572.754907:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133568 00000100:00100000:3.0:1713279572.754910:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279572.754912:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133568 00000100:00100000:3.0:1713279572.754932:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200133952:0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.754937:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133824 00000100:00100000:1.0:1713279572.754939:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133824 00000100:00100000:3.0:1713279572.754957:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279572.754959:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:1.0:1713279572.754966:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200133376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279572.754968:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:2.0:1713279572.754974:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1713279572.754975:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200133824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279572.754982:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200133184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279572.754999:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133312 00000100:00100000:3.0:1713279572.755006:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133312 00000100:00100000:1.0:1713279572.755018:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200133376:12345-0@lo:400:kworker.0 Request processed in 52us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279572.755022:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200133824:12345-0@lo:400:kworker.0 Request processed in 46us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279572.755026:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1713279572.755030:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:3.0:1713279572.755038:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133440 00000100:00100000:3.0:1713279572.755042:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133440 00000100:00100000:1.0:1713279572.755043:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:2.0:1713279572.755046:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200133184:12345-0@lo:400:kworker.0 Request processed in 65us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279572.755048:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200133568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279572.755054:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1713279572.755061:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279572.755066:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99169 00000100:00100000:0.0:1713279572.755074:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200133504:0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.755075:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200133568:12345-0@lo:400:kworker.0 Request processed in 25us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279572.755075:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200133312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.755085:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:2.0:1713279572.755090:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133632 00000100:00100000:0.0:1713279572.755093:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279572.755093:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133632 00000100:00100000:1.0:1713279572.755094:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133248 00000100:00100000:1.0:1713279572.755097:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133248 00000100:00100000:0.0:1713279572.755102:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200133760:0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.755110:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133504 00000100:00100000:1.0:1713279572.755112:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133504 00000100:00100000:2.0:1713279572.755114:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133888 00000100:00100000:2.0:1713279572.755116:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133888 00000100:00100000:0.0:1713279572.755122:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279572.755129:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133696 00000100:00100000:3.0:1713279572.755131:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200133312:12345-0@lo:400:kworker.0 Request processed in 55us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279572.755132:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133696 00000100:00100000:1.0:1713279572.755139:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133760 00000100:00100000:1.0:1713279572.755142:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133760 00000100:00100000:2.0:1713279572.755143:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200133952 00000100:00100000:3.0:1713279572.755143:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99169 00000100:00100000:2.0:1713279572.755145:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200133952 00000100:00100000:0.0:1713279572.755151:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1713279572.755157:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200133632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.755157:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1713279572.755162:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200133248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279572.755163:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1713279572.755163:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99170 00000100:00100000:2.0:1713279572.755168:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200133888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279572.755171:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200133440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279572.755186:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200133632:12345-0@lo:400:kworker.0 Request processed in 29us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279572.755193:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1713279572.755196:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200133248:12345-0@lo:400:kworker.0 Request processed in 33us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279572.755202:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:2.0:1713279572.755204:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200133888:12345-0@lo:400:kworker.0 Request processed in 35us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279572.755207:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1713279572.755215:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200133696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.755217:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:2.0:1713279572.755217:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1713279572.755219:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200133440:12345-0@lo:400:kworker.0 Request processed in 43us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279572.755221:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200133504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279572.755227:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1713279572.755230:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99170 00000100:00100000:2.0:1713279572.755232:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200133952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279572.755240:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200133696:12345-0@lo:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279572.755245:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200133504:12345-0@lo:400:kworker.0 Request processed in 22us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279572.755247:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1713279572.755287:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200133952:12345-0@lo:400:kworker.0 Request processed in 54us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279572.755288:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:2.0:1713279572.755294:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1713279572.755299:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1713279572.755303:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200133760:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1713279572.755310:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279542 00000100:00080000:2.0:1713279572.755314:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279542 00000100:00080000:2.0:1713279572.755316:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279542 00000100:00080000:2.0:1713279572.755318:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279542 00000100:00100000:3.0:1713279572.755319:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200133184:0@lo:400:kworker.0 00000100:00080000:2.0:1713279572.755320:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279542 00000100:00100000:0.0:1713279572.755332:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200133248:0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.755333:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200133760:12345-0@lo:400:kworker.0 Request processed in 29us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279572.755337:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200133440:0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.755339:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:0.0:1713279572.755343:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200133504:0@lo:400:kworker.0 00000100:00100000:3.0:1713279572.755353:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200133696:0@lo:400:kworker.0 00000100:00100000:0.0:1713279572.755354:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200133760:0@lo:400:kworker.0 00000100:00100000:3.0:1713279572.755368:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200133952:0@lo:400:kworker.0 00000100:00100000:0.0:1713279572.755382:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200133312:0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.755383:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200133376:0@lo:400:kworker.0 00000100:00100000:0.0:1713279572.755392:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200133568:0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.755394:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200133632:0@lo:400:kworker.0 00000100:00100000:0.0:1713279572.755401:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200133824:0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.755404:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200133888:0@lo:400:kworker.0 00000100:00100000:1.0:1713279572.770565:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713279572.770579:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200134016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279572.770621:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279572.770629:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200134080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279572.770657:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134016 00000100:00100000:1.0:1713279572.770662:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134016 00000100:00100000:2.0:1713279572.770676:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279572.770724:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134080 00000100:00100000:1.0:1713279572.770727:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134080 00000100:00100000:1.0:1713279572.770740:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1713279572.770746:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200134016:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279572.770751:0:10045:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1713279572.770761:0:10045:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200134080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1713279572.770774:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:3.0:1713279572.770781:0:10045:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279572.770813:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200134016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279572.770820:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1713279572.770841:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200134016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279572.770841:0:10045:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200134080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279572.770849:0:10045:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1713279572.770900:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200134080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279573.490628:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713279573.490650:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200134144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279573.490709:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279573.490747:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134144 00000100:00100000:2.0:1713279573.490755:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134144 00000100:00100000:2.0:1713279573.490795:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1713279573.490800:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200134144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279573.490823:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279573.490860:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200134144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279573.490864:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1713279573.490895:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200134144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279573.506586:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200134208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1713279573.506623:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279573.506647:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134208 00000100:00100000:2.0:1713279573.506670:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134208 00000100:00100000:2.0:1713279573.506704:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:2.0:1713279573.506711:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200134208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279573.506731:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279573.506789:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200134208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279573.506796:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1713279573.506825:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008be58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200134208:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279573.740637:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279574.315473:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279574.315511:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279574.315535:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279574.315550:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346624 00000100:00100000:0.0:1713279574.315555:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279574.315560:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346624 00000100:00100000:0.0:1713279574.315570:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279574.315571:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346752 00000100:00100000:1.0:1713279574.315575:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346752 00000100:00100000:3.0:1713279574.315579:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346560 00000100:00100000:0.0:1713279574.315583:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279574.315584:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346560 00000100:00100000:2.0:1713279574.315594:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346688 00000100:00100000:1.0:1713279574.315595:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346816 00000100:00100000:2.0:1713279574.315595:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346688 00000100:00100000:0.0:1713279574.315596:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279574.315597:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346816 00000100:00100000:2.0:1713279574.315604:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346880 00000100:00100000:2.0:1713279574.315605:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346880 00000100:00100000:1.0:1713279574.315606:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347008 00000100:00100000:1.0:1713279574.315607:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347008 00000100:00100000:0.0:1713279574.315610:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279574.315610:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 489 00000100:00100000:3.0:1713279574.315615:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281346560:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279574.315616:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281346944 00000100:00100000:2.0:1713279574.315617:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281346944 00000100:00100000:1.0:1713279574.315618:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 505 00000100:00100000:1.0:1713279574.315622:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281346752:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279574.315627:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 963 00000100:00100000:0.0:1713279574.315632:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279574.315632:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281346624:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279574.315648:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347072 00000100:00100000:0.0:1713279574.315652:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347072 00000100:00100000:1.0:1713279574.315660:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281346752:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279574.315661:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281346560:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279574.315665:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 489 00000100:00100000:2.0:1713279574.315666:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281346624:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279574.315667:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 505 00000100:00100000:2.0:1713279574.315670:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 963 00000100:00100000:0.0:1713279574.315673:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 506 00000100:00100000:1.0:1713279574.315677:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 507 00000100:00100000:0.0:1713279574.315679:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281346816:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279574.315680:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281347008:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279574.315681:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 964 00000100:00100000:2.0:1713279574.315683:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281346688:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279574.315690:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 508 00000100:00100000:1.0:1713279574.315692:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281347008:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 11us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279574.315694:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281347072:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279574.315696:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 507 00000100:00100000:2.0:1713279574.315696:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281346688:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 12us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279574.315700:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 964 00000100:00100000:2.0:1713279574.315704:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 965 00000100:00100000:0.0:1713279574.315707:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281346816:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279574.315707:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 966 00000100:00100000:2.0:1713279574.315707:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281346880:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279574.315710:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281346944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279574.315710:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281347072:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 15us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279574.315713:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 506 00000100:00100000:3.0:1713279574.315716:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 508 00000100:00100000:2.0:1713279574.315719:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281346880:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 11us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279574.315721:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281346944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 10us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279574.315722:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 965 00000100:00100000:1.0:1713279574.315725:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 966 00000100:00080000:2.0:1713279574.315736:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279544 00000100:00080000:2.0:1713279574.315738:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279544 00000100:00080000:2.0:1713279574.315739:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279544 00000100:00080000:2.0:1713279574.315740:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279544 00000100:00080000:2.0:1713279574.315741:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279544 00010000:00010000:2.0:1713279574.742732:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279575.410732:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200134272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1713279575.410812:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279575.410877:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134272 00000100:00100000:1.0:1713279575.410888:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134272 00000100:00100000:1.0:1713279575.410942:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99171 00000100:00100000:1.0:1713279575.410951:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200134272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1713279575.410992:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:1.0:1713279575.411056:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200134272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279575.411065:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99171 00000100:00100000:2.0:1713279575.411097:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200134272:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279575.744785:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279576.746802:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279577.090736:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200134336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1713279577.090816:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279577.090878:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134336 00000100:00100000:2.0:1713279577.090891:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134336 00000100:00100000:2.0:1713279577.090953:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99172 00000100:00100000:2.0:1713279577.090961:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200134336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279577.090998:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279577.091066:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200134336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279577.091075:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99172 00000100:00100000:1.0:1713279577.091118:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200134336:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279577.748635:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279577.762693:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200134464:0@lo:400:kworker.0 00000100:00100000:2.0:1713279577.762716:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200134528:0@lo:400:kworker.0 00000100:00100000:0.0:1713279577.762723:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200134592:0@lo:400:kworker.0 00000100:00100000:2.0:1713279577.762771:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279577.762779:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279577.762788:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200134400:0@lo:400:kworker.0 00000100:00100000:2.0:1713279577.762814:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200134784:0@lo:400:kworker.0 00000100:00100000:3.0:1713279577.762817:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200134720:0@lo:400:kworker.0 00000100:00100000:0.0:1713279577.762847:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279577.762852:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279577.762870:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134528 00000100:00100000:0.0:1713279577.762872:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200134656:0@lo:400:kworker.0 00000100:00100000:3.0:1713279577.762875:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134464 00000100:00100000:2.0:1713279577.762878:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134528 00000100:00100000:3.0:1713279577.762882:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134464 00000100:00100000:1.0:1713279577.762890:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200134848:0@lo:400:kworker.0 00000100:00100000:0.0:1713279577.762892:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279577.762905:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200134912:0@lo:400:kworker.0 00000100:00100000:2.0:1713279577.762918:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134656 00000100:00100000:2.0:1713279577.762921:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134656 00000100:00100000:3.0:1713279577.762923:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134592 00000100:00100000:0.0:1713279577.762927:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279577.762928:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134592 00000100:00100000:2.0:1713279577.762939:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99173 00000100:00100000:1.0:1713279577.762941:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:0.0:1713279577.762942:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200135168:0@lo:400:kworker.0 00000100:00100000:2.0:1713279577.762946:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200134528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279577.762949:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200134464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279577.762957:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279577.762974:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:3.0:1713279577.762983:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200134592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279577.762995:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134912 00000100:00100000:0.0:1713279577.763000:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134912 00000100:00100000:2.0:1713279577.763002:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200134528:12345-0@lo:400:kworker.0 Request processed in 55us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279577.763007:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200134464:12345-0@lo:400:kworker.0 Request processed in 56us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279577.763010:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99173 00000100:00100000:1.0:1713279577.763019:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1713279577.763028:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99174 00000100:00100000:2.0:1713279577.763033:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200134656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279577.763033:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200134592:12345-0@lo:400:kworker.0 Request processed in 51us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279577.763034:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135168 00000100:00100000:0.0:1713279577.763036:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135168 00000100:00100000:3.0:1713279577.763041:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:0.0:1713279577.763052:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:0.0:1713279577.763060:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200134912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279577.763061:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1713279577.763061:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200134656:12345-0@lo:400:kworker.0 Request processed in 26us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279577.763067:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99174 00000100:00100000:1.0:1713279577.763070:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200135168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279577.763072:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1713279577.763082:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279547 00000100:00100000:3.0:1713279577.763086:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200134976:0@lo:400:kworker.0 00000100:00080000:2.0:1713279577.763087:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279547 00000100:00100000:0.0:1713279577.763096:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200134912:12345-0@lo:400:kworker.0 Request processed in 37us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279577.763101:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279577.763104:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1713279577.763115:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134720 00000100:00100000:3.0:1713279577.763118:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134720 00000100:00100000:2.0:1713279577.763121:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200135040:0@lo:400:kworker.0 00000100:00100000:1.0:1713279577.763128:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200135168:12345-0@lo:400:kworker.0 Request processed in 57us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279577.763130:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134400 00000100:00100000:0.0:1713279577.763133:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134400 00000100:00100000:1.0:1713279577.763136:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1713279577.763139:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134784 00000100:00100000:2.0:1713279577.763141:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279577.763142:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134784 00000100:00100000:3.0:1713279577.763155:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135040 00000100:00100000:0.0:1713279577.763156:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1713279577.763157:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135040 00000100:00100000:0.0:1713279577.763161:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200134400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279577.763163:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:1.0:1713279577.763168:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200134720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279577.763170:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200134528:0@lo:400:kworker.0 00000100:00100000:3.0:1713279577.763173:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1713279577.763178:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200134784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279577.763185:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200134400:12345-0@lo:400:kworker.0 Request processed in 23us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279577.763192:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1713279577.763199:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200134720:12345-0@lo:400:kworker.0 Request processed in 30us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279577.763205:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1713279577.763211:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:3.0:1713279577.763213:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200134784:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279577.763256:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200135040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279577.763264:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:1.0:1713279577.763277:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279577.763291:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279577.763294:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200134400:0@lo:400:kworker.0 00000100:00100000:1.0:1713279577.763298:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200135104:0@lo:400:kworker.0 00000100:00100000:0.0:1713279577.763305:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200134656:0@lo:400:kworker.0 00000100:00100000:2.0:1713279577.763318:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200135040:12345-0@lo:400:kworker.0 Request processed in 63us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279577.763321:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200134912:0@lo:400:kworker.0 00000100:00100000:3.0:1713279577.763325:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200134464:0@lo:400:kworker.0 00000100:00100000:1.0:1713279577.763328:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279577.763330:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200135168:0@lo:400:kworker.0 00000100:00100000:2.0:1713279577.763330:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:3.0:1713279577.763336:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200134720:0@lo:400:kworker.0 00000100:00100000:2.0:1713279577.763351:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134976 00000100:00100000:1.0:1713279577.763356:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200134592:0@lo:400:kworker.0 00000100:00100000:2.0:1713279577.763357:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134976 00000100:00100000:0.0:1713279577.763369:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200134848 00000100:00100000:0.0:1713279577.763372:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200134848 00000100:00100000:1.0:1713279577.763376:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135104 00000100:00100000:1.0:1713279577.763380:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135104 00000100:00100000:2.0:1713279577.763386:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:0.0:1713279577.763390:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1713279577.763394:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200134976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279577.763396:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200134848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279577.763404:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1713279577.763409:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200135104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279577.763465:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200134848:12345-0@lo:400:kworker.0 Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279577.763470:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200135104:12345-0@lo:400:kworker.0 Request processed in 60us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279577.763472:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1713279577.763477:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00080000:3.0:1713279577.763504:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279547 00000100:00100000:1.0:1713279577.763507:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200134848:0@lo:400:kworker.0 00000100:00080000:3.0:1713279577.763509:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279547 00000100:00080000:3.0:1713279577.763512:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279547 00000100:00080000:3.0:1713279577.763514:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279547 00000100:00080000:3.0:1713279577.763516:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279547 00000100:00100000:1.0:1713279577.763518:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200135104:0@lo:400:kworker.0 00000100:00100000:2.0:1713279577.763522:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200134976:12345-0@lo:400:kworker.0 Request processed in 126us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279577.763534:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:3.0:1713279577.763539:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200134784:0@lo:400:kworker.0 00000100:00100000:3.0:1713279577.763549:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200135040:0@lo:400:kworker.0 00000100:00100000:1.0:1713279577.763554:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200134976:0@lo:400:kworker.0 00000100:00100000:1.0:1713279577.778608:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200135232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279577.778646:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200135296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279577.778664:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279577.778728:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135232 00000100:00100000:3.0:1713279577.778731:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279577.778736:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135232 00000100:00100000:2.0:1713279577.778778:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135296 00000100:00100000:2.0:1713279577.778781:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135296 00000100:00100000:1.0:1713279577.778786:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1713279577.778795:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200135232:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279577.778806:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1713279577.778813:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200135296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1713279577.778824:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279577.778829:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279577.778877:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200135232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279577.778884:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1713279577.778885:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200135296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279577.778893:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1713279577.778922:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800997f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200135232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279577.778935:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200135296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279578.498736:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200135360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279578.498825:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279578.498899:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135360 00000100:00100000:0.0:1713279578.498914:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135360 00000100:00100000:0.0:1713279578.498982:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1713279578.498992:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200135360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279578.499033:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279578.499109:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200135360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279578.499119:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1713279578.499163:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200135360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279578.514729:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200135424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279578.514783:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279578.514838:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135424 00000100:00100000:2.0:1713279578.514848:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135424 00000100:00100000:2.0:1713279578.514895:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1713279578.514902:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200135424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279578.514920:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279578.514974:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200135424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279578.514982:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1713279578.515021:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200135424:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279578.750718:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279579.323460:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279579.323515:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279579.323546:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279579.323565:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279579.323591:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279579.323593:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347200 00000100:00100000:2.0:1713279579.323607:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347200 00000100:00100000:0.0:1713279579.323609:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279579.323624:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279579.323639:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347136 00000100:00100000:0.0:1713279579.323640:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279579.323648:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347136 00000100:00100000:2.0:1713279579.323661:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347264 00000100:00100000:2.0:1713279579.323663:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347264 00000100:00100000:0.0:1713279579.323669:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279579.323679:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347456 00000100:00100000:2.0:1713279579.323681:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347456 00000100:00100000:1.0:1713279579.323693:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347520 00000100:00100000:3.0:1713279579.323694:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 491 00000100:00100000:0.0:1713279579.323697:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 973 00000100:00100000:1.0:1713279579.323703:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347520 00000100:00100000:3.0:1713279579.323704:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281347136:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279579.323706:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281347200:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279579.323713:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 974 00000100:00100000:2.0:1713279579.323721:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281347264:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279579.323745:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 975 00000100:00100000:1.0:1713279579.323753:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281347456:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279579.323770:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281347200:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 65us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279579.323775:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281347136:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 71us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279579.323780:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 973 00000100:00100000:2.0:1713279579.323782:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281347264:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 60us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279579.323783:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 491 00000100:00100000:2.0:1713279579.323790:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 974 00000100:00100000:1.0:1713279579.323801:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281347456:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279579.323804:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 976 00000100:00100000:0.0:1713279579.323809:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281347520:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279579.323809:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 975 00000100:00080000:2.0:1713279579.323817:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279549 00000100:00080000:2.0:1713279579.323821:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279549 00000100:00100000:3.0:1713279579.323822:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347328 00000100:00080000:2.0:1713279579.323824:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279549 00000100:00100000:3.0:1713279579.323828:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347328 00000100:00100000:0.0:1713279579.323835:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281347520:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279579.323835:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347392 00000100:00100000:1.0:1713279579.323838:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347392 00000100:00100000:0.0:1713279579.323842:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 976 00000100:00080000:2.0:1713279579.323851:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279549 00000100:00080000:2.0:1713279579.323854:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279549 00000100:00100000:1.0:1713279579.323860:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347584 00000100:00100000:1.0:1713279579.323863:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347584 00000100:00100000:3.0:1713279579.323871:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347648 00000100:00100000:3.0:1713279579.323875:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347648 00000100:00100000:0.0:1713279579.323881:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 513 00000100:00100000:0.0:1713279579.323886:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281347392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279579.323887:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 514 00000100:00100000:2.0:1713279579.323893:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281347328:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279579.323901:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 515 00000100:00100000:1.0:1713279579.323907:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281347584:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279579.323914:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281347392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279579.323920:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 513 00000100:00100000:2.0:1713279579.323924:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281347328:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279579.323928:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 516 00000100:00100000:2.0:1713279579.323936:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 514 00000100:00100000:1.0:1713279579.323937:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281347584:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279579.323939:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008242ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281347648:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279579.323944:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 515 00000100:00100000:3.0:1713279579.323982:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008242ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281347648:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 44us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279579.323994:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 516 00000100:00080000:2.0:1713279579.324106:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279549 00000100:00080000:2.0:1713279579.324110:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279549 00010000:00010000:2.0:1713279579.752631:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279580.418660:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713279580.418695:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200135488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279580.418783:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279580.418849:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135488 00000100:00100000:0.0:1713279580.418860:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135488 00000100:00100000:0.0:1713279580.418923:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99175 00000100:00100000:0.0:1713279580.418931:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200135488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1713279580.418971:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:0.0:1713279580.419043:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200135488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279580.419051:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99175 00000100:00100000:3.0:1713279580.419122:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200135488:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279580.754632:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279581.756734:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279582.098754:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713279582.098788:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200135552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279582.098879:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279582.099024:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135552 00000100:00100000:2.0:1713279582.099037:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135552 00000100:00100000:2.0:1713279582.099100:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99176 00000100:00100000:2.0:1713279582.099109:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200135552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279582.099149:0:15542:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279582.099261:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200135552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279582.099270:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99176 00000100:00100000:0.0:1713279582.099304:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200135552:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279582.758710:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279582.770708:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200135616:0@lo:400:kworker.0 00000100:00100000:0.0:1713279582.770718:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200135680:0@lo:400:kworker.0 00000100:00100000:3.0:1713279582.770745:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200135808:0@lo:400:kworker.0 00000100:00100000:1.0:1713279582.770765:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200135744:0@lo:400:kworker.0 00000100:00100000:0.0:1713279582.770795:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279582.770796:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279582.770835:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135616 00000100:00100000:2.0:1713279582.770836:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200135872:0@lo:400:kworker.0 00000100:00100000:0.0:1713279582.770838:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200135936:0@lo:400:kworker.0 00000100:00100000:1.0:1713279582.770839:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279582.770843:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135616 00000100:00100000:2.0:1713279582.770866:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279582.770867:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279582.770871:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200136000:0@lo:400:kworker.0 00000100:00100000:0.0:1713279582.770888:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200136192:0@lo:400:kworker.0 00000100:00100000:2.0:1713279582.770889:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200136128:0@lo:400:kworker.0 00000100:00100000:3.0:1713279582.770892:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1713279582.770900:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200135616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279582.770903:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279582.770914:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279582.770925:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135680 00000100:00100000:2.0:1713279582.770928:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200136384:0@lo:400:kworker.0 00000100:00100000:0.0:1713279582.770930:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135680 00000100:00100000:1.0:1713279582.770932:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200136256:0@lo:400:kworker.0 00000100:00100000:2.0:1713279582.770953:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279582.770953:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200135616:12345-0@lo:400:kworker.0 Request processed in 52us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279582.770958:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135936 00000100:00100000:0.0:1713279582.770960:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135936 00000100:00100000:3.0:1713279582.770961:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1713279582.770975:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279582.770979:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200135616:0@lo:400:kworker.0 00000100:00100000:0.0:1713279582.770985:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136000 00000100:00100000:0.0:1713279582.770989:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136000 00000100:00100000:3.0:1713279582.770995:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136128 00000100:00100000:3.0:1713279582.770999:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136128 00000100:00080000:2.0:1713279582.771006:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279552 00000100:00080000:2.0:1713279582.771011:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279552 00000100:00100000:0.0:1713279582.771012:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136256 00000100:00080000:2.0:1713279582.771014:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279552 00000100:00100000:0.0:1713279582.771016:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136256 00000100:00080000:2.0:1713279582.771016:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279552 00000100:00100000:3.0:1713279582.771021:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136384 00000100:00100000:3.0:1713279582.771024:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136384 00000100:00100000:1.0:1713279582.771027:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:2.0:1713279582.771036:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:1.0:1713279582.771039:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200135680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279582.771040:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1713279582.771044:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200135936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279582.771045:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200136128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279582.771055:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:0.0:1713279582.771065:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200136000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279582.771086:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200136128:12345-0@lo:400:kworker.0 Request processed in 39us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279582.771091:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200135936:12345-0@lo:400:kworker.0 Request processed in 47us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279582.771097:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1713279582.771098:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200135680:12345-0@lo:400:kworker.0 Request processed in 60us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279582.771099:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:1.0:1713279582.771109:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:3.0:1713279582.771112:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1713279582.771118:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200136384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279582.771122:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200136000:12345-0@lo:400:kworker.0 Request processed in 58us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279582.771128:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:0.0:1713279582.771134:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1713279582.771134:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200136256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279582.771157:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200136384:12345-0@lo:400:kworker.0 Request processed in 37us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279582.771158:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135744 00000100:00100000:0.0:1713279582.771162:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135744 00000100:00100000:2.0:1713279582.771166:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200136256:12345-0@lo:400:kworker.0 Request processed in 32us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279582.771167:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1713279582.771173:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:1.0:1713279582.771177:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200136000:0@lo:400:kworker.0 00000100:00100000:0.0:1713279582.771213:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135872 00000100:00100000:0.0:1713279582.771216:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135872 00000100:00080000:2.0:1713279582.771223:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279552 00000100:00080000:2.0:1713279582.771226:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279552 00000100:00100000:3.0:1713279582.771232:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279582.771237:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99177 00000100:00100000:0.0:1713279582.771244:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200135744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279582.771244:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99178 00000100:00100000:1.0:1713279582.771249:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200136256:0@lo:400:kworker.0 00000100:00100000:2.0:1713279582.771249:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200135872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279582.771258:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200136064:0@lo:400:kworker.0 00000100:00100000:2.0:1713279582.771286:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200135872:12345-0@lo:400:kworker.0 Request processed in 36us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279582.771293:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200135808 00000100:00100000:2.0:1713279582.771294:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99178 00000100:00100000:3.0:1713279582.771294:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279582.771298:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200135808 00000100:00100000:0.0:1713279582.771304:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200135744:12345-0@lo:400:kworker.0 Request processed in 61us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279582.771311:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99177 00000100:00100000:3.0:1713279582.771312:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200136320:0@lo:400:kworker.0 00000100:00100000:0.0:1713279582.771332:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279582.771336:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:3.0:1713279582.771338:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279582.771344:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200135808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279582.771345:0:15480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136192 00000100:00100000:2.0:1713279582.771350:0:15480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136192 00000100:00100000:0.0:1713279582.771360:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200135680:0@lo:400:kworker.0 00000100:00100000:0.0:1713279582.771370:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200135936:0@lo:400:kworker.0 00000100:00100000:2.0:1713279582.771372:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:2.0:1713279582.771376:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200136192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279582.771376:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136064 00000100:00100000:3.0:1713279582.771381:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136064 00000100:00100000:1.0:1713279582.771397:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200135808:12345-0@lo:400:kworker.0 Request processed in 52us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279582.771401:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136320 00000100:00100000:3.0:1713279582.771404:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136320 00000100:00100000:1.0:1713279582.771407:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1713279582.771446:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200136192:0@lo:400:kworker.0 00000100:00100000:2.0:1713279582.771450:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200136192:12345-0@lo:400:kworker.0 Request processed in 33us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279582.771462:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1713279582.771465:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1713279582.771470:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200136064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279582.771473:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1713279582.771481:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200136320:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1713279582.771481:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279552 00000100:00080000:2.0:1713279582.771484:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279552 00000100:00080000:2.0:1713279582.771487:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279552 00000100:00100000:3.0:1713279582.771504:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200136064:12345-0@lo:400:kworker.0 Request processed in 33us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279582.771510:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1713279582.771521:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200135808:0@lo:400:kworker.0 00000100:00100000:1.0:1713279582.771524:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200136320:12345-0@lo:400:kworker.0 Request processed in 43us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279582.771532:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200136064:0@lo:400:kworker.0 00000100:00100000:1.0:1713279582.771534:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1713279582.771543:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200136320:0@lo:400:kworker.0 00000100:00100000:3.0:1713279582.771543:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200136128:0@lo:400:kworker.0 00000100:00100000:3.0:1713279582.771554:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200136384:0@lo:400:kworker.0 00000100:00100000:3.0:1713279582.771565:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200135872:0@lo:400:kworker.0 00000100:00100000:1.0:1713279582.771570:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200135744:0@lo:400:kworker.0 00000100:00100000:3.0:1713279582.786587:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713279582.786592:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f1d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200136448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279582.786602:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200136512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279582.786643:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279582.786668:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136448 00000100:00100000:2.0:1713279582.786677:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136448 00000100:00100000:3.0:1713279582.786681:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279582.786723:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1713279582.786727:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136512 00000100:00100000:2.0:1713279582.786730:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200136448:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279582.786733:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136512 00000100:00100000:1.0:1713279582.786756:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00002000:00000024:2.0:1713279582.786761:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279582.786762:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200136512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1713279582.786778:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279582.786811:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200136448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279582.786818:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1713279582.786832:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200136512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279582.786840:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1713279582.786877:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f1d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200136448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1713279582.786877:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200136512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279583.506715:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200136576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1713279583.506806:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279583.506912:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136576 00000100:00100000:1.0:1713279583.506922:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136576 00000100:00100000:1.0:1713279583.506981:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1713279583.506996:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200136576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1713279583.507030:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:1.0:1713279583.507093:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200136576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279583.507102:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1713279583.507169:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200136576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279583.522627:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713279583.522648:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f1d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200136640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1713279583.522701:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279583.522773:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136640 00000100:00100000:2.0:1713279583.522784:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136640 00000100:00100000:2.0:1713279583.522841:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1713279583.522852:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200136640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279583.522879:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279583.522953:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200136640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279583.522966:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1713279583.523016:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f1d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200136640:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279583.760722:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279584.331461:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279584.331507:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279584.331533:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279584.331554:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279584.331566:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279584.331570:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347712 00000100:00100000:2.0:1713279584.331573:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347776 00000100:00100000:0.0:1713279584.331579:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279584.331580:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347776 00000100:00100000:3.0:1713279584.331580:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347712 00000100:00100000:0.0:1713279584.331592:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279584.331619:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279584.331636:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347840 00000100:00100000:2.0:1713279584.331638:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347840 00000100:00100000:3.0:1713279584.331639:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 493 00000100:00100000:0.0:1713279584.331644:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279584.331644:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281347712:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279584.331648:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348032 00000100:00100000:2.0:1713279584.331649:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348032 00000100:00100000:1.0:1713279584.331656:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347904 00000100:00100000:2.0:1713279584.331658:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348096 00000100:00100000:2.0:1713279584.331659:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348096 00000100:00100000:1.0:1713279584.331662:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347904 00000100:00100000:0.0:1713279584.331670:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 983 00000100:00100000:0.0:1713279584.331676:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281347776:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279584.331679:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 984 00000100:00100000:2.0:1713279584.331683:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281347840:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279584.331686:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281347968 00000100:00100000:1.0:1713279584.331688:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281347968 00000100:00100000:3.0:1713279584.331695:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281347712:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279584.331697:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348160 00000100:00100000:1.0:1713279584.331698:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348160 00000100:00100000:3.0:1713279584.331700:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 493 00000100:00100000:0.0:1713279584.331704:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f1d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281347776:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279584.331706:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348224 00000100:00100000:1.0:1713279584.331707:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348224 00000100:00100000:0.0:1713279584.331709:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 983 00000100:00100000:2.0:1713279584.331711:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281347840:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279584.331716:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 984 00000100:00100000:1.0:1713279584.331719:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 521 00000100:00100000:0.0:1713279584.331724:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 985 00000100:00100000:3.0:1713279584.331724:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 522 00000100:00100000:1.0:1713279584.331725:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281347904:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279584.331728:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281348032:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279584.331729:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 986 00000100:00100000:3.0:1713279584.331730:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281347968:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279584.331732:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281348096:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279584.331741:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281348032:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 13us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279584.331745:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 985 00000100:00100000:2.0:1713279584.331748:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281348096:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 15us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279584.331752:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 986 00000100:00100000:1.0:1713279584.331754:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281347904:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279584.331754:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281347968:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279584.331758:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 522 00000100:00100000:1.0:1713279584.331761:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 521 00000100:00080000:2.0:1713279584.331764:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279554 00000100:00080000:2.0:1713279584.331766:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279554 00000100:00080000:2.0:1713279584.331767:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279554 00000100:00100000:3.0:1713279584.331768:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 523 00000100:00080000:2.0:1713279584.331769:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279554 00000100:00080000:2.0:1713279584.331770:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279554 00000100:00100000:1.0:1713279584.331771:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 524 00000100:00100000:3.0:1713279584.331772:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281348160:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279584.331774:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281348224:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279584.331784:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281348160:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 12us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279584.331787:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281348224:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 12us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279584.331791:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 523 00000100:00100000:1.0:1713279584.331799:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 524 00010000:00010000:2.0:1713279584.762687:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279585.426707:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713279585.426735:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200136704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1713279585.426810:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279585.426939:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136704 00000100:00100000:0.0:1713279585.426949:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136704 00000100:00100000:0.0:1713279585.427004:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99179 00000100:00100000:0.0:1713279585.427012:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200136704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1713279585.427050:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:0.0:1713279585.427117:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200136704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279585.427125:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99179 00000100:00100000:2.0:1713279585.427203:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200136704:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279585.764757:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279586.766760:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279587.106695:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200136768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713279587.106773:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279587.106843:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136768 00000100:00100000:0.0:1713279587.106854:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136768 00000100:00100000:0.0:1713279587.106908:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99180 00000100:00100000:0.0:1713279587.106916:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200136768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713279587.106958:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:0.0:1713279587.107025:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200136768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279587.107033:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99180 00000100:00100000:2.0:1713279587.107060:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200136768:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279587.768722:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279587.778680:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200136896:0@lo:400:kworker.0 00000100:00100000:3.0:1713279587.778682:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200136832:0@lo:400:kworker.0 00000100:00100000:2.0:1713279587.778694:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200137024:0@lo:400:kworker.0 00000100:00100000:0.0:1713279587.778719:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200136960:0@lo:400:kworker.0 00000100:00100000:1.0:1713279587.778772:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279587.778776:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279587.778788:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279587.778803:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136832 00000100:00100000:3.0:1713279587.778808:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200137088:0@lo:400:kworker.0 00000100:00100000:2.0:1713279587.778812:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136832 00000100:00100000:1.0:1713279587.778814:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200137152:0@lo:400:kworker.0 00000100:00100000:0.0:1713279587.778817:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200137216:0@lo:400:kworker.0 00000100:00100000:3.0:1713279587.778832:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279587.778837:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279587.778848:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200137344:0@lo:400:kworker.0 00000100:00100000:0.0:1713279587.778850:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136960 00000100:00100000:1.0:1713279587.778854:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200137408:0@lo:400:kworker.0 00000100:00100000:0.0:1713279587.778855:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136960 00000100:00100000:2.0:1713279587.778863:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1713279587.778873:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200136832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279587.778875:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279587.778875:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279587.778886:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137088 00000100:00100000:3.0:1713279587.778887:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200137600:0@lo:400:kworker.0 00000100:00100000:0.0:1713279587.778889:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137088 00000100:00100000:0.0:1713279587.778904:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99181 00000100:00100000:3.0:1713279587.778906:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279587.778909:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200136896 00000100:00100000:0.0:1713279587.778911:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200136960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279587.778914:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200136896 00000100:00100000:2.0:1713279587.778929:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200136832:12345-0@lo:400:kworker.0 Request processed in 58us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279587.778937:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1713279587.778940:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200136832:0@lo:400:kworker.0 00000100:00100000:1.0:1713279587.778941:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137152 00000100:00100000:1.0:1713279587.778944:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137152 00000100:00100000:0.0:1713279587.778955:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200136960:12345-0@lo:400:kworker.0 Request processed in 43us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279587.778957:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137408 00000100:00100000:1.0:1713279587.778959:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137408 00000100:00100000:0.0:1713279587.778962:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99181 00000100:00080000:2.0:1713279587.778968:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279557 00000100:00080000:2.0:1713279587.778973:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279557 00000100:00100000:1.0:1713279587.778975:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1713279587.778975:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137344 00000100:00100000:0.0:1713279587.778976:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99182 00000100:00100000:0.0:1713279587.778980:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200137088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279587.778980:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137344 00000100:00100000:1.0:1713279587.778982:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200136896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279587.778991:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:2.0:1713279587.778996:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200137152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279587.779009:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200137088:12345-0@lo:400:kworker.0 Request processed in 28us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279587.779009:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137600 00000100:00100000:3.0:1713279587.779012:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137600 00000100:00100000:0.0:1713279587.779015:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99182 00000100:00100000:1.0:1713279587.779023:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200136896:12345-0@lo:400:kworker.0 Request processed in 41us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279587.779027:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200137152:12345-0@lo:400:kworker.0 Request processed in 31us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279587.779028:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1713279587.779031:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1713279587.779034:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200137344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279587.779036:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279587.779036:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:1.0:1713279587.779045:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137216 00000100:00100000:1.0:1713279587.779048:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137216 00000100:00100000:0.0:1713279587.779050:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200137472:0@lo:400:kworker.0 00000100:00100000:2.0:1713279587.779051:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:2.0:1713279587.779056:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009089c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200137408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279587.779065:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:1.0:1713279587.779069:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200137216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279587.779070:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279587.779075:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200137344:12345-0@lo:400:kworker.0 Request processed in 39us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279587.779082:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:2.0:1713279587.779110:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009089c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200137408:12345-0@lo:400:kworker.0 Request processed in 36us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279587.779112:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1713279587.779116:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200137600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279587.779121:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1713279587.779125:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200137216:12345-0@lo:400:kworker.0 Request processed in 55us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279587.779130:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137472 00000100:00100000:1.0:1713279587.779132:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:0.0:1713279587.779133:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200136960:0@lo:400:kworker.0 00000100:00100000:2.0:1713279587.779134:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137472 00000100:00100000:3.0:1713279587.779138:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200137600:12345-0@lo:400:kworker.0 Request processed in 21us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279587.779144:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1713279587.779182:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200137216:0@lo:400:kworker.0 00000100:00100000:2.0:1713279587.779189:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:2.0:1713279587.779193:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200137472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279587.779222:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200136896:0@lo:400:kworker.0 00000100:00100000:1.0:1713279587.779232:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200137152:0@lo:400:kworker.0 00000100:00100000:2.0:1713279587.779233:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200137472:12345-0@lo:400:kworker.0 Request processed in 38us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279587.779238:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1713279587.779241:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200137408:0@lo:400:kworker.0 00000100:00100000:0.0:1713279587.779244:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200137472:0@lo:400:kworker.0 00000100:00080000:2.0:1713279587.779254:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279557 00000100:00080000:2.0:1713279587.779257:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279557 00000100:00080000:2.0:1713279587.779260:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279557 00000100:00100000:2.0:1713279587.779268:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279587.779277:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200137088:0@lo:400:kworker.0 00000100:00100000:2.0:1713279587.779286:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200137280:0@lo:400:kworker.0 00000100:00100000:1.0:1713279587.779287:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137024 00000100:00100000:1.0:1713279587.779290:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137024 00000100:00100000:0.0:1713279587.779292:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200137344:0@lo:400:kworker.0 00000100:00100000:0.0:1713279587.779308:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200137600:0@lo:400:kworker.0 00000100:00100000:2.0:1713279587.779309:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279587.779310:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:1.0:1713279587.779314:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200137024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279587.779320:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e7e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200137536:0@lo:400:kworker.0 00000100:00100000:2.0:1713279587.779341:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279587.779347:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200137024:12345-0@lo:400:kworker.0 Request processed in 32us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279587.779353:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:2.0:1713279587.779364:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200137024:0@lo:400:kworker.0 00000100:00100000:1.0:1713279587.779368:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137280 00000100:00100000:1.0:1713279587.779370:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137280 00000100:00080000:2.0:1713279587.779382:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279557 00000100:00100000:1.0:1713279587.779388:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137536 00000100:00100000:1.0:1713279587.779391:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137536 00000100:00100000:2.0:1713279587.779395:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1713279587.779400:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200137280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279587.779405:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1713279587.779449:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091be8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200137536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279587.779484:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200137280:12345-0@lo:400:kworker.0 Request processed in 82us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279587.779484:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091be8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200137536:12345-0@lo:400:kworker.0 Request processed in 73us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279587.779491:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1713279587.779495:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00080000:2.0:1713279587.779524:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279557 00000100:00100000:0.0:1713279587.779525:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200137280:0@lo:400:kworker.0 00000100:00100000:0.0:1713279587.779537:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e7e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200137536:0@lo:400:kworker.0 00000100:00100000:1.0:1713279587.794584:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200137728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279587.794610:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200137664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279587.794627:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279587.794655:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279587.794678:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137728 00000100:00100000:1.0:1713279587.794684:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137728 00000100:00100000:2.0:1713279587.794709:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137664 00000100:00100000:1.0:1713279587.794713:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1713279587.794718:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137664 00000100:00100000:1.0:1713279587.794719:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200137728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1713279587.794748:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:2.0:1713279587.794751:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:2.0:1713279587.794758:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200137664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1713279587.794777:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279587.794783:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200137728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279587.794791:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1713279587.794809:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200137728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279587.794823:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200137664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279587.794831:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1713279587.794853:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200137664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279588.514716:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200137792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279588.514810:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279588.514967:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137792 00000100:00100000:2.0:1713279588.514980:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137792 00000100:00100000:2.0:1713279588.515042:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:2.0:1713279588.515051:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200137792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279588.515089:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279588.515196:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200137792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279588.515204:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1713279588.515246:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200137792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279588.530634:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713279588.530651:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200137856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279588.530697:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279588.530751:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137856 00000100:00100000:2.0:1713279588.530760:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137856 00000100:00100000:2.0:1713279588.530804:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1713279588.530811:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200137856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279588.530830:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279588.530888:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200137856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279588.530899:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:0.0:1713279588.530948:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200137856:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279588.770806:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279589.339034:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279589.339072:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279589.339091:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279589.339102:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279589.339118:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279589.339124:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348288 00000100:00100000:2.0:1713279589.339125:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348352 00000100:00100000:0.0:1713279589.339129:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279589.339134:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348352 00000100:00100000:3.0:1713279589.339134:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348288 00000100:00100000:0.0:1713279589.339153:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279589.339163:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279589.339183:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348416 00000100:00100000:0.0:1713279589.339185:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279589.339185:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348416 00000100:00100000:1.0:1713279589.339188:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348608 00000100:00100000:3.0:1713279589.339191:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 495 00000100:00100000:1.0:1713279589.339193:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348608 00000100:00100000:3.0:1713279589.339197:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281348288:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279589.339201:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348672 00000100:00100000:2.0:1713279589.339203:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348672 00000100:00100000:0.0:1713279589.339208:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 993 00000100:00100000:0.0:1713279589.339212:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281348352:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279589.339215:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 994 00000100:00100000:1.0:1713279589.339219:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281348416:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279589.339219:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 995 00000100:00100000:2.0:1713279589.339224:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281348608:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279589.339255:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281348352:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279589.339260:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 993 00000100:00100000:3.0:1713279589.339262:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281348288:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 64us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279589.339263:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281348416:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279589.339266:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281348608:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279589.339267:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 994 00000100:00100000:3.0:1713279589.339268:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 495 00000100:00100000:2.0:1713279589.339271:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 995 00000100:00100000:0.0:1713279589.339275:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 996 00000100:00100000:0.0:1713279589.339278:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281348672:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279589.339285:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348480 00000100:00100000:2.0:1713279589.339286:0:11415:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348544 00000100:00100000:1.0:1713279589.339287:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348480 00000100:00100000:2.0:1713279589.339288:0:11415:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348544 00000100:00100000:3.0:1713279589.339290:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348736 00000100:00100000:0.0:1713279589.339291:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281348672:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 13us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279589.339293:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348736 00000100:00100000:0.0:1713279589.339295:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 996 00000100:00100000:1.0:1713279589.339302:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348800 00000100:00100000:1.0:1713279589.339303:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348800 00000100:00100000:2.0:1713279589.339305:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 529 00000100:00100000:2.0:1713279589.339308:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281348480:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279589.339311:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 530 00000100:00100000:1.0:1713279589.339314:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 531 00000100:00100000:3.0:1713279589.339316:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281348544:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279589.339317:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281348736:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279589.339324:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281348480:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 15us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279589.339328:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 529 00000100:00100000:1.0:1713279589.339334:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281348736:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 16us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279589.339334:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 532 00000100:00100000:1.0:1713279589.339337:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 531 00000100:00100000:2.0:1713279589.339338:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281348800:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279589.339340:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281348544:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279589.339346:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 530 00000100:00100000:2.0:1713279589.339350:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281348800:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 12us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279589.339353:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 532 00000100:00080000:2.0:1713279589.339361:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279559 00000100:00080000:2.0:1713279589.339363:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279559 00000100:00080000:2.0:1713279589.339364:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279559 00000100:00080000:2.0:1713279589.339366:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279559 00000100:00080000:2.0:1713279589.339367:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279559 00010000:00010000:2.0:1713279589.772639:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279590.434701:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200137920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1713279590.434792:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279590.434895:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137920 00000100:00100000:3.0:1713279590.434907:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137920 00000100:00100000:3.0:1713279590.434999:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99183 00000100:00100000:3.0:1713279590.435008:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008acce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200137920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279590.435048:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279590.435110:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008acce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200137920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279590.435120:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99183 00000100:00100000:1.0:1713279590.435180:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200137920:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279590.774683:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279591.776581:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279592.114708:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200137984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1713279592.114787:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279592.114879:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200137984 00000100:00100000:3.0:1713279592.114890:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200137984 00000100:00100000:3.0:1713279592.114947:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99184 00000100:00100000:3.0:1713279592.114955:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200137984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1713279592.115010:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:3.0:1713279592.115075:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200137984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279592.115083:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99184 00000100:00100000:0.0:1713279592.115113:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200137984:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279592.778746:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279592.786645:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200138112:0@lo:400:kworker.0 00000100:00100000:1.0:1713279592.786653:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200138176:0@lo:400:kworker.0 00000100:00100000:0.0:1713279592.786671:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200138240:0@lo:400:kworker.0 00000100:00100000:1.0:1713279592.786737:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279592.786739:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279592.786757:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200138048:0@lo:400:kworker.0 00000100:00100000:1.0:1713279592.786772:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200138432:0@lo:400:kworker.0 00000100:00100000:2.0:1713279592.786797:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200138368:0@lo:400:kworker.0 00000100:00100000:0.0:1713279592.786817:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279592.786825:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279592.786841:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138176 00000100:00100000:3.0:1713279592.786853:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138176 00000100:00100000:2.0:1713279592.786860:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138112 00000100:00100000:1.0:1713279592.786861:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200138688:0@lo:400:kworker.0 00000100:00100000:2.0:1713279592.786867:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138112 00000100:00100000:0.0:1713279592.786868:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801251da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200138304:0@lo:400:kworker.0 00000100:00100000:1.0:1713279592.786878:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279592.786900:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279592.786907:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138432 00000100:00100000:1.0:1713279592.786908:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138688 00000100:00100000:3.0:1713279592.786908:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99185 00000100:00100000:2.0:1713279592.786911:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138432 00000100:00100000:1.0:1713279592.786913:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138688 00000100:00100000:3.0:1713279592.786918:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200138176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279592.786923:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200138560:0@lo:400:kworker.0 00000100:00100000:2.0:1713279592.786942:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1713279592.786951:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:0.0:1713279592.786953:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279592.786953:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200138112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279592.786957:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200138432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279592.786977:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200138816:0@lo:400:kworker.0 00000100:00100000:1.0:1713279592.787000:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200138432:12345-0@lo:400:kworker.0 Request processed in 42us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279592.787007:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1713279592.787008:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200138176:12345-0@lo:400:kworker.0 Request processed in 89us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279592.787019:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279592.787019:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200138112:12345-0@lo:400:kworker.0 Request processed in 65us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279592.787020:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99185 00000100:00100000:1.0:1713279592.787025:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1713279592.787029:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200138688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279592.787030:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:3.0:1713279592.787039:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138304 00000100:00100000:3.0:1713279592.787044:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138304 00000100:00100000:1.0:1713279592.787047:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200138688:12345-0@lo:400:kworker.0 Request processed in 18us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279592.787053:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00080000:2.0:1713279592.787059:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279562 00000100:00100000:3.0:1713279592.787068:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99186 00000100:00100000:3.0:1713279592.787075:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200138304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279592.787081:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138048 00000100:00100000:2.0:1713279592.787085:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138048 00000100:00100000:1.0:1713279592.787086:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138560 00000100:00100000:0.0:1713279592.787090:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279592.787090:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138560 00000100:00100000:1.0:1713279592.787111:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138816 00000100:00100000:1.0:1713279592.787139:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138816 00000100:00100000:0.0:1713279592.787152:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200138496:0@lo:400:kworker.0 00000100:00100000:1.0:1713279592.787155:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1713279592.787157:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1713279592.787160:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c36aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200138560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279592.787166:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200138304:12345-0@lo:400:kworker.0 Request processed in 88us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279592.787168:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200138048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279592.787177:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99186 00000100:00100000:0.0:1713279592.787183:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279592.787195:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c36aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200138560:12345-0@lo:400:kworker.0 Request processed in 32us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279592.787204:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1713279592.787206:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200138752:0@lo:400:kworker.0 00000100:00100000:1.0:1713279592.787217:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138496 00000100:00100000:2.0:1713279592.787218:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200138048:12345-0@lo:400:kworker.0 Request processed in 50us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279592.787221:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138496 00000100:00100000:3.0:1713279592.787222:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1713279592.787229:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279592.787229:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1713279592.787231:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200138816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279592.787247:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138752 00000100:00100000:1.0:1713279592.787251:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138752 00000100:00100000:0.0:1713279592.787267:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1713279592.787276:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:0.0:1713279592.787278:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200138496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279592.787280:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200138816:12345-0@lo:400:kworker.0 Request processed in 48us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279592.787284:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200138752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279592.787291:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00080000:2.0:1713279592.787293:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279562 00000100:00080000:2.0:1713279592.787298:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279562 00000100:00080000:2.0:1713279592.787302:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279562 00000100:00100000:1.0:1713279592.787338:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200138752:12345-0@lo:400:kworker.0 Request processed in 53us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279592.787341:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200138496:12345-0@lo:400:kworker.0 Request processed in 62us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279592.787341:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279592.787345:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200138176:0@lo:400:kworker.0 00000100:00100000:1.0:1713279592.787348:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:0.0:1713279592.787354:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1713279592.787364:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200138432:0@lo:400:kworker.0 00000100:00100000:2.0:1713279592.787365:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200138624:0@lo:400:kworker.0 00000100:00100000:3.0:1713279592.787378:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200138688:0@lo:400:kworker.0 00000100:00100000:0.0:1713279592.787383:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138240 00000100:00100000:0.0:1713279592.787389:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138240 00000100:00100000:1.0:1713279592.787391:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200138496:0@lo:400:kworker.0 00000100:00100000:2.0:1713279592.787403:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279592.787407:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200138752:0@lo:400:kworker.0 00000100:00100000:0.0:1713279592.787470:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138368 00000100:00100000:1.0:1713279592.787471:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138624 00000100:00100000:0.0:1713279592.787474:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138368 00000100:00100000:1.0:1713279592.787476:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138624 00000100:00080000:3.0:1713279592.787495:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279562 00000100:00100000:2.0:1713279592.787502:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200138112:0@lo:400:kworker.0 00000100:00100000:0.0:1713279592.787504:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:0.0:1713279592.787511:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200138240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279592.787511:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1713279592.787520:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200138368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279592.787535:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1713279592.787544:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200138624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279592.787562:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200138240:12345-0@lo:400:kworker.0 Request processed in 50us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279592.787571:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1713279592.787588:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200138624:12345-0@lo:400:kworker.0 Request processed in 43us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279592.787590:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200138368:12345-0@lo:400:kworker.0 Request processed in 67us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279592.787595:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1713279592.787600:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:0.0:1713279592.787628:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200138048:0@lo:400:kworker.0 00000100:00100000:3.0:1713279592.787643:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200138368:0@lo:400:kworker.0 00000100:00100000:0.0:1713279592.787646:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801251da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200138304:0@lo:400:kworker.0 00000100:00100000:3.0:1713279592.787655:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200138624:0@lo:400:kworker.0 00000100:00100000:1.0:1713279592.787656:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200138240:0@lo:400:kworker.0 00000100:00100000:0.0:1713279592.787667:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200138560:0@lo:400:kworker.0 00000100:00100000:0.0:1713279592.787681:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200138816:0@lo:400:kworker.0 00000100:00100000:0.0:1713279592.802550:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713279592.802568:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008accc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200138880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279592.802571:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713279592.802585:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200138944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279592.802620:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279592.802670:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138880 00000100:00100000:2.0:1713279592.802678:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138880 00000100:00100000:1.0:1713279592.802688:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279592.802709:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200138944 00000100:00100000:2.0:1713279592.802711:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200138944 00000100:00100000:0.0:1713279592.802729:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1713279592.802740:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200138880:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279592.802744:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1713279592.802753:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200138944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1713279592.802779:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279592.802782:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279592.802840:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200138880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279592.802850:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200138944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279592.802852:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1713279592.802855:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200138944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279592.802863:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1713279592.802886:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008accc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200138880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279593.522825:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200139008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279593.522906:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279593.522934:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139008 00000100:00100000:2.0:1713279593.522947:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139008 00000100:00100000:2.0:1713279593.523009:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1713279593.523018:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200139008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279593.523057:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279593.523161:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200139008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279593.523170:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1713279593.523181:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200139008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279593.538586:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200139072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1713279593.538626:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279593.538714:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139072 00000100:00100000:2.0:1713279593.538723:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139072 00000100:00100000:2.0:1713279593.538763:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:2.0:1713279593.538776:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008accc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200139072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279593.538794:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279593.538844:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008accc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200139072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279593.538851:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1713279593.538880:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200139072:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279593.780773:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279594.347564:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279594.347613:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279594.347648:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279594.347671:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279594.347690:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279594.347694:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348928 00000100:00100000:2.0:1713279594.347697:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348864 00000100:00100000:1.0:1713279594.347707:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348928 00000100:00100000:2.0:1713279594.347708:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348864 00000100:00100000:0.0:1713279594.347718:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279594.347734:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279594.347751:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279594.347761:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281348992 00000100:00100000:1.0:1713279594.347764:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281348992 00000100:00100000:2.0:1713279594.347768:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 497 00000100:00100000:2.0:1713279594.347777:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281348864:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279594.347782:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349184 00000100:00100000:0.0:1713279594.347783:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279594.347784:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349184 00000100:00100000:1.0:1713279594.347797:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349248 00000100:00100000:1.0:1713279594.347799:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349248 00000100:00100000:0.0:1713279594.347807:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349056 00000100:00100000:0.0:1713279594.347813:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349056 00000100:00100000:1.0:1713279594.347815:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1003 00000100:00100000:1.0:1713279594.347824:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281348928:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279594.347835:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1004 00000100:00100000:0.0:1713279594.347843:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349120 00000100:00100000:0.0:1713279594.347845:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349120 00000100:00100000:3.0:1713279594.347846:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281348992:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279594.347851:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281348864:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 75us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279594.347857:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349312 00000100:00100000:2.0:1713279594.347859:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 497 00000100:00100000:0.0:1713279594.347860:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349312 00000100:00100000:0.0:1713279594.347870:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349376 00000100:00100000:0.0:1713279594.347873:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349376 00000100:00100000:1.0:1713279594.347881:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281348928:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 56us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279594.347889:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 537 00000100:00100000:1.0:1713279594.347889:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1003 00000100:00100000:0.0:1713279594.347896:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281349056:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279594.347900:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281348992:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 56us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279594.347901:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 538 00000100:00100000:1.0:1713279594.347906:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1005 00000100:00100000:2.0:1713279594.347908:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281349120:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279594.347912:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281349184:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279594.347912:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1004 00000100:00100000:3.0:1713279594.347933:0:15480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1006 00000100:00100000:0.0:1713279594.347938:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281349056:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279594.347938:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281349184:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279594.347938:0:15480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281349248:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279594.347943:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281349120:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279594.347945:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1005 00000100:00100000:0.0:1713279594.347947:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 537 00000100:00100000:2.0:1713279594.347951:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 538 00000100:00100000:0.0:1713279594.347962:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 539 00000100:00100000:3.0:1713279594.347964:0:15480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281349248:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279594.347967:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 540 00000100:00100000:0.0:1713279594.347968:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281349312:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279594.347971:0:15480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1006 00000100:00100000:2.0:1713279594.347972:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281349376:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:3.0:1713279594.347989:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279564 00000100:00100000:2.0:1713279594.347991:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281349376:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 18us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279594.347992:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281349312:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (256us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279594.347994:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279564 00000100:00080000:3.0:1713279594.347997:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279564 00000100:00100000:2.0:1713279594.347998:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 540 00000100:00080000:3.0:1713279594.347999:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279564 00000100:00080000:3.0:1713279594.348002:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279564 00000100:00100000:0.0:1713279594.348011:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 539 00010000:00010000:2.0:1713279594.782790:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279595.442803:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200139136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1713279595.442881:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279595.442946:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139136 00000100:00100000:0.0:1713279595.442958:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139136 00000100:00100000:0.0:1713279595.443021:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99187 00000100:00100000:0.0:1713279595.443029:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200139136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1713279595.443069:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:0.0:1713279595.443192:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200139136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 162us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279595.443201:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99187 00000100:00100000:3.0:1713279595.443240:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200139136:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279595.784715:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279596.786705:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279597.122698:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713279597.122728:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f38bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200139200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1713279597.122802:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279597.122863:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139200 00000100:00100000:0.0:1713279597.122874:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139200 00000100:00100000:0.0:1713279597.122928:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99188 00000100:00100000:0.0:1713279597.122939:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200139200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713279597.122987:0:15494:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:0.0:1713279597.123079:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200139200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279597.123126:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99188 00000100:00100000:1.0:1713279597.123147:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f38bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200139200:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279597.788676:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279597.794666:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200139392:0@lo:400:kworker.0 00000100:00100000:2.0:1713279597.794672:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200139264:0@lo:400:kworker.0 00000100:00100000:0.0:1713279597.794674:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200139328:0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.794681:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fd8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200139456:0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.794756:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279597.794761:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279597.794762:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279597.794787:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139456 00000100:00100000:2.0:1713279597.794795:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200139520:0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.794796:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200139712:0@lo:400:kworker.0 00000100:00100000:0.0:1713279597.794798:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139456 00000100:00100000:3.0:1713279597.794800:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200139648:0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.794827:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279597.794827:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279597.794831:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279597.794842:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200139776:0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.794843:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200139968:0@lo:400:kworker.0 00000100:00100000:0.0:1713279597.794845:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139648 00000100:00100000:0.0:1713279597.794848:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139648 00000100:00100000:3.0:1713279597.794850:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200139904:0@lo:400:kworker.0 00000100:00100000:2.0:1713279597.794862:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279597.794867:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279597.794871:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:1.0:1713279597.794877:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139712 00000100:00100000:0.0:1713279597.794879:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200139456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279597.794879:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009764c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200140032:0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.794882:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139712 00000100:00100000:2.0:1713279597.794894:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279597.794905:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139264 00000100:00100000:3.0:1713279597.794910:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139264 00000100:00100000:1.0:1713279597.794912:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139776 00000100:00100000:1.0:1713279597.794915:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139776 00000100:00100000:2.0:1713279597.794929:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139904 00000100:00100000:1.0:1713279597.794930:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140032 00000100:00100000:1.0:1713279597.794932:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140032 00000100:00100000:2.0:1713279597.794935:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139904 00000100:00100000:0.0:1713279597.794937:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3490:x1796503200139456:12345-0@lo:400:kworker.0 Request processed in 57us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279597.794942:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1713279597.794945:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:1.0:1713279597.794948:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:3.0:1713279597.794949:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200139264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.794955:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200139712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279597.794961:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1713279597.794967:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:0.0:1713279597.794968:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200139648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279597.794974:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200139904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279597.794994:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3491:x1796503200139264:12345-0@lo:400:kworker.0 Request processed in 45us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279597.794997:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200139712:12345-0@lo:400:kworker.0 Request processed in 41us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279597.795002:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1713279597.795004:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1713279597.795008:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3493:x1796503200139648:12345-0@lo:400:kworker.0 Request processed in 41us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279597.795014:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1713279597.795017:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001-lwp-OST0001_UUID+5:3493:x1796503200139904:12345-0@lo:400:kworker.0 Request processed in 41us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279597.795018:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1713279597.795022:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200139776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279597.795025:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00080000:3.0:1713279597.795027:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279567 00000100:00080000:3.0:1713279597.795031:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279567 00000100:00100000:0.0:1713279597.795032:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1713279597.795033:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279567 00000100:00080000:3.0:1713279597.795036:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279567 00000100:00100000:2.0:1713279597.795041:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139328 00000100:00100000:2.0:1713279597.795044:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139328 00000100:00100000:1.0:1713279597.795049:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200139776:12345-0@lo:400:kworker.0 Request processed in 26us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279597.795050:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200139584:0@lo:400:kworker.0 00000100:00100000:3.0:1713279597.795054:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1713279597.795058:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:2.0:1713279597.795060:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:3.0:1713279597.795060:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200140032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279597.795064:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200139328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279597.795072:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279597.795118:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139584 00000100:00100000:0.0:1713279597.795121:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200139840:0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.795122:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139584 00000100:00100000:2.0:1713279597.795129:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0000_UUID+5:3492:x1796503200139328:12345-0@lo:400:kworker.0 Request processed in 63us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279597.795134:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200140032:12345-0@lo:400:kworker.0 Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279597.795137:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1713279597.795142:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279597.795147:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1713279597.795156:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139840 00000100:00100000:1.0:1713279597.795158:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139840 00000100:00100000:2.0:1713279597.795162:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:2.0:1713279597.795167:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200139584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.795173:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1713279597.795177:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3492:1796503200139328:0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.795179:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200139840:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1713279597.795184:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279567 00000100:00100000:2.0:1713279597.795196:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0000_UUID+5:3492:x1796503200139584:12345-0@lo:400:kworker.0 Request processed in 27us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279597.795197:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3492:1796503200139584:0@lo:400:kworker.0 00000100:00100000:2.0:1713279597.795202:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1713279597.795209:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3492:x1796503200139840:12345-0@lo:400:kworker.0 Request processed in 30us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279597.795213:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3492:1796503200139840:0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.795216:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1713279597.795236:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139392 00000100:00100000:3.0:1713279597.795242:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139392 00000100:00100000:0.0:1713279597.795243:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3493:1796503200139648:0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.795250:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279597.795253:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3493:1796503200139904:0@lo:400:kworker.0 00000100:00100000:2.0:1713279597.795254:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008df06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3491:1796503200139264:0@lo:400:kworker.0 00000100:00100000:0.0:1713279597.795271:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139520 00000100:00100000:2.0:1713279597.795273:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200139776:0@lo:400:kworker.0 00000100:00100000:0.0:1713279597.795275:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139520 00000100:00100000:1.0:1713279597.795277:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3490:1796503200139456:0@lo:400:kworker.0 00000100:00100000:3.0:1713279597.795278:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99189 00000100:00100000:3.0:1713279597.795286:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200139392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.795287:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200139712:0@lo:400:kworker.0 00000100:00100000:2.0:1713279597.795289:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200140032:0@lo:400:kworker.0 00000100:00100000:0.0:1713279597.795295:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99190 00000100:00100000:0.0:1713279597.795300:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200139520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.795308:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200139968 00000100:00100000:1.0:1713279597.795310:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200139968 00000100:00100000:1.0:1713279597.795331:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:1.0:1713279597.795335:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008254ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200139968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279597.795341:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3491:x1796503200139520:12345-0@lo:400:kworker.0 Request processed in 40us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279597.795348:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99190 00000100:00100000:3.0:1713279597.795350:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200139392:12345-0@lo:400:kworker.0 Request processed in 62us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279597.795361:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200139520:0@lo:400:kworker.0 00000100:00100000:3.0:1713279597.795361:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99189 00000100:00100000:1.0:1713279597.795365:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008254ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200139968:12345-0@lo:400:kworker.0 Request processed in 28us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279597.795371:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1713279597.795373:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fd8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200139392:0@lo:400:kworker.0 00000100:00080000:1.0:1713279597.795382:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279567 00000100:00100000:1.0:1713279597.795398:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009764fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200139968:0@lo:400:kworker.0 00000100:00100000:1.0:1713279597.810571:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713279597.810584:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200140096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279597.810631:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279597.810645:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713279597.810661:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140096 00000100:00100000:0.0:1713279597.810663:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200140160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279597.810669:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140096 00000100:00100000:0.0:1713279597.810703:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279597.810733:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140160 00000100:00100000:2.0:1713279597.810737:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140160 00000100:00100000:1.0:1713279597.810752:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1713279597.810760:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200140096:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279597.810777:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1713279597.810787:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200140160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1713279597.810791:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279597.810809:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279597.810846:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200140096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279597.810853:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1713279597.810865:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200140160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279597.810875:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1713279597.810887:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200140096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279597.810917:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012bbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200140160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279598.530731:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200140224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279598.530813:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279598.530928:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140224 00000100:00100000:0.0:1713279598.530941:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140224 00000100:00100000:0.0:1713279598.531018:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1713279598.531030:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200140224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279598.531101:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279598.531196:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200140224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279598.531210:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1713279598.531235:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200140224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279598.546551:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713279598.546571:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200140288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279598.546607:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279598.546682:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140288 00000100:00100000:0.0:1713279598.546690:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140288 00000100:00100000:0.0:1713279598.546737:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1713279598.546746:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200140288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279598.546768:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279598.546828:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200140288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279598.546839:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:2.0:1713279598.546874:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200140288:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279598.790595:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279599.355652:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279599.355709:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279599.355747:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279599.355765:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349504 00000100:00100000:0.0:1713279599.355777:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279599.355782:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349504 00000100:00100000:3.0:1713279599.355795:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349440 00000100:00100000:0.0:1713279599.355798:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279599.355803:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349440 00000100:00100000:0.0:1713279599.355815:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279599.355824:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349632 00000100:00100000:0.0:1713279599.355832:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279599.355836:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349632 00000100:00100000:1.0:1713279599.355846:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349760 00000100:00100000:3.0:1713279599.355846:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 499 00000100:00100000:0.0:1713279599.355848:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279599.355852:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349760 00000100:00100000:3.0:1713279599.355855:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281349440:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279599.355874:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349568 00000100:00100000:1.0:1713279599.355878:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349568 00000100:00100000:0.0:1713279599.355883:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279599.355884:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349888 00000100:00100000:2.0:1713279599.355890:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349888 00000100:00100000:1.0:1713279599.355902:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349824 00000100:00100000:1.0:1713279599.355907:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349824 00000100:00100000:2.0:1713279599.355911:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349696 00000100:00100000:2.0:1713279599.355915:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349696 00000100:00100000:0.0:1713279599.355917:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1013 00000100:00100000:3.0:1713279599.355926:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281349440:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279599.355927:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281349504:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279599.355934:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 499 00000100:00100000:2.0:1713279599.355935:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281349952 00000100:00100000:2.0:1713279599.355939:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281349952 00000100:00100000:1.0:1713279599.355944:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1014 00000100:00100000:1.0:1713279599.355952:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281349760:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279599.355967:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 545 00000100:00100000:0.0:1713279599.355973:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281349504:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279599.355979:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009764c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281349632:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279599.355982:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1013 00000100:00100000:3.0:1713279599.355984:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 546 00000100:00100000:3.0:1713279599.355989:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281349888:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279599.355998:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281349760:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279599.356004:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1015 00000100:00100000:0.0:1713279599.356010:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281349568:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279599.356010:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1014 00000100:00100000:3.0:1713279599.356019:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281349888:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279599.356028:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1016 00000100:00100000:3.0:1713279599.356028:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 546 00000100:00100000:0.0:1713279599.356034:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281349568:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279599.356034:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281349824:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279599.356037:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009764c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281349632:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 58us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279599.356041:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1015 00000100:00100000:3.0:1713279599.356046:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 547 00000100:00100000:3.0:1713279599.356050:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281349696:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279599.356059:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281349824:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279599.356064:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 545 00000100:00100000:1.0:1713279599.356093:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1016 00000100:00100000:0.0:1713279599.356101:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 548 00000100:00100000:0.0:1713279599.356107:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281349952:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279599.356107:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281349696:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 55us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279599.356114:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 547 00000100:00080000:1.0:1713279599.356116:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279569 00000100:00080000:1.0:1713279599.356120:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279569 00000100:00080000:1.0:1713279599.356123:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279569 00000100:00080000:1.0:1713279599.356125:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279569 00000100:00080000:1.0:1713279599.356127:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279569 00000100:00100000:0.0:1713279599.356130:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281349952:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279599.356137:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 548 00010000:00010000:3.0:1713279599.792721:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279600.450834:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200140352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279600.450926:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279600.451054:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140352 00000100:00100000:3.0:1713279600.451103:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140352 00000100:00100000:3.0:1713279600.451166:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99191 00000100:00100000:3.0:1713279600.451175:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200140352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1713279600.451215:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:3.0:1713279600.451272:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200140352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279600.451281:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99191 00000100:00100000:0.0:1713279600.451331:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200140352:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279600.794777:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279601.796694:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279602.130722:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200140416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713279602.130805:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279602.130953:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140416 00000100:00100000:3.0:1713279602.130965:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140416 00000100:00100000:3.0:1713279602.131026:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99192 00000100:00100000:3.0:1713279602.131035:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200140416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1713279602.131126:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:3.0:1713279602.131198:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3493:x1796503200140416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279602.131206:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99192 00000100:00100000:2.0:1713279602.131266:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200140416:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279602.798662:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279602.802646:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200140480:0@lo:400:kworker.0 00000100:00100000:0.0:1713279602.802670:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200140608:0@lo:400:kworker.0 00000100:00100000:1.0:1713279602.802689:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200140672:0@lo:400:kworker.0 00000100:00100000:3.0:1713279602.802691:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008254bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200140544:0@lo:400:kworker.0 00000100:00100000:0.0:1713279602.802739:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279602.802745:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279602.802746:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279602.802767:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140608 00000100:00100000:1.0:1713279602.802775:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140608 00000100:00100000:0.0:1713279602.802778:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200140864:0@lo:400:kworker.0 00000100:00100000:2.0:1713279602.802782:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200140736:0@lo:400:kworker.0 00000100:00100000:0.0:1713279602.802801:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279602.802801:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200140800:0@lo:400:kworker.0 00000100:00100000:0.0:1713279602.802817:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200141120:0@lo:400:kworker.0 00000100:00100000:1.0:1713279602.802819:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99193 00000100:00100000:2.0:1713279602.802819:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279602.802827:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200140608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279602.802838:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279602.802845:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140736 00000100:00100000:0.0:1713279602.802850:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140736 00000100:00100000:2.0:1713279602.802852:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200140992:0@lo:400:kworker.0 00000100:00100000:3.0:1713279602.802867:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200141056:0@lo:400:kworker.0 00000100:00100000:0.0:1713279602.802879:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99194 00000100:00100000:0.0:1713279602.802885:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200140736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279602.802888:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279602.802895:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279602.802896:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200140608:12345-0@lo:400:kworker.0 Request processed in 67us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279602.802909:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99193 00000100:00100000:2.0:1713279602.802911:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200141248:0@lo:400:kworker.0 00000100:00100000:0.0:1713279602.802922:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200140736:12345-0@lo:400:kworker.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279602.802929:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99194 00000100:00100000:3.0:1713279602.802932:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140480 00000100:00100000:2.0:1713279602.802936:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279602.802937:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140480 00000100:00100000:1.0:1713279602.802951:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140544 00000100:00100000:0.0:1713279602.802954:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140992 00000100:00100000:1.0:1713279602.802957:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140544 00000100:00100000:0.0:1713279602.802958:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140992 00000100:00100000:2.0:1713279602.802971:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200140736:0@lo:400:kworker.0 00000100:00100000:3.0:1713279602.802972:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1713279602.802979:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200140480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279602.802982:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141248 00000100:00100000:0.0:1713279602.802986:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141248 00000100:00100000:1.0:1713279602.802988:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140864 00000100:00100000:1.0:1713279602.802992:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140864 00000100:00100000:0.0:1713279602.803013:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1713279602.803014:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140800 00000100:00100000:1.0:1713279602.803018:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140800 00000100:00100000:3.0:1713279602.803018:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3490:x1796503200140480:12345-0@lo:400:kworker.0 Request processed in 39us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279602.803021:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200140992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279602.803025:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1713279602.803033:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141056 00000100:00100000:2.0:1713279602.803040:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141056 00000100:00100000:1.0:1713279602.803070:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1713279602.803080:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200140544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279602.803094:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:3.0:1713279602.803099:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200140864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279602.803113:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1713279602.803122:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200140800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279602.803130:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200140992:12345-0@lo:400:kworker.0 Request processed in 106us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279602.803135:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0001-lwp-OST0000_UUID+5:3492:x1796503200140864:12345-0@lo:400:kworker.0 Request processed in 35us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279602.803142:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1713279602.803142:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:1.0:1713279602.803148:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3491:x1796503200140544:12345-0@lo:400:kworker.0 Request processed in 66us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279602.803158:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1713279602.803161:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:3.0:1713279602.803162:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200141056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279602.803165:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:0.0:1713279602.803168:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200141248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279602.803185:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0000_UUID+5:3491:x1796503200140800:12345-0@lo:400:kworker.0 Request processed in 60us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279602.803188:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0001_UUID+5:3491:x1796503200141056:12345-0@lo:400:kworker.0 Request processed in 24us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279602.803194:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1713279602.803199:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:0.0:1713279602.803207:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3490:x1796503200141248:12345-0@lo:400:kworker.0 Request processed in 37us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279602.803217:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1713279602.803217:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1713279602.803221:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279572 00000100:00080000:3.0:1713279602.803225:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279572 00000100:00080000:3.0:1713279602.803227:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279572 00000100:00080000:3.0:1713279602.803230:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279572 00000100:00100000:2.0:1713279602.803231:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140672 00000100:00080000:3.0:1713279602.803232:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279572 00000100:00100000:2.0:1713279602.803236:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140672 00000100:00100000:1.0:1713279602.803245:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009387d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200140928:0@lo:400:kworker.0 00000100:00100000:0.0:1713279602.803247:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279602.803256:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008254bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3491:1796503200140544:0@lo:400:kworker.0 00000100:00100000:2.0:1713279602.803264:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141120 00000100:00100000:3.0:1713279602.803266:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3491:1796503200140800:0@lo:400:kworker.0 00000100:00100000:2.0:1713279602.803268:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141120 00000100:00100000:3.0:1713279602.803275:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3491:1796503200141056:0@lo:400:kworker.0 00000100:00100000:1.0:1713279602.803285:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279602.803294:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200140608:0@lo:400:kworker.0 00000100:00080000:3.0:1713279602.803298:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279572 00000100:00100000:0.0:1713279602.803307:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3492:1796503200140864:0@lo:400:kworker.0 00000100:00100000:1.0:1713279602.803307:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200141184:0@lo:400:kworker.0 00000100:00100000:2.0:1713279602.803310:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1713279602.803319:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200140672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279602.803320:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:3.0:1713279602.803325:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200141120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279602.803331:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200140928 00000100:00100000:0.0:1713279602.803334:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200140928 00000100:00100000:1.0:1713279602.803336:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279602.803357:0:15556:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141184 00000100:00100000:0.0:1713279602.803360:0:15556:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141184 00000100:00100000:3.0:1713279602.803365:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796503200141120:12345-0@lo:400:kworker.0 Request processed in 40us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279602.803371:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1713279602.803377:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1713279602.803377:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-MDT0001_UUID+5:3493:x1796503200140672:12345-0@lo:400:kworker.0 Request processed in 57us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279602.803382:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200140928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279602.803388:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00080000:3.0:1713279602.803388:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279572 00000100:00100000:1.0:1713279602.803389:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00080000:3.0:1713279602.803391:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279572 00000100:00100000:1.0:1713279602.803398:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200141184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279602.803409:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3492:1796503200141120:0@lo:400:kworker.0 00000100:00100000:0.0:1713279602.803446:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200140928:12345-0@lo:400:kworker.0 Request processed in 62us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279602.803454:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1713279602.803470:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200140992:0@lo:400:kworker.0 00000100:00100000:1.0:1713279602.803472:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200141184:12345-0@lo:400:kworker.0 Request processed in 75us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279602.803487:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1713279602.803488:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200141248:0@lo:400:kworker.0 00000100:00100000:2.0:1713279602.803500:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3490:1796503200140480:0@lo:400:kworker.0 00000100:00100000:1.0:1713279602.803526:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3493:1796503200140672:0@lo:400:kworker.0 00000100:00100000:1.0:1713279602.803536:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009387d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200140928:0@lo:400:kworker.0 00000100:00100000:1.0:1713279602.803544:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200141184:0@lo:400:kworker.0 00000100:00100000:0.0:1713279602.818605:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713279602.818623:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200141312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279602.818668:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200141376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279602.818672:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279602.818709:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141312 00000100:00100000:0.0:1713279602.818716:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141312 00000100:00100000:3.0:1713279602.818728:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279602.818754:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141376 00000100:00100000:0.0:1713279602.818758:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141376 00000100:00100000:1.0:1713279602.818767:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1713279602.818780:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200141312:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1713279602.818796:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1713279602.818805:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200141376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1713279602.818818:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:0.0:1713279602.818824:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279602.818889:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200141376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279602.818899:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1713279602.818900:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200141312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279602.818914:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1713279602.818941:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200141312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1713279602.818950:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200141376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279603.538716:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200141440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1713279603.538814:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279603.538886:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141440 00000100:00100000:2.0:1713279603.538896:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141440 00000100:00100000:2.0:1713279603.538953:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1713279603.538962:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200141440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1713279603.538999:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279603.539090:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200141440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279603.539098:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1713279603.539169:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200141440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713279603.554702:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200141504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1713279603.554748:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279603.554809:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141504 00000100:00100000:2.0:1713279603.554817:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141504 00000100:00100000:2.0:1713279603.554855:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1713279603.554863:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200141504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1713279603.554880:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:2.0:1713279603.554923:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200141504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279603.554931:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:0.0:1713279603.554947:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200141504:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279603.800716:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279604.363792:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279604.363871:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279604.363924:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279604.363959:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350080 00000100:00100000:3.0:1713279604.363959:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350016 00000100:00100000:0.0:1713279604.363971:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279604.363971:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350080 00000100:00100000:3.0:1713279604.363971:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350016 00000100:00100000:0.0:1713279604.364001:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279604.364021:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350144 00000100:00100000:1.0:1713279604.364024:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350144 00000100:00100000:0.0:1713279604.364030:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279604.364056:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 501 00000100:00100000:3.0:1713279604.364067:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e97a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281350016:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279604.364069:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1023 00000100:00100000:1.0:1713279604.364077:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281350080:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279604.364078:0:15752:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350400 00000100:00100000:2.0:1713279604.364087:0:15752:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350400 00000100:00100000:0.0:1713279604.364094:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1713279604.364131:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1024 00000100:00100000:2.0:1713279604.364139:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281350144:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279604.364140:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3709:1957:x1796503281350080:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279604.364143:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e97a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1956:x1796503281350016:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 77us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279604.364148:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1023 00000100:00100000:3.0:1713279604.364151:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 501 00000100:00100000:0.0:1713279604.364154:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279604.364176:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350336 00000100:00100000:1.0:1713279604.364179:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350336 00000100:00080000:3.0:1713279604.364184:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279574 00000100:00100000:2.0:1713279604.364188:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:385c4b71-808c-40cf-91de-b076b668d13f+3639:1956:x1796503281350144:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 49us (266us total) trans 0 rc 0/0 00000100:00080000:3.0:1713279604.364189:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279574 00000100:00080000:3.0:1713279604.364191:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279574 00000100:00100000:2.0:1713279604.364196:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1024 00000100:00100000:1.0:1713279604.364204:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1025 00000100:00100000:1.0:1713279604.364209:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281350400:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279604.364214:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1026 00000100:00100000:2.0:1713279604.364219:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281350336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279604.364238:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1956:x1796503281350400:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279604.364243:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1957:x1796503281350336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279604.364247:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1025 00000100:00100000:2.0:1713279604.364252:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1026 00000100:00100000:0.0:1713279604.364254:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279604.364273:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350272 00000100:00100000:1.0:1713279604.364276:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350272 00000100:00080000:3.0:1713279604.364292:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279574 00000100:00100000:1.0:1713279604.364302:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350208 00000100:00100000:1.0:1713279604.364304:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350208 00000100:00100000:2.0:1713279604.364305:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350528 00000100:00100000:2.0:1713279604.364308:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350528 00000100:00100000:0.0:1713279604.364318:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350464 00000100:00100000:1.0:1713279604.364324:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 553 00000100:00100000:0.0:1713279604.364326:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350464 00000100:00100000:1.0:1713279604.364329:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281350272:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279604.364333:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 554 00000100:00100000:2.0:1713279604.364338:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281350208:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279604.364354:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:385c4b71-808c-40cf-91de-b076b668d13f+43:1956:x1796503281350272:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279604.364360:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 553 00000100:00100000:2.0:1713279604.364364:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:385c4b71-808c-40cf-91de-b076b668d13f+39:1957:x1796503281350208:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279604.364368:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 555 00000100:00100000:2.0:1713279604.364374:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 554 00000100:00100000:0.0:1713279604.364379:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281350528:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279604.364379:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 556 00000100:00100000:1.0:1713279604.364384:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281350464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:3.0:1713279604.364398:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279574 00000100:00080000:3.0:1713279604.364401:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279574 00000100:00100000:1.0:1713279604.364409:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1957:x1796503281350464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279604.364455:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 556 00000100:00100000:0.0:1713279604.364464:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1956:x1796503281350528:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 86us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279604.364477:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 555 00010000:00010000:3.0:1713279604.802669:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279605.458756:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713279605.458785:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200141568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1713279605.458858:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279605.458981:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141568 00000100:00100000:2.0:1713279605.458992:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141568 00000100:00100000:2.0:1713279605.459082:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99195 00000100:00100000:2.0:1713279605.459090:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200141568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279605.459128:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279605.459193:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008be59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200141568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279605.459201:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99195 00000100:00100000:1.0:1713279605.459246:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200141568:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279605.804710:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279606.806696:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713279607.138796:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200141632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1713279607.138876:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279607.138946:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141632 00000100:00100000:2.0:1713279607.138956:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141632 00000100:00100000:2.0:1713279607.139048:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99196 00000100:00100000:2.0:1713279607.139058:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200141632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1713279607.139097:0:15516:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:2.0:1713279607.139167:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801251d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:3492:x1796503200141632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279607.139176:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99196 00000100:00100000:3.0:1713279607.139215:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200141632:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1713279607.808679:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279607.810687:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200141824:0@lo:400:kworker.0 00000100:00100000:2.0:1713279607.810688:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200141696:0@lo:400:kworker.0 00000100:00100000:3.0:1713279607.810704:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200141888:0@lo:400:kworker.0 00000100:00100000:0.0:1713279607.810727:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200141760:0@lo:400:kworker.0 00000100:00100000:1.0:1713279607.810775:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279607.810778:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279607.810782:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279607.810802:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200142080:0@lo:400:kworker.0 00000100:00100000:0.0:1713279607.810810:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141888 00000100:00100000:2.0:1713279607.810812:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200141952:0@lo:400:kworker.0 00000100:00100000:3.0:1713279607.810816:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200142144:0@lo:400:kworker.0 00000100:00100000:0.0:1713279607.810818:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141888 00000100:00100000:1.0:1713279607.810822:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279607.810838:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200142336:0@lo:400:kworker.0 00000100:00100000:3.0:1713279607.810840:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279607.810841:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279607.810857:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279607.810858:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142080 00000100:00100000:2.0:1713279607.810859:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200142208:0@lo:400:kworker.0 00000100:00100000:0.0:1713279607.810860:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142080 00000100:00100000:3.0:1713279607.810874:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200142400:0@lo:400:kworker.0 00000100:00100000:2.0:1713279607.810879:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279607.810880:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142336 00000100:00100000:0.0:1713279607.810882:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142336 00000100:00100000:2.0:1713279607.810894:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200142464:0@lo:400:kworker.0 00000100:00100000:3.0:1713279607.810896:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279607.810897:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1713279607.810905:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200141888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279607.810913:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1713279607.810913:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279607.810920:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200142080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279607.810941:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141696 00000100:00100000:3.0:1713279607.810946:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141696 00000100:00100000:2.0:1713279607.810949:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1713279607.810957:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796503200141888:12345-0@lo:400:kworker.0 Request processed in 51us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279607.810957:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200142336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279607.810965:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:0.0:1713279607.810970:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3491:x1796503200142080:12345-0@lo:400:kworker.0 Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279607.810978:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1713279607.810978:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1713279607.810985:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200141696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279607.810996:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3491:x1796503200142336:12345-0@lo:400:kworker.0 Request processed in 38us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279607.811000:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142144 00000100:00100000:0.0:1713279607.811004:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279607.811004:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1713279607.811005:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142144 00000100:00100000:2.0:1713279607.811052:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141760 00000100:00100000:2.0:1713279607.811057:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141760 00000100:00100000:0.0:1713279607.811059:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200142016:0@lo:400:kworker.0 00000100:00100000:3.0:1713279607.811060:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3493:x1796503200141696:12345-0@lo:400:kworker.0 Request processed in 74us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279607.811065:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142208 00000100:00100000:1.0:1713279607.811068:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142208 00000100:00100000:3.0:1713279607.811068:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1713279607.811079:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1713279607.811082:0:15538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142400 00000100:00100000:1.0:1713279607.811085:0:15538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142400 00000100:00100000:0.0:1713279607.811086:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279607.811086:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200141760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279607.811098:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200142272:0@lo:400:kworker.0 00000100:00100000:3.0:1713279607.811099:0:15519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142464 00000100:00100000:3.0:1713279607.811102:0:15519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142464 00000100:00100000:1.0:1713279607.811110:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:2.0:1713279607.811117:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3490:x1796503200141760:12345-0@lo:400:kworker.0 Request processed in 33us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279607.811119:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279607.811119:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200142144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279607.811124:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:3.0:1713279607.811126:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1713279607.811131:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200142208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713279607.811137:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142016 00000100:00100000:2.0:1713279607.811140:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142016 00000100:00100000:0.0:1713279607.811152:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3490:1796503200141760:0@lo:400:kworker.0 00000100:00100000:2.0:1713279607.811154:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142272 00000100:00100000:2.0:1713279607.811157:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142272 00000100:00100000:3.0:1713279607.811166:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200142208:12345-0@lo:400:kworker.0 Request processed in 34us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279607.811173:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1713279607.811176:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:2.0:1713279607.811177:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200142016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279607.811179:0:15752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1713279607.811179:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200142144:12345-0@lo:400:kworker.0 Request processed in 56us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279607.811185:0:15752:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200142272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279607.811188:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1713279607.811192:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200142400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279607.811193:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:2.0:1713279607.811205:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0000_UUID+5:3490:x1796503200142016:12345-0@lo:400:kworker.0 Request processed in 27us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279607.811211:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1713279607.811215:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1713279607.811220:0:15752:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_034:lustre-MDT0000-lwp-OST0001_UUID+5:3490:x1796503200142272:12345-0@lo:400:kworker.0 Request processed in 33us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279607.811220:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3492:x1796503200142400:12345-0@lo:400:kworker.0 Request processed in 27us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279607.811223:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e90b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200142464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279607.811226:0:15752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1713279607.811230:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1713279607.811237:0:15542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141824 00000100:00100000:2.0:1713279607.811239:0:15542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141824 00000100:00080000:3.0:1713279607.811245:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279577 00000100:00080000:3.0:1713279607.811249:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279577 00000100:00100000:0.0:1713279607.811252:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200141952 00000100:00080000:3.0:1713279607.811252:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279577 00000100:00080000:3.0:1713279607.811254:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279577 00000100:00080000:3.0:1713279607.811256:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279577 00000100:00100000:0.0:1713279607.811257:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200141952 00000100:00100000:2.0:1713279607.811259:0:15542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99197 00000100:00100000:2.0:1713279607.811264:0:15542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200141824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279607.811266:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e90b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200142464:12345-0@lo:400:kworker.0 Request processed in 42us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279607.811276:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1713279607.811278:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99198 00000100:00100000:0.0:1713279607.811283:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200141952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279607.811287:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796503200141888:0@lo:400:kworker.0 00000100:00100000:2.0:1713279607.811293:0:15542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200141824:12345-0@lo:400:kworker.0 Request processed in 28us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279607.811298:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200142144:0@lo:400:kworker.0 00000100:00100000:2.0:1713279607.811300:0:15542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99197 00000100:00100000:3.0:1713279607.811308:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796503200142400:0@lo:400:kworker.0 00000100:00100000:0.0:1713279607.811310:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+86:3493:x1796503200141952:12345-0@lo:400:kworker.0 Request processed in 27us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279607.811316:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99198 00000100:00100000:2.0:1713279607.811326:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3493:1796503200141696:0@lo:400:kworker.0 00000100:00100000:1.0:1713279607.811328:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200141824:0@lo:400:kworker.0 00000100:00100000:2.0:1713279607.811338:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200141952:0@lo:400:kworker.0 00000100:00100000:1.0:1713279607.811339:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3491:1796503200142080:0@lo:400:kworker.0 00000100:00100000:0.0:1713279607.811347:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3490:1796503200142016:0@lo:400:kworker.0 00000100:00100000:1.0:1713279607.811349:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3491:1796503200142336:0@lo:400:kworker.0 00000100:00100000:2.0:1713279607.811349:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200142208:0@lo:400:kworker.0 00000100:00100000:0.0:1713279607.811357:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3490:1796503200142272:0@lo:400:kworker.0 00000100:00100000:2.0:1713279607.811359:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200142464:0@lo:400:kworker.0 00000100:00100000:1.0:1713279607.826654:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200142592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713279607.826685:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200142528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279607.826697:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279607.826728:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279607.826757:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142592 00000100:00100000:1.0:1713279607.826759:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142528 00000100:00100000:1.0:1713279607.826765:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142528 00000100:00100000:2.0:1713279607.826765:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142592 00000100:00100000:1.0:1713279607.826801:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1713279607.826808:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200142528:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279607.826825:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1713279607.826832:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200142592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1713279607.826837:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:2.0:1713279607.826850:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:1.0:1713279607.826879:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3490:x1796503200142528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279607.826886:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1713279607.826897:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200142592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279607.826904:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200142528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713279607.826904:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1713279607.826924:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200142592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279608.546737:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713279608.546763:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200142656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279608.546835:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279608.546974:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142656 00000100:00100000:0.0:1713279608.546987:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142656 00000100:00100000:0.0:1713279608.547095:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1713279608.547104:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200142656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1713279608.547140:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279608.547210:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3493:x1796503200142656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279608.547218:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1713279608.547264:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796503200142656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713279608.562666:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200142720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1713279608.562708:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279608.562767:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142720 00000100:00100000:0.0:1713279608.562774:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142720 00000100:00100000:0.0:1713279608.562812:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1713279608.562819:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200142720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1713279608.562835:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 980915904 pending 0 free 3849015296 avail 3617492992 00000100:00100000:0.0:1713279608.562888:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200142720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279608.562897:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:2.0:1713279608.562932:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200142720:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1713279608.810664:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279609.371395:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279609.371489:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1713279609.371521:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279609.371523:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350656 00000100:00100000:1.0:1713279609.371537:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350656 00000100:00100000:0.0:1713279609.371541:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279609.371564:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350592 00000100:00100000:0.0:1713279609.371571:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279609.371574:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350592 00000100:00100000:0.0:1713279609.371593:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279609.371606:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350720 00000100:00100000:1.0:1713279609.371609:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350720 00000100:00100000:0.0:1713279609.371610:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1713279609.371620:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 503 00000100:00100000:1.0:1713279609.371624:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350912 00000100:00100000:0.0:1713279609.371626:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1713279609.371627:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350912 00000100:00100000:3.0:1713279609.371630:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281350592:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279609.371640:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350976 00000100:00100000:1.0:1713279609.371642:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350976 00000100:00100000:0.0:1713279609.371656:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00080000:2.0:1713279609.371666:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279579 00000100:00100000:1.0:1713279609.371667:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1033 00000100:00080000:2.0:1713279609.371674:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279579 00000100:00100000:1.0:1713279609.371677:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281350656:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:2.0:1713279609.371677:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279579 00000100:00100000:0.0:1713279609.371694:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1034 00000100:00100000:3.0:1713279609.371701:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:445b5c0f-9b6b-4005-af72-386b918c4c97+12:1957:x1796503281350592:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279609.371707:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281350720:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279609.371709:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 503 00000100:00100000:2.0:1713279609.371711:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1035 00000100:00100000:2.0:1713279609.371720:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281350912:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279609.371743:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:385c4b71-808c-40cf-91de-b076b668d13f+3709:1956:x1796503281350656:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 64us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279609.371747:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1036 00000100:00100000:1.0:1713279609.371756:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1033 00000100:00100000:3.0:1713279609.371756:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281350976:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279609.371770:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:385c4b71-808c-40cf-91de-b076b668d13f+3639:1957:x1796503281350720:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279609.371772:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3712:1956:x1796503281350912:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 52us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279609.371780:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1035 00000100:00100000:1.0:1713279609.371793:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350784 00000100:00100000:1.0:1713279609.371799:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350784 00000100:00100000:0.0:1713279609.371814:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1034 00000100:00100000:3.0:1713279609.371817:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+3369:1957:x1796503281350976:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279609.371825:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281350848 00000100:00100000:3.0:1713279609.371828:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1036 00000100:00100000:2.0:1713279609.371829:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281350848 00000100:00100000:1.0:1713279609.371839:0:15783:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281351040 00000100:00100000:1.0:1713279609.371844:0:15783:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281351040 00000100:00100000:2.0:1713279609.371855:0:9197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503281351104 00000100:00100000:2.0:1713279609.371858:0:9197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503281351104 00000100:00100000:1.0:1713279609.371872:0:15783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 561 00000100:00100000:1.0:1713279609.371882:0:15783:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281350784:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1713279609.371882:0:15519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 562 00000100:00100000:2.0:1713279609.371892:0:9197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 563 00000100:00100000:3.0:1713279609.371892:0:15519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281350848:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1713279609.371898:0:9197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281351040:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1713279609.371901:0:15538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 564 00000100:00100000:0.0:1713279609.371912:0:15538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281351104:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1713279609.371930:0:15783:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:385c4b71-808c-40cf-91de-b076b668d13f+39:1956:x1796503281350784:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279609.371930:0:9197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+45:1956:x1796503281351040:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279609.371937:0:9197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 563 00000100:00100000:3.0:1713279609.371937:0:15519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:385c4b71-808c-40cf-91de-b076b668d13f+43:1957:x1796503281350848:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279609.371944:0:15783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 561 00000100:00100000:0.0:1713279609.371949:0:15538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d3aa14ef-c7cd-4a88-98a5-de5f970d6507+52:1957:x1796503281351104:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279609.371960:0:15519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 562 00000100:00100000:0.0:1713279609.371965:0:15538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 564 00000100:00080000:2.0:1713279609.372124:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279579 00000100:00080000:2.0:1713279609.372128:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279579 00010000:00010000:3.0:1713279609.812727:0:6919:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713279610.466757:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200142784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1713279610.466834:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279610.466882:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142784 00000100:00100000:2.0:1713279610.466896:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142784 00000100:00100000:2.0:1713279610.466968:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99199 00000100:00100000:2.0:1713279610.466977:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200142784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1713279610.467047:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1439399936 avail 1309937664 00000100:00100000:2.0:1713279610.467106:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3490:x1796503200142784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279610.467114:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99199 00000100:00100000:0.0:1713279610.467139:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796503200142784:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1713279610.814687:0:15544:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713279611.816612:0:6918:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713279612.146615:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801313c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200142848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713279612.146672:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279612.146708:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142848 00000100:00100000:0.0:1713279612.146715:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142848 00000100:00100000:0.0:1713279612.146753:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99200 00000100:00100000:0.0:1713279612.146757:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200142848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713279612.146783:0:15580:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1436626944 avail 1307164672 00000100:00100000:0.0:1713279612.146817:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3491:x1796503200142848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279612.146821:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99200 00000100:00100000:2.0:1713279612.146832:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801313c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200142848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1713279612.818595:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200142912:0@lo:400:kworker.0 00000100:00100000:0.0:1713279612.818596:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200143040:0@lo:400:kworker.0 00000100:00100000:2.0:1713279612.818624:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200142976:0@lo:400:kworker.0 00010000:00010000:1.0:1713279612.818630:0:8071:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713279612.818642:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200143104:0@lo:400:kworker.0 00000100:00100000:0.0:1713279612.818647:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279612.818647:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279612.818656:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279612.818667:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200143168:0@lo:400:kworker.0 00000100:00100000:2.0:1713279612.818679:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200143232:0@lo:400:kworker.0 00000100:00100000:0.0:1713279612.818680:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200143296:0@lo:400:kworker.0 00000100:00100000:1.0:1713279612.818680:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279612.818683:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279612.818692:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200143360:0@lo:400:kworker.0 00000100:00100000:2.0:1713279612.818693:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279612.818695:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200143424:0@lo:400:kworker.0 00000100:00100000:2.0:1713279612.818704:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200143488:0@lo:400:kworker.0 00000100:00100000:0.0:1713279612.818705:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200143040 00000100:00100000:1.0:1713279612.818707:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279612.818711:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200143040 00000100:00100000:2.0:1713279612.818713:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279612.818715:0:6924:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142912 00000100:00100000:1.0:1713279612.818717:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200143616:0@lo:400:kworker.0 00000100:00100000:3.0:1713279612.818718:0:6924:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142912 00000100:00100000:1.0:1713279612.818726:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279612.818733:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200142976 00000100:00100000:0.0:1713279612.818734:0:15580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200143168 00000100:00100000:2.0:1713279612.818735:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200142976 00000100:00100000:0.0:1713279612.818736:0:15580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200143168 00000100:00100000:1.0:1713279612.818744:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200143104 00000100:00100000:1.0:1713279612.818746:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200143104 00000100:00100000:0.0:1713279612.818749:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99201 00000100:00100000:3.0:1713279612.818749:0:6924:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1713279612.818751:0:15658:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200143232 00000100:00100000:2.0:1713279612.818752:0:15658:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200143232 00000100:00100000:0.0:1713279612.818754:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200143040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279612.818754:0:6924:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200142912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279612.818759:0:6929:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200143488 00000100:00100000:1.0:1713279612.818761:0:6929:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200143488 00000100:00100000:2.0:1713279612.818762:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1713279612.818765:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200142976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279612.818770:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1713279612.818773:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200143104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279612.818792:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+50:3490:x1796503200143040:12345-0@lo:400:kworker.0 Request processed in 37us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279612.818794:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-MDT0000_UUID+5:3493:x1796503200142976:12345-0@lo:400:kworker.0 Request processed in 27us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279612.818794:0:6924:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5+23:3492:x1796503200142912:12345-0@lo:400:kworker.0 Request processed in 38us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279612.818798:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99201 00000100:00100000:1.0:1713279612.818800:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3491:x1796503200143104:12345-0@lo:400:kworker.0 Request processed in 24us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279612.818800:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:3.0:1713279612.818800:0:6924:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1713279612.818804:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1713279612.818809:0:15658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:0.0:1713279612.818810:0:15580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99202 00000100:00100000:1.0:1713279612.818813:0:6929:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1713279612.818813:0:15658:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200143232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1713279612.818814:0:15580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801313c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200143168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279612.818815:0:6929:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200143488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279612.818821:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200143360 00000100:00100000:3.0:1713279612.818823:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200143360 00000100:00100000:2.0:1713279612.818829:0:15658:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796503200143232:12345-0@lo:400:kworker.0 Request processed in 16us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279612.818831:0:6929:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3493:x1796503200143488:12345-0@lo:400:kworker.0 Request processed in 15us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279612.818832:0:15658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1713279612.818834:0:6929:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:0.0:1713279612.818836:0:15580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801313c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+86:3492:x1796503200143168:12345-0@lo:400:kworker.0 Request processed in 21us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279612.818836:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200143616 00000100:00100000:3.0:1713279612.818837:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200143616 00000100:00080000:2.0:1713279612.818840:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279582 00000100:00100000:0.0:1713279612.818841:0:15580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99202 00000100:00080000:2.0:1713279612.818842:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279582 00000100:00080000:2.0:1713279612.818844:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713279582 00000100:00100000:1.0:1713279612.818845:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00080000:2.0:1713279612.818845:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713279582 00000100:00100000:1.0:1713279612.818848:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200143360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279612.818849:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1713279612.818852:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200143616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279612.818862:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200143360:12345-0@lo:400:kworker.0 Request processed in 14us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279612.818863:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279612.818866:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:2.0:1713279612.818867:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3493:1796503200142976:0@lo:400:kworker.0 00000100:00100000:3.0:1713279612.818869:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3491:x1796503200143616:12345-0@lo:400:kworker.0 Request processed in 17us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279612.818872:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3493:1796503200143232:0@lo:400:kworker.0 00000100:00100000:3.0:1713279612.818873:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:0.0:1713279612.818874:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200143552:0@lo:400:kworker.0 00000100:00100000:1.0:1713279612.818875:0:15474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200143296 00000100:00100000:1.0:1713279612.818877:0:15474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200143296 00000100:00100000:2.0:1713279612.818877:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3493:1796503200143488:0@lo:400:kworker.0 00000100:00100000:0.0:1713279612.818888:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713279612.818889:0:15474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1713279612.818891:0:15474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200143296:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1713279612.818891:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279582 00000100:00100000:3.0:1713279612.818892:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200143552 00000100:00100000:3.0:1713279612.818894:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200143552 00000100:00100000:0.0:1713279612.818903:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796503200143040:0@lo:400:kworker.0 00000100:00100000:1.0:1713279612.818905:0:15474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-lwp-OST0000_UUID+5:3490:x1796503200143296:12345-0@lo:400:kworker.0 Request processed in 13us (43us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279612.818905:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1713279612.818909:0:15474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1713279612.818909:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200143552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713279612.818913:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279612.818917:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3490:1796503200143296:0@lo:400:kworker.0 00000100:00100000:3.0:1713279612.818920:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200143680:0@lo:400:kworker.0 00000100:00100000:1.0:1713279612.818924:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3491:1796503200143104:0@lo:400:kworker.0 00000100:00100000:0.0:1713279612.818928:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3490:1796503200143552:0@lo:400:kworker.0 00000100:00100000:2.0:1713279612.818928:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3490:x1796503200143552:12345-0@lo:400:kworker.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279612.818930:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200143360:0@lo:400:kworker.0 00000100:00100000:2.0:1713279612.818931:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1713279612.818935:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796503200143616:0@lo:400:kworker.0 00000100:00080000:2.0:1713279612.818939:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713279582 00000100:00100000:3.0:1713279612.818943:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713279612.818954:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ff8997a-cad7-437c-8cfa-6f3d0e12edb5:3492:1796503200142912:0@lo:400:kworker.0 00000100:00100000:2.0:1713279612.818957:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200143424 00000100:00100000:2.0:1713279612.818959:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200143424 00000100:00100000:3.0:1713279612.818961:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200143168:0@lo:400:kworker.0 00000100:00080000:0.0:1713279612.818992:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1713279582 00000100:00100000:2.0:1713279612.818993:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200143680 00000100:00100000:2.0:1713279612.818994:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200143680 00000100:00100000:3.0:1713279612.819000:0:15556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1713279612.819003:0:15556:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200143424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713279612.819006:0:11415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1713279612.819009:0:11415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200143680:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1713279612.819014:0:6926:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713279582 00000100:00100000:3.0:1713279612.819026:0:15556:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200143424:12345-0@lo:400:kworker.0 Request processed in 22us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1713279612.819029:0:15556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1713279612.819031:0:11415:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3492:x1796503200143680:12345-0@lo:400:kworker.0 Request processed in 21us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1713279612.819033:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200143424:0@lo:400:kworker.0 00000100:00100000:1.0:1713279612.819035:0:11415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1713279612.819039:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796503200143680:0@lo:400:kworker.0 00000100:00100000:1.0:1713279612.834497:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713279612.834506:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200143744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713279612.834521:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009009df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200143808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279612.834531:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713279612.834545:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713279612.834546:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200143744 00000100:00100000:0.0:1713279612.834550:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200143744 00000100:00100000:1.0:1713279612.834559:0:9201:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796503200143808 00000100:00100000:1.0:1713279612.834561:0:9201:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796503200143808 00000100:00100000:0.0:1713279612.834569:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1713279612.834574:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200143744:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1713279612.834584:0:9201:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1713279612.834587:0:9201:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009387fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200143808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713279612.834594:0:9200:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00002000:00000024:1.0:1713279612.834595:0:9201:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 979903296 pending 0 free 3877130240 avail 3645607936 00000100:00100000:0.0:1713279612.834622:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3491:x1796503200143744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1713279612.834623:0:9201:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009387fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3493:x1796503200143808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1713279612.834627:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1713279612.834630:0:9201:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1713279612.834648:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009009df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796503200143808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713279612.834651:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796503200143744:0@lo:13:osp-pre-1-0.0 Debug log: 69875 lines, 69875 kept, 0 dropped, 0 bad.